When viewing the comparison value next to the Focal Point roundel, you might notice that the comparator percentage and the displayed difference don't align when calculating the difference manually.
For instance, the survey’s Focal Point score might be 75%, and the comparator’s score is also 75%, yet the comparison difference might display as +2 percentage points.
Why does this happen?
The discrepancy occurs because comparator differences are calculated using only the mapped questions between the surveys. If, for example, only three out of five questions from the current survey are mapped to questions from the previous survey, the comparison value is based on just these three questions.
As a result, the difference shown is based on the average of the mapped questions, excluding any non-mapped questions. Changes in the dataset, such as adding or removing questions in the theme, can affect comparison outcomes. If all the questions in a theme are the same across surveys or compared benchmarks, the theme-level comparison will match the Focal Point comparison.
If the mapping between surveys isn't exact due to changes in the questions, the Focal Point scores might both be 75%, but the comparator difference (e.g., +2 percentage points) reflects only the mapped questions. While this might seem incorrect, it is accurate when considering the mapped subset.
Should you avoid adding or removing questions between surveys?
Adding or removing questions over time is often necessary as your organisation evolves. Introducing new questions can provide additional insights that reflect the current state of the workplace. However, it’s essential to understand that changes to the survey structure will impact the comparisons at the theme level.
If you have any questions or need further clarification, please email us at [email protected], and we will be happy to assist you.