This guide provides an overview of Engagement Survey Analytics in Surveys & Pulses
When you conduct an Engagement Survey using the Quantum Workplace Surveys & Pulses tool (also referred to as Surveys 2.0), the Engagement Survey Analytics will differ slightly from the analytics for surveys you conduct on any other topic. The primary difference between Engagement Survey Analytics and any other Survey Analytics is that your Engagement Survey Analytics will include High Impact items, or the specific survey items that had the biggest impact on overall engagement in your organization. Your Overview report will also showcase different data than for surveys on other topics.
You will receive Engagement Survey Analytics for any survey that you launch using the Annual Engagement Survey template as a starting point, regardless of whether you edit the Annual Engagement questions.
The Overview report is the first page you will see within Engagement Survey Analytics. The top of the Overview Report displays the Favorability and Response Rate for the Engagement Survey. Your Favorability refers to the percentage of Strongly Agree and Agree responses to the scaled agreement items on the survey. Response Rate refers to the percentage of employees who submitted the survey out of the number of employees who were invited to take the survey. Read more: What is a Good Response Rate?
Next to the Favorability and Response Rate for this survey, you may see a comparison data point that represents the difference between the Favorability and/or Response Report for the Engagement Survey that you're currently viewing compared to a previous survey. Or, you might see a comparison to the average Engagement Survey Favorability for other organizations in your industry or for organizations that are roughly the same size as yours.
We refer to comparisons to average results in your industry or for organizations with a similar headcount to your own as "benchmarks." You can click the Compared To drop down and select your industry or sub-industry to view the overall favorability for your industry or sub-industry.
High Impact Items
Directly below your Favorability and Response Rate you will see your High Impact items for this Engagement survey. Your High Impact items are the 10 items on your survey that had the biggest impact on overall engagement in your organization. We calculate these items by performing a correlation analysis between the majority of the survey items and the Engagement Outcome items on the survey that directly measure your employees' engagement. We recommend that both the organization overall and the individual teams identify 2-3 High Impact items to focus on for their survey follow-up efforts.
The remaining reports in the survey (e.g. the Results, Comments, Categories, Heat Map, and Response Rate reports) all function the same for an Engagement Survey as they do for any other Survey Analytics.
You can access the reports either by clicking on the cards below the Dive Deeper heading or by clicking the tabs at the top of the screen:
The Results tab includes the responses to all of the scaled agreement items on your survey (which comprise the majority of survey items). If you chose to include any multiple-choice, single-choice, or NPS items to the Engagement Survey, the responses to those will also be included in the Results tab.
At the top of the Results tab, you will again see your overall favorable score, which represents the percentage of strongly agree and agree responses out of all possible responses to the scaled agreement items on the survey.
Below the overall favorable score, you will see every scaled agreement item that was included on the survey. Every row displays the text of the scaled agreement item, the n count (the number of survey participants who responded to that item) and the percent favorable (the percentage of agree and strongly agree responses).
In addition, any items that are labeled as high-impact will be called out below the Impact column.
You are not limited to viewing the percentage of favorable responses to every item; you can view neutral and unfavorable responses in isolation by clicking the Neutral or Unfavorable options by the top of the screen by Chart Legend. The Neutral option displays the percentage of somewhat agree or agree responses, while Unfavorable displays the percentage of disagree or strongly disagree responses.
You can click the All Favorability option to view a complete breakout of the favorable, neutral, and unfavorable responses to every item:
If you would like to view the average score of every item out of a possible 6 points, click the Average option from the Chart Legend.
At the end of the row of any given survey item, you will see a lightbulb icon that you can click to create a Highlight (or bookmark) for that data point.
At the bottom of the Results tab, you will see the responses to any multiple-choice, single-choice, or NPS items that you included on your survey.
Slice By and Filter For
The Slice By and Filter For buttons allow you to view survey results for specific groups in your organization and compare how results differ across a particular demographic so that you can see how survey results differ between departments, generations, tenure ranges, and more.
Clicking the Slice By button and selecting a specific demographic will reveal the range in favorability across that demographic for every item on your survey.
Click the drop down arrow to the left of the item text to reveal the favorability for every group in that demographic.
Conversely, the Filter For... button allows you to view survey results for one or more specific demographic groups (e.g. certain departments) in isolation.
The Compare To button allows you to add a comparison between your Engagement Survey results and other organizations that have surveyed with Quantum Workplace or with your own survey data that you have collected previously.
To apply a comparison, click Compare To and select either a prior year or a benchmark (for organizations in your industry or organizations that are roughly the same size as your own). When you apply an external benchmark a pin will appear to represent the average favorability for every standard survey item on the Engagement Survey. When you apply a comparison to a prior year that you have surveyed, a pin will appear to represent the difference between every item that was asked in that previously conducted survey and this year's Engagement survey.
To the right of the favorability for every survey item, you will be able to see the delta, or difference between your current year survey results and the benchmark you have selected.
Any data you are viewing can be exported into Excel or PDF via the Export button in the top right corner. The PDF or Excel Export will include any slice, filter, or comparison you have applied at the time that you generate the export.
All text responses that your employees submitted on the survey are visible from the Comments tab. This includes the responses to all open-ended questions that you included on your survey and all comments that were left in responses to scaled agreement items.
On the left, you will see total number of comments and open-ended responses left on the survey.
Below that you will see the themes that our software has detected in your comments and open-ended responses. You can click on any of the themes in order to view all comments that were classified by our software as relating to that theme.
By default, the Comments report displays all open-ended responses and comments left on the survey. If you would like to see the responses for a specific open-ended question, click the All Items drop down menu and select the question (prompt) you would like to view responses for:
The comments report includes a key word search so that you can view all comments and open-ended responses that include a specific word or phrase.
You can apply slices and filters to only view comments for a specific demographic group or to view a breakout of comments by a certain demographic.
The categories report provides the same information as the results report but displays the average favorability at the level of the category, or aspect of the employee experience that is measured in the survey. Every scaled agreement item on the survey is classified as belonging to one category that describes a particular aspect of the employee experience.
You can click the drop down arrow next to any category to view all of the survey items belong to that category.
All of the Slice By, Filter For, Compare To, and Export functionality exists in the Categories report, just as it does in the Results report.
The Heat Map report provides a visual alternative to slicing Categories and scaled agreement items. For every demographic that you slice by, you can view a heat map that displays how favorability differs across that demographic (e.g. which departments or generations are more or less favorable on the survey).
When you first access the Heat Map, you will be prompted to slice your data by a demographic in order to generate a heat map for that demographic. Click the Slice By button and select your demographic of interest.
Once you have selected a demographic, a heat map will appear that represents the average favorability for every category included on the Engagement Survey for every group in the demographic you selected (e.g. for every department). Each row represents a category, while each column represents a group in the demographic that you selected.
The favorability scores are color coded to indicate how favorable each demographic group is on each category; the legend on the left displays the color coding of the heat map, which ranges from yellow (least favorable) to purple (most favorable). The leftmost column represents the average favorability for the organization overall (for top-level admins or analysts who have visibility into the full survey results for the organization).
For every category, you can click the drop down arrow to view the heat map for every item included in that category.
The response rate report displays the percentage of survey participants who completed their survey and shows how the completion rate has changed over the course of the survey period. The response rate report is available to view as soon as your survey launches so that you can track the response rate to the survey in real time. Read more about the Response Rate report here.