This guide provides an overview of Engagement Survey Analytics in Surveys & PulsesIn this Article:
- Overview Report
- High Impact Items
- Heat Map
- Response Rate
- Exporting Reports
When you conduct an Engagement Survey using the Quantum Workplace Surveys & Pulses tool (also referred to as Surveys 2.0), the Engagement Survey Analytics will differ slightly from the analytics for surveys you conduct on any other topic.
The primary difference between Engagement Survey Analytics and any other Survey Analytics is that your Engagement Survey Analytics will include High Impact items or the specific survey items that had the biggest impact on overall engagement in your organization. Your Overview report will also showcase different data than surveys on other topics.
You will receive Engagement Survey Analytics for any survey launched using the Annual Engagement Survey template as a starting point, regardless of whether you edit the Annual Engagement questions.
The Overview report is the first page you will see within Engagement Survey Analytics. The top of the Overview Report displays the Favorability and Response Rate for the Engagement Survey.
Your Favorability refers to the percentage of Strongly Agree and Agree responses to the scaled agreement items on the survey.
Response Rate refers to the percentage of employees who submitted the survey out of the number of employees who were invited to take the survey. Read more: What is a Good Response Rate?
Next to the Favorability and Response Rate for this survey, you may see a comparison data point that represents the difference between the Favorability and/or Response Report for the Engagement Survey that you're currently viewing compared to a previous survey. Or, you might see a comparison to the average Engagement Survey Favorability for other organizations in your industry or for organizations that are roughly the same size as yours.
We refer to comparisons to average results in your industry or for organizations with a similar headcount to your own as "benchmarks." You can click the Compared To drop-down and select your industry or sub-industry to view the overall favorability for your industry or sub-industry.
High Impact Items
Directly below your Favorability and Response Rate, you will see your High Impact items for this Engagement survey. Your High Impact items are the 10 items on your survey that had the biggest impact on overall engagement in your organization.
We calculate these items by performing a correlation analysis between the majority of the survey items and the Engagement Outcome items on the survey that directly measure your employees' engagement. We recommend that both the organization overall and the individual teams identify 2-3 High Impact items to focus on for their survey follow-up efforts.
The remaining reports in the survey (e.g. the Results, Comments, Categories, Heat Map, and Response Rate reports) all function the same for an Engagement Survey as they do for any other Survey Analytics.
You can access the reports either by clicking on the cards below the Dive Deeper heading or by clicking the tabs at the top of the screen:
The Results tab includes the responses to all of the scaled agreement items on your survey (which comprise the majority of survey items). If you chose to include any multiple-choice, single-choice, or NPS items in the Engagement Survey, the responses to those will also be included in the Results tab.
At the top of the Results tab, you will again see your overall favorable score, which represents the percentage of Strongly Agree and Agree responses out of all possible responses to the scaled agreement items on the survey.
Below the overall favorable score, you will see every scaled agreement item that was included in the survey. Each row displays the text of the scaled agreement item, the n count (the number of survey participants who responded to that item) and the percent favorable (the percentage of Agree and Strongly Agree responses).
In addition, any items that are labeled as high-impact will be called out below the Impact column.
You are not limited to viewing the percentage of favorable responses to every item; you can view neutral and unfavorable responses in isolation by clicking the Neutral or Unfavorable options by the top of the screen by Chart Legend. The Neutral option displays the percentage of somewhat Agree or Somewhat Disagree responses, while Unfavorable displays the percentage of Disagree or Strongly Disagree responses.
You can click the All Favorability option to view a complete breakout of the favorable, neutral, and unfavorable responses to every item:
If you would like to view the average score of every item out of a possible 6 points, click the Average option from the Chart Legend.
At the end of the row of any given survey item, you will see a lightbulb icon that you can click to create a Highlight (or bookmark) for that data point.
At the bottom of the Results tab, you will see the responses to any multiple-choice, single-choice, or NPS items that you included in your survey.
Slice By and Filter For
The Slice By and Filter For buttons allow you to view survey results for specific groups in your organization and compare how results differ across a particular demographic so that you can see how survey results differ between departments, generations, tenure ranges, and more.
Clicking the Slice By button and selecting a specific demographic will reveal the range in favorability across that demographic for every item on your survey.
Click the drop-down arrow to the left of the item text to reveal the favorability for every group in that demographic.
Conversely, the Filter For... button allows you to view survey results for one or more specific demographic groups (e.g. certain departments) in isolation.
The Compare To button allows you to add a comparison between your Engagement Survey results and other organizations that have surveyed with Quantum Workplace or with your own survey data that you have collected previously.
To apply a comparison, click Compare To and select either a prior year or a benchmark (for organizations in your industry or organizations that are roughly the same size as your own).
When you apply an external benchmark, a pin will appear to represent the average favorability for every standard survey item on the Engagement Survey.
When you apply a comparison to a prior year that you have surveyed, a pin will appear to represent the difference between every item that was asked in that previously conducted survey and this year's engagement survey.
To the right of the favorability for every survey item, you will be able to see the delta, or difference between your current year survey results and the benchmark you have selected.
Any data you are viewing can be exported into Excel or PDF via the Export button in the top right corner. The PDF or Excel Export will include any slice, filter, or comparison you have applied at the time that you generate the export.
All text responses submitted by your employees are visible from the Comments tab. This includes the responses to all open-ended questions that you included on your survey and all comments that were left in responses to scaled agreement items.
On the right, you will see the total number of comments and open-ended responses left on the survey.
Sentiment Analytics shows the distribution of sentiment for your current set of comments. You can click Full Text Analytics to dive deeper into text analytics.
Below you will see the themes that our software has detected in your comments and open-ended responses. You can click on any of the themes in order to view all comments that were classified by our software as relating to that theme. Learn more about Theme and Sentiment Text Analytics.
By default, the Comments report displays all open-ended responses and comments left on the survey. If you would like to see the responses for a specific open-ended question, click the All Items drop-down menu and select the question (prompt) you would like to view responses for:
The comments report includes a keyword search so that you can view all comments and open-ended responses that include a specific word or phrase.
You can apply slices and filters to only view comments for a specific demographic group or to view a breakout of comments by a certain demographic.
The categories report provides the same information as the results report but displays the average favorability at the level of the category, or aspect of the employee experience that is measured in the survey. Every scaled agreement item on the survey is classified as belonging to one category that describes a particular aspect of the employee experience.
You can click the drop-down arrow next to any category to view all of the survey items belonging to that category.
All of the Slice By, Filter For, Compare To, and Export functionality exists in the Categories report, just as it does in the Results report.
The Heat Map report provides a visual representation of how different groups within a demographic, i.e. Departments, Locations, etc., responded to scaled agreement items and categories on the survey.
Understanding the Heat Map
When viewing the Heat Map, the leftmost column represents the average favorability score across all demographics currently being sliced by. Depending on your role, this column indicates varying information:
- Full admins: this column averages favorability for the organization overall
- Focused admins: this column indicates average favorability within their scope
- Managers: this column indicates average favorability within their downline
The Heat Map uses a white-blue color scale, with white indicating low favorability and blue indicating high favorability. As favorability increases, the cell will gradually take on a deeper blue gradient.
The first row of the Heat Map displays the Response Count or the number of responses being represented.
Note: Response Count information is not included when exporting to Excel.
Accessing the Heat Map
To use the Heat Map:
- From Surveys & Pulses under the Analytics in the left-hand navigation menu, click the survey
- Click the Heat Map tab
- Click Slice By
- Click Apply to view the heat map according to the sliced demographic
Optionally for Full Admins and Focused Admins, in the Slice By modal, click Add Intersection to add an additional demographic and view intersectional data. This will reflect the results from the two selected demographics.
To view the individual results for questions within a category, click the drop-down arrow.
The response rate report displays the percentage of survey participants who completed their survey and shows how the completion rate has changed over the course of the survey period. The response rate report is available to view as soon as your survey launches so that you can track the response rate to the survey in real-time. Read more about the Response Rate report here.
Click to learn more about exporting the results for your engagement survey.