Engagement Survey Analytics: All Reports

This guide provides an overview of Engagement Survey Analytics in Surveys & Pulses

In this article:

• Overview
  
• Access Survey Analytics
• Reporting Tools
• Overview & Team Report
• Questions Report
  
• Engagement Outcomes Report
• Engagement Levels Report (BETA)
• Comments Report
  
• Categories Report
  
• Heat Map
  
• Response Rate Report
• Action Plan

 

Overview

When you conduct an Engagement Survey with Quantum Workplace, the Engagement Survey Analytics will differ slightly from the analytics for surveys you conduct on any other topic.

The primary difference between Engagement Survey Analytics and other Survey Analytics is that your Engagement Survey Analytics include High Impact items, or the specific survey items that had the biggest impact on overall engagement in your organization.

The Team Report also showcases different data than surveys on other topics.

To receive Engagement Survey Analytics, use the Annual Engagement survey template when creating a new survey. Questions within the template can be added/edited and still receive Engagement Survey Analytics.

Access Survey Analytics

To access analytics for a survey: 

1. Click and expand the Analytics drop-down menu in the left-hand navigation menu 
2. Click Surveys & Pulses
3. Click the survey to navigate to its analytics

Reporting Tools

When viewing the different analytics reports available to you, use the different reporting tools available to you to view data from different angles and compare insightful data points.  

• A. Filter, Slice By, Compare To:

• • Filter: Isolate and view survey results by one demographic, e.g. by Department, Gender, Location, etc.  

  • Slice By: Select a specific demographic and reveal a range of how the demographic responded to a survey question

    In the following example, the results are sliced by Department revealing how the Sales, Finance, and IT departments responded to the question

    

  • Compare To: Allows you to compare your results against a benchmark or previous survey

  • Multiple Comparisons 

    The Compare To function allows you to add up to five comparisons and analyze how your survey results compare against previous surveys and different benchmarks

    Comparisons are represented via pins in the results

    If only a single comparison is active, the Comparison column is visible and indicates the difference in percentage points

    

• B. Export: From any report, export your data as PDFs, Powerpoints, or Excel spreadsheets via the Export button in the upper-right corner

  PDF and Excel exports reflect any slices, filters, and comparisons active at the time the report is exported-Excel exports include the actual data points you're examining

• C. Time Range: View survey results according to the time the survey was submitted

Active filters, slices, etc. automatically carry over as you navigate between the different survey reports and are applied to any exports. 

Time Range

Use the Time Range function to view survey results according to the time the survey was submitted. 

By default, the time range is set to All Time. Other pre-set time ranges include This Month, Past 3 Months, Past 6 Months, Past Year, etc. A Custom Range option is also available. 

Export Reports

From any report, you can export your data as PDFs, Powerpoint, or Excel spreadsheets via the Export button in the upper-right corner. 

PDF and Excel exports reflect any slices, filters, and comparisons active at the time the report is exported.  Excel exports include the actual data points you're examining. 

Report: Overview & Team Report 

The Overview report presents an overview of the survey results and relevant engagement insights for your entire organization. 

Click Select Team and the appropriate org tree branch to view the Team Report, which displays an overview of the survey results specific to the selected branch.

How to navigate the Overview and/or Team Report: 

• A. Walkthrough: In the Team Report view, admins and managers can follow the steps as a guide to understanding and acting on the survey results
  
  1. Review & Understand: Click View Walkthrough to learn how to navigate the Team Report, understand the survey results, and strategize follow-up action
  2. Communicate & Decide: Click See Discussion Starters to view survey questions as a starting point for discussing questions directly related to the lowest favored High-Impact items, learn more about Discussion Starters
  3. Follow Up with Action: Click Action Plan to navigate to the Action Plan tab to strategize and act on focus areas
• B. Organizational/Team Favorability: Displays favorability and participation rate 
  • Organizational: Includes organization-wide favorability, the favorability difference between the previous engagement survey, and the total participation rate
  • Team: Includes the team's favorability, the favorability difference between the previous engagement survey and the organization, and the total participation rate
• C. Favorability by Categories: Displays favorability levels by question category
• D. Focus Areas: Quantum Workplace-recommended focus areas to improve or maintain to increase engagement
  
  • Click Add to Plan to include the recommended Focus Area in an Action Plan 
  • Click Discussion Starters to view recommended discussion starters or add customer discussion starters for the Focus Areas and add them to an Action Plan
• E. High-Impact Questions: Displays the High-Impact questions with the lowest favorability, learn more about High-Impact questions
  • Click Show remaining High-Impact Questions to reveal favorability for all High-Impact questions in the survey
  • Click the Compared To: drop-down menu to specify what the High-Impact questions are compared against, e.g. previous engagement survey or overall organization favorability
• F. Lightweight 1-on-1s: Click Set Them Up Today to schedule a 1-on-1 with direct reports to communicate follow-up actions or create dialogue around survey results, learn more about Lightweight 1-on-1s

When viewing the Team Report, if the minimum number of responses is not reached to protect confidentiality, you are not able to view the results in the Team Report. However, you can still view the overall results and create Action Plans. 

Discussion Starters

The Discussion Starter modal allows managers and admins to view the survey's standard engagement questions, select relevant discussion starters for each question and organize them for reference and note-taking. 

Added discussion starters and any associated notes are specific to the selected team.

This section covers Discussion Starters from Quantum Workplace's Library, learn more about the Discussion Starter Generator.

To use the Discussion Starter modal:

1. Click See Discussion Starters
2. Scroll and click the appropriate question(s) in the left half of the modal
3. For each survey question, enter information in the General Notes field or use the Discussion Starters to add relevant and actionable ideas to discuss

Lightweight 1-on-1s 

Use the 1-on-1s feature from the Team Report to quickly schedule 1-on-1s with direct reports to communicate essential information and foster dialogue around relevant survey questions and topics. 

Scheduled 1-on-1s will appear in the inbox of the 1-on-1s page. 

To schedule a lightweight 1-on-1:

1.  Click Set Them Up Today in the Lightweight 1-on-1 Setup card
2. Click Set Up for each direct report without a scheduled 1-on-1
3. Configure the date and time, and whether the 1-on-1 should recur regularly
4. Click Create to finalize and launch the 1-on-1

For scheduled 1-on-1s, click the ⋮ icon, then Edit to make changes.

Learn more about 1-on-1s.

Overview: Live Response Rate

As an admin, you are presented with the following view for an open survey until the survey's analytics are available. 

While survey participants complete the survey, take advantage of the help resources to improve your organization's response rate and prepare your admins and managers for action following the survey analytics. 

• Improve Your Response Rate
• Admin Post-Survey Toolkit
• Manager Post-Survey Toolkit

Learn more about the Live Response Rate.

Report: Questions

The Questions report displays the favorability score and lists the responses to all of the survey's scaled agreement items which are the majority of survey questions.

Other question types, i.e. multiple-choice, single-choice, or NPS questions are also listed in the Questions report. 

How to navigate the Questions report:

• A. Chart Legend: By default displays, the Favorable score but can be used to view results via different responses, all responses, or by the average
  • Favorable: Agree & Strongly Agree responses
  • Neutral: Somewhat Agree & Somewhat Disagree responses
  • Unfavorable: Disagree & Strongly Disagree responses
  • All Favorability: Displays all three of the above responses
  • Average: View the average score out of the possible six points
• B. Question & N-Count: The question as it appears on the survey and the number of responses received
• C. Impact: Indicates whether the question is considered a High-Impact question 
• D. Comments: Displays the number of comments received by survey participants, click to navigate to the Comments report
• E. Insights: Click to create an insight for the question and add it to an action plan, learn more about Insights

Report: Engagement Outcomes

The Engagement Outcomes reports provide a similar experience to the Questions report but only include Outcome questions in the survey for easier analysis.

This report is available if: 

• The survey includes a minimum of one Outcome question, and
•  The survey was set up using the Annual Engagement or Engagement Follow-Up template

The Outcome Questions report is the alternative for non-engagement surveys, learn more.

Report: Engagement Levels (BETA)

The Engagement Levels report, available for Engagement and Engagement Follow-Up surveys, provides macro engagement data at the organizational level. 

Admins can use this report to share organizational engagement data with relevant stakeholders and assess how engagement and behavior is impacted by Quantum Workplace usage.

This report is available if:

• Available for Engagement and Engagement Follow-Up surveys that include at least three E9 Engagement Outcome questions
  • Of the included E9 questions, there must be one E9 question from each category: Work, Team, and Organization engagement
  • Survey questions must use a 6-point agreement scale, with or without the Not Applicable option

Learn more about the Engagement Levels report.

Report: Comments

All text-based responses submitted by survey participants are captured in the Comments report. This includes responses to all open-ended questions and comments left by participants in response to scaled agreement items. 

How to navigate the Comments report:

• A. Item Filter/Search: Use the drop-down menus or keyword search to filter the displayed comments
  
  • Use the first drop-down to display comments by category, or question, or show all
  •  Use the Sentiment drop-down to filter the comments view by Negative, Mixed, Positive, or Unclear sentiment
  • Use the text field to search and show comments by the specified keyword
• B. Comment: Relevant comments to the selected question or category (Figure A) that contain the participant's comment, automatically assigned sentiment and theme
  • Click the ⋮ icon to quarantine a potentially damaging comment, learn more about quarantining comments
  • To correct a sentiment or theme, click the drop-down or Edit Themes respectively and select the appropriate option
  • Click Reply to leave a comment and communicate with the participant who left the comment, learn more about comment replies 
• C. Sentiment Analytics: Provides a visual of the breakdown of the number of displayed comments and their sentiment, learn more about sentiments and themes in the Comments report
• D. Theme Analytics: Lists the three most negative and most positive themes 
  • Click More Text Analytics to view theme and sentiment data visually, learn more about text analytics
• E. Theme Count/Sentiment: Toggle between displaying themes and the associated amount or the color-coded sentiment

Comment Translations

Survey comments come in all languages. The Comments report offers the users, side-by-side translations.

 

Translated comments contain a Show Original Language button, which allows readers to see the comment as written and understand the original language and translation source. 

The keyword search returns matches from both the original and translated comments.

Translations, including the original and translated language, are included in the Excel report. Although the original comment is not included in the PDF export, the translation source, if needed, can be accessed in the report. 

Quantum Workplace can source translations from an online translation service for free or from a team of professional linguists for an additional fee. 

Contact your CIM/CSM for any comment translation-related questions. 

Report: Categories

The Categories report provides favorability information similar to the Questions report but at the category level. 

How to navigate the Categories report:

• A. Chart Legend: By default displays, the Favorable score but can be used to view results via different responses, all responses, or by the average
  • Favorable: Agree & Strongly Agree responses
  • Neutral: Somewhat Agree & Somewhat Disagree responses
  • Unfavorable: Disagree & Strongly Disagree responses
  • All Favorability: Displays all three of the above responses
  • Average: View the average score out of the possible six points
• B. Categories: Each question category and its favorability score
  • Expand a category to see the questions under the category and the associated scores
• C. Comments: Displays the number of comments received by survey participants, click to navigate to the Comments report
• D. Insights: When a category is expanded, click the ribbon icon to create an insight for the question and add it to an action plan, learn more about Insights

Report: Heat Map

The Heat Map report provides a visual representation of how different groups within a demographic, i.e. Departments, Locations, etc., responded to scaled agreement items and categories on the survey. 

When viewing the Heat Map, the leftmost column represents the average favorability score across all demographics currently being sliced by. Depending on your role, this column indicates varying information: 

• Full admins: this column averages favorability for the organization overall
• Focused admins: this column indicates average favorability within their scope
• Managers: this column indicates average favorability within their downline
  
  

The Heat Map uses a white-blue color scale, with white indicating low favorability and blue indicating high favorability. As favorability increases, the cell will gradually take on a deeper blue gradient. 

The first row of the Heat Map displays the Response Count or the number of responses being represented. 

Note: Response Count information is not included when exporting to Excel.

How to use the Heat Map: 

1. From Surveys & Pulses under the Analytics in the left-hand navigation menu, click the survey
2. Click the Heat Map tab 
3. Click Slice By
4. Click Apply to view the heat map according to the sliced demographic

Optionally for Full Admins and Focused Admins, in the Slice By modal, click Add Intersection to add an additional demographic and view intersectional data. This will reflect the results for the two selected demographics.

To view the individual results for questions within a category, click the drop-down arrow.

Report: Response Rate

The Response Rate report displays the percentage of survey participants who completed the survey and shows how the completion rate changed over the survey period. 

This report also includes a list of invited survey participants. Attributed surveys will indicate the identity of the participant and their completion status. Confidential surveys do not indicate whether an invited participant has completed the survey or not. 

This report is available as soon as the survey launches to track the response rate in real-time. 

For reporting purposes, click Edit Participant Demographics to update a user's demographics. Any changes to a user's demographics only affect the selected survey. 

Action Plan

The Action Plan tab enables teams and organizations to create actionable solutions around a survey's most impactful questions. 

Learn more about Action Planning.