Understanding Survey Analytics

In this article: 

 

Accessing Analytics

To view the analytics of a survey, click Analytics in the left sidebar to expand the menu and select Surveys & Pulses.

Click the survey title to navigate to the survey's analytics. 

Alternatively, as an Admin, you can simply click Surveys in the left-hand navigation menu to 

 

Find the survey in question. At the right-end of the survey row, click the corresponding ⋮ icon followed by Analytics. This navigates you to the Overview page of the survey's analytics. 

 

Overview Report

This takes you to the Overview Report, which displays key details for your surveys, such as the overall score on the survey, the response rate, and the most and least favorable items on the survey.

 

If you are an admin, you have visibility into survey data for the entire organization.

By default, you will be viewing aggregate data for the entire organization, but you can change your view at any time using the Select Team button. Click Select Team and use the expandable menu to select the team you would like to view results for. 

 

If you are a manager, you will have visibility into data for your downline, but not for the entire organization. Depending on your organization's permissions, you may be able to view aggregate data for your upline managers' downline or for the organization overall.

If you have the ability to view data outside of your downline, you'll be able to use the Select a Team button to navigate to that data.

Results

The Results tab displays all data for scaled, multi-choice, and NPS questions, grouped by question type. For scaled agreement items, the default view is to show the percent of responses to that that were favorable (e.g., the percentage of responses that were Agree or Strongly Agree on a 6-point Likert scale.)

 

You can view a complete breakout of responses by clicking All Favorability next to Chart Legend. This will show you the breakout of responses that were favorable, neutral (somewhat agree or somewhat disagree on a Likert scale), and unfavorable (strongly disagree or disagree on a Likert scale) for every item. Or, you can click Neutral or Unfavorable to just view those responses. 

 

You can click Average to view the average responses on the scale that you were using; (e.g., the average score out of 6 points for a Likert scale). 

 

Question-Level View

Question-Level View is an extension of the Results data that allows you to continue your analysis into specific questions. Examining your survey items in this view can help connect survey information across Results, Categories, Heat Maps, etc. into a cohesive employee story.

From the Results tab, click the survey item to dive deeper into the analytics.  

 

From the Results Detail page, click the Slice By button. Then, from the modal, select the demographic you wish to slice your data against. 

4-1

5v3

By slicing this item by Department, you'll notice you can now see how each Department responded to the survey question. You can also use this ability while the Filter and Compare To are enabled. 

6v2

Slice By/Filter Capabilities

From the Results tab,  you can view a breakout of your data by any demographic on record using the  Filter, Slice By and Compare To buttons in the top left corner.

Clicking Slice By will open a model with a list of demographics to Slice By, the results will then be shown as an interactive range with the ability to see where each Department is placed.

The Filter and Compare To buttons work the same way. 

ABC-1

 

You'll notice that for each question, you'll now see responses to each item as a range. By hovering over the range, you can identify how, in this case, each Department responded to each item. ABC-2

 

When the Slice By button is enabled, a dropdown arrow to the left of each survey item expands the question to reveal how each Department, on average, responded to an item. This applies to any Slice By variable you apply.

 

The Filter button is useful to view data for any given department at a time. For example, clicking Filter and selecting Sales underneath the Department dropdown displays data from the Sales team by itself. In the image below, you can see the different filters available to you.

 

Note: Any Slice or Filter you apply will carry over to any subsequent report that you view. Click the X next to any filter to remove it or click Clear All or Remove Slice depending on which modal you're in. 

 

Compare To/ Benchmark Capabilities

Clicking Compare To allows you to select other surveys, benchmarks and Best Places to Work benchmarks to compare against your responses.

Benchmarks are useful as they represent the average response for companies in the same industry, similar employee populations, etc. Being able to see how you compare to other similar companies question-by-question is useful to better strategize where to focus your engagement efforts. 

If you don't see industry or same-size benchmarks available within the Compare To menu, contact your CSM to have these benchmarks enabled. 

 

If you click Compare To and select a survey that you've conducted previously, a pin will appear to represent the average response on that survey for any item that you included on both that survey and the survey you're currently viewing results for.

 

If you click Compare To and select your industry, a data pin will drop to represent your industry's average result for every standard Quantum Workplace item that you've included in this survey. 

To the right of the data bar, you'll see a comparison of how you compare to the selected benchmark, in this case, companies in the same industry. 

 

Categories

The Categories tab displays all scaled items grouped into their respective categories.

You can click the dropdown arrow on the left-side to see which survey items make up a particular category, as shown in Box A. Click the numbers under the Textbox Icon to the right of the bar to view comments associated with any given category, as shown in Box B.



Trending data on the Categories report is calculated by the category itself, regardless of what questions are included in a category.

For example, let's look at data across multiple surveys for a category titled, Communication. In one survey, this category includes questions A, B, and C and in a different survey, the same category includes questions D, E, and F. Trending data for the category, Communication, will reflect questions A - F because they were included under the same category of Communication. 

Comments

If you included either open-ended questions or offered the option to provide a comment on a scaled question on your survey, all free text responses will appear in the Comments report.

11-3

The Theme Analysis and Themes panel on the right displays all themes that were detected in your comments.

From this panel, click on any theme to view all comments that were tagged with that theme.

 

You can add custom themes or remove themes for any comment by clicking Edit Themes. 

You can also add themes of your own or remove the automated theme for any comment by clicking Edit Themes.  

 

Type in the theme and click Save to add the theme. To remove a theme, click the to delete the theme. To add an existing theme, expand the dropdown and select the theme you wish to include. 

You are not limited to adding one of the themes our software detects; you can add any text that helps you categorize your comments.

Filtering and Slicing your Comments

Filtering by Question

You can use the question filter to just look at responses to a single survey item or survey category.  By default, All Items and All Sentiments are selected. Expand the dropdown to select an individual survey question or sentiment to narrow your search.

If you navigate to item-level comments from the Results report, the question filter will already be set to the appropriate question.

 

Filtering by Team Select (Org Tree)

Like all survey analytics, the comments report automatically responds to the scope of your Team Select. So if you only have access to your downline respondents (or if you have access to a leaf on a custom org tree), your comments report will be limited to the scope of this filter.

 

Filtering by Demographic

You can use the Filter button to limit your comments based on respondent demographic. Expand the dropdown, select the demographic options you’re interested in, and click Apply.  You can expand your filters by removing individual demographics or by clicking Clear All to see all available comments.

Filtering by Keyword search

Within your current filter set, you can search your comments for a keyword or phrase. If you’re looking for an exact match, be sure to place double quotes (“) around your search string.

 

Slicing the Comments Report

You can slice your comments by any demographic grouping. The comments are then sorted and displayed based on the Slice filters, in this case, by Generation. 

Theme and Sentiment Classification

Survey comments offer color and narrative to your survey analytics. But unstructured data is notoriously difficult to turn into insight. And as your comment count increases, this problem just gets worse.

Theme analysis and sentiment analysis offer powerful tools to help users find the story in survey comments. Quantum Workplace’s proprietary algorithms use natural language processing (NLP) to classify comment themes and sentiment. With the help of machine learning, these algorithms get smarter as administrators modify the automated theme and sentiment classifications.

Learn more about Theme and Sentiment Text Analytics here.

Replying to Comments

Admins and managers who have been given visibility into the comments for a survey are able to reply to a comment left on the survey. This allows you to probe for more details when a comment contains enough detail to spark your interest, but not enough to offer clarity.

Learn more about replying to survey comments here.

Comment Translations

Survey comments come in all languages. The Comments report offers the users, side-by-side translations.

 

Translated comments contain a Show Original Language link, which allows readers to see the comment as written and understand the original language and translation source. 

The keyword search returns matches from both the original and translated comment.

Translations (as well as original language and translated source) are included in the Excel export. And while we don’t add the original comment to the PDF export, we do list the translation source so, if needed, you can log in and find the comment to see the untranslated comment.

Quantum Workplace can source translations from an online translation service for free or from a team of professional linguists for an additional fee. Contact your Customer Success Manager if you have comments you would like translated.

Response Rate

The Response Rate report shows the survey participation rate over time. 

Heat Map

The Heat Map report provides a visual representation of how different groups within a demographic, i.e. Departments, Locations, etc., responded to scaled agreement items and categories on the survey. 

Understanding the Heat Map

When viewing the Heat Map, the leftmost column represents the average favorability score across all demographics currently being sliced by. Depending on your role, this column indicates varying information: 

  • Full admins: this column averages favorability for the organization overall
  • Focused admins: this column indicates average favorability within their scope
  • Managers: this column indicates average favorability within their downline

The Heat Map uses a white-blue color scale, with white indicating low favorability and blue indicating high favorability. As favorability increases, the cell will gradually take on a deeper blue gradient. 

The first row of the Heat Map displays the Response Count or the number of responses being represented. 

Note: Response Count information is not included when exporting to Excel.

Accessing the Heat Map

To use the Heat Map: 

2022-11-16_17-51-13 (1)

  1. From Surveys & Pulses under the Analytics in the left-hand navigation menu, click the survey
  2. Click the Heat Map tab 
  3. Click Slice By
  4. Click Apply to view the heat map according to the sliced demographic

Optionally for Full Admins and Focused Admins, in the Slice By modal, click Add Intersection to add an additional demographic and view intersectional data. This will reflect the results from the two selected demographics. 

To view the individual results for questions within a category, click the drop-down arrow.