Understanding Survey Analytics

In this article: 

 

Accessing Analytics

To view the analytics of a survey, click Analytics in the left sidebar to expand the menu and select Surveys & Pulses. Then, 

To view Analytics for a survey, navigate to Analytics and select Surveys & Pulses

Then, click Analytics next to the particular survey you would like to view.

 

Alternatively, as an Admin, you can simply click Surveys in the left-hand navigation menu to 

Find the survey in question. At the right-end of the survey row, click the ⋮ icon followed by Analytics

Then, click Analytics next to the particular survey you would like to view.

 

This takes you to the Overview Report, which displays key details for your survey such as the overall score on the survey, the response rate, and the most and least favorable items on the survey. 

 

With Pulse Surveys, you can click Survey Details to view additional information for the survey such as when the survey was conducted, who was invited to take the survey, and the questions that were asked. 

image-png-Jan-26-2022-03-13-18-62-PM

 

If you are an Admin or if you are an Analyst for this survey, you will have visibility into survey data for the entire organization. By default, you will be viewing aggregate data for the entire organization, but you can change your view at any time using the Select a Team button. Click Select a Team and use the expandable menu to select the team you would like to view results for. 

ABC

 

If you are a manager, you will have visibility into data for your downline, but not for the entire organization. Depending on your organization permissions, you may be able to view aggregate data for your upline managers' downline or for the organization overall. If you have the ability to view data outside of your downline, you'll be able to use the Select a Team button to navigate to that data.

Results

The Results tab displays all data for scaled, multi-choice, and NPS questions, grouped by question type. For scaled agreement items, the default view is to show the percent of responses to that that were favorable (e.g., the percentage of responses that were Agree or Strongly Agree on a 6-point Likert scale.)

 

You can view a complete breakout of responses by clicking All Favorability next to Chart Legend. This will show you the breakout of responses that were favorable, neutral (somewhat agree or somewhat disagree on a Likert scale), unfavorable (strongly disagree or disagree on a Likert scale) for every item. Or, you can click Neutral or Unfavorable to just view those responses. 


You can click Average to view the average responses on the scale that you were using; (e.g., the average score out of 6 points for a Likert scale). 


 

Question-Level View

Question-Level View is an extension of the Results data that allows you to continue your analysis into specific questions. Examining your survey items in this view can help connect survey information across Results, Categories, Heat Maps, etc. into a cohesive employee story.

From the Results tab, click the survey item to dive deeper into the analytics.  

3-1

From the Results Detail page, click the Slice By button. Then, from the modal, select the demographic you wish to slice your data against. 

4-1

5v3

By slicing this item by Department, you'll notice you can now see how each Department responded to the survey question. You can also use this ability while the Filter and Compare To are enabled. 

6v2

Slice By/Filter Capabilities

From the Results tab,  you can view a breakout of your data by any demographic on record using the  Filter, Slice By and Compare To button in the top left corner. Clicking Slice By will open a model with a list of demographics to Slice By, the results will then be shown as an interactive range with the ability to see where each Department is placed. The Filter and Compare To buttons work the same way. 

ABC-1

 

You'll notice that for each question, you'll now see responses to each item as a range. By hovering over the range, you can identify how, in this case, each Department responded to each item. ABC-2

When the Slice By button is enabled, a dropdown arrow to the left of each survey item expands the question to reveal how each Department, on average, responded to an item. This applies to any Slice By variable you apply.

 

The Filter button is useful to view data for any given department at a time. For example, clicking Filter and selecting Sales underneath the Department dropdown displays data from the Sales team by itself. In the image below, you can see the different filters available to you.

 

Note: Any Slice or Filter you apply will carry over to any subsequent report that you view. Click the X next to any filter to remove it or click Clear All or Remove Slice depending on which modal you're in. 

 

Compare To/ Benchmark Capabilities

Clicking Compare To allows you to select other surveys, benchmarks and Best Places to Work benchmarks to compare against your responses.

Benchmarks are useful as they represent the average response for companies in the same industry, similar employee populations, etc. Being able to see how you compare to other similar companies question-by-question is useful to better strategize where to focus your engagement efforts. 

If you don't see industry or same-size benchmarks available within the Compare To menu, contact your CSM to have these benchmarks enabled. 

 

If you click Compare To and select a survey that you've conducted previously, a pin will appear to represent the average response on that survey for any item that you included on both that survey and the survey you're currently viewing results for.

 

If you click Compare To and select your industry, a data pin will drop to represent your industry's average result for every standard Quantum Workplace item that you've included in this survey. 

To the right of the data bar, you'll see a comparison of how you compare to the selected benchmark, in this case, companies in the same industry. 

 

Categories

The Categories tab displays all scaled items grouped into their respective categories.

You can click the dropdown arrow on the left-side to see which survey items make up a particular category, as shown in Box A. Click the numbers under the Textbox Icon to the right of the bar to view comments associated with any given category, as shown in Box B.



Trending data on the Categories report is calculated by the category itself, regardless of what questions are included in a category.

For example, let's look at data across multiple surveys for a category titled, Communication. In one survey, this category includes questions A, B and C and in a different survey, the same category includes questions D, E and F. Trending data for the category, Communication, will reflect questions A - F because they were included under the same category of Communication. 

Comments

If you included either open-ended questions or offered the option to provide a comment on a scaled question on your survey, all free text responses will appear in the Comments report.

11-3

The Theme Analysis and Themes panel on the right displays all themes that were detected in your comments.

From this panel, click on any theme to view all comments that were tagged with that theme.

You can add custom themes or remove themes for any comment by clicking Edit Themes. 

You can also add themes of your own or remove the automated theme for any comment by clicking Edit Themes.  

 

Type in the theme and click Save to add the theme. To remove a theme, click the to delete the theme. To add an existing theme, expand the dropdown and select the theme you wish to include. 

You are not limited to adding one of the themes our software detects; you can add any text that helps you categorize your comments.

Filtering and Slicing your Comments

Filtering by Question

You can use the question-filter to just look at responses to a single survey item or survey category.  By default, All Items and All Sentiments are selected. Expand the dropdown to select an individual survey question or sentiments to narrow your search.

If you navigate to item-level comments from the Results report, the question-filter will already be set to the appropriate question.

 

Filtering by Team Select (Org Tree)

Like all survey analytics, the comments report automatically responds to the scope of your Team Select. So if you only have access to your downline respondents (or if you have access to a leaf on a custom org tree), your comments report will be limited to the scope of this filter.

 

Filtering by Demographic

You can use the Filter button to limit your comments based on respondent demographic. Expand the dropdown, select the demographic options you’re interested in, and click Apply.  You can expand your filters by removing individual demographics or by clicking Clear All to see all available comments.

Filtering by Keyword search

Within your current filter set, you can search your comments for a keyword or phrase. If you’re looking for an exact match, be sure to place double-quotes (“) around your search string.

 

Slicing the Comments Report

You can slice your comments by any demographic grouping. The comments are then sorted and displayed based on the Slice filters, in this case, by Generation. 

Theme and Sentiment Classification

Survey comments offer color and narrative to your survey analytics. But unstructured data is notoriously difficult to turn into insight. And as your comment count increases, this problem just gets worse.

Theme analysis and sentiment analysis offer powerful tools to help users find the story in survey comments. Quantum Workplace’s proprietary algorithms use natural language processing (NLP) to classify comment themes and sentiment. With the help of machine learning, these algorithms get smarter as administrators modify the automated theme and sentiment classifications.

Learn more about Theme and Sentiment Text Analytics here.

Replying to Comments

Admins and managers who have been given visibility into the comments for a survey are able to reply to a comment left on the survey. This allows you to probe for more details when a comment contains enough detail to spark your interest, but not enough to offer clarity.

Learn more about replying to survey comments here.

Comment Translations

Survey comments come in all languages. The Comments report offers the users, side-by-side translations.

 

Translated comments contain a Show Original Language link, which allows readers to see the comment as written and understand the original language and translation source. 

The keyword search returns matches from both the original and translated comment.

Translations (as well as original language and translated source) are included in the Excel export. And while we don’t add the original comment to the PDF export, we do list the translation source so, if needed, you can login and find the comment to see the untranslated comment.

Quantum Workplace can source translations from an online translation service for free or from a team of professional linguists for an additional fee. Contact your Customer Success Manager if you have comments you would like translated.

Response Rate

The Response Rate report shows the survey participation rate over time. 

Heat Map

The heat map report provides a visual representation of how different groups within a demographic (e.g., departments) responded to scaled agreement items and categories on the survey.

When you first open the heat map, you will need to select a demographic to slice your data by via the Slice dropdown menu.

Visually, the scores will be color coded from yellow to purple, with yellow representing low favorability and purple representing high favorability.

The leftmost column, under Demo Company, represents the average (aggregate) favorability score across all groups that you're slicing by.

For top-level admins, that column represents the average favorability for the organization overall. For focused admins, that column represents the average favorability within their administrative scope.

For managers, the leftmost column represents the average favorability within their downline.