Survey Design & Customization
      Back to home
      1. Help Library
      2. Surveys & Pulses
      3. Survey Design & Customization

      Survey Quality Checks

      The Survey Quality Check feature provides admins and survey-admins with best practice guidance as the survey is being created. 

      Last Updated: November 4, 2024

      In this article:

       

      Overview

      The Survey Quality Check feature provides admins and survey-admins with best practice guidance as the survey is being created. Use the Survey Quality Check to ensure a robust survey design that yields meaningful and actionable results.

      Refer to this article to address any issues detected by the Quality Check during the survey setup. 

      Requirements

      • Available to full admin and survey-admin users

      Use the Survey Quality Check

      As you configure and create your survey, the Quality Check will monitor the survey settings and details.

      If any issues are detected, the Quality Check button will list the number of critical and/or possible issues. Click Quality Check at any time to view and address any issues.

      Survey Quality Check: Questions

      Potential Duplicate Question

      Quality Check Type: Possible

      Alert when a potential duplicate survey question is detected.

      To address a duplicated question:

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check 
      3. Use the Quality Check modal to identify the detected issue
      4. Scroll through the Questions page and identify the potential duplicate question, as indicated by the [x] Possible Issue alert
      5. Click the [x] Possible Issue alert to view additional details, including the number of the potential duplicate question
      6. Address the duplicate question:
        • Edit the question text to distinguish the question as a new unique question, and click Save Question to finalize the edits
        • Click Delete Question to remove the duplicate question from the survey 

      Engagement Survey Not Using the 6-Point Agreement Scale

      Quality Check Type: Possible/Critical

      Alert if more than one question scale is detected in the survey, e.g. 6-Point Agreement and 3-Point Agreement.

      Note: Inconsistent scales for Engagement and Engagement Follow-Up survey types are considered a critical issue. Inconsistent scales for other survey types are considered a possible issue. Learn more about survey types.

      To address a question(s) with inconsistent scales:

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check 
      3. Use the Quality Check modal to identify the survey question(s) using an inconsistent scale
        • Note: If you are using the recommended Annual Engagement template, the default scale is the 6-Point Agreement scale
      4. Once you have identified the question(s), click the question's corresponding ⋮ icon
      5. Click Edit to view the question's settings
      6. Click and expand the Scale drop-down menu

      7. Click and select the scale that is consistent with the rest of the survey's questions
        • Note: If you are using the recommended Annual Engagement template, select the 6-Point Agreemtnent scale
      8. Click Save Question to finalize the edits

      Survey Quality Check: Categories

      Category Without At Least Two Questions

      Quality Check Type: Possible

      Alert if a category does not have at least two questions.

      It's recommended that each category have at least two questions for robust reporting data. If a category only includes one question, consider if the question can be added to a different relevant category or if the question can be deleted without impacting the survey.

      To address a category without at least two questions: 

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check 
      3. Use the Quality Check modal to identify one or more categories without at least two questions
      4. Identify a question that should be assigned/reassigned to a different category
      5. Click the identified question's corresponding ⋮ icon to open a menu of additional options
      6. Click Edit 
      7. Under Category, click x corresponding to the Uncategorized tag
      8. Enter and click the category or use the drop-down to select the category the question should be assigned to
      9. Click Save Question
      10. Repeat until each category has a minimum of two questions

      Scaled Question Not Assigned to a Category

      Quality Check Type: Critical

      Alert if the survey uses scaled questions that are not assigned to a category.

      It's recommended that each category have at least two questions for robust reporting data. If a category only includes one question, consider if the question can be added to a different relevant category or if the question is even necessary.

      To address a scaled survey question without a category:

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check 
      3. Use the Quality Check modal to identify the question and question number that does not have a category
      4. Click the identified question's corresponding ⋮ icon to open a menu of additional options
      5. Click Edit 
      6. Under Category, click x corresponding to the Uncategorized tag
      7. Enter and click the category or use the drop-down to select the category the question should be assigned to
      8. Click Save Question

      Survey Quality Check: Survey Design

      Best Places to Work Qualification

      Quality Check Type: Possible

      For Engagement and Engagement Follow-Up survey types- an alert if all of the Best Places to Work questions are not included.

      Including all of the Best Places to Work questions in the survey ensures your organization qualifies for the Best Places to Work contests, should you choose to participate. Learn more about the Best Places to Work contests.

      To add a missing Best Places to Work question:

      1. Navigate to the Questions step of the survey creator
      2. Click Add from Library in the left-hand Questions card
      3. Click and expand the Type drop-down menu in the top-right of the Your Library modal
      4. Click BPTW (Best Places to Work) to view every Best Places to Work-required question
      5. Select the Best Places to Work question(s) missing from the survey
      6. Click Add

      Engagement Surveys Not Using the Recommended E9 Questions

      Quality Check Type: Possible

      For Engagement and Engagement Follow-Up survey types, alerts if the survey does not include the recommended Engagement Outcome questions that are used to measure employee engagement. Learn more about Quantum Workplace's Engagement Survey model.

      To add missing Engagement Outcome (E9) questions:

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check
      3. Use the Quality Check modal to identify the one or more E9 questions not included in the survey
      4. Click Add from Library in the left-hand Questions card
      5. Click and expand the Type drop-down menu in the top-right of the Your Library modal
      6. Click Scaled
      7. Scroll through the scaled questions and select the E9 question(s) identified in step 3
      8. Click Add

      ME Report Qualification

      Quality Check Type: Critical 

      For Engagement surveys with scaled questions and the ME Report enabled- an alert if the survey does not qualify for the ME Report. Learn more about the ME Report.

      To add missing questions to ensure a successful ME Report:

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check
      3. Use the Quality Check modal to identify the one or more categories that do not have a minimum of two questions that support Quick Impacts
      4. Click Add from Library in the left-hand Questions card
      5. Click and expand the Type drop-down menu in the top-right of the Your Library modal
      6. Click Scaled
      7. Scroll through the scaled questions and select questions from the one or more categories identified in step 3
      8. Click Add

      Flight Risk Questions for Retention Radar

      Quality Check Type: Critical

      For Engagement or Engagement Follow-Up surveys- an alert if your survey does not include at least three Flight Risk questions to update your organization's Flight Risk calculations and provide up-to-date Retention Radar data. Learn more about Retention Radar.

      To add a missing Flight Risk question:

      1. Navigate to the Questions step of the survey creator
      2. Click Quality Check
      3. Use the Quality Check modal to identify the Flight Risk questions not included in the survey; highlight and copy the missing question(s)
      4. Click Add from Library in the left-hand Questions card
      5. Enter or paste the missing Flight Risk question(s) in the search field
      6. Click and select the question's corresponding ☐ icon
      7. Click Add

      Survey Quality Check: Translations

      Missing Translations

      Quality Check Type: Critical 

      Alert if the survey includes an additional non-English language and does not have the required translations for questions, email notifications, categories, etc. Learn more about survey translations.

      To add missing translations:

      1. Navigate to the Languages step of the survey creator
      2. Identify the field that does not have a translation
      3. Enter the translation and click Save