The Complete Research Suite

The Complete Research Suite A step-by-step guide to using Qualtrics Written by Jonathan Snow

Introduction QUALTRICS SURVEY RESEARCH SUITE Welcome to the official Qualtrics Survey Research Suite guidebook! The goal at Qualtrics is to make your life easier. We have provided you with a robust survey tool that simplifies your research ventures. As a cherry on top, we would like to impart to you the wisdom of our Q University experts. We know you’re busy; you have important data to collect! You don’t have months to spend on learning a new software tool. We’ve got you covered. Our objective is to provide you a quick reference you can easily search to find answers to your pressing Qualtrics questions. Of course, if you desire to become a real Qualtrics expert, this book will provide you with all the in-depth information you need to achieve mastery. You will find all the information you need to get started in the Research Suite, laid out in step-by-step detail. As you become more familiar with the tool, you can use this guide to accomplish your more advanced research objectives. WHY YOU SHOULD BE EXCITED! This book will help you on your journey to becoming a Qualtrics expert. Your friends and colleagues will be in awe at your survey building skills. You will find the information you need to get started with the tool as well as step-by-step instruc- tions on how to use our more advanced features. WHAT’S A TRIAL ACCOUNT AND HOW DO I GET ONE? If you don’t already have access to the Qualtrics Survey Research Suite, you can start one now; it’s easy! A trial account can be acquired by going to www.Qualtrics.com and clicking the Free Account button. This will guide you through a short process of setting up an account. Table i-1 Nuts and Bolts Icing on the Cake Access to 40 question types Access to the latest survey design interface of the © Copyright 2011, Qualtrics Labs, Inc. Qualtrics Survey Research Suite Introduction | 3

Nuts and Bolts Icing on the Cake 2 surveys active at the same time Use skip logic and display logic 250 responses per survey Embed graphics and videos directly into the survey Up to 20 total surveys Get more advanced with branches and quotas 350 free responses (total) Create polls and survey pop-ups No expiration date Collect data No credit card required View real-time results Publish online reports Download data to Excel and SPSS About the Author Export reports to Word, PPT, PDF, and Excel Perform cross tabulations Jonathan Snow founded the Qualtrics Support Team in 2006. He has Now that you’re set up with a user account, lets get started! consulted with thousands of leading researchers around the world, and -TIP he is still on a first-name basis with many of them. Q-TIP Snow also created a proactive support model, through Qualtrics Univer- Q - T I P sity and Qualtrics Training, that focused on providing extra resources for users in addition to simply answering Q - T I P phone calls. In 2010, his team was awarded the People’s Choice Stevie Most likely, you’re all set to get started, but if you run into some problems, here are a couple things to check: Award for Favorite Customer Service. - T I P At Qualtrics, he is considered the foremost expert on the Qualtrics Research Suite. 1. JAVASCRIPT AND COOKIES BOTH NEED TO BE ENABLED ON YOUR BROWSER. Check our the Web Browser Tools page online (Go to http://www.qualtrics.com/university and enter “Web Browser Tools”): • JavaScript—The Qualtrics Research Suite uses the latest javascript and AJAX technology, and will not function well without javascript enabled. • Cookies—Cookies are used to allow the system to authenticate who you are and to make sure you see the correct information while logged into your account. 2. EACH PAGE HAS A TIP OR HINT AT THE VERY BOTTOM IN BOLD. THESE HINTS ROTATE AND ARE DESIGNED TO DISPLAY USEFUL INFORMATION RELATING TO FEATURES WITHIN THE TOOL. 4 | Introduction About the Author | 5

Table of Contents Introduction ................................................... 03 Chapter 1: Create and Manage Surveys ......... 05 Chapter 2: Your Account Libraries ................. 21 Chapter 1 Chapter 3: Edit Your Survey ........................... 29 Create and Chapter 4: Advanced Question Options .......... 59 Chapter 5: Block Options and Survey Flow ..... 75 Manage Chapter 6: Special Features ........................ 101 Surveys Chapter 7: Distribute Survey ........................ 129 Chapter 8: Panels ........................................ 143 The first steps for creating a survey are critical. This chapter explains how to create, copy and even collaborate on a survey. 6 | Table of Contents Qualtrics: The Complete Research Suite | 7

AFTER READING THIS CHAPTER, YOU WILL KNOW HOW TO: The Create Survey Tab • Create your first survey • Use the My Surveys tasks • Organize surveys in folders Once in the Create Survey tab, you will see that there are three main options for creating your survey: Quick Survey Builder, • Use the Collaborate feature to share surveys Create from Copy, and Survey Library. Each option, once selected, will takes you into the Edit Survey tab where you can begin building and editing your survey. If you have successfully logged in to your Qualtrics account, then you are ready to create a survey. There are several op- tions for creating a new survey and we will help you become familiar with them in this chapter. This is the first step you will need to take as you start the survey building process. In addition to teaching about survey creation, this chapter will go over the tools available to you in the My Surveys tab when accessing and organizing your surveys. This includes the option to sort your surveys by header and add your surveys to folders Creating Your First Survey When you log in to the Qualtrics Research Suite, you will arrive in the My Surveys tab. If you have not yet created any surveys, you will be prompted to create a survey. To proceed, click on “Click here to create your first survey.” You will then be taken to the Create Survey tab. Alternatively, click directly on the Create Survey tab to see all of your survey creation options (Figure 1-1). Figure 1-2 Click to create first survey. If you already have surveys in your account, you will see all of them listed in the My Surveys tab along with any surveys that have been shared with you and the task icons available associated with each survey. The Quick Survey Builder is called “quick” because it allows you to build a survey instantly within the Qualtrics tool. When you select this option, your survey is brought in completely blank and you can add new questions manually. If you would like to start with a pre-existing survey, select to Create from Copy. This is a good option if you need to build a survey similar to another survey you have in your account and just need to make a few tweaks, Finally, there is the Survey Library option. This option is similar to the Create from Copy option described above, but it lets you copy from your Survey Library, a Group Library, or the Qualtrics survey library. Qualtrics has a whole list of already built surveys in the Qualtrics library that can be used as templates when you are just starting out. Feel free to browse them and get ideas. Figure 1-1 Click to create first survey. 8 | Chapter 1: Create and Manage Surveys Chapter 1: Create and Manage Surveys | 9

QUICK SURVEY BUILDER SURVEY LIBRARY Clicking this option will display the Create a New Survey window (Figure 1-3). Clicking this option will display the Create from Survey Library window (Figure 1-5). Figure 1-3 The Create a New Survey dialog after clicking the Quick Survey Builder button. Figure 1-5 The Create from Survey Library dialog window. Since you are starting from scratch, you are asked for a survey name. You can also specify a folder, which is optional. Once you click the Create Survey button, you are immediately taken to the Edit Survey tab so you can get to work. This allows you to copy a survey from your own survey library, or copy one from the group library of a group you belong to (including the Qualtrics survey library). Simply specify which library you want to pull the survey from and use the naviga- Q-TIP -TIP CREATE FROM COPY tion to select the survey. From there you can name the survey and place it in a folder. Q - T I P Clicking this option will display the Create from Copy window (Figure 1-4). Q - T I P Don’t forget the Qualtrics Library! It contains a variety of different surveys and questions that you are welcome to copy - T I P and use. Navigating the My Surveys Tab Figure 1-4 The Create from Copy dialog window. You are asked which survey you would like to copy, what you would like to name it, and which folder you want to put it in. Once you have created surveys in your account you will see the My Surveys tab as a homepage where you can see the list You can also copy a survey by going to the My Surveys tab and clicking the Copy button next to the survey you want to of all your surveys and access useful tools for each of them. These tools can be found under the Tasks column. copy. You will be given a similar window to specify the survey name and folder. 10 | Chapter 1: Create and Manage Surveys Chapter 1: Create and Manage Surveys | 11

TASK ICONS TRANSLATE: Jumps to the Translate Survey feature in the Edit Survey tab. In Figure 1-6 you can see that there are a list of Tasks on the right-hand side of every survey listed. Use these icons for DELETE: Displays a dialog box to confirm deletion. All data is deleted with the survey so make sure you really want quick access to the main areas of the Qualtrics survey tool. Each task correlates to the survey it is next to on the table. to do this. First, download a copy of your data and a copy of your survey. Qualtrics Survey Format, or .qsf, is the provided format when downloading your survey. A survey stored in .qsf format can be uploaded and reinstalled into Qualtrics. A .qsf however, can only be read by Qualtrics. COLLABORATION Figure 1-6 Task Icons. One of the most useful buttons available in the task menu is the Collaborate button. When clicked on, it opens a window where you can choose to share your survey with another person or group. Collaboration is a great way to get someone’s feedback on a survey before you distribute it. Col- You can use the Task Icons (Figure 1-7) to jump directly to a specific task or location within the Research Suite. These laborators can be given permission to make edits, distribute, and even view and analyze the results of shared surveys. icons provide one-click access to commonly used areas and features. Don’t worry, you control their access. They only have permission to perform those tasks that you specify. To collaborate, first click the Collaborate task icon and enter the individual’s username or email address into the text box at the top (see Figure 1-12). All matches will be displayed as you type and you can select the correct one. You also have the option of clicking the User and Group Address Book link to the right. This gives you a list of users in your organization you can select instead of typing in the username. Figure 1-7 A Close-up of the Task Icons. Click here to get a list of users. These task icons carry out the following actions: EDIT: Jumps to the Edit Survey tab of the specific survey selected. RESULTS: Jumps to the View Results tab of the specific survey selected. SEND: Jumps to the Distribute Survey tab of the specific survey selected. The tool searches Permissions are found in these for the username. columns. Click ‘Details’ for more VIEW: Functions the same as the Preview Survey link found on the Edit Survey and Distribute Survey tabs. specific permissions. COLLABORATE: Enables you to give permissions to and share a survey with another Qualtrics user so they can view, edit, distribute, and analyze data in your survey. If there isn’t an existing user account for the person you want to collaborate with, then the tool will send an email and create a trial user account for them. You can read more Figure 1-12 Add a user to share the survey within the Collaborate dialog window. about collaboration later on in the chapter. COPY: Enables you to copy a survey, and even send the copy to another user account. When a copy is made, it Once you’ve found your user, click the Add button. The user will then show up in the collaborate table and you will be able becomes a completely separate survey with its own survey link. Survey data is not copied along with the survey. to specify what the user can access (Figure 1-13). In the Edit and View Results sections, you can allow all permissions by selecting the main checkbox, or be more specific by clicking the Details link. 12 | Chapter 1: Create and Manage Surveys Chapter 1: Create and Manage Surveys | 13

ALERT: You can’t give permission for the user to do anything that your personal user account doesn’t give you permission to do. Email for new account. Figure 1-14 Send an email for a trial account if the person you are sharing with does not have a user account. Figure 1-13 Set the permissions for the user. Table 1-1 Edit Permission Details EDIT SURVEYS* Collaborator can use the entire Edit Survey tab and make changes to your survey. When setting up the permissions you will see that there are five categories: SET SURVEY OPTIONS Just like it sounds, you can specify if you want to allow your collaborator EDIT: Allows collaborator to Edit survey. to delete questions. DELETE SURVEY QUESTIONS Just like it sounds, you can specify if you want to allow your collaborator to delete VIEW RESULTS: Allows collaborator to view survey results. questions. USE SKIP LOGIC Specify whether or not the person can set skip logic within the survey. ACTIVATE/DEACTIVATE: Allows collaborator to activate or deactivate the survey for you. USE QUOTAS Choose whether or not the person can set quotas on the survey. TRANSLATE SURVEYS Decide whether you want to allow the person to view, add, and edit COPY: Allows collaborator to make a copy of the survey to place and use in their own account. translations for the survey. CREATE RESPONSE SETS Pick whether or not you allow the option to create Response Sets in the Survey Options DISTRIBUTE: Allows collaborator to use the Distribute Survey options window. EDIT SURVEY FLOW Control whether the collaborator can work with branch logic, end of survey elements, See Tables 1-1 and 1-2 for more details about the specific collaboration permission. randomizers, and other elements within the Survey Flow. USE CONJOINT Give permission to access the self-explicated conjoint tool under Advanced Options on Most users will have the ability to share within their organization, but not all users will have the ability to share outside of the Edit Survey tab. their organization. In fact, this is a feature mostly used in the academic world where research is shared between universi- COPY SURVEY QUESTIONS Give the ability to use the Copy Question feature to the right of each question in the ties. The corporate world typically does not use this feature in an effort to keep sensitive research secure. blue column. If you try to share a survey with someone who does not already have an account, you will be prompted to send an email to EDIT SURVEY QUESTIONS Provide the ability to edit or remove the questions already in the survey, as well as add them that contains a link that, when clicked on, automatically creates a trial account for them. This allows them to col- new questions. laborate with you through the trial account. 14 | Chapter 1: Create and Manage Surveys Chapter 1: Create and Manage Surveys | 15

USE BLOCKS Give the ability to create new question blocks within the Edit Survey tab. Task Icons option in the drop-down menu allows you to select the Task icons to display in the Tasks column. Each Task icon, except for Survey Copy and Survey Delete, is accessible in other places in the Survey Research Suite. Changed set- USE TRIGGERS Give the ability to use Email and Panel Triggers, under Advanced Options on the Edit tings will be remembered the next time you log in. Survey tab. *If you don’t give access to the Edit Surveys permission, all other permissions are overridden Table 1-2 Q-Reference: View Results Permissions Details EDIT SURVEY RESULTS Allow the collaborator to access data and be able to delete or import data on the Responses page on the View Results tab. USE CROSS TABS Decide whether the collaborator can build and work with Cross Tabulations on the View Results tab. USE SUBGROUP ANALYSIS Allows the collaborator to set up subgroups within reports. VIEW SURVEY RESULTS* Allows the collaborator to access the View Results tab. If unchecked, the collaborator can not access the View Results tab. VIEW RESPONSE ID Decide whether the collaborator can view the Response ID column on the Responses Figure 1-15 Specify what should be displayed. page and in the files downloaded from the Download Data page. *If you don’t give access to the View Survey Results permission, all other permissions are overridden. In the gray navigation bar at the top of the My Surveys tab (Figure 1-16), you have more icons that will take you to other tabs within the tool, like Create Survey, Distribute Survey, and View Results. These icons can help you quickly navigate the tool. Show More Data Figure 1-16 Jump to a corresponding tab from the My Surveys tab by clicking an icon in the navigation bar. In the right-hand corner of the My Surveys tab is the Show More Data drop-down button (see Figure 1-15). This option allows you to display or not display certain columns in survey table. Creation Date and Modified Date are not displayed by default, but you can choose to display them. 16 | Chapter 1: Create and Manage Surveys Chapter 1: Create and Manage Surveys | 17

Organizing More Surveys As you create more and more surveys, it may get difficult for you to find the survey you need. You’re in luck! Within the My Surveys tab there are several tools for organizing your surveys. Become familiar with these tools so you will have a clean account that is easy to navigate. Figure 1-18 The folder management view. SORT BY HEADING Q-TIP -TIP Once you have organized your surveys into folders, you can close the folder manager and go back to the survey table. Se- Each column header across the top of the survey table can be clicked. When the header is clicked, the corresponding lect which folder of surveys you want to look at by clicking on the drop-down menu to the left of the Manage Folders link. column is sorted alphabetically, by number of responses, or by date created or by date modified. Q - T I P Q - T I P You can also star a survey (similar to flagging an email), and sort for the starred or un-starred surveys. Sorting by starred surveys will bring all of the starred surveys to the top of the list. The same goes for the active and inactive surveys. If you You may assign a survey to a folder when creating it. The Edit Survey tab also allows you to add a survey to a folder or - T I P sort by Creation Date and Modified Date, the most recently dated surveys are brought to the top. change which folder it is in. To do this, click on the survey name at the top of your survey while in the Edit Survey tab. SEARCH The search bar is convenient when you would like to find a survey fast. It is located near the top right of the page and Q-TIP -TIP allows you to search for a survey in your list of surveys by typing in the name. Your survey list will filter with matches ac- cording to what you type. Q - T I P Figure 1-17 Column Headers. Q - T I P Qualtrics searches within the folder you currently have selected. - T I P FOLDERS If you are a folder lover, you can create folders to group your surveys. At the top of the survey table is a Manage Folders RENAMING SURVEYS link that expands to a folders view (see Figure 1-18). If you have created a survey but would like to change the name, you can do so in the Edit Survey tab. When you click on When in the Manage Folders view, you can: the survey in the My Surveys tab you will be taken to the Edit Survey tab. The survey name will show at the top of the 1. Click Add Folder to create a new folder. survey. To change it, click directly on the survey name and start typing in the new name. You can change the name, as 2. See all of your surveys and click, drag, and drop them into a folder to make them part of a folder. well as the folder it is in. 3. When you are finished making changes, click Close. 18 | Chapter 1: Create and Manage Surveys Chapter 1: Create and Manage Surveys | 19

Research Suite Helps As you navigate through the Research Suite, you will notice that there are many powerful tools accessible to you across every page. Feel free to use these tools as you work through your research process. The Current Survey Drop-Down Menu is a convenient feature found on every page of the Suite. You can be working in one survey on the Edit Survey page and quickly change to another survey using the drop-down menu. When you go to the Library and Panels tabs, this drop-down changes to show the current library you are in or the current panel library. The Get Help button is also available on each page. This button directs you to a page that lists the following helps available to you: • Live online trainings • Qualtrics University online documentation • Email support address • Phone support numbers Please not that many of the features within the tool are permission based. While all permissions will be described here, Chapter 2 you may not have access to a particular feature. If access is missing, please communicate with your in-house Qualtrics Administrator or contact the Qualtrics sales team to see about gaining more access. Your Account Libraries Don’t duplicate your efforts. Qualtrics saves your questions, surveys, graphics, messages and more in libraries so you can easily paste them into other places as needed. 20 | Chapter 1: Create and Manage Surveys Qualtrics: The Complete Research Suite | 21

AFTER READING THIS CHAPTER, YOU WILL KNOW HOW TO: • Create your first survey • Access your libraries • Store content in your libraries • Organize your libraries • Share content from your libraries Your account libraries are a great resource that you will use constantly. As you work in the tool, you will use your librar- ies to store graphics, organize your messages, access survey questions and much more. The Libraries are like your office file cabinets, where you can keep your important items organized. In this chapter we will teach you how to properly store items in your libraries and access them as you build and distribute your surveys. Figure 2-2 Library Overview SURVEY LIBRARY Navigate Your Libraries The Survey Library is where you can keep copies of surveys that you would like to reference later. While you can always make copies of your existing surveys, it’s a great resource to have a library of survey templates for you and other col- leagues to reference when building new surveys. Your libraries are broken up into multiple categories: Survey Library, Questions Library, Graphics Library, Files Library, and Message Library. The Graphics Library stores graphics, the Message Library stores messages, and so on. When you enter To copy a survey to a Survey Library: each of these categories you will see multiple subcategories for storing your items. 1. Go to the Library tab and click on the Survey Library icon to enter the Survey Library. 2. Click the green Copy a Survey to This Library button. 3. In the Source Survey menu, select the survey to copy. 4. If needed, specify a category to put the survey into. This is optional. If you don’t select a category, the survey will be placed into the predefined “Unassigned” category. a. To create a new category, type it into the text field. Figure 2-1 Library Tab b. To select an existing category, click the blue arrow. 5. Under Survey Name, enter a name for the survey. It will automatically populate with the name of the survey selected. Q-TIP -TIP LIBRARY OVERVIEW 6. Click Copy. Q - T I P The Library Overview section (Figure 2-2) provides the basic information on each category in your library. You can see a Q - T I P clear layout of all of the categories, as well as the total number of items in each category. Each section is linked, so you can click on a category and jump directly from the Library Overview page to the individual category. You can copy a survey to a library from the My Surveys tab as well. Click the Copy button next to a survey, then under the - T I P Copy to menu select Library. 22 | Chapter 2: Your Account Libraries Chapter 2: Your Account Libraries | 23

QUESTION LIBRARY The Question Library (Figure 2-3) is where you can keep copies of specific questions you might want to reference later on. You can copy questions into the library from existing surveys in your account. This is great when you want to have a library of question templates for you and other colleagues to reference when building a new survey. Figure 2-4 Sample Graphics Library Figure 2-3 Question Library You can also add graphics to your Graphics Library directly from the Library Tab. The Copy Items From button at the bottom of each block in the Edit Survey tab will allow you to insert questions from your To Upload a New Graphic while in the Library tab: Question Library as you build your surveys. 1. Click into the Graphics Library from the Library tab. 2. Click the green Upload a New Graphic button. To add a question to a Question Library: 3. At this point you can select a graphic off of your computer by selecting Browse or Choose File, or you can click 1. Go to the Library tab and click on the Question Library icon to enter the Question Library. the Use a graphic from the web option to paste the URL of the image you found on the internet. 2. Click the green Copy a Question to This Library button. 4. Provide a Category. This is optional. If you choose not to specify a category, the image will be placed under the 3. In the Source Survey menu, select the survey to copy. “Unassigned” category. 4. In the Source Question menu, select the question to copy. 5. Specify a Description or name for the image. The tool will automatically grab the file name of the image. 5. Under Category, specify a category to put the survey into. This is optional. If you don’t select a category, 6. If you uploaded an image from your computer, you will be able to specify a width and height to change the size of the survey will be placed into the predefined “Unassigned” category. the image. The ability to modify size is not available if using the Use a graphic from the web option. 7. Click Save. If you are on the Edit Survey tab using the Rich Text Editor, clicking Save will automatically place the a. To create a new category, type it into the text field. Q-TIP -TIP b. To select an existing category, click the blue arrow. image into the question or answer choice text. 6. Under Description, enter a name for the question. It will automatically populate with the name of the question Q - T I P selected under Source Question. 7. Click Copy. Q - T I P Make sure you have permission to use the images you upload into your library and display in your surveys. - T I P GRAPHICS LIBRARY FILES LIBRARY The Graphics Library (Figure 2-4) is where your images are stored. All images you put into your question text, answer The Files Library is where you will store all files that don’t fall under the Graphics category. There are several situations choice text, or email messages are stored here. where you will need to use your Files Library. For example, if you are attaching a file to a question in your survey so that your respondents can download it, you will store that file in your Files Library. When you enter the Rich Text Editor from a question, answer choice, or message, you can click on the Insert Image icon to insert an image from your graphics library. A box containing your graphics library will appear and you can choose one of To Upload a New File: your already uploaded graphics or click on Upload a New Graphic. 1. Click into the Files Library from the Library tab then click the Upload a New File button. 2. Click Browse or Choose File to find the file on your computer. 3. Assign the file to a Category. This is optional. If you choose not to specify a category, the file will be placed under 24 | Chapter 2: Your Account Libraries Chapter 2: Your Account Libraries | 25

the “Unassigned” category. 4. Provide a Description or name for the file. By default the file will be assigned the name you gave it when you saved it on your computer. 5. Click Save when ready. MESSAGE LIBRARY The Message Library (Figure 2-5) is where all messages you use in the Research Suite are stored (survey invitation, reminder, thank you, etc.). In the Message Library you can find and edit any existing messages, as well as create new mes- sages as needed. Figure 2-5 Example Message Library Chapter 3 To create a new message while in the Library tab: 1. On the Message Library page, click the Create a New Message button. 2. Choose a Category for your message. Categories determine where in the tool the message is available. The mes- Edit Your sage library doesn’t allow you to create your own category. The following categories are available: Invite Email, Reminder Email, Thank You Email, End of Survey Messages, Inactive Survey Messages, Validation Messages, General Messages, and Look and Feel Messages. Survey There are many times you will need to insert or create a message while you are working within the tool. When you email your survey out, for instance, or choose to change the End of Survey message, you will be prompted to choose a message or create a new one. At these times you will be able to access to your library messages through a drop-down or choose to create a new message. Any new message you create while working in the tool will be saved to the message library. Qualtrics has thousands of options for you in editing your survey. This is the first chapter that seeks to explain them all in detail. 26 | Chapter 2: Your Account Libraries Qualtrics: The Complete Research Suite | 27

AFTER READING THIS CHAPTER, YOU WILL KNOW HOW TO: COPY QUESTIONS FROM... • Build a survey from scratch You can also pull questions from other surveys or libraries by clicking the purple Copy Item From... button. This allows • Edit survey questions you to select questions from other surveys in your account, or from the Survey and Question Libraries you have access to. • Edit answer choices • Change the appearance of your surveys After clicking Copy Item From, you will click to drill-down to a more specific category or item until you find the desired • Enable important settings in Survey Options questions. Once you see the question, hover your mouse over the question text on the left to see a preview. Click all of the questions you want to add. You can add as many as you want at one time, then click the blue Add button at the bottom of You will likely spend much of your questionnaire development time in the Edit Survey tab, so this chapter is the meat and Q-TIP -TIP the window. potatoes of the book. Take some time to become familiar with the basic breakdown of how to use the Edit Survey tab and watch your survey building horizons widen. Q - T I P In this chapter, we will first introduce how to add questions and basic elements to your survey, then examine general Q - T I P survey level options. Finally, we discuss how to check spelling in your survey, preview the survey and print the survey. • Click the gray question block header in the list of questions on the left to select every question within - T I P that block at once. Once you have an idea of how to build your survey, feel free to read over the appendix following this chapter for a detailed • Just click a question again if you want to deselect it. explanation of all question types and how to use them. • When no questions are selected, the blue Add button allows you to “Import Entire Survey”, which is all the questions in the list on the left. Add and Position Questions COPY QUESTIONS You can add a question or group of questions to your survey by copying existing question in your survey. Do this by clicking on the question you would like to copy (the question will turn blue) and then clicking on the Copy Question link to the bottom right of the question in the blue column. To copy a group of questions, you can either select them by checking each When you click the Quick Survey Builder option and create a new survey, you are given a blank template, which is actually checkbox near the top left of each question, or by clicking on a question and using Ctrl+click (on Macs: Cmd+click) to your Default Question Block. It is within the question block that questions are added and edited. select additional questions individually. You can also use Shift+click to select a large amount of questions all at once. To do this click on the first question in the list, hold down Shift+click then click on the last question in the list of questions you would like to copy. To the right you ADDING QUESTIONS WITH THE GREEN “+” BUTTONS will have a menu of options that can be used when multiple questions are selected. Click the Copy button and you will copy all of the questions into your survey. These copied questions will show up below the original questions in the survey. Questions can be inserted after any existing question, page break, or at the bottom of a question block. Just click one of three green “+” buttons. One is found at the bottom of a question block (Create New Item). The other two are found by hovering your mouse over any question or page break – they will display at the top right and top left corners. MOVE QUESTION The Move Question option allows you to move your questions to a different location in the survey. When you select Move Question, the question you have selected turns into a light blue block that follows your mouse until you find where you want to place it. Figure 3-1 Plus buttons for adding questions to a survey. 28 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 29

To use Move Question: PREVIEW QUESTION 1. Click the question you want to move. Clicking Preview Question is the equivalent to clicking Preview Survey at the top of the page, but just for an individual 2. Click Move Question (located at the bottom of the blue bar on the far right). question. It’s a great way to see how your question will look within the selected Look and Feel without having to click through the survey to get to it. To use Preview Question: 1. Click the question you want to preview. Q-TIP -TIP 2. Click Preview Question. A small browser window will open, showing the question. Q - T I P Q - T I P • Preview the entire survey by clicking Preview Survey at the very top of the Edit Survey tab. This button is also Figure 3-2 Move Question. - T I P available on the Distribute Survey tab, as well as the My Surveys tab, next to each survey (the “View” button). 3. Move your mouse to the place in the survey you want the question to be. The light blue block will follow • Preview an entire question block by clicking Block Options and selecting View Block. your mouse wherever you scroll. Q-TIP -TIP 4. Click in the survey where you would like the question to be placed. Q - T I P ADD A PAGE BREAK Q - T I P Add Page Break allows you to break up a block of questions into separate pages. This is similar to inserting a break into a • To move your question a short distance, hover over the question and click the up/down arrows that appear Word document. It’s great to use this option when you have a lengthy block of questions. It allows you to keep your survey - T I P directly to the left of the question. in screen-sized chunks so that the participant does not become overwhelmed by having to scroll through a long screen of • Move multiple questions at a time by selecting multiple questions (Shift+click or Ctrl/Cmd+click, or click questions. the checkboxes), then click the Move button to the right. Then follow steps 3 and 4 above. To use Add Page Break: 1. Click the question you want the break to appear after. 2. Click Add Page Break (located at the bottom of the blue bar on the far right). \ Q-TIP -TIP Q - T I P Figure 3-3 Move multiple questions. Q - T I P Figure 3-4 Add a page break. - T I P 30 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 31

If you want a set number of questions per page throughout a survey, use the Questions Per Page option found under Look EDITING TEXT and Feel on the Edit Survey tab. To edit question or answer choice text, click directly on the question text and answer choice text to write in what you would like it to say. To customize the question text using HTML, click on the question and then click on the HTML View button above the question text field. The answer choice fields can receive HTML directly. If HTML isn’t your skill, the Rich Text Editor is also available, providing a toolbar of options for text formatting. To use the Rich Text Editor when editing question text, click the Rich Text Editor tab near the top left corner of the ques- tion text window. When you are done using the Rich Text Editor, click the gray space outside of the Rich Text Editor window and the changes Edit Questions will automatically be saved. When the Rich Text Editor is opened, there are buttons at the top that all serve a specific function: • {a} - Pipe in text from a question, panel, or embedded data field (first icon in the top row). SELECTING A QUESTION TYPE • Insert images into a survey or message from your graphics library. You can upload a graphic from this view as well. When you insert a question into a survey, the default question type is multiple choice. You can change the question type • Attach or link to files for respondents to download from surveys or messages. by selecting the question (it turns blue), then clicking the green Change Item Type button (Figure 3-5) to the right of the • Insert media into your survey, such as video or audio clips from a URL (film strip icon). You can also question in the blue column. When a question type is selected, the options in the question menu bar to the right adjust use the links from your Files Library and have Qualtrics host the media files. according to the question type you have selected. A detailed description of each Question Type and their accompanying • Insert special characters that you can’t find on your keyboard. options is given in the appendix following this chapter (Appendix 3a). • Insert a table in which you can then insert content. • Hyperlink a word or phrase (chain link icon), or remove a hyperlink (broken chain link icon). • Paste from Word without bringing in rogue code. Use this option to Copy and Paste text from Word without causing formatting issues. • Undo/Redo changes. • Align text left, center, right, and block justify. • Increase/decrease indent of text and numbering/bullet lists. • Insert Numbered and/or Bulleted Lists. • Remove formatting (eraser icon) from text you need to clean up. • Change font. • Change text size. • Format text with options to bold, italicize, and underline. • Use subscripts or superscripts. • Change text background color, or highlight text. • Change text color. Figure 3-5 Select a question type. • Use Source to view the HTML of the text being used and edit as needed The Rich Text Editor will appear through out the Research Suite whenever you need to draft a message or edit text. These same tools are available wherever you have access to the Rich Text Editor. ALERT: If you’ve already begun collecting responses, changing your question type could result in the loss of collected data. 32 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 33

Q-TIP -TIP Q-TIP -TIP Q - T I P Q - T I P Q - T I P Q - T I P • In the Edit Survey tab, the Rich Text Editor tab will not be available until you click the question text field you • Text entered into the text entry boxes appears as an extra column when you download your data set. - T I P - T I P want to edit, so click in the text field to get started. The responses are displayed verbatim. • Viewing Source in the Rich Text Editor is the same thing as viewing your question in HTML view for a question. • On a multiple choice question, by default, the text entry field displays just below the choice. To make it appear If you would rather use code to edit your font, you can enter the code into Source or HTML view. directly to the side, change your multiple choice question position to Column in the question menu bar to the • Make sure you highlight the text you want to edit before you select the edit option in the Rich Text Editor toolbar. right. If you want just one column, then specify the number of columns as “1”. If you have selected “Allow Text Entry”, then you can decide to add content validation to your text box. Text Entry Validation EDIT ANSWER CHOICES allows you to require that the respondent’s entered text matches a particular format, such as email address, phone num- ber, date, month, year or valid US state. Except for Force Response, these options are the same as the Content Validation options when using the Text Entry Single Line question type. Once you have inserted a question and written your question text, you will want to edit your answer choices. You can edit answer choices by clicking on them. When the choice is selected, it becomes highlighted and the text may be edited. To use Text Entry Validation: 1. Click to edit an answer choice. When editing an answer choice, a blue arrow appears to the right. Clicking the arrow provides a myriad of advanced op- 2. Click the blue arrow to the right. tions that will help you customize your answer choices (Figure 3-6). 3. Hover over Text Entry Validation. Q-TIP -TIP 4. Select the necessary validation option. The following section will give you details about each answer choice option. Q - T I P Q - T I P Force Response can be applied in addition to any content validation. Just repeat steps 1—3 above. - T I P RICH TEXT EDITOR FOR ANSWER CHOICES Figure 3-6 Click on the blue arrow to access advanced answer choices. The Rich Text Editor can also be used to edit individual answer choice text. You can also edit the answer choice field by typing HTML into the answer choice text field, but the Rich Text Editor makes it much easier! To use the Rich Text Editor for your answer choices (Figure 3-7): ALLOW TEXT ENTRY 1. Click the answer choice to edit it. 2. Click the blue arrow to the right. Allow Text Entry places a small text field next to an answer choice. This allows respondents to enter their own information, 3. Select Rich Text Editor. such as their own answer choice, into the question. This is most commonly used when placing an “Other (please specify)” 4. Edit your text using the toolbar of options. answer choice into the question. 5. Click Save when finished. To use Allow Text Entry: 1. Click to edit an answer choice. 2. Click the blue arrow to the right. 3. Select Allow Text Entry 34 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 35

EXCLUDE FROM ANALYSIS Exclude From Analysis is an off-on switch that can be selected so an answer choice and its data are not used in the tables and graphs in the reports (Figure 3-8). To use Exclude From Analysis: 1. Click the answer choice to edit it. 2. Click the blue arrow to the right. 3. Select Exclude From Analysis. Figure 3-7 Rich Text Editor for an answer choice. INSERT GRAPHIC This option, found in the blue arrow drop-down, makes it easy to insert a .png, .gif, or .jpg image into your answer choice field. To use Insert Graphic: 1. Click on the answer choice you would like to edit. 2. Click the blue arrow to the right. Q-TIP -TIP Figure 3-8 A red ‘x’ will appear next to an answer set with Exclude From Analysis. 3. Select Insert Graphic. 4. Select an image using one of the following methods: Q - T I P a. Click the Library drop-down menu near the top left if grabbing an image from a group library. b. Click Upload a New Graphic if the image isn’t already in your library. Q - T I P i. Click Browse to find the file on your computer. Q-TIP -TIP • Exclude From Analysis is automatically selected when you enter None of the Above. ii. Click Use a graphic from the web to reference an image online. - T I P • An excluded choice is designated by a small red X appearing to the left of the choice. Q - T I P • To turn off, just repeat steps 1–3. Q - T I P • Valid file types: .png, .gif, and .jpg (.jpeg). - T I P • Make sure you have permission to use the images you want to display in your survey. • Images can also be inserted through the Rich Text Editor. Just click the Insert Image icon found at the top INSERT PIPED TEXT of the Rich Text Editor toolbar. Insert Piped Text allows you to display information from other places in the survey. You can pipe text from a Survey Ques- tion, Embedded Data Field, Panel Field, Loop and Merge Field, or Quota. To use Insert Piped Text: 1. Click the answer choice to edit it. 2. Click the blue arrow to the right. 36 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 37

3. Select Insert Piped Text. To move a choice up one spot: 4. Hover over the category you would like to pipe from: Survey Question, Embedded Data Field, Panel Field, 1. Click on the answer choice you would like to move up. Loop and Merge Field, and Quota. 2. Click on the blue arrow to the right. Q-TIP -TIP 5. Select or enter the necessary information. 3. Select Move Up. Q - T I P It will give you a little code that is replaced with the text that gets piped. Place the code where you would like the informa- Q - T I P tion to show up. This can be in an answer choice or a question. Q-TIP -TIP You can insert an answer choice in between existing answer choices. Just click on the choice above where the new one - T I P Q - T I P should display, then press Enter on your keyboard. Selecting Move Down allows you to move an answer choice down one spot. Q - T I P To move a choice down one spot: The piped text code can be formatted. The piped text will be displayed the way that it is formatted. To format the code, 1. Click on the answer choice you would like to move down. - T I P open the Rich Text Editor and highlight the code. Select to apply a format from the Rich Text Editor toolbar. 2. Click on the blue arrow to the right. 3. Select Move Down. ADD DISPLAY LOGIC TO AN ANSWER CHOICE REMOVE CHOICE In the answer choice drop-down you can also choose to add display logic to an answer choice. This is a great way for you to Remove Choice deletes the answer choice from your list of choices. specify if a certain answer choice should be displayed conditionally. To remove an answer choice: To Add Display Logic to an answer choice: 1. Click on the answer choice you would like to remove. 1. Click on the answer choice you would like to display conditionally. 2. Click on the blue arrow to the right. 2. Click on the blue arrow to the right. 3. Select Remove Choice. 3. Select Add Display Logic. 4. Complete the logic statement. ALERT: Be careful deleting choices when you have data in your survey. Deleting an answer choice will delete the data as- sociated with that answer choice. Deleting answer choices after activating your survey and then adding them back in can Q-TIP -TIP Q-TIP -TIP You can find out more information about Display Logic and how to apply it to a whole question in Chapter 4. also mess up the way your choices are coded. If you do this, make sure to check your coded values before analyzing. Q - T I P Q - T I P Q - T I P Q - T I P If you need to Carry Forward choices from multiple different questions, use Add Display Logic. Insert all possible choices, You can also remove an answer choice by using the Backspace or Delete keys on your keyboard. Delete all the text, then - T I P - T I P then set Display Logic on each choice to specify when it should be visible. press the key one more time to remove the choice. If you have data in your survey, the tool will confirm you want to delete the choice. MOVE UP AND MOVE DOWN VALIDATION Selecting Move Up allows you to move an answer choice up one spot. There are four main types of validation available: Force Response, Request Response, Content Type Validation (where ap- 38 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 39

plicable), and Custom Validation. Validation options vary with each Question type and can be viewed in the question menu • US ZIP CODE: The entered text must be in the following formats: ##### or #####-####. bar to the right when a question is selected. • DATE: Require the date be in the mm/dd/yyyy format, or the dd/mm/yyyy format. • NUMBER: Only numeric characters are allowed. Q-TIP -TIP • TEXT ONLY (NON-NUMERIC): Only regular text, no numbers or punctuation. FORCE RESPONSE Q - T I P Q - T I P Select Force Response to require respondents to answer a question before they can move on to the next page of the survey. • Content Validation is only checked after the content is entered. It does not force a response. - T I P This option can also be applied to multiple questions at a time. Select multiple questions, either by checking the check box • To force this information to be entered, select the Force Response option as well. next to each or using your keyboard, then select Force Response in the group of options to the right. • Any entry meeting the content validation requirements will pass the Forced Response validation as well. CUSTOM VALIDATION Custom Validation allows you to specify certain criteria, and only allows the respondent to get past the question if they meet the criteria. You can then display a custom message to the respondent if/when they don’t meet the criteria. When you click Custom Validation, a special dialog window will display for setting it up. Figure 3-9 Find Force Response in the question menu bar to the right. 1. Select the question you want to base the logic off of. 2. Select the choice. 3. Most questions list the potential choices here. Text Entry fields will have you select the question again in order to move to the next drop-down. REQUEST RESPONSE 4. Specify the criteria. 5. The available options are: Selected, Not Selected, Displayed, and Not Displayed. Click the text (or arrow) for Force Response, then click Request Response. Selecting this option lets the survey taker 6. Text Entry field options are: Equal/Not Equal to, Greater/Less Than, Greater/Less Than or Equal to, Empty/Not know if they didn’t answer the question, but allows them to choose whether to return to answer the question or continue. Empty, Contains/Does Not Contain, Matches Regex, and Displayed/Not Displayed. After choosing one, specify It’s like a gentle reminder to answer the question. what value the entered text should be compared against. 7. Choose an error message to display on failure. 8. Load a saved Message or choose from System Defaults. 9. If necessary, create a new message (click Load a Saved Message, then select your library, then click New Message...). 10. Select a Description. The Description is a folder for reference in the message selection dropdowns. CONTENT TYPE VALIDATION Q-TIP -TIP 11. The green plus button allows you to edit the text and specify a new error category, if needed. 12. Click Save. This validation is available for text fields, like the Text Entry Single Line question type, Form Entry text fields, and even the Q - T I P Allow Text Entry option. Q - T I P Custom Validation does not have to be based off the question being edited, but can be based off any other question The following validation options are available: - T I P in the survey. • EMAIL ADDRESS: Checks if content matches the basic email address format ([email protected] domain). • PHONE NUMBER: Choose between United States (US), United Kingdom (UK), and Australia (AU) options. • US STATE: Checks if entered text is a state name or postal code abbreviation (California or CA). 40 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 41

Look and Feel To Select a Skin: 1. Click on the drop-down menu above the thumbnail and select the Qualtrics brand library or your own organization’s library of skins. 2. Click the thumbnail itself to see the available skins within your chosen library. So far, we have gone over how to put questions in your survey and edit them. When you have the building blocks in place 3. Click on the skin of your choice. for your survey, you will want to format and personalize the appearance. This is what the Look and Feel is for. You can access the Look and Feel through the icon located on the far left-hand side of the navigation bar in the Edit Survey tab (Figure 3-10). There are five aspects to the Look and Feel section: GENERAL TAB • Skins • General • Fonts • Colors • Advanced (Header, Footer, Cascading Style Sheets) Figure 3-12 Available options of the General tab. Q-TIP -TIP Some of the most common settings people want to change on their surveys are shown in Figure 3-12 and include: • NEXT/BACK BUTTON: Change the text that appears on the button. Click the blue arrow to select a message Q - T I P Figure 3-10 The Edit Survey Tab with Look & Feel button. or create a new one. Q - T I P If altering the Back button text, remember to enable the Back Button option under Survey Options first. - T I P SKINS • PROGRESS BAR: Want to display a progress bar in the survey? There are several options: • NONE: The default. No progress bar will display. A skin is a template you select for the overall appearance (background, text color, etc.) of your survey. You can change the • WITH TEXT: Displays a bar with “0%” and “100%” on either side. skin in the upper left hand corner of the Look and Feel (Figure 3-11). • WITHOUT TEXT: Displays a bar without “0%”, “100%”, or any other text. • WITH VERBOSE TEXT: In order to better explain to survey takers what they are looking at, this displays “Survey Completion” above the progress bar, along with “0%” and “100%” on either side. • QUESTIONS PER PAGE: Type in a number to specify how many questions should display on each page. This is easier than placing page breaks everywhere, especially if you want just one question per page. • HIGHLIGHT QUESTIONS: If selected, the question is highlighted when a survey taker clicks anywhere within the question. This can improve the respondent’s experience by accentuating the question that is currently being answered. • QUESTION SEPARATOR: Displays a line or extra space between questions (depending on the template selected). Figure 3-11 Clicking this allows you to select a new skin. 42 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 43

FONTS TAB The Colors tab allows you to change the colors of the different elements in your survey. This is where you can really alter the look of your survey. To edit you survey colors: 1. Click the color square or text of an element to change that color. The default skin colors are shown. 2. A color spectrum and color hex code box will appear. You can choose the color you would like to use for the element you want to alter. The vertical slider on the right can be used to alter the color palette. If you know the HTML color code you want, you can enter that into the text field at the bottom (#XXXXXX). To remove edited colors: Figure 3-13 Available options of the Fonts tab. • After altering a color, click the red “x” to return to the default. • Remove all color edits by clicking the Reset Colors button. Here you can change the font styles and font sizes in your survey. You can select to change the font for the entire survey or specify the font styles for the Question and Choice text individually. • ENTIRE SURVEY: At the top, select the font drop-down and select a font style. Then click on the Font size ADVANCED TAB drop-down to choose a font size. • CHANGE QUESTION TEXT: Change the font, font size, and basic formatting (bold, underline, italic) for question text across entire survey by checking this option. • CHANGE CHOICE TEXT: Change the font, font size, and basic formatting (bold, underline, italic) for choice text Q-TIP -TIP across entire survey by checking this option. Q - T I P Figure 3-15 Available options of the Advanced tab. Q - T I P In the Advanced Tab you can insert and edit your survey’s header and footer or further alter the look of your survey using The Look and Feel settings will not override styles applied through the Rich Text Editor on each individual question. CSS (Cascading Style Sheets). - T I P • EDIT: Click the edit button under the header or footer to open the Rich Text Editor. In the Rich Text Editor COLORS TAB you can insert an image or text. • CSS: Cascading Style Sheets are a common way to edit the look and feel of websites. These are advanced editing options. Go to Qualtrics.com/University and search “Example Stylesheet” for a CSS example. • ADD CUSTOM CSS: If you’re familiar with CSS, feel free to click this button to access the CSS editor. You can use this feature to further change the look and feel of your survey template. • EXTERNAL CSS: If you have a file hosted online you would like to reference, place the URL to the file here. Figure 3-14 Available options in the Colors tab. After changing the Look and Feel options, save your changes by clicking on the Save option in the bottom right-hand corner, and you will return to the main Edit Survey section. 44 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 45

Survey Options SURVEY EXPERIENCE The Survey Experience options are mainly options that affect how the survey displays to the survey taker. Other options affect how respondents are able to Save and Continue the survey later. Next to the Look and Feel icon on the navigation bar is the Survey Options icon. The Survey Options page includes options Q-TIP -TIP for survey experience, protection, termination, and response rules This page is divided into six areas: Survey Experience, • BACK BUTTON: The Back Button option allows respondents to go back to previous pages in the survey. Survey Protection, Survey Termination, Inactive Surveys, Partial Completion, and Response Set (Figure 3-16). This option is disabled by default. Q - T I P Q - T I P This option can conflict with elements in the Survey Flow. If advanced elements (e.g., embedded data, branch) - T I P are in the Survey Flow between blocks, respondents will not be able to go back across those blocks. • SAVE AND CONTINUE: Uses a cookie stored on the respondent’s browser to keep track of how far in the survey Q-TIP -TIP the respondent has progressed. If the respondent exits the survey early, this option allows them to simply click the link to return to where they left off. Q - T I P P Q - T I This is machine and browser dependent. If someone starts the survey at work and then goes home to continue - T I P from a different machine, there won’t be a cookie for the tool to know where they left off and it will not start them where they left off. This option is designed for use with the Anonymous Survey Link (found in the Distrib- ute Survey tab) where no tracking is included. Save and Continue is not necessary when using the Authentica- tor or the unique link from the survey mailer. Q-TIP -TIP • SURVEY LANGUAGE: Choose the default language of your survey. This affects the display language of default error and end of survey messages. Q - T I P Q - T I P If you need multiple languages for your survey, try using the Translate Survey option in the Advanced Options - T I P menu (Edit Survey tab). Q-TIP -TIP -TIP Figure 3-16 Survey Options Window. • SHOW EXPORT TAGS: Specify if you want to show Export Tags to survey takers or not. Export Tags are the Q - T I P Q-TIP question numbers appearing at the top left corner of each question on the Edit Survey tab. Q - T I P Q - T I P Change Export Tags by clicking on them. Once selected, you can type in a different number or change the tag to Q - T I P - T I P a letter. Alternatively, you can use the Auto-Number Questions option in the Advanced Options menu (far right The most common settings are in place as the default. Be sure to double-check the Survey Options to make sure they fit side of the Edit Survey tab). - T I P your needs before distributing your survey. • SURVEY TITLE: Specify the title text that appears in the browser window/tab for your survey. 46 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 47

SURVEY PROTECTION redirect your respondent to your website when they submit their response. Here is a list of all of the options under Survey Termination and what they do: Survey Protection provides some control over how people access the survey and how frequently they can access the survey. • Default end of survey message: Respondents will get this message if you have not chosen one of the other • Open Access: When this option is selected, the survey can be taken through the anonymous survey link. The custom messages. The text displayed is, “We thank you for your time spent taking this survey. Your response survey taker does not have to click the unique link from the Email Survey page to access the survey. To limit the has been recorded.” access, change the setting to By Invitation Only. • Redirect to a single response report: Redirect the respondent to a report that displays their responses. The Q-TIP -TIP • By Invitation Only: This is only for use with the unique link you get from the Email Survey page. When this is report they see is similar to the report found under the View Results>Responses page. The respondent is given enabled, the participant must click the unique link to access the survey. the option of exporting the report as a PDF. Q-TIP -TIP Q - T I P • Password Protection: This enables you to set a single password for your survey. Q - T I P Q - T I P An alternative approach is to customize an End of Survey element in the Survey Flow and select Show - T I P Q - T I P Response Summary, which displays a view of the survey questions with their selections in place. This can also be exported to PDF. If you need a unique password for each survey taker, use the Authenticator option in the Survey Flow - T I P (see Survey Flow section in Chapter 5). Q-TIP -TIP • End of survey message from a library: This allows you to create and select your own message to display to • Prevent Ballot-Box Stuffing: This keeps people from taking the survey more than once. Qualtrics uses a browser- respondents. based cookie to mark if someone took the survey. If they attempt to take the survey again, they will be kept out. Q - T I P Q - T I P • HTTP Referer Verification: This enables you to specify a URL users have to come from in order to take the survey. It is useful if your survey link is posted on a particular website (like an internal university or company page) and Insert additional End of Survey elements in the Survey Flow to have multiple messages in place. Use the - T I P you want to make sure the link does not get copied and sent to others. Only those who can access the url you branch logic to control when each displays. specify will be able to take the survey. Q-TIP -TIP • Send a thank you email from a library: Specify a Thank You message for the system to send out to each • Prevent Indexing: This option prevents Google, Yahoo, Bing and other search engines from being able to index survey taker as their completed response comes in. This only sends to those who have completed the survey. your survey and present it in search results. Typically, this is only an issue for long-term studies where the Q - T I P survey is active for a long time. - P Q T I • This survey does not expire: If this option is selected, there is no set date range for when respondents are able This only works if you email the survey to a panel on the Distribute Survey tab using the unique link - T I P to access the survey. If the survey is active, the link can be accessed. (the default setting). Go to the Email History page to send a one-time Thank You email blast to all who completed the survey. • This survey is valid from: This enables you to specify a date range when respondents can access the survey. These Survey Termination options are also available when customizing an End of Survey element in the Survey Flow. Click the calendar icon or enter in the date directly (YYYY-MM-DD) to specify a date range. Those trying to access the survey before or after the specified range receive a simple message explaining it is currently unavailable. INACTIVE SURVEYS SURVEY TERMINATION Under the Inactive Survey section, you can choose the message that will appear when you deactivate your survey. You can either use the default inactive survey message or create one of your own using the message library. The Survey Termination options are great if you want to show a custom thank you message at the end of your survey or 48 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 49

Q-TIP -TIP • Default inactive survey message: If the survey is inactive/deactivated, the default message is, “Thank you for surveys is not selected you can use the Retake Survey and Retake Survey as New Response options on the your time, unfortunately this survey has been closed.” View Results > Responses page. These options generate a new link that you can send to the respondent. Q - T I P The Retake Survey link will contain any data the respondent had in their previous response. - P Q T I • The respondent’s ability to return to the survey depends on the kind of link you are using. If you are using a You can determine if your survey is active by looking at the Active column on the My Surveys tab. If a gray unique link sent through the mailer, the respondent can click on the link to continue taking the survey. If you - T I P box displays, it’s inactive. If it’s a green checkbox, then it’s active. are using the anonymous survey link, with Save and Continue enabled, the respondent can click the anony- mous survey link. If they are in the same browser on the same machine they were using when they started the • Display inactive survey message from a library: Create and select your own custom message when the survey, they can see their responses up to that point. survey is inactive. PARTIAL COMPLETION RESPONSE SET Response Sets allow you to place survey responses into different data collection buckets. For example, quarterly or Partial Completion allows you specify the amount of time your respondents has to finish the survey once they have started monthly surveys could be collected in different buckets. This allows you to view results of the same survey for differ- it. If someone starts the survey, but is unable to complete it in one sitting, the system starts counting down from their last ent data collection periods. Response Sets are added by checking on the Manage Response Sets link, where multiple activity. If no activity occurs within the time frame you select, their survey session is closed and whatever data has been Response Sets can be created. The Default Response Set is in place for all surveys. Note that data from response sets entered is available in your reports. If they access the survey again before the time runs out, then the countdown restarts. cannot be analyzed together in the Reporting tool. The data is stored in different buckets that are meant to be kept apart. There are many timeframes to choose from, as seen in Figure 3-17. Spell Check Also found in the Edit Survey navigation bar is the Spell Check option. You can use this built-in Spell Check tool for Figure 3-17 Timeframes available under Partial Completion. scanning question text and answer choices (Figure 3-18). Alternate spellings are suggested for text identified as potential misspellings. The Do not record partially completed surveys option provides a week’s time for the respondent to return to complete the Q-TIP -TIP survey. If they do not return, the survey session is closed and their response is not stored. Q - T I P Q - T I P • A Survey Session is created whenever someone starts a survey. The participant’s individual response is - T I P a survey session. • Once the survey session is closed, it cannot be reopened. As long as Do not record partially completed Figure 3-18 Spell Check in action. 50 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 51

To use Spell Check: Preview Survey tools: 1. At any time during the survey building process, click Spell Check under the Edit Survey tab. The spell check • IGNORE VALIDATION: If you have Force Response, Request Response, or any Content Validation or Custom window will drop-down from the top of the page. Validation applied to your questions, you can check the box for Ignore Validation. This is probably the most 2. If a potential misspelling is found, select the correct spelling in the Suggestions list. The Spell Check tool will useful of the testing tools, as you can quickly skip over the questions that would typically force you to answer. Q-TIP -TIP automatically move to the next potentially misspelled word. • This option is not available for your survey takers. It is only an option for you when Q - T I P previewing your survey. Q - T I P • DO NOT SHOW HIDDEN QUESTIONS: This option is only visible after clicking the more options button. • Timing and Meta Info question types are automatically hidden from the survey taker’s view, • If the correct spelling is not found, type the correct spelling into the text box and click the Use This Spelling but they are automatically shown to you in the Preview Survey view. This is for testing purposes. - T I P button that appears to the right. You can make sure the question is in the right place and correctly taking effect. Select this option • Use the Next Word and Preview Word buttons to navigate through the list. to not see these hidden questions in the preview. • Click Next Word to ignore the potential misspelling, or Ignore All to ignore all instances of that word in the survey. • CLICK HERE TO START OVER: Just like it sounds, clicking this option will jump you back to the beginning of the • When the tool finishes checking your spelling it will say, “Finished spell checking survey...” survey. It is a great option when you would like to make changes to a specific section of your survey. You can Q-TIP -TIP • Click Done to terminate the Spell Check tool before it is finished. quickly jump back to the beginning and restart testing. Q - T I P Q - T I P • If you click through your entire survey in Preview Survey, a response will be recorded. This response does not - T I P PREVIEW SURVEY count toward any response quota that may be a part of your license. You can always delete these responses by going to the Responses page in the View Results tab, before collecting actual data. There is a Preview Survey button found on the Edit Survey tab, but you can also preview the survey from the Distribute • To test out a single block of questions, click Block Options and select View. All of the aforementioned tools are Survey tab, as well as by clicking the View button under the My Surveys tab. Clicking one of these buttons opens a new available here as well. browser window for testing out your survey (Figure 3-19). The survey will appear exactly the way survey takers will see it, • When you select to Preview Question instead of Preview Survey, these preview survey tools will not be except for a white bar across the top of the page. The white bar won’t be there for the actual survey takers, but it’s great available. Only the single question will be previewed. for you because it contains some simple preview survey tools to help you test your survey. Print Survey Finally, we have reached the Print Survey icon in the Edit Survey tab. Clicking Print Survey will open a separate window Figure 3-19 After clicking the Preview Survey button. containing your survey with the Look and Feel settings you have chosen. (Figure 3-20). The version of the survey in this window is more printer friendly because it places every question on one page. It will also open your browser’s print dialog box. 52 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 53

Summary In this chapter, you learned how to add questions to your survey and edit them through customizing the question text and answer choices. We went over the many Look and Feel options available to help you customize the appearance of your survey and covered the important options found in the Survey Options tab. After reading this chapter you should have the ability to build a basic survey in the Research Suite and use the main tools in the Edit Survey tab. If you have more questions about question types, Appendix 3a goes over all of the question types available to you and will shed light on which questions you should use. Now that you are familiar with the survey basics, read on to Chapter 4 for information on how to add complex logic to your survey as well as use the more advanced tools specific to setting up a question. Figure 3-20 After clicking the Print Survey button. To use Print Survey: 1. On the Edit Survey tab, click the Print Survey button at the top of the page. 2. In the Print dialog, adjust any settings as needed, then click OK to start printing. ALERT: While the Print Survey window will contain any background images and colors, most browsers are designed not to print them. The purpose is to save you ink, since printing from the web is often done for the textual content, rather than for the images and colors. Internet Explorer 8 and older have a Print background colors and images option you can select. Q-TIP -TIP This is done by selecting Tools, Internet Options and then Advanced. Q - T I P Q - T I P In many cases, especially when needing a printed survey for paper surveys, the Export Survey to Word is more useful than - T I P the Print Survey option. 54 | Chapter 3: Edit Your Survey Chapter 3: Edit Your Survey | 55

Chapter 4 Advanced Question Options Very few people know every advanced feature that’s available in Qualtrics. This chapter covers everything related to individual questions. Qualtrics: The Complete Research Suite | 57

AFTER READING THIS CHAPTER, YOU WILL KNOW HOW TO: In this chapter you will learn how to: • Use advanced logic on questions • Access advanced question options from the Purple Gear Button, including Carry Forward Choices, Add Javascript, and Add Default Choices • Randomize answer choices • Recode Values • Check Survey Accessibility In this chapter we continue to explore options found in the Edit Survey tab, but focus on the more advanced functions that you might find useful as your surveys become more complex. In the past, when paper surveys were more prevalent, survey takers would have to flip through pages of the survey to find the questions that applied to them. With the options found in Figure 4-1 Main view of Advanced Question Options menu. this chapter, you can automate the logic in your survey, displaying questions only when they are needed. Also gone are the days of having to manually assign values to each of your answer choices. Qualtrics automatically as- Additional options are found in the blue question menu bar to the right of the question. These options don’t fall under the signs numeric values to each choice and allow you to edit them. Advanced Question Options menu, but they are useful question-specific options to be aware of. This chapter is full of features that that were developed to make survey building easier. Use these options to create expert Some important options are also found in the Advanced Options drop-down menu in the Edit Survey tab. This drop-down surveys with very little legwork on your part. can be found in the upper right hand corner of the screen. ADD DISPLAY LOGIC The Add Display Logic option is the first option listed under the Purple Gear button. Display Logic is used to display a question conditionally, based on the logic you set up in the survey. If you want to display a question only if a certain con- dition is met (a question answered a certain way, a particular embedded data is assigned, etc.), then you will use Display Logic. Clicking the “+” button allows you to place advanced “And If” and “Or If” statements in your logic. Advanced Questions Options Button Advanced Question Options are available in two locations. You may have noticed every time you click on a question, a purple gear button displays to the left of the question. Clicking the purple gear button opens a menu of Advanced Ques- tion Options (Figure 4-1). Figure 4-2 Display Logic applied to a question. 58 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 59

The Add Display Logic button is also available in the question menu bar to the right of the selected question being edited. 2. Click the purple gear button to the left and select Carry Forward Choices. 3. On the green bar that appears below the question, specify which choices are carried forward: To set up Display Logic: a. Choose to carry forward All Choices, Selected Choices, or Unselected Choices. Selected Choices 1. Select the question that you would like to display conditionally. is the most commonly selected option. 2. Click the purple gear button to the left and select Add Display Logic. b. Select the question containing the original choices you would like to carry forward. 3. Complete the logic statement. The menus will guide you through the logic setup. 4. When finished, click Done. a. Logic can be based upon a question response, embedded data, quota, or panel field. b. Add additional conditions by clicking the “+” button. To edit or delete existing Carry Forward Choices logic: 4. Click Save to apply the logic. • To Edit, click Edit on the Carry Forward Choices bar to change your logic. From here, just re-specify the choices. Q-TIP -TIP • To Delete, click the X at the top right of the green Carry Forward Choices bar. To edit existing Display Logic, click Edit on the blue Display Logic bar that appears on the question when the Display Logic Q - T I P Q-TIP -TIP is applied. Q - T I P Q - T I P • With Carry Forward Choices, you can have pre-existing answer choices in the question you are carrying forward - T I P Q - T I P to. Add them like you would normal choices (you might need to click the “+” Choices button below the Change Item Type menu. The pre-existing answer choices will show in the question as well as any carried forward You can apply Display Logic to individual answer choices as well. Click on the answer choice to edit a choice, click the choices. - T I P blue arrow, and select Add Display Logic. • Carry Forward Choices can only pull from one question at a time. If you need Carry Forward Choices from multiple questions, you’re better off not using Carry Forward Choices. Instead, create a new question that shows all the potential choices from all the different questions, then add Display Logic to each individual choice, CARRY FORWARD CHOICES specifying when each individual choice should be displayed. Carry Forward Choices allows you to dynamically adjust which choices are displayed to your respondents (Figure 4-3). As an example of this two-step process, the respondent would select the stores they have shopped at in the last 12 months and, where the respondent is asked to select their favorite store, only the previously selected choices would be displayed. ADD SKIP LOGIC Skip Logic is a simple way to skip or jump over multiple questions. Unlike Display Logic, Skip Logic is added to the question you want to skip from (Figure 4-4). Multiple lines of logic can be put in place, but they are not linked together. Instead, the logic is evaluated from the top to the bottom of the logic condition list. Whichever logic condition is met first is the one that is applied. Figure 4-3 Carry Forward Choices applied to a question. To set up the Carry Forward Choices option: 1. Select the question that the items will be carried into. Figure 4-4 Skip Logic applied to a question. 60 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 61

Add Skip Logic is also available in the question menu bar to the right of the question being edited. To use Skip Logic: 1. Select the question you would like to skip from. 2. Click the purple gear button to the left and select Add Skip Logic. 3. In the first two drop-down menus, set the condition that triggers the Skip Logic (which choice and the action – Selected, Not Selected, Displayed, or Not Displayed). 4. In the third menu, specify where to send the respondent. This can be to another question within the block, or directly to the end of the block or to the end of the survey. You cannot skip to the middle of another block. 5. When finished, click Done. After you click Done, you’ll notice there is a dropdown menu of options available called “Skip Logic.” The options found in the drop-down are as follows: • EDIT SKIP LOGIC: To edit existing Skip Logic, select this option. • ADVANCED OPTIONS: Do you want to include a Quota as part of your Skip Logic? Whatever action you have selected for the Quota will take effect (For example, End Survey will occur in place of skipping to the specified question). • QUOTAS: To setup quotas for each answer choice, see Quotas under the Advanced Options drop-down Figure 4-5 Add JavaScript window. menu (located at the far right of the Edit Surveys tab). • GO TO SKIP DESTINATION: Select this option to jump down to the destination question while in the Edit Survey view. There will also be a colored arrow next to the question being skipped to. If you don’t know what Javascript is, you will probably need to get a good JavaScript programmer to work with you. How- • REMOVE SKIP LOGIC: Selecting this option deletes this particular line of Skip Logic. ever, we will explain how your Javascript code can be inserted into your Qualtrics survey. • If you have multiple lines of Skip Logic, you can delete them all at once by clicking the “x” at the top Q-TIP -TIP To Add JavaScript: right of the Skip Logic bar. Q - T 1. Select the question to which you would like to add Javascript. I P 2. Click the purple gear button to left of the question, and select Add JavaScript. Q - T I P 3. Place your cursor after the gold text that says, “/*Place Your JavaScript Below This Line*/” and press Enter. 4. Paste in your script (Ctrl/Cmd+v). You can only use Skip Logic to jump to questions within your current question block. If you need to jump to a question in 5. Click Save when done. A JavaScript icon (“JS”) will now display to the left of the question. - T I P another block, you will need to either (1) use a combination of Skip Logic with Display (Skip to the end of the block, then use Display Logic to display or not display particular questions), or (2) use Branch Logic to skip over groups of questions, To remove your JavaScript: skipping people to the end of a block then branching people off to a block of questions if they meet the condition. 1. Click the JS icon to the left of the question. 2. In the editor click the Clear button. Q-TIP -TIP 3. Click Save. ADD JAVASCRIPT Q - T I P Q - T I P The Qualtrics team works hard to make it so you don’t ever need extra code to set up your survey. But hey, let’s face it, we • To preview your changes, click Preview Survey or Preview Question. can’t account for every unique experiment or study performed by the world’s leading researchers. For that reason, Qualtrics - T I P • For some useful scripts, go to Qualtrics.com/University, and find the Coder’s Corner in the bottom left-hand gives you the ability to add your own code to your survey. (Figure 4-5). The Add Javascript option is the fourth option under corner of the page. There you will find a list of scripts for a variety of special tasks. Use any of these to the Purple Gear button. experiment with the Add JavaScript option. 62 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 63

ALERT: The Qualtrics University team (the Support staff), is specifically trained on the survey tool, but not specifically RECODE VALUES trained in JavaScript. They are not set up to figure out bugs or issues in scripts you have written. Selecting Recode Values opens the recode wizard, and within the wizard, there are two tasks available to you: Recode Values and Variable Naming (Figure 4-7). These options allow you to change the value and assign alternate text to answer choices. ADD DEFAULT CHOICES Add Default Choices allows you to specify particular choices as pre-selected (Figure 4-6). The respondent then has the ability to leave the choice selected as is, or change it to a choice that more accurately describes their situation. Figure 4-7 Recode Values window. RECODE VALUES Each answer choice for your question is given an answer choice value. The Qualtrics Survey Research Suite uses this value to identify the answer choice. This same value is used in the reports (basic statistics) and Download Data page exports. Recode Values allows you to change the value used for the statistics and data exports, as needed. Recoding is often used to reverse the coding on scales, like on a Matrix Likert question. If a scale is positive (Strongly Agree) on the left side and negative (Strongly Disagree) on the right side, then the positive scale points will have a lower value than the negative scale points. To reverse the scale, you can do the following: Figure 4-6 Add Default Choices view. To use Recode Values: 1. Click the purple gear button to left of question, and select Recode Values. 2. Select the Recode Values checkbox. Q-TIP -TIP To use Add Default Choices: 3. Change the value in the yellow boxes next to each choice. 1. Click on the question you want to add default choices to. Q - T I P 2. Click the purple gear button to left of the question and select Add Default Choices. 3. In the window that opens, your question will appear and you can click the choices you want to have Q - T I P pre-selected. Combine answer choices in reporting by recoding answer choices to the same value (e.g., recode both as a “3”). For a. With Text Entry and Constant Sum questions, you can enter the text and/or numbers you - T I P want to display. example, on a five point scale you might combine the top two boxes (Satisfied and Very Satisfied), as well as the bottom 4. Click Save. two boxes (Dissatisfied and Very Dissatisfied). 64 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 65

VARIABLE NAMING Variable Naming allows you to assign a label for an answer choice. This is useful when wanting to shorten long answer choices or to use internal labels to represent choices. These changes are visible in reports and Download Data page exports. To use Variable Naming: 1. Click the purple gear button to the left of the question, and select Recode Values. 2. Select the Variable Naming checkbox. Q-TIP -TIP 3. Change the label in the pink boxes next to each choice. Q - T I P Figure 4-8 Randomization options for answer choices. Q - T I P When combining answer choices (refer to Q-tip under Recode Values), assign the same name/label to the choices being - T I P Once you apply Randomization to a question, a randomization icon (as seen in Figure 4-9) will appear on the left. combined. QUESTION EXPORT TAGS Figure 4-9 The Randomization icon displays to the left of questions with randomized choices. When you click Recode Values for a Matrix question, you will be given the Question Export Tags option. This allows you to assign an export tag to each row of your matrix, much like the export tags of an individual question (the question number- ing). This is visible as part of the data you export from the Download Data page. There are four options in the Randomization window: • NO RANDOMIZATION: The default selection. Choices are not randomized. To see and change Question Export Tags: • Randomize the order of all choices: This automatically takes all choices and randomizes the order when 1. On a Matrix question, click the purple gear button to the left of the question, and select Recode Values. displayed to the respondent. 2. Select the Question Export Tags checkbox. • PRESENT ONLY __ OF TOTAL CHOICES: This allows you to specify a number of choices to be randomly selected 3. In the blue boxes next to each choice, change the export tag. and displayed (for example, 4 of 7 could be displayed). • ADVANCED RANDOMIZATION: Allows for more control over the randomization options. You can even combine fixed and random display options for choice variables. By viewing the Advanced Randomization tables, you can see which choices are in a fixed position and which are randomized. Click Set Up Advanced Randomization to RANDOMIZATION access these options: Randomization gives you the option of randomizing the choices displayed in a question. This function is important in • FIXED DISPLAY ORDER: A subset (or all) choices are selected and the order of presentation is fixed. preventing question order bias. Selecting Randomization will open a Choice Randomization window (Figure 4–8). • RANDOMIZE CHOICES: Randomizes order of all choices moved into this area. • RANDOMIZE SUBSET: Specify a number of choices to randomly choose and display (2 of 4, 3 of 7, etc.) • UNDISPLAYED ITEMS: Specify certain choices you don’t want displayed at all. To add answer choices to the different randomization option boxes: 1. Click to select the choices to randomize (Shift+click or Ctrl/Cmd+click to select multiple). 2. Click the arrow pointing to the right to pull the choices into any of the three randomization option boxes on the right. 3. Repeat steps 1 and 2 for other randomization options you want to implement (Figure 4-10). 66 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 67

STRIP FORMATTING Selecting this option removes any extra formatting from question and answer choice text on selected questions. This is the equivalent of clicking Remove Formatting while editing question text or Remove Format (eraser icon) in the Rich Text Q-TIP -TIP Editor, but on a much larger scale. Q - T I P Q - T I P You must have questions selected in order to use this option. You can select as few or as many questions as you want. - T I P AUTO-NUMBER QUESTIONS Every question has a number, or export tag, that appears to its left. As you move questions around and insert questions in between existing questions, the numbers get out of order. Rather than edit the export tags manually (unless you have a very specific type of numbering you would like to use), click the Auto-Number Questions option and the system will re- Figure 4-10 Advanced Randomization window. number the questions automatically (Figure 4-11). This feature renumbers the current questions, but if questions are moved or if more are added, the numbers will get out of The up/down arrows for Fixed Display Order will change the order in which the choices and randomized subsets are dis- order again. You may want to renumber your questions when you get done with all your editing in the survey. played. When choice items are moved to the randomization boxes at the right, a randomization marker appears in the fixed display order box to designate their randomization ({Randomized} and {Random Subset}), which can also be moved using the up/down arrows. Additional Question Options These options don’t fall under the Advanced Question Options menu, but they are important options to be aware of. These are found in Advanced Options drop-down in the upper right corner of the Edit Survey tab. Figure 4-11 Auto-Number Questions dialog SURVEY PREVIEW MODE Survey Preview Mode is selected by default. Unchecking this option changes the editing view. You shouldn’t ever need to • SEQUENTIAL NUMBERING: Renumbers questions one-by-one, starting from one until the very last question. uncheck this option. It is, however, nice to be aware of its uses. • BLOCK NUMBERING: Assigns a number to each block, then assigns a secondary number to each question within 68 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 69

that block. Question numbering in each block restarts at one. • Multiple Choice, all 21 types • Slider Example: [Block #].[Question #]. • Matrix, except Bipolar • Constant Sum Slider • INTERNAL ID NUMBERING: Uses the question ID in Qualtrics to keep track of the questions in your survey. Odds • Text Entry, all • Matrix Bipolar are that if you’ve been editing your survey, your Internal ID Numbering will not end up in alpha-numeric order. • Side by Side • Rank Order Drag and Drop • PREFIX: The default is “Q” for “Question”, but you can change your prefix and use any number or letter there • Rank Order except Drag and Drop • Pick, Group, and Rank (no punctuation allowed). You may enter up to four characters, or even remove the prefix and just display • Constant Sum, except Slider • Heat Map numbers without a prefix. • Timing • Hot Spot • Meta • Sliding Scale • Descriptive Block • GAP Analysis • Drill Down CHECK SURVEY ACCESSIBILITY Known by many as 508 Compliance, survey accessibility refers to how usable your survey is for someone using a screen reader application. This feature’s sole purpose is to help you make your survey friendlier to screen reader applications, and SUMMARY subsequently, to those using the applications. Check Survey Accessibility is similar to using Spell Check. Clicking this option scans through your survey and makes In this chapter we covered some of the more advanced survey building options, including the options you have for adding suggestions about areas where accessibility improvements can be made, as shown in Figure 4-12. It makes recommenda- logic to your survey. Display Logic and Skip Logic are super handy tools that allow you to dictate which respondents see tions for question types and options to improve access for those individuals using a screen reader program. which questions and when. We also went into detail about the Carry Forward and Default Answer Choices options and their use when customizing how respondents interact with your survey. Additionally, we introduced the option to randomize answer choices. In the tool, the system can randomize the answer choices to prevent display order bias. Later in this book we will go over how you can randomize questions within a block and/or blocks within a survey. Finally, we covered some of the advanced functions found in the Advanced Options drop-down. It is important to check your survey accessibility if you know you will have respondents that require screen readers or other accessibility tools. The rest of the options in the Advanced Options drop-down menu are more specialized and are covered in Chapter 5, Special Figure 4-12 Check Survey Accessibility in action. Features. You should now have the knowledge you need to add questions and sophisticated logic to your survey. If you master the ideas in this chapter, you will find that you will be able to collect useful data with greater efficiency. Most organizations allow survey builders to create non-accessible surveys. There is an Allow Non-Accessible Surveys permission enabled by default, which can be disabled at the organization, user type, or user level. If permission changes are needed for your account, please contact the Qualtrics brand administrator at your organization to enable/disable that permission for you. While Qualtrics does strive for accessibility, certain question types and formats are better suited for accessibility than others. Below is a list showing the different question types and whether they are judged to be accessible. ACCESSIBLE NOT ACCESSIBLE 70 | Chapter 4: Advanced Question Options Chapter 4: Advanced Question Options | 71

Chapter 5 Block Options and Survey Flow The Survey Flow is among the most powerful features in the entire Research Suite. Everything you want to know about it is explained here. Qualtrics: The Complete Research Suite | 73

AFTER READING THIS CHAPTER, YOU WILL KNOW HOW TO: You can collapse a block by clicking on the down arrow to the left of the Default Question Block label. The view will col- lapse, showing only the block name and number of questions in the block. Click the blue heading bar. The block view will In this chapter you will learn how to: expand to show all questions. This contract-expand feature is useful when managing large surveys. You can open any block you are working on and close all others. You can also rename the block by clicking on the block name and typing in a • Use blocks to organize your survey. new name. • Use the Survey Flow for advanced logic. • Randomize Questions within a block and blocks within a survey. More advanced surveys are better served with several blocks of questions. You can create a block for each different ques- • Use all the Survey Flow elements. tion type or category of questions. It is easier to organize and stay on top of your survey when the questions are broken up into smaller bite-sized chunks. More importantly, blocks allow you the flexibility to apply logic options and control each block separately when using Survey Flow and Block Options. When building your Qualtrics survey, there are many advanced options available that give additional control over your survey questions, your survey logic, and the flow of the questions presented to the respondent. These options won’t be To help understand the power of using blocks, imagine that you create a new product concept test survey with 6 blocks: needed by everyone all of the time, but the blocks and flow are very useful and powerful tools. • BLOCK 1: The introduction and screener block that welcomes respondents and identifies those who are qualified to be respondents. This chapter first provides a discussion on the use of blocks and the available options. Following the introduction to • BLOCKS 2 – 4: The three treatment blocks, one for each product version that will be viewed and evaluated. blocks, we then focus on Survey Flow and the tool to make optimal use of the blocks. • BLOCK 5: A demographic questions block. • BLOCK 6: A recruiting block for those interested in providing further feedback about your products - it requests When editing your survey, there are advanced options available for additional control over your survey. These options won’t the respondent’s email address, and then thanks them for their participation. be needed by everyone all the time, but they are very useful and powerful tools. You can find these advanced features in the Advanced Options drop-down located to the far right side of the Edit Survey tab. Given this block layout, you can easily conceive how you would like to reorder your blocks or add logic to them. Set up in this way, you can decide to only show one of the three treatment blocks to the respondent, randomly display all of them, or set up logic so that they are displayed conditionally. A block can contain a series of questions, or just a single question. The choice is yours. Creating question blocks will add great power to your ability to do experiments, or just organize the questions within your survey. The Block Options drop-down menu is located at the top-right corner of the block, and the Survey Flow icon appears in the navigation bar at the top of the edit survey tab. Blocks and Block Options ADD AND DELETE A BLOCK You can Add a block as an option in the Advanced Options menu (right side of the Edit Survey Bar), or just click on the When you first create a survey, there is a single default question block inserted for you. This is where you can start insert- Add Block button located at the bottom right corner of each question block. Clicking on either will add an additional block ing your questions. As your survey gets larger and more complicated, you will want to add more blocks to your survey to at the end of the survey. No need to worry about getting a new block into the survey flow; new blocks are automatically organize your questions and make it easy to set up which respondents see which questions in your survey. This section added. will go over all you want to know about blocks and probably more. Try clicking on Add Block and then add a question to that block using the green “+” button to create a new question. QUESTION BLOCKS When finished, delete the block by selecting Delete in the Block Options menu. Question blocks (called Blocks for short), are containers for a group of questions that you create in the Edit Survey tab. For simple surveys, you will probably need only the Default Question Block. If you look just above the first question of your survey, you will see the label Default Question Block. 74 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 75

BLOCK OPTIONS COLLAPSE QUESTIONS The Block Options menu is found as a drop-down menu at the top-right corner of each question block as shown in The Collapse Questions option minimizes the view of the question to only show the question text in the block and not the Figure 5-1. answer choices. Like the collapse block option, the collapse question option saves screen real estate when you have a lot of questions in your block and you would like to see a short version of them all. Clicking the option again will expand the questions to full size. Your question block will automatically collapse when you have a large number of questions in the block (approximately 70+ questions will trigger this). The collapsed questions, or Large Block mode helps the page and the questions to load more quickly in large surveys. As noted at the beginning of this chapter, you can expand a block by clicking on the block heading (gray space at top of question block). You can click the Turn on/off large block mode to expand the questions view. You also have the option to enter Block Options and unselect the Collapse Questions option. LOCK BLOCK Figure 5-1 Block Options. The Lock Block option (Figure 5-3), as the name implies, locks the question block so it can no longer be edited. You can click Block Options and unselect Lock Block to edit it again. The idea is to avoid inadvertent editing. Lock Block works like a safety lock you can turn on or off as needed to protect the questions. The Lock Block feature has the option of add- ing a password (or not) for additional protection. VIEW BLOCK At some point, you may want to test out a couple of new questions without having to click through the entire survey to get there. Clicking the View Block option is like clicking the Preview Survey button at the top of the page, except it only previews the content of that question block. Figure 5-3 Selecting Lock Block places this label on your question block. QUESTION RANDOMIZATION WITHIN A BLOCK We’ve already covered how to randomly present answer choices within a question, but in the Block Options menu you can choose to randomize questions within a block. Question Randomization is one of the more commonly used Block Options. Selecting Question Randomization will open a Question Randomization window (Figure 5-4). Figure 5-2 Block Options Menu. Figure 5-4 Question Randomization dialog window. 76 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 77

Blocks with randomization applied to them will display the Randomized Questions icon (Figure 5-5) at the top left, which can be clicked to reopen the Question Randomization dialog. Fixed Display Order is used to predetermine the order of some of the questions. For example, if a question should always appear last, even when you are randomizing other choices, then you can move that question to the bottom of the list in the Fixed Display Order. You can move questions up or down the list by using the up/down arrows. Figure 5-5 Randomized Questions label. Use Questions per Page to specify how many questions to display at a time. Not specifying a number will randomly display all questions on the same page. ALERT: There are four options in the Question Randomization window: • Using Randomization overrides existing page breaks. Q-TIP -TIP • NO RANDOMIZATION: When selected, nothing is randomized. • Randomization also overrides Skip Logic because the question order on the Edit Survey page no longer applies. • RANDOMIZE THE ORDER OF ALL QUESTIONS: Automatically takes all questions and randomizes their Q - T I P order when displayed. • PRESENT ONLY __ OF TOTAL QUESTIONS: Allows you to specify a number of questions to be randomly selected Q - T I P and displayed (4 of 7, 2 of 3, etc.). • ADVANCED RANDOMIZATION: Allows for more control over the randomization options, and you can even combine Though page breaks are ignored, you can indicate how many questions you’d like to appear on each page of the block by - T I P randomization options (Figure 5-6). using the Questions per Page option. • Fixed Display Order: A subset (or all) questions are selected and the order of presentation is fixed. • Randomize Choices: Randomizes order of all questions moved into this area. • Randomize Subset: Specify a number of questions to randomly choose and display (2 of 4, 3 of 7, etc.) • Undisplayed Items: Specify certain questions you don’t want displayed at all. LOOP & MERGE Suppose you have just built a multiple response (check box type) question that states, “Please check up to three car brands you or your family have most recently owned or leased.” You have also created a block of questions containing questions about the quality of the automobile that the family owned or leased. Loop and Merge saves you time with this kind of survey. In this example, Loop and Merge can be used to loop the respondent through the block of evaluation questions for each automobile that they choose. Piped text is used to display the name of the automobile that they are evaluating for each loop. The block will be presented up to three times, once for each car brand selected. The question blocks might read as follows: “Please reflect on your family’s experience with your Ford (and then repeated for Chevrolet and Toyota) and complete the following evaluation:” This takes the place of creating a separate block for each potential scenario. Figure 5-6 Advanced Randomization dialog. Figure 5-7 Loop and Merge label. The up/down arrows for the Fixed Display Order box (Figure 5-5) will change the order of questions. Randomized ques- tions can also be moved using the up/down arrows, and are marked to designate their randomization ({Randomized} and {Random Subset}). 78 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 79

• ALL CHOICES AND ENTERED TEXT: Will loop through displayed choices plus Other (please specify) text-entry There are two Loop & Merge methods: type questions. 1. LOOP AND MERGE OVER QUESTION RESPONSE: Repeats a block of questions according to each item the • SELECTED CHOICES: The block loops only for responses selected in the target question. Most people choose participant indicates in a previous question in the survey. Selected Choices. 2. STATIC LOOP AND MERGE: This is not based off of the participant’s selection on a previous question, but on a • SELECTED CHOICES AND ENTERED TEXT: Displayed choices plus Other (please specify) type questions. list of predefined options you provide. • UNSELECTED CHOICES: The block loops only for responses not selected in the target question. 7. If needed, check one of the advanced options at the bottom. a) RANDOMIZE LOOP ORDER: The default is to loop the block in the order of the choices selected in the target question. Select this option to randomize that looping order. LOOP AND MERGE OVER QUESTION RESPONSE b) PRESENT ONLY _#_ OF TOTAL LOOPS: Loop the block only for a specified number of the choices (according to the All Choices, Selected Choices, and Unselected Choices options). This option is only available This option is used to ask the same group of questions about a particular set of selected answers from a previous ques- when Randomize Loop Order is selected. tion. It works by looping through one block of questions multiple times, once for each answer choice selected. This option c) Click the Save button. can greatly reduce survey creation time because the survey creator can ask about each targeted answer choice (brand, occasion, etc.) without having to add the same set of questions to the survey over and over. Loop and Merge is actually the equivalent of setting up a branch for each choice. The branch then determines if they should enter and see the block of questions or not. See the diagram (Figure 5–7) below mapping out the process. To use the Loop and Merge feature in Qualtrics, you will need two question blocks. 1. Create the first question block and enter the question upon which you want to base your looping. For example: Which of the following browsers have you used within the last two months? (Select all that apply) Choices: Internet Explorer, Firefox, Safari, Opera, Chrome. 2. Create the second question block and enter the questions you would like to loop through. For example: What do you like about this browser? Since this block will be looped, these questions appear each time the survey loops. In this example, each loop asks about a different browser the respondent has used. 3. Once created, click the Block Options drop-down and select and turn on Loop and Merge. Figure 5-8 Loop and Merge dialog window. 4. Select Automatically bring in Field 1 from a question (Figure 5-8). If you want to pipe in different text than what is in the answer choice text, then enter text into Field 2 or another column. 8. Finally, if you want the respondent to see the item they are currently looping through, you will want to insert 5. Select the question serving as the basis for the loop from the first available drop-down menu. piped text code into your questions. To pipe in the answer choice into the looping block: a) Click on the Pipe Text Tab, available when you click on the text of any one of your question. 6. In the second drop-down menu, select the condition. b) Navigate to pipe text from the Loop and Merge Field. • ALL CHOICES: The looping block will loop for all choices from the target question, selected and not selected. c) Click Field 1, or select Field 2 or another field if you’ve entered text there. • DISPLAYED CHOICES: Only loops through the choices that were displayed in the target question. This would d) The pipe text code will appear and you will want to take the code and put it wherever you would like the item only be relevant if you used Display Logic on answer choices in the target question. name to appear when the respondent loops. • UNDISPLAYED CHOICES: If logic is used to display choices that meet a specific condition, show undisplayed e) Repeat steps 1-4 if you have other Field columns to pipe in. choices. 80 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 81

STATIC LOOP AND MERGE Performing this action is the equivalent of going into the Survey Flow and moving the block element up one spot (either by clicking and dragging Move, or by using the up/down keys on the keyboard). Suppose instead of having the respondent tell you about browsers used, you want to use the same block of questions to ask about the three leading presidential candidates. Since you know you want the questions asked about all of the presi- dential candidates, you do not need to give the respondent the opportunity to select the candidates in a multiple answer MOVE BLOCK DOWN question. Static Loop and Merge allows you to create a list of items (candidates) or topics to ask about and then loop through them. Now on the reverse, selecting this option will move the block down one spot. It actually will switch positions with the block The system loops as many times as there are items in the list. The item text is piped into the questions for the survey taker. below it. Unlike the other loop and merge, it is static because it is not based off selected choices in a previous question. Performing this action is the equivalent of going into the Survey Flow and moving the block element down one spot (either To set up a static loop and merge: by clicking and dragging Move, or by using the up/down keys on the keyboard). 1. Click Block Options and select Loop and Merge. 2. Click Turn On Loop & Merge. 3. Do not select Automatically bring in Field 1 from a question. In the Field columns, enter fields and values to pipe into your questions (Note: Four fields are referenced here, Field 1, Field 2, Field 3, Field 4, but all four are not required). Example values: Candy Bar, Mars, Snickers, Rolos. COPY BLOCK 4. Determine if you want to use randomization options. • RANDOMIZE LOOP ORDER: Displays loop elements in a random order. Copy Block creates an exact replica of the original block. A new question block is created with all of the questions copied • PRESENT ONLY _#_ OF TOTAL LOOPS: Choose a random subset of the possible fields. This is only available and placed within it. The new block is placed at the end of the Edit Survey page, below the existing blocks. when Randomize loop order is selected. 5. Click the Save button. 6. Carry out step 8 from the Question Loop and Merge instructions to pipe in the field. Q-TIP -TIP Q - T I P COPY BLOCK TO LIBRARY Q - T I P The Copy Block to Library option allows you to copy an entire block full of questions to your Question Library. You can choose which library to copy the questions to, which category to put them in (optional), and then specify a description for Data is exported as if a separate block of questions were created for each of the possible options. That is because using each question. Once you click Copy, a copy of each question appears in the selected Question Library. - T I P this option is the equivalent of setting up a specific question block for each possible response on the previous question. For this reason, using loop and merge can increase the size of your data export greatly. Typically this is only an issue when downloading raw data exports into Excel or SPSS, where there is a column limit (Excel 2003: 256 columns; Excel 2007+: 16,000 columns). If you exceed the limit of Excel, the best option is to download groups of questions at a time rather than the entire survey all at once. MOVE BLOCK UP Just as it sounds, selecting this option will move the block up one spot. It actually will switch positions with the block above it. 82 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 83

Survey Flow When you’re serious about creating advanced surveys, you will be using the Survey Flow, found in the Edit Survey Naviga- tion bar (Figure 5-11). Have you ever wanted multiple paths in your survey? Or to display different messages to your qualifying respondents and your non-qualifying respondents? Survey Flow allows you to insert elements into the flow that perform advanced logic, randomization, survey termination messages, and much more to direct the path of the respon- dent through the survey. Figure 5-9 Copy Block to Library dialog window. DELETE BLOCK Figure 5-11 The Survey Flow button. Clicking Delete Block in the Block Options drop-down will bring up a confirmation dialog window (Figure 5-10). Click Delete to confirm and all questions within the block are moved to the Trash/Unused Questions block and the block is The elements that can be inserted into the Survey Flow include (Figure 5-12): removed from the Survey Flow. • BLOCK: Referring to the question blocks on the main Edit Survey tab, when you select to insert a block element, a block is automatically added to the Survey Flow. Blocks can be added to repeat showing the block in the survey (or show them to different respondents who are guided to different parts of the Survey Flow). You can also reinsert them after a temporary removal. • BRANCH: Similar to Display Logic, but Branch encompasses much more than just one individual question. Using Branch, you can conditionally display blocks or any other Survey Flow element. • EMBEDDED DATA: Using this element you can specify which of your existing embedded data fields you want displayed in your data set. You can even assign embedded fields to individuals. Figure 5-10 Confirmation dialog window. • RANDOMIZER: When elements are placed under the randomizer, the elements are randomly displayed. “Evenly Present Elements” turns this randomizer into a sequencer (sequentially present items). This is useful when displaying a subset of elements in the Randomizer. • WEB SERVICE: Probably the most advanced tool in the Survey Flow. Using the web service, you can send information needing evaluation to an external server. The external server responds with information you can then display or base logic off later in the survey. 84 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 85

Q-TIP -TIP Q - T I P • AUTHENTICATOR: Requires users to log into your survey, essentially telling the tool who they are. It’s great for Q - T I P direct-mail campaigns or scenarios where you might not have an email address. This then links to their panel information for logic, data analysis and piped text. Remember that blocks are automatically inserted into the Survey Flow when created in the Edit Survey view. - T I P • END OF SURVEY: Typically used in conjunction with a branch, this is useful for early termination of certain non- qualifying respondents. It can be customized to display a certain message, redirect to a URL, and much more. MOVE ELEMENT Whenever someone reaches an end of survey element in the survey flow, they are taken to the end of the survey. • CONJOINT: The Research Suite contains a conjoint module (self-explicated method). When you set up a conjoint, There are two methods you can use to Move elements to the desired position in the Survey Flow: the conjoint module is automatically added at the end of the Survey Flow and you must use the Survey Flow to 1. Move button (typically used when moving larger distances) specify where and when it is displayed. a. Click and hold the Move button on the element. The selected element turns green. b. Drag and drop the element at desired location (between or within certain elements). 2. Up/Down keys on keyboard (typically used when moving shorter distances) a. Click on the element’s box to select it (outlines in blue when selected). Q-TIP -TIP HANDLING THE SURVEY ELEMENTS b. Press up or down arrow keys on keyboard to change position. Q - T I P Now that you understand the elements that can be added to the Survey Flow, we will briefly identify how to use these Q - T I P elements. When moving a branch, randomizer or authenticator, all elements that are nested under it will move as well. - T I P INSERT ELEMENT DELETE ELEMENT To Delete or remove elements from the Survey Flow: 1. Press the Delete button (every element has a red Delete button on it). Q-TIP -TIP 2. When confirmation window displays, click OK or Yes. Q - T I P Q - T I P When deleting a branch, randomizer, or authenticator, all elements contained underneath it are removed as well. Figure 5-12 Add a New Element. - T I P To Insert elements into the Survey Flow: COLLAPSE / EXPAND VIEW OF NESTED ELEMENTS 1. Click Add a New Element Here or Add Below (green text). 2. Add a New Element Here is a link displayed at the end of the Survey Flow and underneath each Branch, Randomizer, and Authenticator. The branch, randomizer and authenticator elements can have other elements nested underneath them. For example, if 3. Add Below appears on each element, allowing you to insert an element directly between that element you would like to randomize blocks , you would place them under a randomizer element. and the one below it. 4. Choices appear in the yellow box. Select the element you would like to insert (Figure 5-11). On these elements, you will also find the Collapse view option. 86 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 87

To Collapse or Expand the view of an element (for elements containing other elements): ALERT: If respondents see the same block multiple times in a survey, they will see each question with their previous 1. Select Collapse to collapse elements. responses selected. They are essentially getting the opportunity to answer the questions again, overwriting their previous 2. Select Expand to expand and see all contained elements. answers. If you need to have them provide separate responses, then copy the block (Edit Survey tab > Block Options) and use the copied block to subsequently “repeat” the block. Clicking the “-” and “+” button at the top left corner of the element will also collapse/expand these elements. BRANCH RE-SIZE THE SURVEY FLOW VIEW Change the Size of the Survey Flow view by using the Make Smaller and Make Bigger buttons at the top right of the Sur- Each branch has the Add a New Element Here option beneath it, allowing you to insert elements within the branch. You vey Flow window to adjust the size. Make Smaller comes in handy when you need to view more of the Survey Flow at once can also move existing items directly into the branch (see the previous section on moving Survey Flow elements). These to get a better feel for your Survey Flow. Make Bigger becomes useful when wanting to return the Survey Flow to its original are the items the respondent will see only if they meet the condition specified on the branch. size. SAVE SURVEY FLOW When Finished working in the Survey Flow, always remember to click the Save Flow button (located at the bottom right). Unlike the main Edit Survey tab, your changes are not automatically saved. Figure 5-14 Branch Survey Flow element with condition. Click Add a Condition to specify the criteria that must be met for the items under the branch to be shown. You can base your logic off questions, embedded data, and quotas. Click on the condition to edit the logic statements. When editing, HOW TO USE THE SURVEY FLOW ELEMENTS... there are +/- buttons to the right of each line of logic to add additional lines of if-then logic and to remove lines of logic, as needed. Branch conditions are an if-then style of logic; If the logic is met, then show what is in the branch. This is similar to BLOCK Q-TIP -TIP Display Logic, but different in that you can include any Survey Flow element within the branch, including other branches. Click the Block option when inserting an element, then select the block you would like to insert. Repeat this each time you Q - T I P need to insert a block. Each block created on the Edit Survey tab is automatically inserted into the Survey Flow. Q - T I P Shift+click the “+” button on your logic to get “And If” logic, which is like having additional parentheses in place within - T I P your condition. EMBEDDED DATA Figure 5-13 Block Survey Flow element. Embedded Data (Figure 5-15) is extra information, usually about the respondent, that can be included in the panel and attached to the respondent’s data. You can also assign embedded data to respondents through the Survey Flow. If you put in an embedded data into the Survey Flow and assign a value to it, then if the respondent takes a path in the flow through that embedded data, they will be assigned that embedded data value. 88 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 89

particular field and place the element where it’s needed within the flow. With panels, there is no need to specify the value. This is automatically taken care of when the field name is entered. To Assign Embedded Data Fields on the Fly: 1. Insert an Embedded Data element. Figure 5-15 Embedded Data Survey Flow Element. 2. Type the name of the embedded data field where it shows Enter Embedded Data Field Name Here. 3. Click Set a Value Now to enter in a value that the embedded data will equal. Embedded data can be used for in-survey logic (Display and Branch Logic), as well as to filter data and reports. Embed- After setting up the embedded data with the value assigned in the survey flow, anyone who passes through the embedded ded Data can include extra information like state, city, address, etc., or an identification code. This information is stored data field will be assigned that value. with the survey response. ALERT: Location of the Embedded Data element in the Survey Flow is very important when you are using it for display or branch logic. Make sure you place this embedded data element where it will assign at the correct time and place. If you are branching and want to assign an embedded data with value to the person who goes through that branch, then add EMBEDDED DATA IN THE SURVEY FLOW the embedded data element under the brand. The respondent won’t see it, but they will be assigned the value. The Embedded Data element is obtained in two ways in the Survey Flow: 1. Obtained from a panel or a survey URL. Specifying which embedded data fields to display in the results (passed from panel or URL). RANDOMIZER 2. Assigning embedded data variables to the respondent as they are taking the survey based on logic (how someone responds to questions, etc.). The Randomizer is a very useful tool in experimental design. Randomize the display of any element you put under the Ran- domizer. By default, it will randomize the display order of all elements within the randomizer. For the embedded data from your panel to be seen in your survey results, you need to put an embedded data element into your Survey Flow for each embedded data field in the panel. When pulling embedded data from a panel or survey link, it doesn’t matter where the element is placed in the Survey Flow. It only matters where you put the embedded data element if you are assigning the field AND value of the embedded data in the Survey Flow. When pulling from a panel, you just need to make sure there is an embedded data element somewhere in the flow. To Add Embedded Data From a Panel Figure 5-16 Randomizer Survey Flow Element. 1. Insert an Embedded Data Element into the Survey Flow 2. Define the panel by clicking Add From Panel and select the panel. Data fields will appear, click OK. 3. Value will be set from Panel or URL to right of embedded data field means the value of the field will be pulled To randomly display elements using the Randomizer element: from the embedded data fields in the panel you uploaded, or from the URL (if appending information onto the end of the survey link). 1. Choose the Randomizer element. Q-TIP -TIP 4. Set a Value Now does not apply here. It applies to the scenario (below) where you assign a value on the fly. 2. Move elements underneath the Randomizer, dropping them where it says Add a New Element Here. Q - T I P 3. If you would like to randomly display only a subset of the elements under the randomizer, then click the +/- buttons where it says, Randomly present __ of the following elements. If you have 5 elements and choose to Q - T I P randomly present 2, then each time a respondent takes the survey the tool will choose 2 elements out of the 5 to randomly present to the respondent. To enter additional fields, click Add a New Field. Any fields you add will be assigned to the respondent at the same time. 4. In this situation, you might consider selecting the Evenly Present Elements option to make sure each element - T I P So if you have different locations for assigning different fields, then insert another Embedded Data element for that gets seen a decent amount of times. 90 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 91

EVENLY PRESENT ELEMENTS To use the Web Service element: 1. Paste the link to the external script into the URL field. This simple tool on the Randomizer keeps track of how frequently each item has been displayed. If one item has been 2. Click Add a parameter to send to web service... to specify parameters to pass to the script. displayed more than an other item, the system will try to even it out by showing the lesser shown items more often to 3. Enter the parameters to pass to the script (For example, max and min values for a random number generator respondents. This turns the Randomizer into somewhat of a sequencer. script). Click the “+” to add additional parameters. Click the “-” to remove parameters. 4. Click Add Embedded Data to specify how the returned values will be stored as embedded data. Q-TIP -TIP Example: [embedded data field name] = [return value from script] Q - T I P Q - T I P Go to Qualtrics.com/University in your web browser and enter “Random Number Generator” in the search field. You will be - T I P able to view an example of a random number generator delivered from a Web Service element. Figure 5-17 Evenly Present Elements options. To enable Evenly Present Elements, select Evenly Present Elements on the Randomizer. Once enabled, a Reset button appears. When clicked, it displays the options shown in the following screenshot (Figure 5-16). Q-TIP -TIP You can reset all the counts, returning the counts to “0” or you can manually click on the count numbers to change them. Q - T I P Figure 5-18 Web Service Survey Flow element set up as a Random Number Generator. Q - T I P Evenly Present Elements does not need to be used when displaying all elements, as opposed to just a subset, for which it AUTHENTICATOR - T I P is designed. The Authenticator is an interesting tool. Panel members can authenticate against information you already have, essential- WEB SERVICE ly telling the Qualtrics Survey Research Suite who they are. It requires the respondent to sign into the survey and once they are signed in, the system will know who they are and be able to assign panel information to their response. This is useful The Web Service is an advanced Survey Flow element for advanced logic and data processing. You can send a request to when you have information about the respondent but are not in a situation to send out a unique link through our mailer. an external server, which houses a script that evaluates data you send over. Once evaluated, the server’s script responds with information that is seen by the Qualtrics system as embedded data. You can reference the processed information as You can choose to have the respondent sign in with their name, email address or any other information you may have on embedded data in logic, display it to the respondent, or access it in your post-data-collection analysis. file for them. The respondent tells the tool who they are and they enter the Authenticator (like a branch) and see the ele- ments of the survey. You can use the Web Service to set up a random number generator, set up a time series, pull in headlines from a website To set up an Authenticator element, do the following: and much more. 1. Import a panel into the Panels tab. An email address is not required. See the Panels chapter for more information on how to do this. 2. Go to the Survey Flow (Edit Survey tab) and insert an Authenticator. 92 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 93

3. Select a Panel. Start with the Select Library drop-down, then select panel name. returns to where they left off (much like using the individual link from the Email Survey page). 4. Specify the fields to authenticate against. Click “+” to add additional fields and “-” to remove fields. Typically, this is an option you do want selected. 10. Click the OK button to save specified Options. 11. In the Survey Flow, add or move elements under the Authenticator (typically blocks). Any elements Q-TIP -TIP that do not go under the Authenticator element will be able to be accessed without a log-in. Q - T I P Q - T I P Typically, the Authenticator is placed at the very beginning of the Survey Flow. It’s the first thing seen and is used to control whether or not one can enter the survey. - T I P Figure 5-19 Select the fields you would like to authenticate with. END OF SURVEY 5. Click the blue arrow to select the field, or start typing the field name (it will recognize what you type). Using this element, you can specify different ways to terminate the survey for your respondents. Typically, this element is 6. Select unique fields or a unique combination, like first and/or last name, username, password, phone number, placed within a branch (Figure 5-20), in order to only terminate those who do or do not match certain criteria, but you can or email address. also place one at the end of the flow to give a custom end of survey message or redirect your respondents. 7. If needed, type the Optional Label for each field. Use this to make sure fields display how you want them to display to the respondent. For example “First Name” defaults to “RecipientFirstName.” 8. Select the Password checkbox if you want text entered into that field to appear as dots/asterisks, as is custom when entering your password when logging into email or banking sites. 9. Click Options to further customize the Authenticator. Here are the options provided: • MAXIMUM AUTHENTICATION ATTEMPTS: The number of times potential respondents can fail authentication before they are shown the “Too Many Failures Error” text. The default setting is 3, but you can increase or decrease it as needed. • AUTHENTICATION PROMPT TEXT: The first text you display to the potential respondent when they Figure 5-20 End of Survey Element Within a Branch. are asked to authenticate. The default text is, “Please log in.” Click the button to select other text or provide your own text to display. • AUTHENTICATION ERROR TEXT: Shown each time the potential respondent fails to authenticate There are a lot of useful ways to customize an End of Survey element. Click Customize to see the following customization correctly. The default says, “Unable to log in with the information provided.” Click the button to options: select other text or provide your own text to display. • DEFAULT END OF SURVEY MESSAGE: When selected, the default selection displays a message that says, • TOO MANY FAILURES ERROR TEXT: When someone fails authentication the amount of times you “We thank you for your time spent taking this survey. Your response has been recorded.” specified in Maximum Authentication Attempts, they see this message. The default is “Too many failed log-in attempts. Click next to continue.” Click the button to select other text or provide your • REDIRECT TO SINGLE RESPONSE REPORT: Select if you want to display to the survey taker a report of their own text to display. response, allowing them to download it as a PDF. This is the same report you see on the Responses (Recorded • ALLOW AUTHENTICATING RESPONDENTS TO RETAKE AUTHENTICATED SECTION: Choose this only Responses) page of the tool when clicking the Response ID. if you want to allow respondents to be able to take the survey again (the authenticated section). Typically, you don’t want this option selected. • RELOAD ANY PREVIOUSLY SAVED PROGRESS UPON AUTHENTICATION: If someone can’t complete the survey in one sitting, this allows them to later click the link to authenticate again. The survey 94 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 95

This is not recommended because you’re telling the tool to not store certain responses. These cannot be Q-TIP -TIP recovered if not recorded. Be sure this is a feature you want to use before selecting it. Q - T I P Q - T I P Most of these options are also available in the Survey Termination area of Survey Options, which acts as a sort of unseen - T I P End of Survey element. Figure 5-21 Customization options available when Customize button is clicked. CONJOINT • END OF SURVEY MESSAGE FROM THE LIBRARY: Display your own custom message to your survey-takers. Select Conjoint Analysis is a technique used to assess the relative importance individuals place on different features of a given an existing message from your message library or create a new one. product. A conjoint study usually involves showing respondents a set of features and asking them to indicate how much they like or prefer the different attributes of that feature. • REDIRECT TO A URL: Redirect participants to another URL when they finish the survey, like your organization’s website. Simply copy/paste the URL into the text field. For example, the acceptability of an assortment of yet undeveloped new product configurations could be evaluated using the attribute configurations that define the products. To read more about conjoint analysis go to Qualtrics.com/University. • SEND ADDITIONAL THANK YOU EMAIL FROM THE LIBRARY: Send a Thank You email to your participants who complete your survey, one by one as their responses come in. This only affects those who terminate at this The conjoint option only displays if a conjoint question is built. Discussion of building the conjoint question type is specific End of Survey element. Select an existing Thank You message or create a new one. contained in Chapter 6, Special Features. Once inserted, just place the conjoint in the Survey Flow where you need it to appear to the respondent. The Qualtrics conjoint analysis element uses the self-explicated model approach (Srinivasan • DO NOT INCREMENT QUOTA COUNTS: Don’t increment quota counts for respondents who terminate at the and Park, Journal of Marketing Research, May 1997). Other approaches to conjoint analysis, like choice based and max- specific End of Survey element. Quota counts only increment when someone terminates the survey, but typically diff, will need to be built separately within the survey. you don’t want to increment the count for someone who doesn’t qualify for your survey. • SHOW RESPONSE SUMMARY: Displays a respondent’s survey questions with the buttons/checkboxes selected. This allows the respondent to download it as a PDF. It is very similar to Redirect to single response report but this report has a design template similar to the survey. Figure 5-22 Conjoint Survey Flow Element. • DO NOT RECORD ANY PERSONAL INFORMATION AND REMOVE PANEL ASSOCIATION (NOT RECOMMENDED): Check this option to make sure responses are anonymous. If coming from a panel, respondents who reach this element will not have their response associated with their name, email address, or embedded data from See the Conjoint area under the Advanced Options section for more information on setting up a conjoint. the panel. They will appear as an anonymous response, as if they had clicked the Anonymous Survey Link. This is not recommended because once the association is removed, it cannot be recovered. If you select this, make sure it is a feature you want to use. • DO NOT RECORD SURVEY RESPONSE (NOT RECOMMENDED): Don’t count certain responses that pass over this element. This is especially useful if your license has a restriction on how many responses it can have. Using this option you can count just those who qualify for your survey. 96 | Chapter 5: Block Options and Survey Flow Chapter 5: Block Options and Survey Flow | 97

Summary Phew! You made it to the end of chapter 5. You now know almost everything there is to know about building a survey in the Research Suite. In this chapter we went over the importance of blocks in organizing your survey and preparing for the use of advanced logic in the Survey Flow. We also covered how to use branches in the Survey Flow to guide respondents through different paths in the survey depending on what their responses to previous questions. After reading this chapter you should have a good idea of what all of the elements are in the Survey Flow and what they do. The Branch, Randomizer, Embedded Data and End of Survey elements are the ones you will use the most, so spend some time getting to know them. You will be amazed at the research you can pull off when you combine blocks and Survey Flow elements to create a complex survey. Chapter 6 Special Features (i.e., Really Cool Stuff You May Never Use) If you’re doing a unique study, this is the chapter for you. We’ve built many special features for the world’s leading researchers. This chapter explains how to use them all. 98 | Chapter 5: Block Options and Survey Flow Qualtrics: The Complete Research Suite | 99

AFTER READING THIS CHAPTER, YOU WILL KNOW HOW TO: dissatisfied answer. Likewise, a new sales lead can be instantly delivered to your inbox, allowing you to make a faster response, just when the prospective customer is at the peak of their interest in your product or company. In this chapter, we will cover: • Triggers • SalesForce Integration • Quotas • Translate Survey • Scoring • Test Survey • Import/Export Survey This chapter presents seven special features that are useful in certain circumstances. These options are all available in the Edit Survey tab under the Advanced Options drop-down menu. If you don’t know what triggers are, or whether scoring could be useful to you, read over this chapter and you may find that these special features are exactly what you need to make your survey and reporting great. Figure 6-1 Email trigger window. Triggers TO CREATE AN EMAIL TRIGGER: Two types of triggers are available in Qualtrics. Type one, email triggers, allows you to send an email notification when a 1. Under the Advanced Options drop-down, hover over Triggers and select Email Triggers. certain event occurs. Type two, panel triggers, allows you to add a respondent’s name to a panel you are building. Triggers 2. By default, the Trigger will send an email when a survey is completed. However, if you want to receive only a are often used in conjunction with customer and website feedback surveys that report highly dissatisfied customers. If the specific category of email, click the Add a Condition link located above the Email address box. company wants to engage in customer retention efforts, they can immediately know the results of their surveys and make 3. Set up the condition. the needed changes. • Logic can be based off of Question selections, Embedded Data, and/or Quotas. • The “+” can be used to create additional lines of logic conditions with the AND and OR operators. Similarly, triggers are useful when distributing whistleblower surveys, as prescribed under Sarbanes-Oxley legislation. • Shift+clicking the “+” will create an “AND IF” statement, equal to parentheses for more advanced Finally, if you are collecting sales leads through product interest surveys, you can easily have triggers sent to appropriate logic. Change this to “OR IF” by clicking on the “AND IF” text. sales team. In each of these cases, a key person receives an email and has the information to immediately take action to 4. Now fill in the fields with the necessary information for your trigger: Q-TIP -TIP recover the customer, minimize damage or make a sale. “To” email address; “From” email address; Subject line; Message. Q - T I P Q - T I P EMAIL TRIGGERS An email address can be piped in from an answer choice. To learn how to do this, see Insert Piped Text in the - T I P Advanced Choice Options chapter. The Email Triggers option sends an email message when a specified condition or event occurs (Figure 6-1). This means 5. Choose when you want the email to be sent. Most often you will want to send immediately, but you have the that the Qualtrics system can alert you or someone else when someone answers a survey in a particular way. For example, option to delay the mailing from 1 hour to 28 days. if you’re running a customer satisfaction survey, you may want to know if someone mentions they were dissatisfied with their experience. You can get this alert straight to your inbox or smartphone as soon as a response is completed with a 100 | Chapter 6: Special Features Chapter 6: Special Features | 101

6. Include Response Report means that a simple report summarizing the triggering participant’s response will be Change this to “OR IF” by clicking on the “AND IF” text. sent as part of the email body. Enabled by default, uncheck this option if you prefer not to include this report. 3. Select the Library and Panel into which you would like to place your new panel members. If you don’t have a 7. Click Save Triggers or Finish Editing if you would like to move on to building another Email Trigger. panel already created, see Chapter 8 on Panels to learn how to create a new panel in the Panels tab. 4. Specify which question responses go into the main panel fields: First Name, Last Name, Email External Data When a respondent completes a survey, the email trigger is sent if the specified condition is met. Reference, and Language (Select “None” if that specific field is not needed). 5. Click Add Additional Fields if you would like to include an additional embedded data field in the panel. 6. Specify the embedded data field name (text box on far left). 7. Choose if you would like to pull the information from a question, embedded data field, or recipient information (e.g., fields containing name, email) by clicking on the drop-down. PANEL TRIGGERS 8. Select the question, embedded data field name, or recipient info field using the next drop-down list. 9. Select the answer choice, if based upon a question. This step does not apply if the logic is based upon Panel triggers are a great way to build a customer panel. You can add an individual to a panel or update an existing embedded data or recipient information. panel member (Figure 6-2). This is especially useful when you want to create your own panel, and allows you the flexibility 10. Click Save Triggers, or Finish Editing if you would like to move on to building another Panel Trigger. of only including those who opt into your panel. You can request contact information in an initial survey and have that information automatically inserted into a panel that you can use to send out a second survey. When respondents take the survey, the Panel Trigger will place their information into the panel as long as the condition that you have put in place has been met. Just like the email trigger, the panel trigger performs only when the specific conditions that you specify are met. Salesforce Figure 6-2 Panel trigger window. Do you use Salesforce.com? If so, we’ve got you covered. Salesforce is a powerful Customer Relationship Management (CRM) tool that many organizations use to keep track of sales leads and contacts. Now you can integrate your surveys into Salesforce! Please note that Salesforce Integration is an additional service that is not included with the standard TO CREATE A PANEL TRIGGER: Research Suite packages. 1. Under the Advanced Options drop-down, hover over Triggers and select Panel Triggers. Set Up Link to your Salesforce Account 2. By default, the Panel Trigger is set to include the individual in the panel upon survey completion. To create or All Salesforce options, except for Web to Lead, need the survey to be linked up using the Security Token. It’s best to set up update panel members based on certain criteria, click Add a Condition. the link ahead of time.  Logic can be based upon Question selections, Embedded Data, and Quotas.  The “+” can be used to create AND and OR operators.  Shift+clicking the “+” will create an “AND IF” statement, equal to parentheses for advanced logic. 102 | Chapter 6: Special Features Chapter 6: Special Features | 103

Figure 6-3 Salesforce Account Login dialog. TO LINK YOUR QUALTRICS SURVEY TO YOUR SALESFORCE ACCOUNT: Figure 6-4 Salesforce Web to Lead window. 1. Under the Advanced Options menu, navigate to Salesforce. 2. Select Setup Link to Salesforce Account. 3. Type in your Salesforce User Name, Password, and Security Token. TO USE THE WEB TO LEAD FEATURE: To get your Security Token: a) Log in to Salesforce.com. b) Within Salesforce, click your name and select Setup. 1. Under the Advanced Options drop-down menu, hover over Salesforce. c) Click My Personal Information. 2. Select Web to Lead. d) Select Reset My Security Token. 3. Enter your Organization ID from Salesforce. This specifies where lead information is stored. To get the e) Click Reset Security Token button and wait for the email. Organization ID, log in to salesforce.com. f) Copy and paste the Security Token into the appropriate field in the Qualtrics Survey Research Suite. 4. Within Salesforce click your name and select Setup. Q-TIP -TIP a) Select Administrative Setup. 4. Click Save. b) Click Company Profile. Q - T I P c) Click Company Information. Q - T I P d) Under Organization Detail you will find a 15-character alphanumeric value for the Salesforce.com Organization ID (second column toward the bottom). If you are new to Salesforce integration, check the box for Sandbox Environment. This allows you to create a e) Copy and paste value into the Organization ID field in the Web to Lead window. - T I P 5. At the top of the window, create a condition for when you’d like the lead to be triggered. Don’t specify a carbon copy of your organization and data, placing it in a sandbox. Now you can play around without the worry of messing up your original data. condition if you’d like a lead created every time the survey is completed. Conditions can be based upon questions, embedded data fields, and quotas. 6. Use the drop-down menus to guide you through the fields in Salesforce you’d like to populate. This also guides you through choosing a location in the survey from where you’ll pull the information. This feature limits you to the standard Lead fields identified by Salesforce. For pulling in additional objects and fields, see the Response WEB TO LEAD Mapping information in the next section. The Web to Lead option allows you to pull information from your survey and put it into the Lead object of your Salesforce The basic format is the following: [Salesforce Lead field] = [Qualtrics logic type (Question, Embedded Data, account. Similar to an Email Trigger or Panel Trigger, you can then set the conditions for which respondents get pulled into Specified Value)]. Salesforce. 104 | Chapter 6: Special Features Chapter 6: Special Features | 105

Example setups: • The default setting is for all completed surveys to trigger a lead. Click Add a Condition to specify QUESTION: [Salesforce Lead Field] = Question, select Question, select corresponding answer choice (or answer criteria for when someone should trigger a lead. choice value). This pulls in selected or entered information from a question. • Conditions can be based upon questions, embedded data fields, and quotas. Use the blue plus and minus signs to the right to add or remove additional “and if” and “or if” conditions to your logic. EMBEDDED DATA: [Salesforce Lead Field] = Embedded Data, enter embedded data field name. This pulls in 3. Under the Action drop-down, specify the action for the Qualtrics tool to take when the condition is met. These assigned information from an embedded data field. include the ability to Update, Insert, and Delete objects in your Salesforce account. See below for further information explaining how to use the Update, Insert, and Delete options. SPECIFIED VALUE: [Salesforce Lead Field] = Enter static value to assign. This pulls in static information you want to assign to anyone who triggers this Web to Lead trigger. 7. Use the blue plus and minus signs to the right to add or remove additional “and if” and “or if” conditions TO UPDATE OR DELETE AN OBJECT: to your logic. Q-TIP -TIP 8. When finished click Save, or Finish Editing to add another Web to Lead trigger. 1. Select Update or Delete under the Action drop-down. Q - T I P 2. Identify the Salesforce Object in the drop-down menu. Q - T I P 3. Under the Salesforce Field to Response Mapping section, use the drop-down menus to identify the fields to populate in Salesforce. You will also identify the location in the survey from where you’ll be pulling the • To create additional Salesforce triggers, click Add Another Lead Trigger. You can set up additional triggers to information. - T I P • Add/remove additional fields to map to your Salesforce account by using the blue plus and minus add different information. • To test your Web to Lead trigger setup, use the Preview Survey button in the Edit Survey tab. When finished with signs to the right. the survey, a message is provided indicating whether or not the lead was successfully saved into your 4. Select a Key in the left-hand column. Salesforce account. • When updating or deleting, a unique field (the Key) is needed to make sure the correct object is changed. The • Check your Salesforce account for verification that the lead has been saved as desired. The lead may not appear field you specify as the Key is used as the unique identifier to locate the object. If the key is not unique, more for a few minutes as it needs to pass through the Salesforce Web to Lead system before it can appear. than one object can be returned. If more than one object is returned, the action to update or delete will fail and no action will occur. 5. Click Save, or select Finish and click Add Another Response Mapping to set up additional response mappings. RESPONSE MAPPING TO SALESFORCE Response Mapping takes the Web to Lead feature a step further. It allows you to automatically insert information from your TO INSERT AN OBJECT: survey into any object or field of your Salesforce account. Additionally, you can update or remove any existing Salesforce 1. Under the Action drop-down, select Insert. object. Conditions can be set using advanced logic to identify specifically which respondents will be saved, updated or 2. Identify the Salesforce Object in the drop-down. removed. These conditions can be based upon question responses, embedded data fields, or survey quotas. 3. Under the Salesforce Field to Response Mapping section, use the menus to identify the fields in Salesforce to populate, as well as the location in the survey where you’ll be pulling the information from. • Add/remove additional fields to map to your Salesforce account by using the blue plus and minus signs to the right. TO USE THE RESPONSE MAPPING OPTION: 4. Click Save, or select Finish and click Add Another Response Mapping to set up additional Response Mappings. Q-TIP -TIP 1. Under the Advanced Options menu, navigate to Salesforce. Q - T I P 2. Select Response Mapping. • If you haven’t already linked to your Salesforce account, you can do that in the Salesforce Account Q - T I P Login window that appears. Please refer to the beginning of this Salesforce tutorial for step 3 in the Set Up Link to Salesforce Account section. • Setting up your Response Mapping trigger is just like Web to Lead. Use the Preview Survey button on the Edit - T I P 106 | Chapter 6: Special Features Chapter 6: Special Features | 107

Survey tab. When finished with the survey, a message is provided indicating whether or not the lead was suc TO USE TRIGGER AND EMAIL SURVEY: cessfully saved into your Salesforce account. • Check your Salesforce account for verification that the lead has been saved as desired. The lead may not 1. Under the Advanced Options drop-down, navigate to Salesforce. appear for a few minutes as it needs to pass through the Salesforce Web to Lead system before it can appear. 2. Select Trigger and Email Survey. 3. In the dialog window, click Add an Outbound Message. 4. Once created, you’ll see an option to select a Salesforce Object and Email Field. • The Object’s Rule is what triggers the outbound message. • The Email Field is the email address the message will be sent to. TRIGGER AND EMAIL SURVEY • The Store Email in Panel option allows you to store that person’s information into a panel for future use or for use as embedded data. This is optional, but it is required if you want to use embedded data to pass information from Salesforce into your survey or results. The Trigger and Email Survey option allows you to send an automatic email trigger and trigger a survey that will be sent 5. Once a panel is selected, click Show Available Embedded Data. The listed fields are the fields you can whenever a specified object’s Workflow rule has been met in Salesforce. pass into your survey and use as piped text and save into your results. 6. Enter the From Name, Reply-to Email Address, and Subject for the message to be sent. To use the Trigger and Email option, you first need a Workflow Rule and Outbound Message set up in Salesforce. 7. Click the Load a Saved Message drop-down menu and either select a message from your library or create a new one by selecting New Message under your library. To create a Workflow Rule and Outbound Message in Salesforce: 8. Copy and paste the Outbound Message URL into the endpoint URL for your outbound message in Salesforce. 1. Login to Salesforce.com. This is the message associated with the workflow rule for the object you selected above. 2. Within Salesforce, click on your name near the top of the page and select Setup. 3. In the left-hand menu, click Create and select Workflow and Approvals. 4. Click Workflow Rule. 5. Click the New Rule button. 6. Select the object to use for your rule. 7. Click Next button. TO PASS EMBEDDED DATA FROM SALESFORCE TO QUALTRICS 8. Give your rule a name and description. 9. Set your condition for the rule. At times it’s useful to pull additional information from Salesforce into Qualtrics for reporting purposes. 10. Click the Save and Next button. 11. Set an action for your rule by selecting New Outbound Message. 12. Edit the name, description, and from name for the outbound message. TO PULL FIELDS FROM SALESFORCE INTO QUALTRICS: 13. Copy the end URL found in the Qualtrics Trigger and Email Survey window and paste it into the outbound URL location in Salesforce. 1. Click on the Advanced Options drop-down and navigate to Salesforce. 2. Select Trigger and Email Survey. 3. In the dialog window, click Show Available Embedded Data. 4. Copy the necessary embedded data fields. • The right column is the Salesforce field. • The field in the left column is the Qualtrics field matching the corresponding Salesforce fields. 5. Paste the Embedded Data field IDs as embedded data into your Survey Flow: 6. Under Edit Survey, click Survey Flow. 7. Click Add a New Element Here (the position at the bottom is fine). 8. Select the Embedded Data. 9. Paste the Embedded Data field IDs from the list in step 4 into the text fields where it says Enter Embedded Data Field Name Here. Figure 6-5 Salesforce Trigger and Email Survey window. 108 | Chapter 6: Special Features Chapter 6: Special Features | 109

TO REFERENCE SALESFORCE FIELDS IN QUALTRICS MESSAGES: 1. Follow steps 1-4 above. 2. In the Rich Text Editor when editing the message, click the Piped Text icon {a}. 3. Hover over Embedded Data. 4. In the text field, paste the Embedded Data field name (from the left column referenced in Step 4 of the above steps). QUALTRICS ON SALESFORCE APP EXCHANGE The Salesforce App Exchange enables you to access your Qualtrics account and all of its functionalities within the Sales- force dashboard. It’s a free app to all Qualtrics users. For more information on Qualtrics for Salesforce App Exchange, visit http://appexchange.salesforce.com/ and search for “Qualtrics”. Figure 6-6 Quotas Dialog Box. TO CREATE A QUOTA: 1. Click on the Advanced Options drop-down menu and select Quotas. 2. In the Quotas box, click Add a Quota. 3. Enter a name for the quota. 4. Enter a number for the Quota Limit. • The Quota Limit is the number of responses required before the specified action (step 6) Quotas takes effect. 5. Set up the quota condition. Every time this condition is met, the quota will be tallied. • You can base the condition upon a question response, embedded data, or another quota. • This is the same logic box as used in Skip, Display, or Branch Logic and works in the Also found in the Advanced Options drop-down is the Quotas option. The Quotas feature allows you to track the number of same way. responses that match certain criteria and then limit how many people can take part or all of the survey. Once the quota • Shift+click on the “+” button adds And If, which is like using parentheses to group parts is met, you can terminate the survey, skip a question or block, or deactivate the survey based on the number of specified of logic. responses in the quota. As discussed in Chapter 4 of this book, Quotas can be used with the Add Skip Logic option found 6. Select an action to take when the quota count is met (Quota is full). in the advanced question options (purple Gear) to the left of each question. • The default setting is End Current Survey, which terminates the individual response for a respondent who comes into the survey and meets the quota condition after the quota count is met. Quotas can be measured by question response, embedded data, or even another quota (Figure 6-6). The quota feature • Click Customize to the right of the drop-down to edit what the respondent will see if the survey is useful when you wish to have only a certain number of responses, or when you have several groups and you want a is terminated. Qualtrics can deactivate the survey, hide a question or block of questions (“Do specific number of responses from each group (i.e. equal responses from males and females). Not Display...” options), or leave it to Survey Flow logic. See the additional section below for more information on setting up the quota logic in the Survey Flow. “Do the above action only if the current respondent meets the quota condition” will be available and checked by default if choosing an action other than the default. 7. Click Save Quotas, or Finish Editing if you would like to create more quotas. 110 | Chapter 6: Special Features Chapter 6: Special Features | 111

USING QUOTAS IN SURVEY FLOW TO SET UP A CONJOINT IN YOUR QUALTRICS SURVEY: 1. Under the Advanced Options drop-down, select Conjoint. If you would like to base logic in the Survey Flow off of a quota or terminate someone at a certain point in the survey 2. Click Add a Conjoint. based on a Quota, then you will not choose a Quota action in the Quota wizard, but go into the Survey Flow to set up an 3. The first page shows an explanation of conjoint analysis. When ready, click Next to start your conjoint creation. action. 4. To distinguish this conjoint from others you create, enter a Name (top text box) and Data Export Tag (bottom text box), then click Next. To set up the survey to take action in the Survey Flow: • The Data Export Tag is used to help identify which fields in the survey results relate to the conjoint. 1. Insert a Branch into the Survey Flow (click Add a New Element Here and select Branch). 5. Enter the Features for the product or service being tested. 2. Click Add a Condition. • The logic needs to be set so that that two conditions need to be met. First, that they have met the Quota condition, and second, that the Quota is already met. For example, if you have a quota named Male that is set up to terminate male respondents once the quota has been met, the logic would be like the following... a) If Male is Selected. b) And If Male quota has been met. Now place the necessary elements within the Branch. • Of course, you can also have the logic based upon the quota not being met, or being above or below a Q-TIP -TIP particular value. Q - T I P Q - T I P The End of Survey element is used for terminating participants. Adding this element to the end of a branch will allow you - T I P to set a custom end of survey message for that branch. Figure 6-7 Setting up a self-explicated conjoint. TO ADD A FEATURE: a) Type the name of the feature in the text box below the Feature area. b) Click Add. c) Choose if you want to allow participants the option to eliminate attributes/levels for the feature. This is done by checking or unchecking the box for Do NOT allow level elimination for this feature under the Features list. This is selected by default. If not selected, the Instructions for elimination of feature levels question from the Conjoint Analysis Q-TIP -TIP Question Text – 1 tab will be asked regarding the attributes/levels of that feature. Q - T I P The conjoint option is a combined data collection and analysis tool. Measuring preferences for products or services, it is Q - T I P actually used to understand how people value the specific features of a product or service. Elimination of feature levels implies that you would never buy or use a product with that feature level. In fact, you would - T I P In the Qualtrics tool, you can add a self-explicated conjoint to your survey (Figure 6-7). The self-explicated model asks rather go without than buy this product configuration. For example, if I were highly allergic to peanuts, I’d rather have no respondents direct questions about how much they desire each of a set of attributes or features, and then the model asks candy bar than one with peanuts. respondents to indicate a level of preference for each. 112 | Chapter 6: Special Features Chapter 6: Special Features | 113

Q-TIP -TIP Q - T I P TO REMOVE A FEATURE: Q - T I P a) Select a feature in the Feature list. b) Click Delete. In self-explicated conjoint analysis, the importance scores are used as a multiplier for the preference scores. - T I P c) Enter the Potential Attributes/Levels for the added Features. The constant sum method of measuring importance generally gives a broader distribution for the importance scores than does the upgrade desirability method. The upgrade desirability method is appropriate when the importance features (a feature is absent or present) are being evaluated. TO ADD ATTRIBUTES/LEVELS FOR A FEATURE: a) Select the feature in the Features area. 6. Click the Conjoint Options tab to make any changes as needed. b) Click in the Potential Attributes/Levels box and type in the attributes/levels to include. Insert one per line. • Name for Conjoint Analysis: You can change the name you provided when first setting up the conjoint. • Data Export Tag: You can change the Data Export Tag you provided when first setting up the conjoint. • Conjoint Display Options: TO REMOVE ATTRIBUTES/LEVELS FOR A FEATURE: • Feature Importance Constant Sum: The Constant Sum question displayed at the end of the 1) Select the feature in the Features area. conjoint asks for allocation of each feature’s most preferred attribute/level based upon percentage. 2) Click in the Potential Attributes/Levels box and use the backspace or delete key on your keyboard to delete • Desirability Upgrade Constant Sum: The Constant Sum question displayed at the end of the the attribute’s text. conjoint asks for 100% allocation for each feature. It is based upon the premise that one is upgrading the product from the respondent’s lowest preferred attribute/level (From) to the most preferred attribute/level (To) for the feature. TO EDIT THE TEXT OF THE ACTUAL CONJOINT QUESTIONS: 7.Click Save. 3) Click the Question Text – 1 tab and review the question text and instructions used. Suggested text is found in 8.Click Survey Flow and place the Conjoint element (light blue) in the correct position in the survey. Remember to Q-TIP -TIP each of the question areas. Edit this text to make the questions work better for your study. There are three click the Save Flow button when finished. questions that you will need to write: Q - T I P • INSTRUCTION TEXT FOR ELIMINATION OF FEATURE LEVELS: These instructions only display if “Do NOT allow Q - T I P level elimination for this feature” is not selected for any features. • INSTRUCTION TEXT FOR SELECTING THE MOST AND LEAST PREFERRED LEVELS: This is the question text • Conjoint data does not display in the View Reports area, so data must be downloaded from the Download Data - T I P respondents will see when they are asked to select the Least Preferred attribute and Most Preferred attribute page and analyzed in an external application. from the listed attributes/levels for each feature. • Once your Conjoint is in the correct location, we recommend you click Survey Preview and test your survey with • INSTRUCTION TEXT FOR EVALUATING “PREFERENCE” OF LEVELS NOT MOST OR LEAST PREFERRED: This the Conjoint in place. is always displayed after “Instructions for select most and least preferred levels.” This question asks (using • This book won’t be touching on the analysis side of the conjoint. Go to Qualtrics.com/University to search for a 0-10 scale) about all remaining attributes that were not the least or most preferred from the previous conjoint papers, or the Professional Services team at Qualtrics can provide assistance, if needed. question. 4)Click Question Text – 2 tab and review the instruction text used. Edit this text to make the questions work better for your study. • INSTRUCTION TEXT FOR MEASURING IMPORTANCE USING CONSTANT SUM QUESTION: This is the question text for the Constant Sum question. It displays at the end of the conjoint only when Feature Importance Translate Survey Constant Sum is selected on the Conjoint Options tab. • INSTRUCTION TEXT FOR MEASURING UPGRADE DESIRABILITY USING CONSTANT SUM QUESTION: This is the question text for the Constant Sum question displayed at the end of the conjoint. It appears only when Desirability Upgrade Constant Sum is selected on the Conjoint Options tab. The Translate Survey tool is a powerful tool that provides a fast start in translating your survey. Within the tool you are given a translator-friendly side-by-side view for entering the translations (Figure 6-8). When the survey is taken by the 114 | Chapter 6: Special Features Chapter 6: Special Features | 115

Q-TIP -TIP Q - T I P respondent, the system automatically recognizes the default browser language of the respondent and presents the ap- Q - T I P propriate survey language. The respondent can also choose the language they would like to take the survey in by selecting it from a drop-down in the upper right hand corner of the survey. - T I P • When putting in the translation, a percentage shows above each question to show you how much of the When Translate Survey is used, the survey can be taken in multiple languages and all of the data collected is stored in one question has been translated. place, allowing you to analyze all the data all at once. If desired, you can view which languages the survey was taken in • Click the Toggle Translation Overview button (icon of two columns) next to the left/right arrows to see a and take that into consideration when analyzing your data. percentage of all translations provided. • Click any question’s percentage in its language column to jump directly to that question to edit that particular translation. • If you are using the anonymous survey link, you can append it so that everyone who clicks on that specific survey link will see the survey in that specific language. To do this, you will take the survey link and place “&Q_lang=languagecode” on the end of it. You will need to replace ‘languagecode’ with the offical language code of the language you would like to display. All official language codes can be found online. • If you would like to see in the results which language the respondent took the survey in, you will need to add an embedded data field into the Survey Flow called “RecipientLanguage”. This will place a column in your results showing the language code for each respondent. Figure 6-8 Translate Survey tool in action. TO USE THE TRANSLATE SURVEY TOOL: 1. Select Translate Survey under the Advanced Options drop-down. 2. The first time you open the translator, you’ll see the first question of your survey on the left-half of the screen, and the right-half of the screen will be blank. Above the right-half of the screen, select Add a Language. 3. From the Survey Languages list, choose the language translations to add to your survey, and click Close. Scoring 4. You will now see your default language on the left-half of the editor, and the question text on the right ready to be translated. To begin translating your first question, click on the question text or answer choices and replace the text with the translated text. 5. To switch between questions, click the left and right Arrows on the right side of the gray toolbar. With the Scoring tool you can assign numeric values to individual answer choices that are then added up to give the 6. To change which translation language you are working on, click on the Language drop-down above your respondent a score (Figure 6.9). This feature can be used to make a quiz out of your survey and can also facilitate more translation on the right half of the screen, and choose one of the other languages. complex logic functions. You can assign a numeric score to Multiple Choice, Matrix, and Text Entry question types and 7. For an overview of your translation progress, click Translation Overview or click on the Grid icon next to the left then grade the questions. and right arrows on the gray toolbar. If you are setting up your survey as a quiz, you can show the respondent their score either after each question in the sur- vey or at the end of the survey. (Figure 6-9). The respondent can also be shown whether or not they got the answer correct. After translating your survey into the desired languages, you can preview your survey and see that in the upper-right hand corner of the survey, there is the option to change between languages. The respondent can click here to change between When you download the data, additional columns are provided show the Sum, Weighted Average, and the Weighted Stan- languages. Also, the system will auto-detect which language their browser is in and display the survey automatically in dard Deviation scores for each respondent. that language. 116 | Chapter 6: Special Features Chapter 6: Special Features | 117

individual respondent level. • If a question is not one of the supported question types, the message “This question type is not currently supported” will be displayed to you on the Scoring page. • If you would like to base logic upon Scoring, you will first need to put the scoring category into the Survey Flow as embedded data. If you are in the Grade scoring category, you can add an embedded data called “Grade” to the Survey Flow, then for a question in the survey you can add Display Logic that says “If Embedded Data ‘Grade’ is equal to a ‘certain number’, then display.” The question will only display then if a certain score is obtained. Figure 6-9 Applying scores to survey responses. Test Survey TO USE SCORING: 1. Under the Advanced Options drop-down, select Scoring. The Test Survey feature is a simple way to pump some dummy data into your survey (Figure 6-10). It allows you to test out 2. Assign a Scoring value to answer choices. Scoring is only available for Multiple Choice, Matrix, and Text Entry your survey by seeing if the results come through the way you expected. Test Survey allows you to discover problems and question types. make changes to the survey, as needed, before distributing the survey to your actual participants. • For Multiple Choice and Matrix questions, click on the grayed-out numeric value to enter a value. This turns on Scoring for that particular choice. The default value is “1”. • For Text Entry questions, you can enter text and a score for potential answers. Click the “+” button to add additional answers and numeric scores (like New York City, NYC, N.Y.C., etc.). 3. Decide if you want to use the additional reporting options. • Show End of Survey Summary: Displays a score summary to the participant at the end of the survey. This includes total score, as well as percent correct. • Show Summary After Every Question: Displays a score summary to the participant after every question. This includes the total score for that individual question. For multiple questions on the same page, the next page will show multiple post-question summaries on the same page. Q-TIP -TIP Figure 6-10 Test Survey window. Q - T I P Q - T I P TO USE THE TEST SURVEY FEATURE: • Turn off the Scoring of a choice by going back to Scoring and clicking on answer choice text of the answer 1. Select Test Survey under the Advanced Options drop-down. - T I P choice that has been scored. 2. Enter the number of test responses you want in the Test Iterations text field. The default is “5”. • In most cases, you can also click the answer choice text to Turn On Scoring for that choice. 3. Determine if you want to use the additional options (optional). • Sometimes scoring is also referred to as grading. You can enter GradePercent and save it as an embedded • ALLOW UNANSWERED QUESTIONS: If selected, some questions might not receive a response. This is to data field in the Survey Flow for the received percentage of the potential total score. This is just on an simulate actual respondents who might not answer every question due to skipping the question or 118 | Chapter 6: Special Features Chapter 6: Special Features | 119

skip/display logic. • SHOW VERBOSE OUTPUT: This means additional information will be provided in the window above the options for each response entered. • ADDITIONAL URL PARAMETERS: This allows you to include embedded data fields with your responses. Information is entered in the following format: [field name]=[value]. Example: State=CA Figure 6-11 Import Survey dialog window when importing a .qsf file. Import Survey TO IMPORT THE QUALTRICS SURVEY FORMAT (.QSF): 1. The .qsf format is only available when you export the survey from the tool (see the Export Survey section below). 2. Under Advanced Options, select Import Survey. The Qualtrics team has worked very hard to make it so the Edit Survey tab is so easy to use you don’t need to import 3. Click Browse (or Choose File) and find the .qsf file on your machine. Q-TIP -TIP surveys. If you have a survey that you are trying to bring over from another survey software program, it is usually fastest 4. Click Import. to rebuild the survey in Qualtrics by adding in the questions and pasting in your question text. Q - T I P Q-TIP -TIP However, sometimes importing survey text is necessary. The Import Survey feature allows you to select a file on your Q - T I P machine and import that into the Qualtrics Survey Research Suite. When you select your file, a message will display saying, “This import will replace your entire survey and remove all Q - T I P - T I P responses.” This means if there are any existing questions in the survey already, they will be overwritten. This will also Q - T I P affect any existing data, so make sure you are importing into the correct survey. - T I P The text import method is a useful way to get the majority of a survey into the tool. Since not everything available within the tool is available as a formatting option with text files, odds are you will still want to do some formatting or adjusting to the survey after the import. IMPORTING A TEXT FILE (.TXT) THERE ARE TWO RECOGNIZED FILE FORMATS FOR IMPORTING FILES INTO THE RESEARCH SUITE: This format is best created in a text editor, like Notepad or a similar application. Word processors, like MS Word, can be used, but usually a text editor will function better. 1) Qualtrics Survey Format (.qsf): This format is available only when you export the survey from the Qualtrics There is a Simple Format and an Advanced Format option. The Simple Format is the easier, less specific format. The Survey tool. You may be working with this file type if another Qualtrics user has exported their survey as a .qsf Advanced Format is more specific and provides more control, but it is also more complicated to set up. and given it to you to upload. 2) Text file (.txt): This is a plain-text export that you might have generated from exporting your survey from another survey software program. Also, if your survey is not in a .qsf format, this is the only other acceptable file format for importing your survey questions. 120 | Chapter 6: Special Features Chapter 6: Special Features | 121

INSTRUCTIONS FOR SIMPLE FORMAT: Scale 2 The text file option is appropriate in an automated system, where you have a back-end program that automatically gener- Scale 3 ates .TXT surveys for you to import. To create a survey in the Simple .TXT format, a) Format questions. • A question begins with a number followed by a period (“.”). Choices are below the question text with a blank 4. This is a matrix multiple answer question. line between the question and the answer choices. [[MultipleAnswer]] • For Matrix questions: Answers are after choices with a blank line between. • Make a question multiple answer by using [[MultipleAnswer]] on the line just below the question text. Row a • Insert a page break by entering [[PageBreak]]. Row b b) Save as a .TXT file and import into Qualtrics. Row c Scale 1 HERE IS AN EXAMPLE OF A .TXT FILE FOR THE SIMPLE FORMAT: Scale 2 Scale 3 1. This is a multiple choice question. Every question starts with a number followed by a period. There should be a blank line between the question text and the choices. [[Block]] 5. What is your gender? a b Male c Female d Instructions for Advanced Formating: [[Block:My Block Name]] 1) Format questions. 2. This is a multiple choice multiple answer question. • The file must begin with the [[AdvancedFormat]] tag. [[MultipleAnswer]] • A question begins with the [[Question:]] tag, with the user type code appearing after the colon. • Available question types: MC, Matrix, TE, CS, RO, DB. a • MC = Multiple Choice b • Matrix = Matrix Table c • TE = Text Entry d • CS = Constant Sum • RO = Rank Order • DB = Text/Graphic (Descriptive Block) [[PageBreak]] • Choices start with the [[Choices]] tag and are one per line afterward. 3. This is a matrix question that has question text on multiple lines. As long as the text is no more than one line • Answers start with [[Answers]] tag and are one per line below it. below, it continues to be part of the question text. • Make question multiple answer using [[MultipleAnswer]]. It is a matrix question because it has two groups of choices. • Use [[ID:#]] to set the id of the question (shown as the export tag). Replace “#” with the numeric value. • Insert a page break using [[PageBreak]]. Row a • Insert a block with [[Block]] or [[Block:Name Goes Here]] to name the block. Replace “Name Goes Here” with Row b the block name to use. Row c 2) Save as a .txt file and import into the Qualtrics Survey Research Suite. Scale 1 122 | Chapter 6: Special Features Chapter 6: Special Features | 123

HERE IS AN EXAMPLE OF A .TXT FILE FOR THE ADVANCED FORMAT: [[MultipleAnswer]] This question is a matrix multiple answer question. Use the HTML break tag to actually have question text recognized as [[AdvancedFormat]] different lines. [[Question:MC]] It has lots of question text on multiple lines. [[ID:q1]] This is a multiple choice question. [[Choices]] a [[Choices]] b a c b c [[Answers]] d 1 2 3 [[Question:MC:MultipleAnswer]] [[ID:q2]] This is a multiple choice question multiple answer question. [[Choices]] a b Export Survey c d Exporting your survey is useful for keeping your own backup of the survey outside of the Qualtrics Survey Research Suite. [[PageBreak]] You can export your survey into the Qualtrics Survey Format (.qsf). This is a .xml file of your survey. You can also use this as a method for sending someone a copy of your survey, though you can use the Copy button on the My Surveys page to [[Question:Matrix]] copy it directly into their account as well. This question is a matrix question. It has text on multiple lines. EXPORTING YOUR SURVEY TO .QSF FORMAT: [[Choices]] Under Advanced Options, click Export Survey. A .qsf file will download to your machine. Row a Row b Row c [[Answers]] EXPORT SURVEY TO WORD Scale 1 The Export Survey to Word feature provides you with a .docx file compatible with Microsoft Word (Figure 6-12). This is Scale 2 useful for printing out paper surveys, as well as for collaboration, as you can email the file to clients to look at the survey Scale 3 with you. Also, because this document shows you how each answer choice is coding, downloading it can provide you will a key as you analyze your data. [[Question:Matrix]] 124 | Chapter 6: Special Features Chapter 6: Special Features | 125

Since it is a document, it can be edited as needed. Of course, any changes you make in the document you will want to Summary later make within the tool so the survey is up to date. This chapter completes the two sections in the book on how to build a great survey in Qualtrics. You will have noticed that this in this chapter we covered complex features that, with the exception of the Test Survey feature, you will use only for special cases. However, even if you are not going to be integrating with Salesforce or translating your survey into multiple languages, its important to know that these options are available. If you do find that you are going to use one of these special features, we hope that you have found the guidelines in this chapter useful as you implement them. After reading this chapter, you should have a clear idea of how to use Triggers, integrate with your Salesforce account, set up a Conjoint Analysis, translate your survey, set up Scoring and Import and Export. Figure 6-12 Available options when exporting survey to Word. In the next section of the book, you will learn everything you need to know about how to distribute your survey to respon- dents and analyze data through View Results. Good luck and feel free to revisit these building chapters whenever it’s time to create a new survey. You never know what you might learn. TO EXPORT YOUR SURVEY TO MICROSOFT WORD: 1. Under Advanced Options, select Export Survey to Word. 2. Choose which options you would like to use. All three options are selected by default. • Number Questions with Export Tags: Determines whether question numbers are displayed. The numbers are the Export Tags, which are the numbers appearing at the top left corner of each question. • Show Logic: Allows Skip Logic and Display Logic to be represented in the downloaded file. Branch Logic in the Survey Flow will not be shown. • Show Coded Values: This shows the numeric value of each answer choice. If Recode Values has been used, then the recoded answer choice value will be displayed. 3. Click Export. 126 | Chapter 6: Special Features Chapter 6: Special Features | 127

Chapter 7 Distribute Survey Building the perfect survey is useless if you don’t distribute it. Find out all your distribution options here. Qualtrics: The Complete Research Suite | 129

IN THIS CHAPTER YOU WILL LEARN HOW TO: This is an Anonymous Survey Link. Each participant uses the same link, so the Qualtrics Survey Research Suite doesn’t keep track of, or know who takes each survey. If you want to track respondents and identify who responded to which • Prepare a Survey Link survey, use the Email Survey option. • Email a Survey to a Panel • Access the Email History Traits of the Anonymous Survey Link: • Distribute through Social Media • Any responses collected through this link will be anonymous (No panel information is attached to the response). • Use the In-page Pop-up and Website Feedback options • Saves the respondent’s progress through cookies. If the respondent starts the survey, leaves, and comes back to • Use the Survey Director the same browser, they will start where they left off. • There is no limit to how many times this link can be used. Respondents can pass it on to other respondents Q-TIP -TIP to take. Q - T I P Distribute Survey Tab Q - T I P If you would like to prevent individuals from taking the survey multiple times through the anonymous survey link, you - T I P will want to enable Prevent Ballot Box Stuffing under Survey Options. This will put a cookie on the respondent’s browser, preventing them from The Distribute Survey tab contains all the options you need to distribute your survey. There are seven options you can choose from as you decide how you would like to collect data. Although you will most likely be using the anonymous survey link or the Email Survey options, it is good to become familiar with all of your distribution options. EMAIL SURVEY If this is your first time going to the Distribute Survey tab for the selected survey, you will need to first Activate your Clicking on the Email Survey icon presents an email form that allows you to conduct a mail merge and send a unique survey. Click the Activate your survey to collect responses link. This is the equivalent of clicking the checkbox on the My email and unique survey link to a list of people. This is probably the most common way to distribute your survey. Surveys page to activate the survey. The following sections contain details about each distribution method. As you read each section, take time to explore these options within your account. Click on the anonymous survey link to see what happens. Send a test distribution to yourself. Become familiar with these options before you start collecting responses. SURVEY LINK This is the easiest way to distribute your survey. You can copy/paste the survey link into an email or onto your website or blog. Figure 7-2 Email Survey Page. Figure 7-1 Survey Link button. 130 | Chapter 7: Distribute Survey Chapter 7: Distribute Survey | 131

ADVANCED OPTIONS: Traits of the Unique Link: • SURVEY LINK TYPE: The survey link can carry with it certain constraints related to respondent link • By default, each unique link can only be used once, which prevents spamming. sharing and respondent identification (single use, multiple use, and anonymous). • The data collected through the link is automatically attached to the respondents’ panel information. • INDIVIDUAL LINK: The default selection. This is a unique link for each member of the panel you • The link allows you to track responses in progress and send out reminder and thank you messages to send to. It can only be used once. The Reminder and Thank You options on the Email History page your contacts. will not be available with the individual link. • The link automatically saves the respondents’ data as they progress through the survey. • MULTIPLE COMPLETES PER LINK: This option is designed to obtain a “snowball” type sample, where people forward the survey link to others who might be qualified or interested in taking the same survey. When the response comes in it will be associated with the person who was originally TO DISTRIBUTE THE SURVEY THROUGH EMAIL SURVEY: sent the link through the panel. • ANONYMOUS LINK: This is the same link as the link found on the Survey Link page. Those who take 1. In the “To” area, select who you want to send the survey to. the survey through this link are considered anonymous within the results. The Reminder and Thank • Click Enter Email Address to paste in the list information. You can paste multiple rows and You options on the Email History page will not be available when using the anonymous link. columns at the same time and Qualtrics will recognize those distinctions. Using this option • EMAIL EXPIRES IN: The amount of time until the link expires. Once the link is clicked, this expiration date no automatically saves a panel with a date and time stamp as the panel’s name. longer applies. By default, the link expires in 60 days. The options are from 1-90 days. Alternatively, you can • Hover over My Library (or a Group Library) to find and select a panel, a sample from a panel, click Custom to specify an exact date and time when the link will expire. or an individual within a panel. • CHANGE THE TARGET RESPONSE SET: This allows you to change the response set responses from this • For information on importing a panel, see Chapter 8: Panels. distribution are saved in. If you select the option, you can change the Response Set using the drop-down. 2. In the “When” area, select the time you want to send out the survey. Under Custom, you can specify the exact You can create new Response Sets under Survey Options on the Edit Survey tab. Most people will not need to date and time you want the survey to be sent out. Your other options are to: use this option, so it is not recommended unless you specifically want to place your data from this panel in a • Send Now different place than the rest of the survey data. • Send in 1, 8 hours • USE EMAIL DISTRIBUTION LINK: This option is useful when you would like to generate unique links but do • Send in 1, 3, 7, 14, 28 days not want to send them out through our mailer. For this option, check the box for Use email distribution link • Custom: Select the date and time you want it to go out. Specify the time according and select Don’t send emails. If you select this option and Schedule Mailing, no messages will be sent to to your time zone. participants. Instead, in the Email History section, you’ll be able to click the Actions drop-down next to your 3. If necessary, adjust the “From Name” and “Reply-To Email Address.” These are automatically populated from mailing and select Download Mailing History to get a list of survey links. You can then send these links out the information set in your user account. through a Mail Merge in your own email account. 4. Enter a “Subject” line for your email. • DON’T SEND EMAILS (FOR MANUAL GENERATION OF SURVEY LINKS): This option is only available if you select 5. Enter your email message. Enter the message directly into the Rich Text Editor field. After editing, you will need Use email distribution link. This is useful if you need to get the unique links for sending through your own to save your message by clicking the Save or Save As button. email server. You can download the links from the Email History page. • If needed, click Load a Saved Message to select an existing message. This can be a message you used on a previous mailing, or a message created in your Message Library. You can edit saved When using this option, you will need to create a panel, but the panel does not need to contain real email messages. If you make changes, you will be prompted to click the Save button to the right side. addresses. You can put in [email protected] but still put in the real name of the respondents. When 6. If necessary, click the Advanced Options button to set or modify the behavior of your mailing and survey link. the links are generated, the names will be linked to the survey link but no emails will be sent out. Q-TIP -TIP 7. Click Schedule Mailing. This button will say Send Now if you select the Send Now option in the “When” area. Q - T I P Q - T I P Send Test Email allows you to send an email to yourself with your current settings in place without having to schedule the - T I P entire mailing. This way you can make sure everything is coming through correctly. This feature is optional. Also, the link Figure 7-3 Advanced Email Options. that is sent to you through Send Test Email will be an anonymous link. 132 | Chapter 7: Distribute Survey Chapter 7: Distribute Survey | 133

EMAIL HISTORY • DELETE DISTRIBUTION: Removes the record of the distribution from the Email History page. If the mailing has not gone out yet, it cancels it. If Qualtrics is in the middle of sending to a large panel, The Email History page is directly linked to the Email Survey page. When you schedule a mailing, you are automatically deleting the distribution will not cancel it. Also, if the mailing is already sent, this will not do directed to the Email History page. On this page you are able to see the basic information of your mailing as well as take anything to the distribution further actions with it (Figure 7-4). • Deleting the distribution is not recommended, especially if you’ve sent to it already. Once the distribution is removed, you can no longer schedule Reminder and Thank You messages. Figure 7-4 Email History table. SEND REMINDER OR THANK YOU Scheduling a Reminder or Thank You message is very similar to scheduling the initial invite mailing. Each option looks at the panel members and sends according to those who match certain criteria. There are eight columns of information contained in the Email History table. The Actions column is a menu of options. • STATUS: This refers to the various dots at the bottom of the page, which signify different statuses. • Clear: The mailing is scheduled to be sent. CRITERIA FOR REMINDER AND THANK YOU: • Orange: The emails are currently being sent. • REMINDER: Only sends to those who have not completed the survey. Those who started the survey but didn’t • Green: The mailing was successfully sent. finish, as well as those who never started the survey, will receive the Reminder. • Red: There was an error and no emails were sent. • Scheduled Reminders place a bell icon in the Recipient field of the Email History. • RECIPIENT: The name of the panel you are sending to. • THANK YOU: Only sends to those who completed the survey. It will not send to partial completes or those • SUBJECT: The subject line you entered when you scheduled the mailing. who did not start the survey. • DATE: The date and time the mailing is scheduled to be sent. If the mailing has already been sent, this column • Scheduled Thank You messages place a post-it note icon in the Recipient field. shows the time it was distributed. The time is set to your time zone. • EMAILS FAILED: Shows a count of total emails that were unable to be sent. The left value is the value of emails failed, while the right value is the total of emails in the panel (emails failed / total emails in panel). • This will not show the number of bounce backs. It will just show a count of emails that the mailer SCHEDULING A REMINDER OR THANK YOU: was literally unable to send. To see the specific emails, select Download Mailing History under the 1. On the Email History page, click the Actions button and click on Send Reminder or Thank You. Actions dropdown. 2. At the top of the message wizard, select whether you want to schedule a Reminder or Thank You. See the • SURVEYS STARTED: The number of surveys that were started from this specific distribution. criteria explanation above for more information. • SURVEYS FINISHED: Count of the surveys from this panel that have been completed. This will not include 3. In the When area, specify when you want the mailing to go out. This is just like the When area of the initial partially completed responses. invite mailing. • Actions: A menu of additional options. 4. Adjust the Name, Repy-To Email, and Subject fields. These fields are automatically populated by what • EDIT DISTRIBUTION: Select this option to edit the mailing and its settings before it is sent out. was used when the initial mailing was scheduled. If the mailing has already been sent, selecting this option will show the mailing’s settings as they 5. Enter or select message text appropriate for the message you’re scheduling. were when the mailing was sent. • Just like the initial invite mailing, you can enter a message here, or select one under the Load a • DOWNLOAD MAILING HISTORY: This downloads a .csv (comma separated values) file to be opened Saved Message menu. You will be prompted to save any changes you make to a message. in Excel. It contains each panel member’s basic panel information (name and email), as well as • For the Thank You, you can delete the default text (“Follow this link to the survey”), as you do not their status, survey link, and response ID (if they completed the survey). need to pipe in a survey link or opt-out link. • SEND REMINDER OR THANK YOU: Choose to remind panel members to take the survey, or thank 6. When ready, click the Send button to schedule your Reminder or Thank You. those who did take the survey for their diligence! See the section below for more information on scheduling Reminder and Thank You messages. 134 | Chapter 7: Distribute Survey Chapter 7: Distribute Survey | 135

SOCIAL MEDIA SMARTPHONE QR CODE The Social Media page provides an easy way for you to place your anonymous survey link into your social media networks. QR Codes are becoming more and more common with smartphones. Similar to a barcode, the provided QR code is a code The Research Suite integrates with a rather extensive list of social networks. You can even grab a QR (Quick Response) of your survey URL. The phone can scan the QR code and be automatically directed to your survey. Code for smartphone users. To use the Smartphone QR Code: 1. On the Social Media page, right click the Smartphone QR Code. 2. In the menu, select the option to Save the image. 3. Place the QR Code where smartphone users will be able to find it. Figure 7-5 Social Media button. SOCIAL NETWORKS The Qualtrics Survey Research Suite currently integrates with the following social networks: • Twitter • Buzz • Delicious Figure 7-6 Sample QR Code. • Facebook • Digg • MySpace • LinkedIn • StumbleUpon • Orkut • Blogger • Reddit IN-PAGE POPUP To use the Social Media feature: The In-Page Popup is a less-intrusive version of the traditional popup. It is called an “in-page popup” because it is actu- 1. Select the social network with which to integrate. ally a part of your webpage, rather than a separate window. It will not be blocked by pop-up blockers. 2. Enter an HTML Title. This is the name of the link that appears at the top of the browser tab. This would be something like “Product X Feedback Survey.” Each service will use this slightly differently. 3. Enter the Meta Description. This is to describe the content of the link. For example, in Facebook, it’s the light gray description appearing below the title of the link of video someone posts. Each service has slight differences. 4. Click the Save and Continue button. Figure 7-7 In-Page Popup button. 5. A window will open prompting you for the username and password credentials of the selected social Q-TIP -TIP media network. Q - T I P TO USE THE IN-PAGE POPUP: Q - T I P 1) Go to the Distribute Survey tab and click the In-Page Popup button. • If you’ve never been to this page before, click the Preview Popup button at the bottom to Each social network service has slight differences in their HTML Title and Meta Description fields. It is a good idea to run a see it in action. - T I P quick test beforehand to see how it is used on the selected network. 2) Adjust the Popup Text as needed. The default is “Please take a moment to participate in a survey.” 3) Adjust the Link Text as needed. This text will appear in the popup as a hyperlink. The default is “Click here.” 4) It is recommended that you click the More Options button to take advantage of the additional options and further customize your pop-up. 136 | Chapter 7: Distribute Survey Chapter 7: Distribute Survey | 137

• DISPLAY RATE: This is how frequently the popup displays itself to your site visitors. The default is 100%. Adjust the slider to change this. • DISPLAY AFTER: Once the page finishes loading, this is the amount of time before the pop-up displays. Drag the slider to adjust the time. Sometimes users only want to display the pop-up to those who spend more time on their site (e.g., 30 seconds as opposed to 3 seconds). Figure 7-8 Website Feedback button. • PREVENT REPEATED DISPLAY: Similar to Prevent Ballot-Box Stuffing, this uses a browser-based cookie to remember if the pop-up has been presented to someone already. This way you don’t have to present the pop-up to your visitors every time they visit. TO USE THE WEBSITE FEEDBACK BUTTON: • ANIMATE: Determines how the pop-up displays to the respondent. The default is to have the pop-up scroll in from the middle-left. You can have it scroll in from other locations, or not scroll in 1. Choose how you would like your link to appear. from anywhere. Here are your animation options: • White background with yellow stars. • Top-Left • Middle-Right • Black background with yellow stars. • Top-Center • Bottom-Left • Text link. Enter the text you would like to display. • Top-Right • Bottom-Center • Middle-Left • Bottom-Right 2. Click More Options to see additional options you can use to customize the Website Feedback button. • POPUP WIDTH AND POPUP HEIGHT: Adjust the size of the pop-up window scrolling across the a. CURSOR TOOL TIP: This is the text that displays when you hover your mouse over the feedback screen. The default is 400x300 (width x height). graphic or link. • SURVEY WIDTH AND SURVEY HEIGHT: Adjust the size of the survey window when someone clicks the b. POPUP SIZE WIDTH AND HEIGHT: This refers to the window that displays containing the survey pop-up link. The default is 900x600 (width x height). when you click the feedback button. 5) After changes are made, click Preview Pop-up and test out your survey to make sure it displays correctly. 6) When ready, click Add Pop-up to My Website to get the JavaScript for the pop-up. Use this code to place 3. When ready, click the Add Feedback Link To My Website button. This will give you the JavaScript you need the pop-up on your website or blog, or send it to your IT department to have them place it on your to post this link onto your website or blog. You can also send it to your IT department. Q-TIP -TIP organization’s site. Q - T I P Q - T I P The In-Page Pop-up will not remember your pop-up settings after you leave the page. If you want to keep track of the - T I P code, paste the code into a text editor, like Notepad, and save it to your computer. Survey Director WEBSITE FEEDBACK The Survey Director is a very powerful distribution tool. Through a single URL, you can set conditions controlling what is displayed to a visitor and when. The Survey Director was initially part of the Qualtrics Site Intercept product, but Qualtrics The Website Feedback option allows you to place a feedback button/link on your website, similar to what you see on bank- decided to open it up to every research suite user. ing and credit card sites. When the respondent clicks on the button/link, your survey will pop-up. In the top-right corner of the Feedback page, there is a preview of what your feedback button will look like on the page. Figure 7-9 Survey director button. 138 | Chapter 7: Distribute Survey Chapter 7: Distribute Survey | 139

With the Survey Director, you can post one link on your website or in an email, and then choose what that link will do. For • DAY: This allows you to check if the current day Is or Is Not the specified day of the week. instance, you could have the link point to a survey from Monday through Wednesday, and then point to a public report of • TIME: This allows you to check to see if the current time Is Before or Is After a specified time. the survey results from Thursday through Sunday. Time is specified in 24-hour format (HH:MM). • STATUS: Check to see if a Survey or Poll is active or not active before showing an item. For a high traffic website, place a single link on your website and then have the link direct your visitors to a different sur- • QUOTA: Check a quota and see if the quota’s value has been met, if it’s equal to a particular value vey (about different products or departments) for each day of the week (Figure 7-10). Then you could also display a public or if it is greater than or less than a particular value. report for each survey once it is finished collecting data. 4. Choose what to Link to. The options you can link to are the following: • SURVEY: Choose a survey in your account and have the Survey Director link to it. • POLL: Choose a poll in your account and have the Survey Director link to it. • PUBLIC REPORT: Choose a public report from one of your surveys and link to it. You will need to set up a public report in the View Results section in order to use this. • This is typically used to show your results after you’ve finished collecting the survey data. It is a good idea to use it in conjunction with a specific date and time. When you do this, you don’t have to manually make any changes later. The Survey Director will take care of it for you. • USER DEFINED URL: Redirect to any URL you choose. This is another useful option when you finish collecting data or if someone doesn’t match the criteria to take the survey. 5. If necessary, use the Click Here To Add Action Set button to add an additional Action Set. This makes it possible to address the situation where someone doesn’t match the previously specified condition(s). 6. Repeat steps 4 and 5 above as needed on any additional Action Sets. 7. When finished with the setup, click the Click here to generate link button at the top of the Survey Director. This gives you one URL that checks the logic across all Action Sets within the Director. Q-TIP -TIP Q - T I P Q - T I P • Assign Embedded Data to those matching the criteria of a particular Action Set: - T I P Figure 7-10 S et up a different survey for each day of the week. 1. Click the Embedded Data button at the bottom right corner. 2. Click Add Embedded Data. 3. Enter an embedded data field name in the Name text field on the left. 4. Enter a value for the field in the Value text field to the right. TO USE SURVEY DIRECTOR: 5. Use the “+” button to the right to add additional embedded data fields. 1. On the Distribute Survey tab, click the Survey Director button. 6. Click Save to save your embedded data assignments. • You can also add additional Action Sets by hovering your mouse over an existing Action set and clicking the • Click the Create New Director button to start. This automatically adds an Action Set to your green “+” button at the top right or bottom right. Director. The Action Set is the beef of the Survey Director. This is where you specify your logic and • Remove an existing Action Set by hovering your mouse over the Action Set and clicking the red “-” button what you want to display. You can add as many Action Sets as you need. to the right. 2. Give your Survey Director a name (field at top-left). 3. Click Add Conditional Statement to set logic controlling when the item below will be displayed. If you are using the Survey Director, odds are you want some logic in place, but this certainly isn’t a requirement. You can base logic on the following items: • DATE: You can check to see if the Date Is, Is Not, Is Before, Is After, Is or Is Before, Is or Is After, a specified date (YYYY-MM-DD). 140 | Chapter 7: Distribute Survey Chapter 7: Distribute Survey | 141

Summary There are many great options to choose from when you are ready to distribute your survey. If you would like to make your survey available to a large undefined sample or collect data through a “snowball” method, you can distribute your survey by posting the anonymous survey link on the Internet. The other popular distribution method is to send the survey to a pre- defined panel through the Qualtrics Mailer. You can carry this out by going to Email Survey and setting up the distribution. The following chapter, Chapter 8, will tell you everything you need to know about building a panel to use with the Qualtrics mailer. Qualtrics also provides a group of tools that make it easy for you to post your link on webpages and social media sites. Our Social Media, In-page Pop-up, Website Feedback, and Survey Director tools will help you get your survey noticed and aid you in collecting all the data you need to carry out your research. After you collect your data, you will want to view and analyze your data through the View Results tab. Information on the View Results tab, including how to view reports and download data, can be found in Chapter 9, View and Analyze Data. Chapter 8 Panels Building and maintaining a panel is all the rage. Check out the latest features that Qualtrics has for companies that create in-house panels. 142 | Chapter 7: Distribute Survey Qualtrics: The Complete Research Suite | 143

IN THIS CHAPTER YOU WILL ANSWER THE QUESTIONS: To create a new panel: 1. On the Panels tab, make sure you’re on the Panels page, then click the Create New Panel button. • What is a panel? 2. Provide a name for your panel in the Panel Name text field. • How do I create a panel? 3. Specify a Destination Category (like a folder) for your panel. This is optional. If you do not provide a category, • How do I manage my panels? it will be placed into the “Unassigned” category. • How do I create a panel sample? • If you would like to create a new category, type into the text field. • Select an existing category by clicking the blue drop-down arrow. 4. Click Create. This will automatically jump you to the Panel Members page. A panel is a mailing list you can create in Qualtrics through importing the contact information of your respondents. A Panel can include the recipient name, email address, and any additional information (Embedded Data) you would like stored with the panel members’ responses. The Panels tab is where your mailing lists are stored. The Panels tab is basically a library for your panels. In fact, you can have a Panel Library for a group (your company, department, or work group) so users can share panels. If you have access to multiple Groups or Libraries, just click the Current Panel Library button to select a different library. Figure 8-2 Panel Action Items. PANEL ACTIONS The Panels Tab Once your panel is created, you will see it listed in the Panels section. Next to each panel in your Panels section under Panel Actions is a list of actions that can be taken with your panel. The following is a detailed explanation of each. The Panels tab is like the My Surveys tab in that several functions can be performed within it. First, it is where you can EXPORT PANEL create panels (Figure 8-1). After you create some panels, you can see that each panel has associated Panel Actions icons next to them in the Panel Actions column. Export Panel allows you to export your panel as a .csv, .xml, or .html file. From the Panel Members page, you can click a panel’s name to view and edit information about a member of the panel. To export a panel: The Sample Management tab allows you to filter (select sample subgroups) to receive mailings from the Distribution tab. 1. On the Panels page, click the Export Panel button for the panel you want. 2. Choose a Format for the file. There are three options: • CSV: Exports a .csv file that is typically opened in Excel. CSV stands for Comma Separated Values. • XML: Exports a .xml file. This file type is typically used when importing to database applications. XML stands for eXtensible Markup Language. • HTML: Exports an html file that is typically viewed in a web browser. The data is placed into an HTML based table. HTML stands for HyperText Markup Language. 3. Choose if you want to Export Embedded Data. • Yes will download all embedded data. • No doesn’t include any embedded data fields in the download. • Only Specified Items expands the dialog window to include a text field for entering the field Figure 8-1 Create New Panel window. names of the specific embedded data fields you want to export. 144 | Chapter 8: Panels Chapter 8: Panels | 145

4. Choose a Subscription Status. This is referring to whether or not your panel members have opted out of 1. On the Panels page of the Panels tab, click the Send Email button next to the panel you want to email. receiving any more mailings. 2. Specify a From Name and Reply-To Email for the email to come from. • All includes everyone in the panel, regardless of Subscription Status. 3. Enter a Subject for the email. • Subscribed only includes those who have not clicked the opt-out link in the mailings you 4. Enter the email message text and use the Rich Text Editor for formatting. have sent them. 5. Click Send when you are ready to email your panel members. Your panel members will each be sent a • Unsubscribed only includes those who have clicked the opt-out link in the mailings you separate email. have sent them. 5. Click the Export button. ALERT: The Send Email option will not keep a record of the mailing. It is not like sending an email invite on the Email Survey page and is not to be used for that purpose. The Send Email may be useful for a pre-notification or other commu- nication to an ongoing panel you have organized. If you want to send out a survey invitation with a link to the survey, go to Q-TIP -TIP EMBEDDED DATA the Distribute Survey tab. Q - T I P The Embedded Data option loads a list for all embedded data fields and their associated values used in the panel. This Q - T I P can be a useful reference to make sure embedded data fields and values were imported correctly. If someone was not imported correctly, it will appear as a separate field or value within the list. With Send Email, you can use the piped text icon ({a}) to personalize the message with a name or other information - T I P (like embedded data). MOVE PANEL Selecting Move Panel will allow you to move the panel to a different library. PANEL MEMBERS To move a panel: The Panel Members page is where you get to see the details of your panel members (Figure 8-3). You can view their 1. On the Panels page of the Panels tab, click the Move Panel button for the panel you want to move. individual panel and embedded data information. This is the same page where you can import and update a list of panel 2. Under Destination Panel Library, select a library where you want the panel to be. members. 3. Specify a Destination Category (like a folder) for your panel. This is optional. If you do not provide a category, it will be placed in the “Unassigned” category. • Create a new category by clicking into the text field and typing in a category. 4. Select an existing category by clicking the blue arrow. 5. Edit the Panel Name, if needed. 6. Click Move. SEND EMAIL Send Email allows you to send a notification email to your panel. A separate email is sent to each panel member. This is separate from sending an email invitation and should not be used as such. See the explanation below for more informa- tion. To send an email to your panel that does not include a survey link: Figure 8-3 Panel Members page. 146 | Chapter 8: Panels Chapter 8: Panels | 147

All instructions in the Panel Members area are based on a panel being created already. If you need to create a panel, see • If the column headers are incorrect, click the menu at the top of each column and select the correct the Panels section for more information. heading. This is especially important for the panel fields (FirstName, LastName, and Email). Q-TIP -TIP 5. Click Import. Q - T I P IMPORT FROM A FILE Q - T I P • Depending on if you are using Windows or Mac OS X, Excel will call a .csv file something slightly different. - T I P Importing from a file (.csv) is the most common and the quickest panel importing method (Figure 8-4). • Windows: CSV (Comma Delimited) • Mac OS X: Comma Separated Values (.csv) • Some other spreadsheet applications will call a .csv file “Text CSV (.csv)”. • Since a .csv file is really just a text file, make sure all your data is on the same tab in the spreadsheet. A text file can’t handle the same formatting as a regular spreadsheet file type. • If your spreadsheet is not interpreted correctly and is all jumbled together in the preview, click Import Options. Try using a different Delimiter and/or Enclosure. Each time you make a different selection, the preview will reload to see if it is now loading correctly. • In some regions outside North America, Excel is set to use a non-comma delimiter when saving a .csv file. The system should recognize this, but if not, try using the Import Options. UPDATE PANEL MEMBERS Figure 8-4 Import From a File dialog. As you collect information on your panel members, you might want to reference that information in future surveys. Now you can use the update feature. To import a panel: 1. Go to the Panel Members page of the Panels tab and click the Import From a File button. To update a panel: • If you already have panel members in the panel, then click Import/Update Panel Members near the top of the page. The easiest way to do this is to download your existing panel first. Downloading your panel gives you a RecipientID a) Under Import to Panel, select a panel to import your list into. This will be selected column, which is what is used to determine if the panel member exists for updating or is a new panel member. Download already if you clicked on a panel on the Panels page or just created a new panel. your panels using the Export Panel option on the Panels page. b) Click Import/Update From a File. 1. Export the panel. See the Panels section for information on exporting your panel. c) Continue to follow the directions below. 2. Make any necessary changes to the panel members. ALERT: Be sure to keep the RecipientID column 2. Click Browse or Choose File and select the .csv file on your computer. in your sheet. a. If your file isn’t already saved as a .csv, you will need to save it as a .csv. To do this, go to File in 3. Save the updated spreadsheet (remember, it needs to be a .csv). the Excel toolbar and select Save As. Choose the file type as CSV (Comma Delimited). 4. Import the list. See the previous instructions on how to import a panel for more information on this. 3. Once you have selected the file, a preview of the first five rows of your spreadsheet will display. 4. Make sure the columns of your spreadsheet are being correctly interpreted. ALERT: If your file does not contain the RecipientID column, the Qualtrics Survey Research Suite will import the list as • If the columns are not displaying correctly, click Import Options and work with the options. completely new panel members. It will not recognize the information as an existing panel member for updating unless See the associated Q-tip area for more information. 148 | Chapter 8: Panels Chapter 8: Panels | 149

they have the RecipientID. If you accidently upload duplicates, you can use the Consolidate Duplicates feature to clean it IMPORT FROM A SURVEY up, but it is best not to let it happen in the first place. Let’s say you distributed a survey and in that survey you collected contact information from your respondents. With the Import From a Survey option, you could take that information and turn it into a panel (Figure 8-5). Import From a Survey lets you create new panel members or update existing panel members. ADD PANEL MEMBERS Adding panel members is a quick and easy way to copy and paste your list of contacts into the tool. It can be quite useful for shorter lists of panel members. This option can be a useful for small lists, but for larger lists you will probably want to use the import feature. To paste in a list of panel members: 1. First click on your panel from your panel list to have it open in the Panel Members section. 2. Click the Add Panel Members button. 3. In the Panel field, make sure the correct panel is selected. It will preselect whichever panel you chose to get to the Panel Members page in the first place. 4. Click the “+” button on the right side to add any additional columns. The first two will be optional panel fields that are less commonly used (External Data Reference, Language). All fields after will be in the form of Embedded Data. • Click the column header to edit it, if needed. Q-TIP -TIP 5. Paste in your list. Figure 8-5 Import From a Survey dialog window. Q - T I P Q - T I P To Import From a Survey: • Remember, you can copy your entire spreadsheet (all of your rows and columns) and paste it in all at once. 1. If you have no panels set up, go to the Panel Members page, and select Import From a Survey. - T I P 2. If you already have a panel set up with panel members, click the Import/Update Panel Members button The tool will be smart and recognize the different rows and columns. Just make sure your spreadsheet’s and select Import/Update From a Survey. columns are in the same order as what you specified when pasting. It will always start with Email, First Name, 3. Under Please select import type, specify if you want to Update Recipients or Create New Recipients. Last Name, External Data Reference, and Language. Leave blank any columns you don’t use. 4. Under Please select a survey, choose the survey containing the information to use in the panel. • Remember not to paste in your column headers from your spreadsheet. Those are taken care of in the headers 5. Under Response Date Range, enter a date range of data for the tool to reference. This is optional. of the Add Panel Members dialog. If no date is provided, it will look at all data for the survey. • The Add Panel Members option is actually the same as pasting in your panel on the Email Survey page when you 6. In the area below, choose how to populate the panel information. select Enter Email Addresses in the To field. a. In the Questions column, select a survey question containing information you would like to pull in. b. In the Question Field column, choose a choice or field. On a Text Entry Form question, this is the specific form field (First Name, Last Name). c. In the Field column, choose what area of the panel the data should be placed into. This will be Embedded Data, First Name, Last Name, Email, External Data Reference, or Language. 150 | Chapter 8: Panels Chapter 8: Panels | 151

d. Choose if you want to Import Labels. This refers to standard questions, like a multiple choice To view panel member history: question. For example, if it’s a yes/no question, the default is to pull in the value (1 or 2), so 1. Click the History button to the right of the panel member. selecting Import Labels will pull in the actual answer choice text (yes/no). • The Email History table shows the mailings that the respondents have been sent. e. Click Add to pull in additional fields and repeat these 5 (a-e) sub-steps again. • The Response History table shows when they actually responded to surveys. 7. When finished, click Import to create or update the panel members. To search for specific panel members: 1. Enter criteria into search fields at the top of the Panel Members page. The more criteria you enter, the more specific your search will be. MISCELLANEOUS PANEL MEMBER TASKS Q-TIP -TIP 2. Press the Enter button to start the search. You can also just press the Enter key on your keyboard. Now that you have panel members in your panel, you can work with the individual panel members and make changes, Q - T I P view their history, or even delete them. Q - T I P You can search across multiple panels by removing the panel name in the Panel search field. To Edit existing panel members: - T I P 1. Select the Panel from the Panels page and in the Panel Members page, click the Edit button to the right of the panel member (or click the panel member’s email address). 2. In the Edit Panel Member window, you can edit their existing information. Q-TIP -TIP SAMPLE MANAGEMENT 3. Click Save when finished. Q - T I P The Sample Management area allows you to filter your panel members into smaller groups (Figure 8-6). You can choose to Q - T I P schedule a mailing to a specific sample on the Email Survey page. • Unsubscribe allows you to opt panel members out of receiving any more emails from this panel, the same as if - T I P they clicked the Opt-Out link in the invite email. • Unsubscribed or opted out panel members will display a red dot to the left, as opposed to the green dot. • Language allows you to choose a language for email messages. If the translation is available for the message, it will be sent in that chosen language. • The RecipientID is the ID specific to that panel member. It is the ID mentioned earlier for updating panel members. To delete existing panel members: 1. On the Panel Members page, click the checkbox to the left of each panel member you want to delete. You can also use the All or None buttons at the top of the panel member list to select all or none of your panel members on the page. 2. Click the red Delete button at the top of the list of panel members. Figure 8-6 Sample Management dialog window. 152 | Chapter 8: Panels Chapter 8: Panels | 153

To create a new sample: Through the Research Suite, it is simple to create your panel and distribute your survey to it. Use the panel upload options 1. On the Sample Management page, click the Create New Sample button. available to you to make your contacts accessible in your account. 2. On the Panel button (top right), choose a panel to pull the sample from. If you were already looking at a panel on the Panel Members page, then that panel will be selected already. With the Panels tab you can choose to upload your contacts using a spreadsheet, if you are using a large panel, or you 3. In Sample Name, enter a name for your sample. can choose to copy and paste your contacts through the “Add New Panel Members” option, if you have a smaller distribu- 4. In Max Sample Size, specify the maximum number of panel members for the sample. The Max Sample Size only tion. After uploading your panel members, you can go to the Distribute Survey tab and under the Email Survey page, you takes effect if there are more panel members matching the criteria than the Max Sample Size. can select a panel to send your survey to. Once a panel is created, you can distribute any of your surveys to it. It is not • Click the Calculator button for help deciding on your Max Sample Size. You will be prompted connected to any one survey. to enter your desired number of responses and your expected response rate. 5. Click Add a Sample Condition to specify logic for the desired demographic of panel members. If you don’t In this chapter we also covered the benefits of creating a Panel Sample. If you would like to send the survey to a smaller specify a condition, it will just pull a random sample of panel members until it reaches your Max Sample Size, randomized sample of your panel, you can do this through Sample Management. You could also specify that you would like if possible. to create a sample out of only those respondents who have already taken the survey, those respondents that don’t belong 6. Choose the type of criteria you would like to use. to another sample, or respondents that have a specific embedded data value in the panel. • EMBEDDED DATA: Provide a Field Name, whether it’s equal to, greater/less than, and the value of the field. Using these panel features, you will be able to successfully get your survey out to your respondents and collect only the • RECIPIENT HISTORY: Set up a condition based off Last Survey Taken and the Last Email Distribution data you want to collect. Date. • RECIPIENT SAMPLE MEMBERSHIP: Set a condition based off whether the panel members are a Member or Not a Member of another sample of the panel. 7. Click the blue “+” button to the right to add additional logic to your condition. Doing so will allow you to use the And If and Or If logic. 8. When finished, click Generate Sample to filter the panel members according to the condition. You can make any edits as needed and click Refilter Samples to regenerate your sample. 9. Click Close to close out the Create Sample window when finished. Q-TIP -TIP Q - T I P Q - T I P After your sample has been filtered, you can click the Edit button to see the information for the panel members in the - T I P sample. You can also click the History button to see their panel history, like on the Panel Members page. Summary Good data collection is dependent on a good panel. When you distribute your survey to a panel in Qualtrics, all of the panel information is attached to the responses of the panel members taking the survey. From this, you can tell who has taken the survey and track their responses. 154 | Chapter 8: Panels Chapter 8: Panels | 155