This article will give you tips and advice about writing the most effective usability testing questions for your research. We will explain why it is important to ask good and effective questions and how to do it. Let’s dive in.
Why is it important to ask the right questions?
The role of usability testing is to find issues, technical difficulties, bugs, and errors. Those mistakes wouldn’t be exposed by testing because respondents will focus on the inaccuracy of questions and task instructions. Incorrect or insufficient wording can lead to inaccurate results of testing. The attention of respondents should be on task, not syntax errors of the task. Otherwise, it’s a loss of finances, time, and energy.
Right questions can lead to the most accurate answers which represent how your product is perceived by the audience. Good questions can identify issues or difficulties with the design but also how are people interacting with the design. Let’s say that you added a button to your design that will make certain processes easier. Is the function of the button understood by the users? Is the button really making their life easier?
How to write a good usability testing question?
When writing questions for tests, one could have a feeling that writing simple sentences is really hard. We understand your concerns. Sometimes even UX professionals have a feeling that their native language is some foreign language. Asking the right usability testing questions is the art of language.
Questions should be:
- short and clear
- well defined
- without complicated grammar or syntax
- no suggestive questions
What type of questions ask and when?
Let’s talk about a theory first. There are two kinds of questions that you can ask your respondents
- Open-ended questions: There is no suggestion of the answer, you can ask about reasons, feelings, opinions (What is your opinion.., What do you think about..). You will receive rather qualitative data.
- Closed questions: scales, numbers, choosing one option (multiple choice questions A., B., C., on the scale from 1-5) and therefore, quantitative data.
Enough of theory and back to real life. Testing has various phases and each phase requires a different set of questions. With UXtweak Website Testing, you can prepare questions that would be asked before and after the study and even right after the task. Here are 4 tips on how to do it and when.
Screeners will help to select the most ideal testers based on one or very few questions. Why do you need to ask questions before the actual testing? The role of screeners is to set boundaries, who do you need, what kind of respondents do you need for the test? What characteristics should they have?
Sometimes you need to ask only one question to find out the right respondents, such as: are you using *insert name of the bank product*? The answer is simple: yes or no. On the other hand, some situations require a deeper selection of respondents. Light some candles, pour a glass of wine, and ask questions like: How old are you? What is your occupation? What is your highest level of education? Did you get positive answers? Then you found the love of your life. I mean ideal respondent. You can read other tips for successful recruiting of the right respondents in our blog section.
PRO TIP: Think about those who should be included in the test, but also those, who should be excluded: such as people under 18.
The main aim of the pre-test is to understand the background of respondents. In the case of moderated testing, you have a chance to know your respondents and ask questions regarding their current mood or thoughts. You can get to know your testers. The role of a pre-test is not asking basic questions- quantitative data, but rather qualitative data. It’s important information that can influence the final result. The pre-test can be in a form of an interview (moderated testing) or a questionnaire (unmoderated testing).
You can ask questions regarding brand awareness or the way how respondents interact with the product: Do you know this brand? Have you ever brought anything from this brand? How often do you use internet banking? What kind of device are you using while using internet banking?
3. D-Day: Test day
Asking questions during testing is the domain of moderated testing. It means that the researcher is asking questions while respondents are completing the task. The main goal is to collect information about the intentions of respondents, why they did a certain thing.
Testers are sitting in a room with the device working on the task. They are focused on the task so you have to think twice about questions. When conducting a moderated test, be aware of the wording. Try to use simple questions without suggestions, that would lead to a certain action. Don’t ask questions that would influence the behavior of respondents. You can learn more about how to write effective tasks for your usability testing here.
You can see the behavior of respondents- they are clicking on buttons, their body language, facial expressions, but what is happening in their mind? Questions will support respondents to verbalize their mental processes, to be authentical, their inner monologue. This can be supported by questions such as: What do you think about it? What is your opinion about this?
You can ask questions about personal opinion such as: What did you think about the design of the product? What did you think of.., I see that you clicked on this item. Could you tell me why you did that?
Tasks are finished, you have data from the tests in your hands. However, there is still some room for additional questions. If there is a possibility to reach respondents after the test, don’t hesitate and ask them some questions. This is a great way to find out what is the authentic impression directly of the task and the design. Give them enough time and space for expressing their thoughts, positives, or limitations they experienced with your product.
In the case of moderated testing, researchers can invite respondents to discuss their impressions. After the unmoderated usability testing, you can send questionnaires with open-ended questions. You can ask questions like: What is your opinion about the product? Was the task easy? Would you recommend the product to your friends?
You get what you ask for
Asking good questions leads to high-quality answers. It’s easy. You can gain valuable insight on the design and overall impressions, opinions about your product with effective questions. Did your expectations meet reality? Or in other words, is this cool gadget that you added to the design that cool for users? Ask a good question and you will find out.