Imagine that you want to plan a simple and cost-effective online usability study with five respondents as the baseline. You’d like to have more respondents, but you don’t have enough workforce to process more. Each respondent spends on the average 30 minutes to complete the tasks. When considering all five respondents, the testing would eventually take 2 hours and 30 minutes if you watch each testing sessions only once. In order to properly process all your findings, you’re far more likely to re-watch recordings a few times. Thanks to UXtweak, you can simplify this process, save your time and resources. More specifically, UXtweak offers several ways to make your analysis more time-efficient, such as you can navigate through user actions on the timeline, find when the respondent’s talking in the volume chart, etc. However, this could also take some unnecessary time when analyzing all results.
What about having an access to summarized, high quality insights about transpired actions which happened during the usability testing, before you even had taken a look at any of the recordings? In this manner, you can conduct your user research even with limited resources, so you can recruit more respondents, conduct more tests testing, and spend less time spent on analysis. In UXtweak, we call it Crowd Feedback.
Welcome to UXtweak’s Crowd Feedback
This type of feedback is based on ‘the Wisdom of crowds’ which is achieved by accumulating many answers from different individuals making the results more accurate. Crowdsourcing can be seen as a mobilization of crowds of people towards a certain goal, such as for solving problems or empowering citizens. User research is one of the many areas where crowdsourcing is really useful. Crowd Feedback is a tool that utilizes the crowd to generate feedback that’s accurate and ready to use.
So, what actually is Crowd Feedback?
To explain this term in a simple way, Crowd Feedback allows respondents to leave their feedback, vote for on each other’s feedback and make comments. When more respondents support a specific part of feedback, this parts gets more votes and ends up on the top.
It usually looks like this:
After the respondents they complete your UX study, the first respondents are asked to give ideas in the three following categories:
- what they liked
- what they disliked
- what improvements they would suggest
Respondents can make 2 suggestions per category (to prevent all ideas coming from a single source) with the maximum of 10 ideas for each category. Once, there is at least one idea submitted, the other respondents can upvote for the ideas they strongly agree with as well as leave a comment to further clarify what they think, providing the needed explanation.
That’s the main gist of it. There are more details that you can adjust once you’re more familiar with the concept, such as the number of ideas you would like to collect, whether submitting ideas is optional or how many upvotes a respondent can give, etc. You can even include pre-submitted ideas of your own and see how many people support them. This can also help respondents understand what their own ideas should look like.
Other than that, run your usability study as you normally would. It’s highly recommended that you educate respondents about crowd feedback and its importance in the instructions, so respondents know what to do with it. A well informed and motivated respondent leaves more ideas and comments.
Once the data has been collected, go to your study’s result. You will find all your collected ideas there, prioritized by how many people agreed with them. In the Crowd Cloud, all the popular ideas will be large and in the center of tre cloud, while the minor ideas with fewer voices will be small and on the edges.
By clicking on an idea, you can see how many people supported it and what kind of comments were left. In this way, you can replay test sessions that are relevant to a specific piece of feedback.
All you need is in there. What is good and should be kept or tweaked. What is bad and needs to be redesigned. Even suggestions about improving user experience. All of that is organized, so now you can focus on your user research even with a limited budget.
