Crowd Feedback: Utilizing wisdom of the crowd for quick insights from usability testing
Usability Testing

Published on June 25, 2020

Crowd Feedback: Utilizing wisdom of the crowd for quick insights from usability testing

Interested in more time-efficient and less expensive online usability tests? Let us introduce you to UXtweak's Crowd Feedback.

Imagine that you want to plan a simple and cost-effective online usability study with five respondents as the baseline. You’d like to have more respondents, but you don’t have enough workforce to process more.  Each respondent spends on the average 30 minutes to complete the tasks. When considering all five respondents, the testing would eventually take 2 hours and 30 minutes if you watch each testing sessions only once.  In order to properly process all your findings, you’re far more likely to re-watch recordings a few times. Thanks to UXtweak, you can simplify this process, save your time and resources. More specifically, UXtweak offers several ways to make your analysis more time-efficient, such as you can navigate through user actions on the timeline, find when the respondent’s talking in the volume chart, etc. However, this could also take some unnecessary time when analyzing all results.

What about having an access to summarized, high quality insights about transpired actions which happened during the usability testing, before you even had taken a look at any of the recordings? In this manner, you can conduct your user research even with limited resources, so you can recruit more respondents, conduct more tests testing, and spend less time spent on analysis. In UXtweak, we call it Crowd Feedback.

Welcome to UXtweak’s Crowd Feedback

This type of feedback is based on ‘the Wisdom of crowds’ which is achieved by accumulating many answers from different individuals making the results more accurate. Crowdsourcing can be seen as a mobilization of  crowds of people towards a certain goal, such as for solving problems or empowering citizens. User research is one of the many areas where crowdsourcing is really useful. Crowd Feedback is a tool that utilizes the crowd to generate feedback that’s accurate and ready to use.

So, what actually is Crowd Feedback?

To explain this term in a simple way, Crowd Feedback allows respondents to leave their feedback, vote for on each other’s feedback and make comments. When more respondents support a specific part of feedback, this parts gets more votes and ends up on the top.

It usually looks like this:

After the respondents they complete your UX study, the first respondents are asked to give ideas in the three following categories:

  • what they liked
  • what they disliked
  • what improvements they would suggest

Respondents can make 2 suggestions per category (to prevent all ideas coming from a single source) with the maximum of 10 ideas for each category. Once, there is at least one idea submitted, the other respondents can upvote for the ideas they strongly agree with as well as leave a comment to further clarify what they think, providing the needed explanation.

That’s the main gist of it. There are more details that you can adjust once you’re more familiar with the concept, such as the number of ideas you would like to collect, whether submitting ideas is optional or how many upvotes a respondent can give, etc. You can even include pre-submitted ideas of your own and see how many people support them. This can also help respondents understand what their own ideas should look like.

Other than that, run your usability study as you normally would. It’s highly recommended that you educate respondents about crowd feedback and its importance in the instructions, so respondents know what to do with it. A well informed and motivated respondent leaves more ideas and comments.

Once the data has been collected, go to your study’s result. You will find all your collected ideas there, prioritized by how many people agreed with them. In the Crowd Cloud, all the popular ideas will be large and in the center of tre cloud, while the minor ideas with fewer voices will be small and on the edges.

By clicking on an idea, you can see how many people supported it and what kind of comments were left. In this way, you can replay test sessions that are relevant to a specific piece of feedback.

All you need is in there. What is good and should be kept or tweaked. What is bad and needs to be redesigned. Even suggestions about improving user experience. All of that is organized, so now you can focus on your user research even with a limited budget.

Peter Demcak
Peter Demcak
June 25, 2020
All author's articles

UX enthusiast working at UXtweak as UX researcher and member of the UX research tool development team.

Free 14 day trial

Try Profesional plan with all features for free.

Bee

You might be interested in

Usability Testing Setting up remote usability studies doesn’t have to be hard. Try task-oriented testing.

Discover how to set up task-oriented usability studies for remote testing. With prepared tasks ready to go. Read more ...

UXtweak Team
UXtweak Team
July 7, 2020
Usability Testing How to use our Think-Aloud feature in your online usability tests

Read more to find out how you can implement Thinking-Aloud feature in your online usability tests in UXtweak. Read more ...

Peter Demcak
Peter Demcak
May 29, 2020
Usability Testing How to launch online usability testing of Axure prototypes

In this blog, we’ll discuss how you can set up remote UXtweak testing of your Axure prototypes. Read more ...

Peter Demcak
Peter Demcak
May 22, 2020

Stay informed

Subscribe for UXtweak news & useful UX tips and tricks

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.