Sitemap
Medium.design

Stories from Medium’s design team

--

This is a slightly edited version of a story originally published on Hatch (a version of Medium for Medium employees) on July 11, 2014. See Hatching Inside Medium for context on this collection.

Getting User Feedback

A guide for showing prototypes to users

Showing work in progress to users can be intimidating, but regardless of what stage the work is in, you will learn a lot, and it will almost certainly inform your priorities and give you a new perspective. Here’s a quick guide on how to set up your session with a user to get the most honest and realistic feedback.

Part 1 — Preparation

Before you start talking to your user, write down what questions you want answered. Some common questions are:

Do users discover that they can…?

Are they able to complete… without help?

Is this something they would use if available today?

Is this preferable to other ways they can do the same thing today (whether on Medium or another product)?

What are the top three things they liked about the prototype?

What are the top three things that were frustrating or missing from the prototype?

Once you have this, think about what mindset you want users to be in when interacting with the prototype. It’s important to give the user context, so they have a goal in mind when interacting with your prototype. A good setup gives you much more realistic and honest feedback. For example:

Imagine you’re waiting in line at your favorite coffee shop and have a few minutes to spare. You heard that Medium now has an app available for reading and had downloaded it to try. You open it up and see this…

Imagine you saw a Tweet on your computer from a friend that said… and you clicked on the link to see this…

Part 2 — The Interview

Before you start, make the user feel comfortable. It’s easiest if one person takes the lead in asking questions, with another taking notes. Here’s part of my usual spiel:

Thanks for coming in today. We’re constantly improving and trying new things, and getting your feedback is a really important part of that. This is going to be very informal. We want to show you some ideas we’re working on and will ask a lot of questions, but don’t feel like there’s a right or wrong answer. The more honest you are, the better. So tell us what you like, don’t like, or find confusing. This is all extremely valuable.

Then, take a few minutes to get to know your user. Are they a writer or an avid reader? How technical are they? This will help you interpret their feedback, especially when users give you conflicting feedback.

Get Tina Chen’s stories in your inbox

Join Medium for free to get updates from this writer.

When was the last time you used Medium?

What have you written on Medium?

How do you usually read Medium stories? On your computer, phone, tablet?

What is your favorite thing about Medium?

Tell them what to expect from the prototype.

We’re showing you some brand new prototypes today, so not everything will work, but try to use it the best you can, and I’ll let you know if something isn’t working yet.

And most importantly, remind them to think out loud.

While using this prototype, try to think out loud. It’s not natural, but the more you can tell me what you’re thinking as you think it, the more helpful your feedback will be.

You may have to remind them a few times during the session. Easy ways to do this are:

What do you think is happening now?

What is it you are trying to do?

What do you think this is?

And lastly, observe and resist the urge to help! This is really hard, but try not to lead users to doing what you want them to. If there is a tab called “Trending” don’t ask how they would see what is trending. Instead ask “What if you wanted to see what the most popular things are?”

Part 3 — Notes and Summary

During the session, it’s useful to have someone taking notes. Also, it’s efficient to write up a summary immediately afterwards before you start forgetting what users said. I like to make a list of items for each of these categories.

  1. What worked ☺
  2. What didn’t work ☹
  3. Immediate things to change
  4. Other ideas and insights

And that’s it! Now go talk to some users.

--

--