<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Franziska Roth on Medium]]></title>
        <description><![CDATA[Stories by Franziska Roth on Medium]]></description>
        <link>https://medium.com/@franziska.susanne.roth?source=rss-3b5c830807a6------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*zKjRObm68gTYizZ4Mgrngg.jpeg</url>
            <title>Stories by Franziska Roth on Medium</title>
            <link>https://medium.com/@franziska.susanne.roth?source=rss-3b5c830807a6------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 13:54:51 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@franziska.susanne.roth/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Written all over your face]]></title>
            <link>https://medium.com/zalando-design/written-all-over-your-face-how-tracking-the-emotions-of-users-can-be-scary-and-fascinating-at-c3d66b9ace6d?source=rss-3b5c830807a6------2</link>
            <guid isPermaLink="false">https://medium.com/p/c3d66b9ace6d</guid>
            <category><![CDATA[ux]]></category>
            <category><![CDATA[user-research]]></category>
            <category><![CDATA[advertising]]></category>
            <category><![CDATA[product-design]]></category>
            <category><![CDATA[emotions]]></category>
            <dc:creator><![CDATA[Franziska Roth]]></dc:creator>
            <pubDate>Mon, 17 Jun 2019 10:31:42 GMT</pubDate>
            <atom:updated>2022-03-31T14:09:48.652Z</atom:updated>
            <content:encoded><![CDATA[<h3><strong>Written All over Your Face</strong></h3><h4><strong>How tracking the emotions of users can be scary and fascinating at the same time</strong></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*B53b17mz639rIAux2TscFg.jpeg" /><figcaption>Illustration by <a href="https://www.instagram.com/notflipper/">Not Flipper</a></figcaption></figure><p>In one of Zalando’s most successful advertising campaigns, <a href="https://www.youtube.com/watch?v=tHk42otbSNQ"><em>Scream for Joy</em></a> (2012), we highlighted the excitement that the delivery of a new pair of shoes can bring. While we are still trying to live down the legacy of that campaign, it does highlight the emphasis Zalando has always put on inspiring emotion in our customers.</p><p>Shopping for clothes can be a highly emotional experience. There’s happiness<em>,</em> ‘<em>This is exactly what I was looking for!’. </em>There’s frustration,<em> ‘I can’t believe my size is sold out’. </em>There’s insecurity, ‘<em>I’m not sure if this color is right for me’. A</em>nd there’s even anger, ‘<em>I just can’t make this trend work for my body type’.</em></p><p>We try to ignite moments of happiness in our users throughout the entire shopping experience, while also trying to meet any concerns and frustrations that might be encountered along the way. Problem-solving is often accomplished by appealing to customer’s rationality…helping them to better understand sizing or showing how to combine outfits, for example. Yet, most decision-making is emotional [1], not rational, and we’ve come to realize we need to learn more about how we measure and assess emotions related to online shopping behavior.</p><blockquote>…how might we track users’ emotions at scale in real-time while they are actually using Zalando, allowing us to immediately react to their emotions?</blockquote><p>After I pitched the opportunity in one of Zalando’s hackweeks, it became part of our innovation accelerator. We sought to find a way to measure emotions in an automated manner in order to personalize the experience. A customer’s browsing experience would not be based simply on past behaviour, but also on a comprehensive understanding of what they actually love. For this, I got to lead a team of research engineers, software engineers, and designers for the time of our sprints (<em>Image 1</em>). In those sprints, we asked ourselves: how might we track users’ emotions at scale in real-time while they are actually using Zalando, allowing us to react immediately to their emotions, taking personalization and communication with our users to the next level?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*XDEt-kRjsy8EpsiK" /><figcaption>Image 1: The team during one of our Design sprints</figcaption></figure><p>The first obvious step was to tackle the data and assess its quality. But, since tracking emotions comes with some privacy concerns, we also wanted to dig deep into the fears associated with tracking technology. Therefore, we also conducted qualitative interviews in our user research lab.</p><p><strong>The Technical Setup and Prototype</strong></p><p>Before digging into the results, I would first like to discuss the technical setup. The first challenge we faced was deciding on what technology should be used to track emotions, and settled on facial recognition (headbands would be too intrusive and wristbands wouldn’t give an accurate insight into what emotion we were dealing with).</p><p>Due to time limitations, we decided to use an Amazon algorithm that analyses a person’s facial micro-expressions. It clusters emotions (happiness, anger, sadness, disgust, etc.) based on visible expressions, and then provides a confidence score on the accuracy of the clustering.</p><p>We started by asking users to browse Zalando in our user research lab while being recorded with the laptop camera. Via a Chrome extension, we connected to Amazon Web Services and used Amazon’s API to detect emotions in the images. The API in turn revealed the emotional data in real-time back to our prototype, a dashboard that displayed changes based on the emotions users demonstrated when viewing particular products (<em>Image 2</em>). We conducted six interview sessions lasting about 45 minutes. Interviewees were asked to first shop for a gift, and then something for themselves.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/0*-I5OZNL1DekhzSzv" /><figcaption>Image 2: Our Prototype Setup</figcaption></figure><p>We created the emotion dashboard so we would be able to observe how users interacted with the data (<em>Image 3</em>). Did they find it scary or uncomfortable to see their emotions displayed? Did it make sense to them? We had hypothesized that tracking emotions could provide a similar benefit to tracking activities, like running, for example. Users will give up access to their personal data in order to get something back.</p><p>For the sake of simplicity we displayed only the products associated with positive emotions, making the dashboard a sort of enriched wishlist<em>. </em>Due to technical reasons we didn’t focus on negative emotions…we collected this data but didn’t share it with the users.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/0*C2isZlNYk25eWByf" /><figcaption>Image 3: Emotion Dashboard</figcaption></figure><p><strong>THE RESULTS</strong></p><blockquote>More data can lead to more noise, which is why it is necessary to enrich, and thereby humanize quantitative data with quotes, stories and other data points.</blockquote><p><strong>Emotions observed</strong></p><p>Before we digged into the tracking data, we first wanted to see which emotions we can observe in an interview without technology. <em>Image 4 </em>illustrates the teams’ observations of facial and verbatim expression from several interviews, and does not include tracking data. It covers the journey from the Homepage to the Product Catalog to a Product Detail Page on the Zalando website. Positive emotions are expressed in green, negative in blue.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*aL_haT2EBOlV6jY6ecH_iA.png" /><figcaption>Image 5: Emotion Journey 1.0</figcaption></figure><p>It is important to note how many up and down curves are present. Human emotions can change in milliseconds, and can also be mixed…meaning researchers’ visible assessments may not always be entirely accurate. During decision-making moments in the product catalog or on the product detail page, emotional changes were particularly pronounced.</p><p>Next, we looked at our tracking data. <em>Image 5 </em>shows a sample of our tracking data for <em>happiness</em>. Each line represents a user, with the left axis depicting the likelihood that the respective emotion (happiness in this case) was actually visible in the image. The horizontal axis shows duration of the session. The lines in this graph look more extreme than those depicted in the human observation as shown in the <em>Emotion Journey Map 1.0</em>, supporting the point that emotions can change in milliseconds.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/0*P5_0RDL4Gc4KhDg7" /><figcaption>Image 5: Tracked Happiness</figcaption></figure><p>In <em>Image 6</em>, we flattened the data in order to show it in a similar format to <em>Emotion Map 1.0</em>. What we ended up with is likely closer to the “truth” of what actually occurred. Removing the extremes, the data became less dispersed than was shown in <em>Image 5</em>. More data can lead to more noise, which is why it is necessary to enrich, and thereby <a href="https://medium.com/zalando-design/the-numbers-game-3dde6ae5ed15">humanize quantitative data</a> with quotes, stories and other data points (e.g., where a person is from, what they care about, what their motivations were, etc.). By humanizing data we are given a more accurate interpretation and, in turn, more actionable data.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/0*On1qI2jGbL_bMTmu" /><figcaption>Image 6: Emotion Journey 2.0</figcaption></figure><p><strong>User Reactions</strong></p><p><em>“Oh yeah — the time I spend there — true. It makes sense.”</em></p><p><strong>Users trusted the results</strong>, because OMG — it’s science! Several users, for instance, were unclear how to interpret the dashboard, but once they saw the graph, even if they didn’t particularly understand it, were convinced of the result.</p><p>It was also remarkable that even though we told users at the beginning of the session that we would be tracking their facial expressions, they still thought we used other methods to reach our results: eyetracking, measuring their “decisive clicks” or time spent on page, researchers analyzing video recordings in real time or listening in on them.</p><p><em>“How did you..? This is exactly the thing which I had in mind. How did you know?”</em></p><p><strong>Users felt understood</strong>, and were often shocked at how right the algorithm was in guessing their preferred products. This was visible when they scrolled through the emotion dashboard and commented on the products shown and order in which they were displayed.</p><p><em>“My face belongs to me.”</em></p><p><strong>Privacy concerns were less pronounced than anticipated. </strong>We expected a strong backlash from our scenario, even in a lab setting. But surprisingly, even our most critical user (who uttered the quote above) reported that she had forgotten about the emotion-tracking after a while.</p><p>Of course, privacy concerns that may or may not be expressed in a lab situation might look very different in the wild.</p><p><strong>A QUESTION OF ETHICS</strong></p><blockquote>No matter how much we love data or curious we may be, we always need to ask, “is this really best for the user?”.</blockquote><p>Within our team we spoke a lot about whether our research was ethically right or wrong. On the one hand, the machine was just doing what people do all the time: reading the emotions others display to the outside world. The data was beautiful really — there have been many times in my life I would have preferred such data to self-reports. And we had so many people from our personalization, advice and inspiration teams asking for the data, that there was an obvious need for us to better understand our users on an emotional level.</p><p>But, at times, it also felt as if we were overstepping a boundary. We encountered a clash between curiosity and the wish to do something good with the new data (ease user pain, create joy), with what we felt might be an intrusion into one of the last personal facets not yet being measured at scale: emotions.</p><p>I don’t have an answer to this ethical quandary, but I do know that as researchers we must be the vanguard of users in these conversations. No matter how much we love data or curious we may be, we always need to ask, “is this really best for the user?”.</p><p>As user research and design are no longer “just” about UI and UX, but also about algorithms and tracking and analyzing data, we need to take a step back and reflect on the balance of providing a great user experience while also protecting users from the seeming insatiable hunger for data.</p><p>[1] See e.g., <a href="https://www.routledge.com/Emotions-A-Social-Science-Reader-1st-Edition/Greco-Stenner/p/book/9780415425643">Greco &amp; Stenner (2008)</a> for an overview of how emotions influence decision-making.</p><p><a href="https://medium.com/zalando-design/the-numbers-game-3dde6ae5ed15"><em>Dr. Franziska Roth</em></a><em> is a senior user researcher with a quantitative focus for Zalando.</em></p><p><em>Thanks to Amicis Arvizu, Dr. Géraud Le Falher, Adrian Dampc, Francesco Mucio, Chris Szafranek, and Philipp Erler for joining and/or mentoring this project.</em></p><p><em>Thanks to </em><a href="https://medium.com/zalando-design/introducing-the-design-maturity-series-988a084c3cfb"><em>Eileen Bernardi</em></a><em> for her support on writing this story.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c3d66b9ace6d" width="1" height="1" alt=""><hr><p><a href="https://medium.com/zalando-design/written-all-over-your-face-how-tracking-the-emotions-of-users-can-be-scary-and-fascinating-at-c3d66b9ace6d">Written all over your face</a> was originally published in <a href="https://medium.com/zalando-design">Zalando Design</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Zalando’s Maturity Model: An Origin Story]]></title>
            <link>https://uxplanet.org/zalandos-maturity-model-an-origin-story-bac36e9ee458?source=rss-3b5c830807a6------2</link>
            <guid isPermaLink="false">https://medium.com/p/bac36e9ee458</guid>
            <category><![CDATA[user-experience]]></category>
            <category><![CDATA[ux]]></category>
            <category><![CDATA[design-maturity]]></category>
            <category><![CDATA[product-design]]></category>
            <category><![CDATA[user-research]]></category>
            <dc:creator><![CDATA[Franziska Roth]]></dc:creator>
            <pubDate>Tue, 09 Oct 2018 10:07:30 GMT</pubDate>
            <atom:updated>2018-11-12T09:34:57.697Z</atom:updated>
            <content:encoded><![CDATA[<p><em>How we created a measure to demonstrate the impact of design</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*woqHGZ_AgLEfMbHjodIoYg.png" /><figcaption>Illustration by <a href="https://www.instagram.com/notflipper/">Not Flipper</a></figcaption></figure><p>When the design and user research teams initiated the discussion about measuring design maturity at <a href="https://medium.com/zalando-design">Zalando</a>, there were more questions than answers. It was apparent that product design and user research had an impact not only on our product, but also our work environment. The teams could look at customer satisfaction to gauge our impact on the product, but how could we measure designers’ impact on the overall work environment? And how could we identify which factors influenced the extent of our impact?</p><p>We* tried several of the available maturity models and scored well for overall design maturity, but we wanted to know more — how could we measure maturity on a unit or team basis? And how could we measure the impact product design and research has on the way other Zalandos think and act?</p><blockquote>…how could we measure designers’ impact on the overall work environment? And how could we identify which factors influenced the extent of our impact?</blockquote><p>With these questions in mind we embarked on a journey to discover the best way to measure design maturity at <a href="https://medium.com/zalando-design">Zalando</a>, how to derive the value of design as a capability and finally, how to measure progress over time in the various parts of the business.</p><p><strong>The Inspiration</strong></p><p>The measuring and benchmarking of design maturity has been an ongoing topic within the larger design community. One of the most well-known models is Nielsen’s model of corporate UX maturity (see <a href="https://www.nngroup.com/articles/ux-maturity-stages-1-4/">here</a> and <a href="https://www.nngroup.com/articles/ux-maturity-stages-5-8/">here</a>). This and other “early” models primarily seek to measure maturity on an organizational level, using several stages of maturity based on the capabilities an organization demonstrates (e.g., whether a dedicated usability team exists). For an overview of existing models see <a href="https://www.slideshare.net/Hienadz.Drahun/ux-maturity-models">here</a>.</p><p>While these earlier models are useful for giving us a birds-eye view of the development within an entire organization (no maturity vs. very mature), they are not granular enough when it comes to identifying maturity and non-maturity levels among individual teams. This latter measurement is particularly interesting for us here at Zalando given that design and research capabilities are not evenly distributed across the organization. Therefore, we would expect different maturity levels across the company which cannot be demonstrated with an approach that only shows the organization as a whole.</p><p>Newer design maturity models or measurements of customer centricity tend to look at the level of innovation in companies, and focus more on the individual level (e.g. <a href="https://www.slideshare.net/Hienadz.Drahun/ux-maturity-models">Artefact’s Design Maturity Survey </a>or <a href="https://creativedifference.ideo.com/#/login">IDEO’s Creative Difference Survey</a>). Using surveys that ask individuals about their attitudes and behaviors, and matching this data with information about organizational structures, gives a fuller picture of individual maturity levels and the settings in which they evolve. <a href="https://www.slideshare.net/UXSTRAT/ux-strat-europe-2017-andrea-picchi-embedding-design-thinking-at-sony-to-accomplish-business-strategy">Sony’s Design Driven Culture Approach</a> is an even newer concept that measures maturity (although in the context of company culture) by focusing on the thinking and doing of individuals as a indicator of overall design maturity. This model also tends to focus on the organizational and spatial structures that enhance maturity.</p><p><strong>The Approach</strong></p><p>Based on our desk research we were able to to compose a set of assumptions that guided our search for a design maturity model at Zalando:</p><ol><li><em>Overall design maturity is thought to lead to better and more human-centered products thereby increasing customer satisfaction and revenues.**</em></li><li><em>The values and purpose with which product designers identify will manifest in their daily work and communications, thereby influencing the non-designers working around them.</em></li><li><em>Proximity is key — the closer and longer one works with a designer, the greater the impact.</em></li><li><em>The more a non-designer can think and act like a designer, the more the non-designer will be able to use designers’ skill to address strategic questions — and earlier involvement of design thinking will lead to more customer-centric products.</em></li></ol><p>Compiling these assumptions made it clear that our model should combine measurements of organizational set-ups in which design thrives (which we know from existing maturity models), with measurements of individual maturity. With regards to individual maturity we made the decision not to simply measure the maturity of individual product designers, but rather all members of the organization, regardless of job title. For this, we needed a standardized survey.</p><blockquote><em>Overall design maturity is thought to lead to better and more human-centered products thereby increasing customer satisfaction and revenues.</em></blockquote><p>With the use of a survey, we could learn how our design and research work influences the thinking and doing of our fellow Zalandos over time. However, we weren’t big fans of the buzzwords “thinking and doing”, and therefore decided to rename <em>thinking</em> to <em>design mindset</em> and <em>doing</em> to <em>design excellence.</em> Our next challenge then, was to define the measurement for design mindset and design excellence, as well as the organizational set-ups that should have an impact, as defined in our assumptions.</p><p><strong>Our measures</strong></p><p>Because the survey’s content would have to reflect the work and values of the <a href="https://medium.com/zalando-design">product design team</a>, we knew we would first have to identify the purpose and capabilities that unite the designers and see how these could be translated into the thoughts and behaviors of non-designers. Luckily for us, these capabilities are clearly defined as part of the design job family at Zalando, and we were able to use them as our starting point. Based on this we could identify empathy, craft, experimentation, and sharing as central components of our measurement. These terms are also part of our design purpose statement: <em>We combine empathy, science and creativity to make engaging and joyful user experiences.</em> This added an even stronger point of using them as our basis for defining the dimensions we wanted to measure.</p><p>Our next step was to operationalize these capabilities and bring them to life in a measurement. For that, we thought about how each quality manifests itself in the designers themselves, and how a high maturity level in designers could manifest in non-designers’ mindset and excellence by working alongside them.</p><p>When measuring empathy, for example, we created survey questions concerning the following:</p><p>a) 360 degree view of users by leveraging different kinds of data.</p><p>b) challenging biases in your work (especially those about your users).</p><p>c) having the curiosity to really understand a problem.</p><p>We’ve found these behaviors to be standard for designers and researchers, and also consider them desirable and achievable for non-designers and non-researchers. One way of assessing these qualities in non-designers, for example, is to ask them when they last interacted with users.</p><blockquote>…by measuring maturity on a individual level, while also tracking the organizational structure individuals are tied to, we are able to identify opportunities for improvement.</blockquote><p>After this exercise within each of our dimensions, we developed an initial survey with A LOT of questions. We ran it as a pilot in paper and pencil form — directly interacting with participants in order to gather any feedback and reactions. We analyzed the quantitative survey results in an exploratory factor analysis in order to understand which of our questions were best at measuring the constructs we had defined. Based on this understanding, we selected three questions to gauge design mindset, and three for design excellence. These six questions have become our standardized measurement, which we continue to administer online every six months and measure against our baseline survey. We also ask additional questions regarding the team’s setup, perceptions of design, and opinions about our design system in order to discover ways to maximize the impact of design throughout the entire company. Therefore, by measuring maturity on a individual level, while also tracking the organizational structure individuals are tied to, we are able to identify opportunities for improvement. In addition, this gives us an opportunity to understand the reasons behind low maturity (why, for example, one team is employing design mindset and excellence to a higher extent than another).</p><p><strong>The Results</strong></p><p>Opening survey data is often like trying a praline — you never know what you’re going to get (hooray for the Forrest Gump analogy here!) It was the same for us — we were surprised by the open and honest feedback, and the praise and encouragement, but also the numbers. In mediation analyses, we uncovered how the number of designers and amount of research are related to maturity — giving support to our assumption that proximity to design and research play a central role in building maturity. We learned how various parts of the organization leverage design in different ways. And finally, we learned that management is even more excited about design maturity numbers than we had anticipated.</p><p>One of the first tangible outcomes of our work was the creation of a training program for user research, having found that this is one of the most straightforward skills to nurture in order to increase design maturity. It’s also great that we now have the data to show the evolution in the understanding and usage of our design system.</p><p>For now the journey continues…we are working on increasing our response rates to the survey so that more people will participate and share their thoughts. We’re working on another iteration of the survey in order to improve our measurements. And, we’re spreading the word, showing what individuals or teams can do to improve and celebrate design maturity in teams.</p><p>*the “we” includes Rob Manzano (team lead of user research for Zalando)and <a href="https://medium.com/zalando-design/blog-intro-92856a766e8e">Anne Pascual </a>(vice president of design and fundamentals for Zalando), in addition to the author.</p><p>**<a href="https://erhvervsstyrelsen.dk/sites/default/files/the_economic_effects_of_designn.pdf">this study </a>shows a correlation between these constructs</p><p><a href="https://medium.com/zalando-design/the-numbers-game-3dde6ae5ed15"><em>Dr. Franziska Roth</em></a><em> is a senior user researcher with a quantitative focus for Zalando.</em></p><p><em>Thanks to </em><a href="https://medium.com/zalando-design/introducing-the-design-maturity-series-988a084c3cfb"><em>Eileen Bernardi</em></a><em> for her support on writing this story and to product design leads: Jay Kaufmann, </em><a href="https://medium.com/zalando-design/designer-discourse-with-ray-ho-and-lorenzo-fernandez-how-to-talk-about-design-with-7fc11607f05e"><em>Lorenzo Fernandez</em></a><em>, </em><a href="https://medium.com/zalando-design/gloria-rupprecht-on-designops-and-unleashing-the-potential-of-design-1172f0e7d84e"><em>Gloria Rupprecht</em></a><em>, and </em><a href="https://medium.com/zalando-design/designer-discourse-with-ray-ho-and-lorenzo-fernandez-how-to-talk-about-design-with-7fc11607f05e"><em>Ray Ho</em></a><em> who all lended support in the process of measure development.</em></p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fupscri.be%2Fb3e808%3Fas_embed%3Dtrue&amp;dntp=1&amp;display_name=Upscribe&amp;url=https%3A%2F%2Fupscri.be%2Fb3e808%2F&amp;image=http%3A%2F%2Fapi.screenshotlayer.com%2Fapi%2Fcapture%3Faccess_key%3Dfe59908dad3baab69ffab249a2224b03%26viewport%3D1024x612%26width%3D1000%26url%3Dhttps%253A%252F%252Fupscri.be%252Fb3e808%253Fscreenshot&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=upscri" width="800" height="400" frameborder="0" scrolling="no"><a href="https://medium.com/media/96d08ab34921bdd17986cb5c0396842f/href">https://medium.com/media/96d08ab34921bdd17986cb5c0396842f/href</a></iframe><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=bac36e9ee458" width="1" height="1" alt=""><hr><p><a href="https://uxplanet.org/zalandos-maturity-model-an-origin-story-bac36e9ee458">Zalando’s Maturity Model: An Origin Story</a> was originally published in <a href="https://uxplanet.org/">UX Planet</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Numbers Game: Humanizing Data in User Research]]></title>
            <link>https://medium.com/zalando-design/the-numbers-game-3dde6ae5ed15?source=rss-3b5c830807a6------2</link>
            <guid isPermaLink="false">https://medium.com/p/3dde6ae5ed15</guid>
            <category><![CDATA[researchers]]></category>
            <category><![CDATA[user-research]]></category>
            <category><![CDATA[quantitative]]></category>
            <category><![CDATA[research-methods]]></category>
            <dc:creator><![CDATA[Franziska Roth]]></dc:creator>
            <pubDate>Thu, 26 Apr 2018 18:43:51 GMT</pubDate>
            <atom:updated>2019-03-29T11:53:45.687Z</atom:updated>
            <content:encoded><![CDATA[<p><em>Using quantitative user research to complement customer insights</em></p><p>Most people associate user research with more qualitative methods, like interviews for usability testing or diary studies. These methods are generally used to obtain insights into things like customer needs, product usability issues, and customer journeys. A common method is focusing on observable behavior by actually watching and interviewing customers while they use a product or prototype.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3F6h31Xa7X59U3eY7BIExg.png" /><figcaption>Illustration by <a href="https://www.instagram.com/notflipper/">Not Flipper</a> for Zalando Design</figcaption></figure><p>Observable behavior is a fundamental aspect of user research, for what users say often differs from what they actually do. The emphasis on a user’s behavior helps the researcher to focus on asking the “why” questions: Why do users behave in a certain way? — <em>Is it because they do not understand how something works? Is it because they do not want to do it? Is it because they expect something different? Is it because it does not solve a problem they are facing? </em>To answer these questions, we keep the abilities, motivations, and experiences of the individual constantly in mind. For example: A person motivated to search for a specific product will behave differently on the website than a person searching for inspiration.</p><p>Yet, while these qualitative methods give us invaluable insights, there are even greater possibilities when we combine the qualitative approach with quantitative methods and thinking.</p><blockquote>But what exactly does such quantitative user research entail, and how can it help us to understand more of our customer’s behavior?</blockquote><h3>Diving deeper into quantitative user research</h3><p>I’d like to start with a recent project example in which our user research team combined qualitative and quantitative methodologies. We wanted to better understand how our users experience the editorial section of the Fashion Store, and how we could make the section more inspiring and engaging. We began by inviting users to our in-house research lab, observing them make use of the editorial section and subsections, and asked questions regarding their expectations, difficulties, and overall understanding of the content. We anticipated that people would have varied reactions to our site, based on how fashionable people considered themselves. We therefore recruited participants based on diversity in fashion competence.</p><p>Based on previous qualitative interviews, we had new research questions and hypotheses that we wanted to explore and test. For example, we guessed that users with a high fashion competence would use other sources for fashion inspiration compared to users with a low fashion competence. To test this hypothesis we used a quantitative survey.</p><p>The survey provided another measure of fashion competence by looking at our users’ understanding of the editorial section and their awareness of inspirational content on Zalando. This helped us not only in validating some of the findings from our interviews, but also in gaining additional insights into how and to what extent fashion competence influences the perception and consumption of inspirational content.</p><p>In the future, we definitely hope to integrate more on-site observation data into our research. With surveys behavioral data is, by definition, not very precise as it is based on the self-reported memory of the participants. However, pairing survey data on emotions/motivations/intents/personality traits that might influence behavior with actual on-site behavior data can generate completely new knowledge in areas like developing personalization features or tailoring them for shopping intentions.</p><h3>What does this tell us?</h3><p>One learning that resulted from the above research is that quantitative user research uses the same mindset as qualitative user research: focus on behavior (how did they use what) while keeping individual traits in mind (e.g., their fashion competence, emotions, motivations etc.). Quantitative user research doesn’t merely look at “how much?”, but can also offer answers to “why?”. This is best accomplished by combining data on behavior with insights on the person. However, in quantitative user research we do this with standardized measures and in bigger samples. Here, we are not merely observing three or five participants, but rather 50 participants or more. In the end these results merits analyses that use descriptive as well as inductive statistics, enabling us to reliably test hypotheses that were generated through the qualitative research.</p><blockquote>Quantitative user research doesn’t merely look at “how much?”, but can also offer answers to “why?”.</blockquote><p>Other research methods commonly used for quantitative user research are associated with remote testing (e.g., card sorting and unmoderated task based tests). For example, small scale A/B tests (comparisons between different variants) make it possible to compare customer impressions of different product versions before they are finalized. While such tests are not as reliable as a classic A/B test when it comes to statistical power (i.e., how likely it is to discover a significant effect), sample size, and measuring of KPIs like Conversion Rate, they can be a low-key solution for comparing different mock-ups or prototypes early on. Furthermore, existing solutions that are not yet live in every country can be shown to customers before bringing them live.</p><p>Remote testing studies also offer the possibility of asking customers about their experience, granting additional insights on why one they believe one version performed better than an other. We recently conducted such comparisons with our French customers, researching their perception of different sizing help features (i.e., size chat, size recommendation, etc.) that were not yet live in France. This helped us to establish a ranking of which features were considered most helpful</p><h3>Final thoughts</h3><p>Insights from quantitative user research are used to complement the findings we’ve established with our qualitative research, sometimes by having numbers confirm observed phenomena, and sometimes by enabling comparisons between customers or products. Quantitative research can also build new bridges with market research or A/B testing by speaking a more similar language in ours and their results. However, there are also risks involved: Getting lost in numbers instead of really listening to what the customer says while using the product.</p><blockquote>Quantitative research builds new bridges .</blockquote><p>The user research team at Zalando has only just started to uncover all the possibilities that quantitative user research offers. We are excited about the road ahead. If you have any questions about our thoughts and processes, or would like to contribute your own ideas regarding quantitative user research, feel free to get in contact via email at <a href="/service/mailto:franziska.susanne.roth@zalando.de">franziska.susanne.roth@zalando.de</a>. I would love to hear from you.</p><p><em>Dr. Franziska Roth is a user researcher with Zalando.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3dde6ae5ed15" width="1" height="1" alt=""><hr><p><a href="https://medium.com/zalando-design/the-numbers-game-3dde6ae5ed15">The Numbers Game: Humanizing Data in User Research</a> was originally published in <a href="https://medium.com/zalando-design">Zalando Design</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>