<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Katie Hansen on Medium]]></title>
        <description><![CDATA[Stories by Katie Hansen on Medium]]></description>
        <link>https://medium.com/@drkatiehansen?source=rss-c406c590cf0a------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*4Obb5RIJ-VxYse2f</url>
            <title>Stories by Katie Hansen on Medium</title>
            <link>https://medium.com/@drkatiehansen?source=rss-c406c590cf0a------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 12:17:59 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@drkatiehansen/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Beyond A/B tests: Using research to prioritize product bets]]></title>
            <link>https://medium.com/thumbtack-design/beyond-a-b-tests-using-research-to-prioritize-product-bets-c64348aea10c?source=rss-c406c590cf0a------2</link>
            <guid isPermaLink="false">https://medium.com/p/c64348aea10c</guid>
            <dc:creator><![CDATA[Katie Hansen]]></dc:creator>
            <pubDate>Thu, 07 Aug 2025 17:54:18 GMT</pubDate>
            <atom:updated>2025-08-07T17:54:18.342Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*TKn1lwlBUlM8hxN9" /></figure><p>We’ve all been there: a list of exciting product ideas, limited time, and even more limited experiment slots. In an ideal world, we’d A/B test every idea to see what really works. But the reality is that we don’t have the bandwidth to run every experiment we’d like to. This is where research can be our secret weapon.</p><p>If you think of A/B tests as the final proving ground, research can help us narrow down the contenders before we even step onto the field. By using different research methods, we can identify the most promising bets, understand where to focus our efforts, and reduce the risk of spending precious time and resources on ideas that might fall flat.</p><p>While foundational and tactical research may be familiar tools for understanding user needs and refining designs, those aren’t the only ways research can help. There are additional approaches specifically suited for prioritizing product ideas when A/B tests aren’t an option.</p><p>Let’s explore the research toolkit that goes beyond A/B tests, exploring methods that can help us prioritize our bets efficiently and confidently.</p><h3><strong>Survey experiments</strong></h3><p><em>What it is:</em> Emailed surveys that incorporate controlled experiments within the survey itself.</p><p><em>How it helps:</em> We can gauge reactions to different ideas or messaging and causally identify which concepts show the most promise, all without building a thing. They are great for narrowing down large lists of potential bets and gathering quantitative data quickly.</p><p><em>Example:</em> Randomly assigning respondents to different concepts and comparing their responses on numeric scales.</p><p><em>Pros:</em> Provides quantitative, causal data; can test multiple ideas in parallel; can garner insights from large, diverse user groups.</p><p><em>Cons: </em>Designing robust survey experiments requires careful planning and expertise; limited to reactions to the presented concepts.</p><h3>Concept testing</h3><p><em>What it is:</em> Evaluating early-stage ideas or prototypes with users to understand their reactions, expectations, and potential barriers.</p><p><em>How it helps:</em> We can quickly rule out ideas that don’t resonate or refine concepts based on early feedback before investing in development.</p><p><em>Example:</em> Showing users a storyboard or low-fidelity prototype and gathering qualitative feedback on their understanding and interest.</p><p><em>Pros:</em> Helps rule out unpromising ideas early; provides actionable feedback to refine concepts; can identify potential barriers to adoption or usability issues.</p><p><em>Cons: </em>Limited scalability.</p><h3><strong>Priority testing</strong></h3><p><em>What it is:</em> A category of methods where users rate, rank, or sort different ideas or features based on importance, preference, or desirability. This could be done qualitatively or quantitatively.</p><p><em>How it helps:</em> By understanding which ideas resonate most with our users, we can quickly identify the bets that are worth exploring further.</p><p><em>Examples:</em> Card sorting exercises where users rank feature ideas based on what they find most valuable and MaxDiff analysis where users indicate their most and least preferred options via survey.</p><p><em>Pros:</em> Flexibility to do qualitatively or quantitatively; provides clear prioritization signals based on user preferences; can test a large number of ideas.</p><p><em>Cons: </em>Results are dependent on the quality of the options presented; users may not have a clear understanding of what they truly need; quantitative approaches require specialized statistical expertise.</p><h3><strong>Participatory design</strong></h3><p><em>What it is:</em> A collaborative approach where users co-create solutions with the team.</p><p><em>How it helps:</em> By involving users directly in the design process, we can identify which ideas align most with their needs and ensure we’re solving the right problems.</p><p><em>Example:</em> Workshops where users brainstorm and sketch potential solutions.</p><p><em>Pros:</em> Encourages innovation through collaboration; provides rich, qualitative data.</p><p><em>Cons: </em>More time intensive than other methods.</p><p>These research methods empower us to prioritize product bets with confidence and clarity.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c64348aea10c" width="1" height="1" alt=""><hr><p><a href="https://medium.com/thumbtack-design/beyond-a-b-tests-using-research-to-prioritize-product-bets-c64348aea10c">Beyond A/B tests: Using research to prioritize product bets</a> was originally published in <a href="https://medium.com/thumbtack-design">Thumbtack Design</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>