<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Dave Higgins on Medium]]></title>
        <description><![CDATA[Stories by Dave Higgins on Medium]]></description>
        <link>https://medium.com/@dahiggins?source=rss-181962db99f5------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*vswGtSdm7-wNDfyr7c8Uyw.jpeg</url>
            <title>Stories by Dave Higgins on Medium</title>
            <link>https://medium.com/@dahiggins?source=rss-181962db99f5------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sun, 22 Nov 2026 04:13:06 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@dahiggins/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Targets & Metrics for Software QA]]></title>
            <link>https://medium.com/hotels-com-technology/targets-metrics-for-software-qa-7e0c29bbb542?source=rss-181962db99f5------2</link>
            <guid isPermaLink="false">https://medium.com/p/7e0c29bbb542</guid>
            <category><![CDATA[metrics]]></category>
            <category><![CDATA[software-testing]]></category>
            <category><![CDATA[performance-reviews]]></category>
            <category><![CDATA[software-development]]></category>
            <category><![CDATA[qa]]></category>
            <dc:creator><![CDATA[Dave Higgins]]></dc:creator>
            <pubDate>Tue, 16 Jan 2018 09:33:10 GMT</pubDate>
            <atom:updated>2018-01-16T09:33:10.806Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/511/1*CTZOxR2LR6XXS-N29MMgGQ.jpeg" /></figure><p>I’ve always found metrics in QA to be a tricky subject, as I’ve generally found it difficult to identify and attach meaningful numbers to performance in a role based around providing information.</p><p>I’m dead against keeping track of statistics like personal bug counts, numbers of tests executed and so on. They bring about pointless bugs, endless raising of non-issues, and underhanded tactics all over the place, so they don’t give a true measure of an individual’s performance in the QA field. As I alluded to before, the real measure of QA’s effectiveness is in the information they provide to their customers, whether those customers are the rest of their development team, the product and business teams they work with, or indeed, anyone else who is a stakeholder in the work the team carries out.</p><p>Even when trying to compare the performance of one person against another, the nature of our field means that, due to pressures such as time constraints, the relative state of the system under test and so on, you will never get to see different folks running the same test in exactly the same set of circumstances. So it’s unfair to consider using that sort of thing as measure of performance too.</p><p>But I do understand the need to monitor performance, particularly for new hires, and there are a few things I use to measure the performance, throughput and relative value of folks in QA. While this particular set of metrics is geared more towards the performance of new members of a team, they could easily be adapted to track the progress and performance of established team members too.</p><p><strong>Bug Quality</strong></p><p>The general quality of bugs raised should be spot checked, with closer attention being paid to bugs raised due to issues missed in testing (indicative of areas where testing and detection methods should be improved) and bugs returned as ‘Will Not Fix’ (indicative of areas where priorities and understanding of requirements / product needs / customer needs should be improved). For new hires, I’d expect numbers of such issues to decrease over time as the QA ramps up in their new domain. Also, keep an eye open for any issues which have failed to detect or report incorrect system behaviour, have been assigned an inappropriately low priority, or that otherwise understate the significance of a problem. These will highlight areas where coaching is required to improve understanding of the system under test.</p><p><strong>Critical Bugs in Test vs Production</strong></p><p>Keep an eye on the ratio of critical bugs (&gt;=P2) raised in Test vs Production. Customer satisfaction is the True North of Quality, and if there are more than a handful of instances of critical bugs being identified post-sprint, this could be indicative of a coaching need.</p><p><strong>Test Coverage for Applications</strong></p><p>Whenever a new hire fills a vacancy, I’d expect to see an increase in test coverage. Establish the current base line for the areas the team currently cover, and track for increases — but, importantly, in areas where increases are <em>expected</em>. Don’t forget that, particularly with automation, there are upper limits for test coverage, so don’t make the mistake of setting a coverage target without first discussing and identifying the areas it is actually <em>possible</em> to cover, or you risk setting an unachievable target.</p><p><strong>Load Shift</strong></p><p>When a new QA hire comes on board, overall team output should increase as the new member of the team takes on more of the testing load. This one is a bit arbitrary, and not entirely dependent on the new QA hire, but it’s still worth monitoring as an identifier for potential issues and bottlenecks in your workflow.</p><p><strong>Overall increase in Story Turnaround &amp; Completion</strong></p><p>Keep track of the team’s commitments for each sprint, and of how many of those commitments were delivered with a high standard of quality. Again, this isn’t always going to be directly in the hands of QA, but where a team has recently filled a vacancy, I’d expect month-on-month increases in the number of stories committed to, percentage of commitments met, and an increase in the speed with which stories are completed. Take the current averages as a baseline, and monitor for the expected increases.</p><p><strong>Engagement</strong></p><p>Not a ’numbers’ metric, but arguably the most important one. Are the QA team contributing to Retrospectives? Planning &amp; Estimation? How are they communicating the information they’re finding during the course of their work? For new hires, I’d look for their engagement to increase as they ramp up in their new domain and adapt to the team and company culture, but as a QA professional bringing a fresh pair of eyes to the team, I’d expect there to be some level of insight and engagement from the very beginning. I’d also expect the QAs to be actively involved in the solutions to any bugs / issues they raise — Conferring with developers working on solutions, discuss how the fix should be retested etc.</p><p>Ultimately, regardless of how you decide to measure performance in QA, it is worth considering that <em>any</em> metric should be used as an informational tool rather than any kind of absolute measure. There is no real substitute for getting to know what your QA folks are doing, how they’re communicating with the people around them, the problems they encounter, and how they handle those problems.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7e0c29bbb542" width="1" height="1" alt=""><hr><p><a href="https://medium.com/hotels-com-technology/targets-metrics-for-software-qa-7e0c29bbb542">Targets &amp; Metrics for Software QA</a> was originally published in <a href="https://medium.com/hotels-com-technology">The Hotels.com Technology Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Hotels.com Technology Podcast: Episode 1 — Thierry Bedos]]></title>
            <link>https://medium.com/hotels-com-technology/the-hotels-com-technology-podcast-4c113796f1ba?source=rss-181962db99f5------2</link>
            <guid isPermaLink="false">https://medium.com/p/4c113796f1ba</guid>
            <category><![CDATA[leadership]]></category>
            <category><![CDATA[travel]]></category>
            <category><![CDATA[business-strategy]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[podcast]]></category>
            <dc:creator><![CDATA[Dave Higgins]]></dc:creator>
            <pubDate>Thu, 11 Jan 2018 08:52:45 GMT</pubDate>
            <atom:updated>2018-01-11T09:02:09.941Z</atom:updated>
            <content:encoded><![CDATA[<iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fw.soundcloud.com%2Fplayer%2F%3Furl%3Dhttp%253A%252F%252Fapi.soundcloud.com%252Ftracks%252F381934400%26show_artwork%3Dtrue&amp;url=https%3A%2F%2Fsoundcloud.com%2Fuser-468156304%2Fthe-hotelscom-technology-podcast-episode-1-thierry-bedos&amp;image=http%3A%2F%2Fi1.sndcdn.com%2Fartworks-000283537631-79tuci-t500x500.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=soundcloud" width="800" height="166" frameborder="0" scrolling="no"><a href="https://medium.com/media/71e9d77342993ef28f07866f466d085f/href">https://medium.com/media/71e9d77342993ef28f07866f466d085f/href</a></iframe><figure><img alt="" src="https://cdn-images-1.medium.com/max/500/1*ew8F9gbWVm6jcrn41qH4LQ.jpeg" /></figure><p>In our first episode, Dave has pulled off a bit of a coup as he sits down for a chat with our CTO, Thierry Bedos.</p><p>During this conversation, they get into Thierry’s background in Technology and Travel, the role of CTO and the responsibilities that come with it, the progress we’re making with our Strategic Initiatives, and what the future of our business looks like.</p><p>As always, feedback is very welcome in the comments section below this post.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4c113796f1ba" width="1" height="1" alt=""><hr><p><a href="https://medium.com/hotels-com-technology/the-hotels-com-technology-podcast-4c113796f1ba">The Hotels.com Technology Podcast: Episode 1 — Thierry Bedos</a> was originally published in <a href="https://medium.com/hotels-com-technology">The Hotels.com Technology Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>