<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Dead Reckoning - Medium]]></title>
        <description><![CDATA[Research, strong opinions, and stories about metrics, benchmarking, and communication for innovation, R&amp;D, new product development, and long-term growth opportunities. From Commodore Innovation, where we help people make better decisions for innovation. - Medium]]></description>
        <link>https://medium.com/dead-reckoning?source=rss----263d8aa23e97---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>Dead Reckoning - Medium</title>
            <link>https://medium.com/dead-reckoning?source=rss----263d8aa23e97---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 03:22:40 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/dead-reckoning" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[COVID-19: Business R&D Spending Will Fall by At Least 5–6%]]></title>
            <link>https://medium.com/dead-reckoning/covid-19-business-r-d-spending-will-fall-by-at-least-5-6-af1a893f5bbd?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/af1a893f5bbd</guid>
            <category><![CDATA[innovation-metrics]]></category>
            <category><![CDATA[business-strategy]]></category>
            <category><![CDATA[corporate-innovation]]></category>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[research-and-development]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Thu, 26 Mar 2020 14:33:26 GMT</pubDate>
            <atom:updated>2020-03-24T13:38:10.433Z</atom:updated>
            <content:encoded><![CDATA[<p>In the last few weeks our worlds have been turned upside down. As individuals we are grappling with the fear, disruption and uncertainty brought about by COVID-19. The organizations we work for are scrambling to manage extraordinary challenges. In some sectors, the threat is unquestionably existential. For almost all it is likely unprecedented.</p><p>Innovation teams are not, of course, immune to this disruption. There are immediate challenges and opportunities — and longer-term challenges loom large.</p><h3>Innovation should be part of the immediate response</h3><p>In the immediate term, innovation teams have opportunities to stay relevant by helping their organizations respond effectively to the new environment in which we find ourselves. That might be in relatively small ways like sharing and disseminating knowledge about tools and behaviors that enhance virtual / remote collaboration. And it might be larger ways such as helping to drive or facilitate innovation processes that identify ways your organization can help our communities and our governments (e.g. <a href="https://hackaday.com/2020/03/12/ultimate-medical-hackathon-how-fast-can-we-design-and-deploy-an-open-source-ventilator/">a hackathon for an open source ventilator</a>).</p><h3>Longer-term implications for innovation</h3><p>Innovation leaders will also need to turn their attention to longer-term questions. Recession is looking increasingly likely in many countries. In the US, current baseline or central <a href="https://www.wsj.com/articles/coronavirus-triggered-downturn-could-cost-5-million-u-s-jobs-11584783001">forecasts</a> suggest a very steep Q2 decline in GDP (-7% annualized), followed by zero growth in Q3 and a return to positive territory in Q3 (+2.6%). It is, therefore, likely that innovation teams will face budget pressure. To prepare for such challenges, historical experience can be instructive.</p><p>In five out of the last six recessions the United States has gone through since 1960, R&amp;D spending (a good proxy for total innovation investment) by firms has declined. For example:</p><ul><li>Early 2000s recession: R&amp;D spending fell by 0.9% in 2001 and a further 5.6% in 2002.</li><li>Great Recession (late-2007 to mid-2009): R&amp;D spending didn’t decline until 2009 (by 5.2%), but the decline continued into 2010 (0.4%).</li></ul><p>While neither recession is entirely analogous to economists’ current forecasts, they still suggest <strong>innovation leaders should anticipate pressure to cut innovation budgets by at least 5–6% over the next 12–18 months</strong>. Obviously, this is based on an average impact across all sectors of the US economy — some firms will face pressure for much greater cuts.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*6euNSYi3CNfCstOI" /></figure><p>Data source: NSF Business R&amp;D and Innovation Survey (<a href="https://www.nsf.gov/statistics/srvyindustry/">link</a>), Federal Reserve (<a href="https://fred.stlouisfed.org/series/JHDUSRGDPBR">FRED</a>)</p><h3>Prepare for innovation budget pressure now</h3><p>It is imperative that innovation leaders start preparing for budget conversations now. To do that, we recommend preparing to:</p><ul><li>Demonstrate the value of innovation to the organization.</li><li>Run leaner.</li></ul><h4>Demonstrate value</h4><p>Now more than ever it’s critical your key stakeholders across the organization understand the value innovation brings. Ideally you already have a comprehensive set of innovation metrics that help you demonstrate your innovation team’s return on investment. To check you’re measuring what you need to check your metrics against <a href="https://commodoreinnovation.co/wp-content/uploads/2018/10/Innovation-Performance-Framework.pdf">our measurement framework</a> or take our <a href="https://commodoreinnovation.co/assessment-lp1/">self-assessment</a>. If you’re not measuring what you need to, now is the time to quickly assemble that data.</p><p>The quantitative information provided by metrics should be complemented by stories that make your team’s value and relevance real. Given the current context, these stories could include examples of how your innovation team is supporting your organization’s immediate response to the COVID-19 crisis. And how innovation helped your organization recover from prior recessions.</p><h4>Prepare to run leaner</h4><p>Most innovation teams are likely to face significant cuts. That means you need to start preparing to run leaner — now. Again, innovation metrics can help. If you have a comprehensive innovation performance measurement system in place, it will provide you with the insight necessary to know how to run leaner. For example, it will tell you which projects and portfolios deliver higher RoI. And it will highlight areas of your innovation process that could be more efficient.</p><p>If you don’t have the insight necessary to inform those decisions, it’s not too late to assemble it. The alternative is to fly blind.</p><p>This post was originally published on <a href="https://commodoreinnovation.co/blog/covid-impact-on-innovation-budgets/">commodoreinnovation.co</a> on March 23, 2020.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=af1a893f5bbd" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/covid-19-business-r-d-spending-will-fall-by-at-least-5-6-af1a893f5bbd">COVID-19: Business R&amp;D Spending Will Fall by At Least 5–6%</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[I want to improve how we measure innovation performance. What now?]]></title>
            <link>https://medium.com/dead-reckoning/i-want-to-improve-how-we-measure-innovation-performance-what-now-59206a21c22b?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/59206a21c22b</guid>
            <category><![CDATA[innovation-measurement]]></category>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Fri, 06 Mar 2020 13:36:40 GMT</pubDate>
            <atom:updated>2020-03-06T13:36:40.442Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-j8bc9ae2Ba-7dUft6Ph6w.jpeg" /></figure><p>Once you’ve decided you want to do something about how your organization measures innovation performance, knowing what to do next isn’t always obvious. We often have conversations with innovation leaders who get to this point and reach out to us for advice on what to do next. Our advice tends to cover some combination of the following, which we expand on further in this post:</p><ul><li>Understand whether there are good reasons to tackle innovation measurement now.</li><li>Caution against treating software as the off-the-shelf solution.</li><li>Offer advice on when we’ve seen it make sense to tackle innovation measurement in-house — and point to tools and resources they can use.</li><li>Advise on when it makes sense to bring in outside help, and what to look for .</li></ul><h3><strong>What are some signs that innovation performance measurement should be a priority?</strong></h3><p>Sometimes it’s inescapable: new executive or innovation leadership asks the question: “<em>Are we measuring innovation the right way?</em>” If that’s the case, you’ll likely have to to proceed with a review of your measurement system. If not, consider the next 3 situations.</p><p><strong><em>(1) A new innovation process needs to be measured.<br></em></strong>A new innovation process almost always requires consideration of how to measure its performance. By “new” we don’t just mean: your firm didn’t have any formal innovation activities and processes before, and now it does. We’ve also helped firms who have had decades of innovation / R&amp;D experience, but who are adding a completely new way of innovating (e.g. a stand-alone “innovation lab”) or who’ve expanded their scope to include innovation activities they weren’t previously (e.g. the focus used to be exclusively new product development, but now includes substantial “front end” activities as well).</p><p>We often get this question from our clients in these situations: <em>given we’re just getting started,</em> <em>how soon does it make sense to tackle innovation measurement? </em>Every situation is different, but there are a couple of rules of thumb:</p><ul><li>Consider innovation measurement <strong>after</strong> you have reasonable clarity and alignment around the purpose or strategy of your new innovation process.</li><li>Know how you’re measuring your efforts <strong>before</strong> you’re asked by your superiors or other key internal stakeholders.</li></ul><p><strong><em>(2) It’s been at least 2–3 years anyone reviewed innovation measurement.<br></em></strong>A simple guide to whether you should be reviewing your established measurement system is whether or not it’s been evaluated in the last 2–3 years. Innovation systems tend to evolve quickly: you try new tools and methods, bring in new people, add new measurement capabilities (e.g. from software), and integrate with acquired companies. Measurement systems, on the other hand, tend to be in the “set it and forget it” bucket: no one really has enough time available to take a systematic look and make sure the system is doing what you need it to.</p><p>As a result, we often find measurement systems that aren’t performing the functions an organization needs of it. This can lead to wasted time collecting and reporting metrics that no one uses. And, in the worst case, metrics that send misleading signals or create misaligned incentives. So for these reasons, we recommend clients take a least a <a href="https://commodoreinnovation.co/blog/measurement-system-check-up/">quick look</a> at their measurement system every few years.</p><p><strong><em>(3) Subtle indicators you need to enhance innovation performance measurement.<br></em></strong>More subtle signs you need to consider innovation measurement include:</p><ul><li>You feel like you need better information or explanations for leadership or other stakeholders — you’re not having high-quality conversations or you’re spending an inordinate amount of time “defending” innovation strategy or specific decisions.</li><li>You or your teams don’t feel confident in the decisions you’re making — prioritizing and selecting projects, allocating funds to align with strategy, etc.</li><li>You’re concerned about <a href="https://commodoreinnovation.co/blog/most-companies-are-getting-worse-at-innovation/">declining innovation performance</a> in your organization.</li><li>You’re having a hard time creating a culture that supports innovation AND has the appropriate checks and balances in place (<a href="https://commodoreinnovation.co/blog/the-innovation-culture-balancing-act/">read our post on this subject</a>).</li></ul><h3><strong>No, software isn’t the answer (or, at least, not the full answer).</strong></h3><p>Innovation management software doesn’t tell you what to measure. Sometimes, innovation managers make the assumption that, if they have the right innovation management software, the measurement will take care of itself. If only it were that simple. Innovation management software is a critical aspect of an innovation measurement system. But innovation management software is designed to enable measurement of as many different factors as possible. This is precisely because what needs to be measured varies so much from organization to organization — software providers have to make their systems flexible. So don’t treat software as the solution. We always help our clients establish what they need to measure first, and then turn to what software should be used, and how to use it.</p><p>On a related note, many organizations are finding that innovation software isn’t the best tool for analyzing and communicating innovation metrics. That’s because, notwithstanding the comments above, there isn’t sufficient flexibility with the software to address the very specific needs of their audiences, and the frequency with which those needs are changing. And also because of the need to integrate data from across multiple systems (e.g. product lifecycle management, broader enterprise resource planning systems). As a result, we have found that many organizations are doing much of their analysis and reporting within generic business intelligence software (e.g. Microsoft Power BI, Tableau, Qlikview).</p><h3><strong>Tackle improvements to your innovation performance measurement system in-house when you have leadership support and the right capabilities available.</strong></h3><p>Some organizations choose to undertake initiatives to improve their innovation performance measurement system in-house. We’ve seen this work well under certain conditions:</p><ul><li>There is strong leadership support for the initiative — e.g. from the VP or SVP for Innovation or R&amp;D, or the Chief Technology or Innovation Officer.</li><li>The owner of the innovation process for the organization has the capacity to closely manage the initiative.</li><li>Staff with the right skillset and experience have bandwidth to execute the initiative. Those staff need to understand the fundamentals of measuring innovation performance and deeply understand all aspects of your innovation process. How much bandwidth depends on the scale and complexity of your innovation function. If you’re spending 10M+ annually it will need to be one person’s primary responsibility for several months.</li></ul><p>If you’re looking for an example of an organization that successfully completed improvements in-house, check out <a href="https://www.brighttalk.com/webcast/5570/88567">this webinar</a> from Parker-Hannifin Corporation (Frost &amp; Sullivan presented the webinar, but Parker did the work in-house).</p><p>If you choose to proceed with improvement innovation performance measurement in-house, there are a few resources that could be helpful:</p><ul><li>If you like to hit the books, check out our <a href="https://commodoreinnovation.co/the-library/">Library</a> — we list academic and other articles and books we think are helpful.</li><li>If you’re interested in training on the fundamentals of improving innovation performance measurement, <a href="/service/mailto:phil@commodoreinnovation.co?subject=Training%20on%20innovation%20performance%20measurement">send us an email</a> — we have some courses in the works.</li><li>Check out online “how to” guides. Commodore has several <a href="https://commodoreinnovation.co/downloads/">here</a> — you might start with our Guide to Measuring the Performance of an Innovation Portfolio.</li></ul><h3><strong>Use outside help when you need to move quickly, an independent perspective, or deep measurement expertise.</strong></h3><p>We find that organizations benefit the most from specialist expertise in innovation measurement when one or more of the following conditions exist:</p><ul><li>They need to move quickly, and don’t have the internal capacity to move forward.</li><li>There’s a need for an independent perspective — measurement of innovation performance can quickly get political (you’re talking about how people’s success is evaluated!), so sometimes it’s helpful to have an independent, dispassionate third party lead the conversation internally.</li><li>There’s no one available internally with deep expertise in innovation measurement — this is pretty common, as most of your best people are already busy managing innovation projects or portfolios and the short-term opportunity cost of pulling them off those activities can be high.</li></ul><p>If you recognize yourself in any of those conditions, <a href="https://commodoreinnovation.co/contact/">get in touch</a> — we’d be happy to see if there’s a way we can help.</p><p>This post was originally published on <a href="https://commodoreinnovation.co/blog/what-next/">commodoreinnovation.co</a> on July 25, 2019.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=59206a21c22b" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/i-want-to-improve-how-we-measure-innovation-performance-what-now-59206a21c22b">I want to improve how we measure innovation performance. What now?</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Benchmark Innovation Performance]]></title>
            <link>https://medium.com/dead-reckoning/benchmark-innovation-performance-f5d9423de99c?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/f5d9423de99c</guid>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-measurement]]></category>
            <category><![CDATA[benchmarking]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Wed, 04 Mar 2020 22:15:46 GMT</pubDate>
            <atom:updated>2020-03-04T22:15:46.271Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*9JxCEbiIb0oqq_L7yQeh7A.jpeg" /></figure><h3>How does your innovation performance compare to your competitors’?</h3><p>It’s human nature to be curious about how your performance compares with that of your competitors. But when it comes to innovation performance, this instinctive desire for benchmarking is also a valuable tool for innovation leaders. It can help leaders monitor the adequacy of their performance, communicate about ambition and achievement, and target performance improvement efforts.</p><p>Companies invest in innovation because it’s essential to them maintaining or enhancing their competitive position. That means <strong>relative innovation performance</strong> matters as much as absolute performance does. Benchmarking can be used to determine whether your relative performance is in line with your innovation strategy and objectives. Note that means you’re not using benchmarking to determine whether your performance is at the same level as your competitors. Your strategy should help you establish the relative level of performance you are targeting. For example, a longer average speed to market may make sense if you’ve decided to invest heavily in developing an emerging technology. A higher proportion invested in “core” makes sense if you’re following up on a recent breakthrough.</p><p>Benchmarking is also a valuable tool when communicating about innovation performance. Demonstrating the value you’re creating for the organization will typically carry more weight (especially when reporting “up” the organization) if you’re able to compare your performance against an objective industry benchmark. For example, reporting a vitality index1 metric of 30% is a lot more meaningful if you also report that the sector average is just 15%. Industry benchmarks can also provide succinct, compelling context for communicating targets “down” the organization.</p><p>Benchmarking doesn’t just have to be external. It can also be useful to compare performance within the organization. In fact, if external benchmarking helps you determine <strong>whether</strong> or not you need to improve innovation performance, then internal benchmarking is critical for determining <strong>where</strong> to improve innovation performance. It can, for example, help you determine which divisions or business units are most in need of improvement. Or which aspects of your innovation process to focus on.</p><h3>Data availability makes benchmarking a challenge</h3><p>Unfortunately, meaningful benchmarking of innovation performance is challenging due to a lack of publicly available data.</p><p>There are very few innovation metrics that publicly traded firms share externally — particularly when it comes to output and outcome indicators. GAAP (&amp; IFRS) require firms to report on research and development expenditure. This is at least a partial measure of inputs to the innovation process, even if its definition may be too narrow to cover all innovation related expenditure.</p><p>Patent data is generally available, but is a crude output activity indicator, at best. We place little value on patent activity data for innovation performance benchmarking for two main reasons:</p><ul><li>Not all innovations are patented (e.g. many are kept as trade secrets)</li><li>The existence of a patent tells you virtually nothing about its value to a firm</li></ul><p>Only the coarsest outcome indicators — revenue and earnings — have to be public reported by firms. And that also means relative performance indicators are rare — beyond those attempting to relate R&amp;D expenditure to revenue2. <a href="https://www.mckinsey.com/business-functions/strategy-and-corporate-finance/our-insights/taking-the-measure-of-innovation">McKinsey analysts</a> thought they’d solved this problem when they proposed two conversion indicators: (1) new product sales per dollar of R&amp;D expenditure and (2) gross margin per dollar of new product sales. Unfortunately, a critical component of these metrics, revenue from new product sales, is not nearly as available as the authors implied (although we note that these are still interesting metrics to look at internally). In fact, a quick analysis of earnings transcripts and SEC-filings from 2018 found just 40 examples of companies citing results for this metric (or something close to it). That compares with the ~2,000 US-listed firms that reported R&amp;D expenditure in filings to the SEC for 2018.</p><p>Occasionally survey-based benchmarking studies are conducted. For example, Stage Gate® International has previously published two benchmarking surveys of new product development metrics (in <a href="https://pdfs.semanticscholar.org/41f9/88ae80e62b8abade7001c4ad235bcedfb58c.pdf">2003</a> and in <a href="https://www.stage-gate.com/product/new-product-development-process-benchmarks-and-performance-metrics/">2011</a>). Unfortunately, such studies tend to be one-off or infrequent and give just a snapshot of performance at a point in time. This means they appeal to our curiosity, but rarely provide insight that is both actionable and timely.</p><p>Finally, niche benchmarking services existing in some sectors. <a href="https://clarivate.com/products/professional-services-life-sciences/cmr/">Clarivate</a> and <a href="https://kmrgroup.com/services/benchmarking/">KMR Group</a> are two examples in the pharmaceutical sector (where regulatory processes and investor pressure tend to mean there is more data available).</p><h3>Develop a robust internal benchmarking program and “scrape together” what you can externally</h3><p>So, what should you do to benchmark innovation performance? First up, we recommend ensuring you have a robust and systematic system of benchmarking <strong>internal</strong> innovation performance — to enable comparison of performance both across the organization and over time. Secondly, we suggest it’s worth at least taking a quick look at what data you can gather <strong>externally</strong> — it might be limited, but even that is better than nothing. Finally, stay tuned! We’re exploring how Commodore can help enable benchmarking of meaningful innovation performance indicators.</p><p>This post was originally published on <a href="https://commodoreinnovation.co/blog/benchmark-innovation-performance/">commodoreinnovation.co</a> on June 12, 2019.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f5d9423de99c" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/benchmark-innovation-performance-f5d9423de99c">Benchmark Innovation Performance</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Most Companies are Getting Worse at Innovation. Is Yours?]]></title>
            <link>https://medium.com/dead-reckoning/most-companies-are-getting-worse-at-innovation-is-yours-5c1a998105ee?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/5c1a998105ee</guid>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <category><![CDATA[innovation-measurement]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Wed, 04 Mar 2020 22:15:19 GMT</pubDate>
            <atom:updated>2020-03-04T22:15:19.273Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*GncL8k5-letWedMts_w_7g.jpeg" /></figure><h3>Research shows widespread, declining innovation performance.</h3><p>At first glance, the idea that companies are getting worse at innovation seems ridiculous — “innovations” are such a prevalent part of our daily lives. And we are fed a constant stream of information about the “latest” innovations that will change our lives and disrupt our industries — AR/VR, artificial intelligence/machine learning/deep learning, the internet of things, blockchain, additive manufacturing, etc. But there is mounting evidence that innovation performance is declining — costs are increasing and returns are falling.</p><p>A <a href="https://web.stanford.edu/~chadj/IdeaPF.pdf">study</a> published by the National Bureau of Economic Research in 2017 found that 85% of a large sample of US public companies had seen a decline in research productivity between 1980 and 2010. The average change in research productivity across the whole sample? <strong>A 10%</strong> <strong>annual decline</strong>.</p><p>Anne Marie Knott, an Olin Business School professor, <a href="https://www.amazon.com/dp/B01MRZ52HH/">found</a> that <strong>returns to companies’ R&amp;D spending have declined 65% over the past three decades. </strong>Knott specializes in the measurement of firms’ innovation performance and is the developer of the research quotient measure of innovation performance.</p><p>Studies looking at more recent time periods suggest the trend hasn’t changed. Analysts at Accenture adapted the NBER methodology and <a href="https://www.accenture.com/_acnmedia/Thought-Leadership-Assets/PDF/Accenture-Unlocking-Innovation-Investment-Value.pdf">found</a> a 27% decline in the return on companies’ innovation spending in the last 5 years. And in a pharmaceutical industry-focused study, Deloitte analysts <a href="https://www2.deloitte.com/us/en/pages/life-sciences-and-health-care/articles/measuring-return-from-pharmaceutical-innovation.html">found</a> that <em>forecast </em>returns on R&amp;D fell to a 9-year low of just 1.9% in 2018. This in an industry with, arguably, some of the strongest drivers to innovate more efficiently (e.g. very high costs of R&amp;D, pressure on drug prices from politicians and manufacturers of generic drugs).</p><h3>You need to understand your own innovation performance.</h3><p>The accumulating evidence is difficult to ignore. We believe it raises three urgent questions for innovation leaders:</p><ol><li>Are <strong>we</strong> getting worse at innovation?</li><li>If so, how do we know what to fix?</li><li>And, are our initiatives to fix these problems successful?</li></ol><p>Clearly, being able to accurately and objectively answer the first question is of critical importance. If you don’t know whether your organization is getting better or worse at innovation, you’re essentially flying blind. That’s dangerous when your organization’s medium- to long-term competitiveness depends on your ability to innovate.</p><p>Answering the second question (<strong>what</strong> to fix?) is essential, because it ensures investment in your innovation process is carefully targeted. All too often we see firms who have failed to take a systematic, analytical approach to diagnosing what needs to be improved. Innovation leaders may rely too heavily on judgment (instead of testing judgment with data) and misdiagnose (1). Or they essentially skip this question altogether and jump straight to adoption of the latest “solution” sweeping the world of innovation practice — think open innovation, design thinking, agile methods (NOTE: we have nothing against any of these approaches, provided they’re used in the right context and they demonstrably improve performance).</p><p>The final question (are our efforts succeeding?) is important because you need to check whether your interventions are working — and, if not, course correct. Often it’s necessary to put in place metrics that can provide an early indication of an intervention’s success. That’s because it can take too long for the impact to flow through to your ultimate measures of innovation performance (the ones you use to answer question 1).</p><h3>If you can’t answer these questions, your system for measuring innovation performance needs to be improved.</h3><p>A strong innovation performance measurement system is critical to answering all three of the questions outlined above. Try this simple test: when you’ve finished reading this post, can you immediately answer those three questions for your organization? Check the metric that measures <em>efficiency </em>(2) (e.g. return on innovation investment) — is it trending up or down? If it’s trending down, can identify the weak spots in your innovation process, where data supports your judgment? This might require looking at efficiency indicators by division / business unit and by stage of your innovation process. Finally, for those initiatives you’ve introduced to improve innovation: do you have data to confirm they’re having a positive impact on performance?</p><p>If you’re unable to answer all of these questions quickly and easily, some aspect of your innovation performance measurement system is inadequate.</p><p>1 — Anne Marie Knott catalogues a list of failures of judgment in her <a href="https://www.amazon.com/dp/B01MRZ52HH/">book</a>.</p><p>2 — Check our <a href="https://commodoreinnovation.co/wp-content/uploads/2018/10/Innovation-Performance-Framework.pdf">framework</a> if you’re unsure what we mean here.</p><p>This post was originally published on <a href="https://commodoreinnovation.co/blog/most-companies-are-getting-worse-at-innovation/">commodoreinnovation.co</a> on June 4, 2019.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5c1a998105ee" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/most-companies-are-getting-worse-at-innovation-is-yours-5c1a998105ee">Most Companies are Getting Worse at Innovation. Is Yours?</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Innovation Performance Measurement System Check-up]]></title>
            <link>https://medium.com/dead-reckoning/the-innovation-performance-measurement-system-check-up-78211ab5c112?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/78211ab5c112</guid>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-measurement]]></category>
            <category><![CDATA[innovation]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Wed, 04 Mar 2020 22:15:03 GMT</pubDate>
            <atom:updated>2020-03-04T22:15:03.504Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3YVrnXh9TfnOp0VU9RO2TQ.png" /></figure><p><strong>Problem</strong>: Most firms neglect to evaluate the effectiveness of their innovation performance measurement systems.</p><p><strong>Action</strong>: Conduct a quick check-up by following the 3 steps below.</p><p>High-performing companies know that using metrics effectively is critical to managing innovation. And they see the payback — they attribute 20% of their improvement in innovation performance to better management by metrics.1 And yet, <a href="https://commodoreinnovation.co/innovation-dashboards/">research conducted by the Innovation Research Interchange</a> indicates most organizations don’t review the effectiveness of their measurement systems, even on an ad-hoc basis. If your organization is among those, follow the 3 steps below.</p><h3>Step 1. Check your innovation performance measurement system’s intended functions.</h3><p>Over time, innovation leaders can find themselves with a hodgepodge of metrics — some that they collect because “it’s what we’ve always done;” some because someone read that a competitor collects them; some because the CFO asked for them; etc. But then those metrics don’t end up being used to inform specific decisions. In the best case, reporting unnecessary metrics is a waste of time and resources. In the worst case, those metrics end up sending contradictory or confusing signals that lead to bad decision making.</p><p>It’s important to be deliberate in identifying how the information generated by your innovation performance measurement system will be used. The diagram below lists the possible functions. First, choose the functions your system is intended to accomplish. Next, identify “orphan metrics” — metrics you track that don’t correspond to any of those functions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/0*UasEi-OJdarc4OwP" /></figure><p>Last, determine whether your system is <em>effective </em>at each of the intended functions. The following, corresponding questions may help.</p><ul><li>Do you have the information you and leadership need, to know if your portfolio(s) and mix align with your firm’s strategy, risk tolerance, and innovation ambitions?</li><li>Do you have the information you need to determine portfolio-level investments? What about to allocate resources to projects (e.g., which new projects to fund, which existing projects to continue and which to kill)?</li><li>Can you quickly ascertain whether projects are making sufficient progress toward unlocking future value?</li><li>Using information from your measurement system, can you communicate with leadership, innovation teams, and other functions about innovation priorities and progress?</li><li>Can you tell where improvements in innovation <em>capabilities</em> are most needed?</li><li>Do you have the information you need to evaluate team performance?</li></ul><h3>Step 2: Ask your stakeholders whether the innovation performance measurement system is working for them.</h3><p>We’re big believers in getting to know the customers of your innovation performance measurement system, just as you would for a new product or service concept. So, to review the system’s effectiveness, ask your stakeholders for input. Choose 8 to 10 people including representatives of your team, leadership, and other internal “customers” for innovation. Schedule short (&lt; 30-minute) conversations with each.</p><p>Remind each stakeholder of the functions of your measurement system, as identified in Step 1. For example: “We want to make sure we stay aligned with strategy, get more systematic at allocating resources, and keep everyone posted on the progress being made. We’re having these conversations to make sure we’re accomplishing those things and meeting your information needs.” Then proceed with a few focused questions like:</p><ul><li>Of the information we report, what is most helpful or interesting to you? What else would you like to know, or learn about?</li><li>Does our reporting schedule/cadence align with decisions you need to make?</li><li>What concerns do you have about the state of the innovation function? Is there anything you believe we should be actively encouraging (e.g., more risk-taking) or discouraging (e.g., short-termism)?</li></ul><h3>Step 3: Eliminate unnecessary metrics and prioritize improvements.</h3><p>Next we recommend the following steps to identify specific actions to take:</p><p>A. Eliminate the “orphan metrics” you identified in Step 1.</p><p>B. Make a “long list” of the areas in which your system needs improvement, drawing from the questions you answered “no” to in Step 1; and the input from stakeholders on preferences, cadence, and general concerns.</p><p>C. Select the 3–5 areas above that, if improved, would have the most appreciable positive effect.</p><p>D. Translate those 3–5 areas into actions to improve, and tackle those first.</p><p>This will get you started in addressing some common problems with innovation performance measurement. Be on the lookout for resources for more advanced fine-tuning in the coming weeks. If you want help sooner, <a href="/service/mailto:phil@commodoreinnovation.co">email Phil</a>. We’d be glad to review your system against best (and emerging) practices and provide some recommendations for improvement.</p><h3>References</h3><p>1—RTEC (2010). <em>Driving effective R&amp;D performance through effective measurement.</em></p><p>2 — Adapted from: Godener, A. and Söderquist, K. E. (2004). Use and impact of performance measurement results in R&amp;D and NPD. <em>R&amp;D Management</em> 34.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=78211ab5c112" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/the-innovation-performance-measurement-system-check-up-78211ab5c112">The Innovation Performance Measurement System Check-up</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Avoid disruption with the right innovation metrics — Innovation Book Series]]></title>
            <link>https://medium.com/dead-reckoning/avoid-disruption-with-the-right-innovation-metrics-innovation-book-series-6265921a2893?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/6265921a2893</guid>
            <category><![CDATA[innovation-measurement]]></category>
            <category><![CDATA[disruption]]></category>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Wed, 04 Mar 2020 13:44:10 GMT</pubDate>
            <atom:updated>2020-03-03T21:20:31.008Z</atom:updated>
            <content:encoded><![CDATA[<h3>Avoid disruption with the right innovation metrics — Innovation Book Series</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*f-_MDS5l26whJESmfX4sAg.jpeg" /></figure><p><em>With this blog post we launch an occasional series exploring what some of the best innovation books say about measuring and evaluating innovation. Since you’re reading this blog you are probably trying to figure out how to better measure your innovation efforts (either that or you’re a family member and here under duress). You may also be interested in exploring what some of innovation’s leading thinkers have said about evaluation, measurement, and innovation metrics. We’re starting this series to help directly answer that question (and, perhaps, save you some time).</em></p><p>So where to start? We thought Christensen’s <em>The Innovator’s Dilemma </em>was a fairly obvious place to begin, and so did Google’s algorithms, so we must be right.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/624/0*087GMA_QiEuvg6kr" /></figure><p>Firstly: if you’re hoping for a summary of Christensen’s main points here, you’ll be disappointed. Go read the <a href="https://www.amazon.com/Innovators-Dilemma-Revolutionary-Change-Business/dp/0062060244">book</a> instead. Seriously. Our intent is to explore what the book says specifically about measuring innovation. And, the answer? Nothing. Ok, I’ll admit it, I didn’t re-read the entire book, but a quick scan suggests that the book doesn’t have anything big to say <strong>directly</strong> about measuring innovation. BUT (yes, that big), some of Christensen’s key findings do have significant implications for measurement of innovation processes. Here’s what jumped out at me as I flipped back through the book.</p><h3>Christensen’s Second Dilemma</h3><p>There are, of course, incumbent companies that are disrupted because they aren’t paying attention, or fail to act at all. But Christensen and collaborators found that incumbents were often aware of what would eventually become disruptive technologies, in their early days. Engineers in those firms explored these technologies, building early prototypes and seeking internal resources to undertake development. Although they had both foresight and resources, the projects were not successfully executed; and those firms were ultimately disrupted.</p><p>Why? Christensen’s provides the following description:</p><blockquote>“<em>… in the day-to-day decisions about how time and money would actually be allocated, engineers and marketers, acting in the best interests of the company, consciously and unconsciously starved the disruptive project of resources necessary for a timely launch.</em>”</blockquote><p>(Christensen, 2000, p. 50)</p><p>So, even though companies had decided to explicitly explore a technology, the projects floundered because people shifted resources away to other projects. To me it is fascinating that those individuals thought they were making the right decision for the company, despite having been given approval to explore these potentially disruptive innovations.</p><p>Why did those people think they were acting in the best interests of the firm? Christensen argues that, to succeed in a context of “sustaining” innovations, individuals develop strong knowledge of — even intuition for — what creates value for their existing customers and their existing business. That knowledge and intuition becomes a powerful implicit incentive, causing individuals to prioritize time away from the “disruptive” project towards more traditional initiatives where the value being created resonated with their intuition.</p><p>Innovation managers have several options to overcome these implicit incentives. Some firms go to great lengths, creating entirely new R&amp;D teams to explore disruptive technologies. One global manufacturer we’re familiar with went so far as to deliberately isolate its innovation lab team from current customers, to make sure they were not constrained by current paradigms.</p><h3>The Innovation Metrics Solution</h3><p>Like I said, Christensen didn’t address measurement directly, but we see innovation metrics as a simpler solution to this dilemma. Managers should carefully consider metrics used to evaluate the progress and success of “disruptive” innovation projects. The “wrong” innovation metrics can reinforce the implicit incentives discussed above. The “right” innovation metrics can ensure team members are conscious of those incentives and provide an alternative framework to assess how they are creating value for the business.</p><p>Important questions to address when framing innovation metrics and setting objectives for a “disruptive” innovation project might include:</p><ul><li>How do we track “activity” to ensure timely execution and provide managers with insight into whether resources are being prioritized away from the project?</li><li>What “outcome” metrics would help make value creation clear for team members, even if that value is not for our existing customers?</li><li>How do we ensure these metrics are given equal weight (with metrics related to more conventional innovation projects) when evaluating staff performance?</li></ul><h3><strong>Reference</strong></h3><p>Christensen, C. M. (2000). <em>The innovator’s dilemma</em>. Harper Business, New York.</p><p>Originally published on <a href="https://commodoreinnovation.co/blog/avoid-disruption-with-innovation-metrics/">commodoreinnovation.co</a> on April 27, 2018</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6265921a2893" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/avoid-disruption-with-the-right-innovation-metrics-innovation-book-series-6265921a2893">Avoid disruption with the right innovation metrics — Innovation Book Series</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The way we measure innovation hasn’t changed in 10 years.]]></title>
            <link>https://medium.com/dead-reckoning/the-way-we-measure-innovation-hasnt-changed-in-10-years-a72b784e02a?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/a72b784e02a</guid>
            <category><![CDATA[research-and-development]]></category>
            <category><![CDATA[innovation-portfolio]]></category>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <dc:creator><![CDATA[Phil Watson]]></dc:creator>
            <pubDate>Tue, 03 Mar 2020 21:09:25 GMT</pubDate>
            <atom:updated>2020-03-03T21:09:25.707Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*rXnBVouRxC2VtjXmkOZJ7w.jpeg" /></figure><p>The way companies measure innovation initiatives is outdated. Despite all the progress that has been made in innovation practice in the last decade, firms are still measuring innovation in much the same way. And let’s not forget that <em>what gets measured gets done </em>(with apologies to <a href="https://athinkingperson.com/2012/12/02/who-said-what-gets-measured-gets-managed/">Drucker, Lord Kelvin</a>, <a href="http://www.transperfect.com/blog/four-reasons-why-translation-quality-measurements-are-important">Rheticus</a> or whoever the original source was).</p><h3>Companies are using the same old metrics.</h3><p>Take a look back at surveys on innovation practice that were done in 2008 — here’s one by <a href="http://www.klmanagement.fr/images/PDF/Articles/Innovation%20survey_bcg_2008%20%28002%29.pdf">BCG</a>, and another by <a href="http://innovbfa.viabloga.com/files/McKinseyQuaterly___assessing_innovation_metrics___oct_2088.pdf">McKinsey</a>. The most frequently used metrics include:</p><ul><li>Percentage of sales from new products or services</li><li>Overall revenue growth</li><li>Number of new products or services</li><li>Return on innovation spending.</li></ul><p>Fast forward to more recent surveys (e.g., by Innosight &amp; Innovation Leader) and almost exactly the same metrics show up on the leaderboards. For example, the top ranked metric in the IL survey was “<em>revenue generated from innovation projects</em>” — which captures the same insight as the first two metrics from the earlier surveys shown above. Another popular metric in the IL survey was “<em>internal rate of return</em>” — essentially equivalent to “<em>return on innovation spending.</em>” While “<em>number of new products and services</em>” didn’t explicitly show up in the IL survey, firms still take the same simple activity-based approach, just earlier in the pipeline (e.g. <em>number of projects in the pipeline</em>, <em>number of ideas generated</em>).</p><p>It’s not that these are necessarily bad metrics. For example, as an impact metric, “<em>percentage of sales from new products or services</em>” meets several key tests:</p><ol><li>It’s likely to align strongly with senior management’s objectives for their investments in innovation.</li><li>It’s clear and easy to communicate.</li><li>It’s (relatively) straightforward to collect the data necessary to calculate the metric.</li></ol><p>I guess it’s possible that metrics haven’t changed simply because everyone is happy with the metrics they have — they get all the information they need from them. But that doesn’t resonate with our experience, and <a href="https://commodoreinnovation.co/?p=475">everyone sure seems dissatisfied with innovation</a>.</p><h3><strong>Innovation performance measurement is more than metrics.</strong></h3><p>Conversations about innovation measurement often start and stop with the topic above — which metrics are best? That’s another way innovation measurement — and I would argue, innovation <em>performance</em> — is stuck. With rare exceptions, companies haven’t gotten more sophisticated with measurement practices in the last 10 years, either. If they had, I’d expect to see more high-quality measurement systems that:</p><ul><li><strong>Are elegant.</strong> An up-to-date measurement system would be clear as to purpose and streamlined to collect only metrics that are used to make decisions.</li><li><strong>Enable benchmarking.</strong> Cutting-edge innovation measurement would enable comparison of performance, internally (e.g., across business units, over time) and externally.</li><li><strong>Are built for communication.</strong> Where outdated systems are built only for reporting status “up,” high-quality systems help project teams make decisions <em>and</em> build understanding and commitment among stakeholders.</li><li><strong>Align with decision-making culture.</strong> Effective measurement systems align communication with the way decisions are made in your company.</li><li><strong>Are effective for diverse portfolios.</strong> High-quality measurement systems handle hard-to-measure front end and “disruptive” projects, not just routine new product development projects.</li><li><strong>Measure the impact of changes.</strong> A cutting-edge system would be able to quantify the impact of changes to processes and tools, and innovation culture initiatives, on outcomes.</li></ul><h3><strong>Measurement hasn’t kept up with the evolution of innovation practices.</strong></h3><p>What’s particularly striking about the lack of change in metrics is that innovation practices have evolved significantly in recent years. Take, for example, the use of tools and methods like human-centered design, Lean Startup, and agile innovation. In many ways adoption of these practices marks a significant moment in the maturity of innovation management as a function. No longer are innovation professionals forced to adapt ill-suited tools and methods that were developed for parts of the business that focus on execution. Now they have at their disposal techniques specifically developed to address the challenges unique to innovation initiatives. Many of these techniques create the opportunity to measure innovation initiatives in more effective ways — ways that more accurately reflect whether an initiative is successful and likely to deliver value for the organization.</p><p>Innovation practices are evolving. It’s time the ways we measure innovation did too.</p><p><em>Originally published at </em><a href="https://commodoreinnovation.co/blog/measurement-hasnt-changed-in-10-years/"><em>commodoreinnovation.co</em></a><em> on April 20, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a72b784e02a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/the-way-we-measure-innovation-hasnt-changed-in-10-years-a72b784e02a">The way we measure innovation hasn’t changed in 10 years.</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Why ‘Dead Reckoning’?]]></title>
            <link>https://medium.com/dead-reckoning/why-dead-reckoning-392f612469fe?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/392f612469fe</guid>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[corporate-innovation]]></category>
            <category><![CDATA[innovation]]></category>
            <category><![CDATA[metrics]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <dc:creator><![CDATA[Adrienne Brown]]></dc:creator>
            <pubDate>Fri, 14 Sep 2018 17:40:45 GMT</pubDate>
            <atom:updated>2018-09-12T21:47:46.114Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kigp8zbvvtqbB2cth0OmQA.jpeg" /></figure><p>We thought we’d better go ahead and address this one right up front. What is “dead reckoning” and why on earth would we pick that as the name of our blog?</p><p><a href="https://en.wikipedia.org/wiki/Dead_reckoning">Dead reckoning</a>: the process of calculating one’s current position by using a previously determined position, or fix, and advancing that position based upon known or estimated speeds over elapsed time and course.</p><p>So, you see, dead reckoning is a traditional form of navigation. Mariners have used it for centuries — it’s what Columbus and others used during the Age of Exploration — and aviators later followed suit. A dead reckoning position is the most precise position a navigator can come up with, with <a href="https://timeandnavigation.si.edu/navigating-at-sea/navigating-without-a-clock/dead-reckoning">just a compass, chart, and an estimate of speed</a>.</p><p>Navigation by dead reckoning can be surprisingly accurate, while imperfect. It works even when you can’t get your bearings, e.g., when you can see neither land nor sky.</p><p>Where’s the connection to innovation, and to us, you ask? Wait, there’s more! (Also, you seem awfully invested in this explanation.)</p><p>First of all, “exploring while disoriented” sounds a lot like what innovating feels like. And despite the imperfections and the vast number of unknowns, explorers measured and tracked what they could. We don’t always see that commitment by innovation leaders under similar conditions, especially with hard-to-measure innovation efforts.</p><p>Dead reckoning doesn’t further complicate a complicated situation. It relies on the basics.</p><p>Lastly, dead reckoning is an early system. Over time, it moved from a manual practice to a computer automated one. More sophisticated navigation systems like <a href="https://timeandnavigation.si.edu/satellite-navigation/reliable-global-navigation/inertial-navigation">inertial navigation</a> and global positioning followed. But people still use dead reckoning today, alongside high-tech methods — a good navigator never relies on a single method.</p><p>So those are the connections.* We think it’s critical to measure innovation activities, even if it’s difficult and conditions are subject to change. We believe there are simple, even old-school, measurement practices that can be more widely adopted for innovation. And we think it’s still early days for innovation metrics — the more innovation leaders use and refine the simple stuff, the more sophisticated the tools and practice will get.</p><p>Any other questions?</p><p>* Well, there was one more. It had to do with the fact that “reckon” is one of the few colloquialisms that are used in both of the far-flung places Commodore’s co-founders hail from — the rural southern US and the rural southern New Zealand. If you must know, we barely understand each other half of the time.</p><p>Photo by <a href="https://unsplash.com/photos/yM2Je9uCyOs?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Pete Wright</a> on <a href="https://unsplash.com/search/photos/sailboat-fog?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></p><p><em>Originally published at </em><a href="https://commodoreinnovation.co/blog/why-dead-reckoning/"><em>commodoreinnovation.co</em></a><em> on May 4, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=392f612469fe" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/why-dead-reckoning-392f612469fe">Why ‘Dead Reckoning’?</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Companies struggle to measure well at the front end of innovation]]></title>
            <link>https://medium.com/dead-reckoning/companies-struggle-to-measure-well-at-the-front-end-of-innovation-41ec512d2dcd?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/41ec512d2dcd</guid>
            <category><![CDATA[corporate-innovation]]></category>
            <category><![CDATA[innovation]]></category>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <category><![CDATA[metrics]]></category>
            <dc:creator><![CDATA[Adrienne Brown]]></dc:creator>
            <pubDate>Fri, 14 Sep 2018 17:40:35 GMT</pubDate>
            <atom:updated>2018-09-12T21:52:23.191Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*b0-GRrvedacI2jY4BlRX0w.jpeg" /></figure><p>We think companies can measure better all along the innovation pipeline, but if you asked us what sorts of activities need the most improvement vis-à-vis measurement? It’s not even close: it’s at the front end.</p><p>The front end of innovation holds all of the activities companies undertake to figure out what to make for whom. It’s called the front end because it happens before the better defined, more linear part of an innovation process. In images depicting these processes, it’s situated in front of the ubiquitous funnel. It may be festooned with lightbulbs or fairy dust.</p><p><strong>There aren’t established options for measuring progress before you have a concept.</strong></p><p>Smart people struggle with measurement at the front end for lots of reasons. For one thing, there are fewer well-established <em>options </em>for measuring at the front end. If you look for guidance on innovation measurement, most of what you’ll find evaluates the potential or tracks the progress of a given product or service concept, designed for a target customer. This is decidedly not helpful at the point in the process where you may know neither.</p><p>Once you have a product or service concept, you could start using traditional metrics like ROI or NPV. (There are lots of downsides to early use of these, but they’re on the list of possibilities.) You could also use the metrics set forth by your chosen innovation process. The Outcome-Driven Innovation approach, for example, would have you define the jobs to be done and prioritize subsequent concepts in terms of how well they fulfill those jobs. As Phil described <a href="https://commodoreinnovation.co/blog/innovation-accounting/">here</a>, Lean Startup proponents would model their value and growth hypotheses and run experiments to test them.</p><p>But what about all of the work it takes to identify the customer and land on a concept? Looking at the service development process we use at Commodore, below,* none of those approaches offer metrics for the first 5 of the 7 steps:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*_RQ2lri7u1_8asXm" /></figure><p><strong>Front-end goals don’t lend themselves to easy measurement.</strong></p><p>Metrics help us assess progress toward stated goals. Is it something about the goals of those activities that makes them resistant to straightforward measurement? If you overlay the intended outcome of each stage…</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*wqDndrAmNk_AxlTT" /></figure><p>… you’ll see that the goals in those first steps are shared perspective, a shared basis for judgment. These may seem nebulous, but this is the work of the front end. In later stages, the work is to test, to prove and disprove. Michael Winnick, the founder of dScout, a remote user research platform, says the front end “is about getting people to believe things, And belief is different than proof. Belief is about taking leaps or developing a sense of intuition about what’s next or asking, ‘Why should I do something bold when there are an enormous amount of really valid reasons not to do anything at all?’”</p><p>So the goals at the front end resist straightforward measurement. And learning, the means for reaching those goals, is notoriously hard to measure. It’s even more difficult in the context at hand, when innovating teams need to find, evaluate, assimilate, and apply new knowledge and capabilities.</p><p><strong>With few straightforward options, companies forego measurement or focus on output.</strong></p><p>Faced with few agreed-upon options and goals that aren’t easy to measure, companies tend to do one of two things. They forego measurement at this stage altogether, or they focus exclusively on output metrics (e.g., number of ideas generated, number of people who attended a workshop, number of meetings with startups). While those sorts of things are easy to measure, they’re almost certainly not the most important or useful things to measure. Without getting beyond output and into outcome metrics, you won’t know if those activities are advancing your ultimate objectives.</p><p>Additionally, an emphasis on output metrics may unintentionally prescribe an approach at exactly the point when teams need to experiment with methods and process.</p><p><strong>Good measurement matters, especially at the front end.</strong></p><p>So what? Does it matter that companies struggle to measure well at the front end? Based on how often we’ve seen poor measurement practices foil important front-end initiatives, we’d say yes, unequivocally.</p><p>Good measurement enables innovation teams and leaders to communicate clearly — about their charge, their methods, their impact. Without such communication, stakeholders often misunderstand or outright dismiss front-end initiatives. Front-end teams are therefore unable to garner the support they need from across the organization. That may mean they don’t get the right staff or feedback for projects, or that they’re unable to transition opportunities to business units.</p><p>Good measurement provides the information innovation teams need to make decisions, like which opportunities to pursue and which tools and techniques are most effective. Good practices also ensure that teams and leaders don’t spend a disproportionate amount of time <em>on measurement</em> — we’ve seen many innovation managers spend the bulk of their time crafting their next presentation to executive leadership, rather than on the actual work of the front end.</p><p>Lastly, poor measurement practices represent an existential threat for both the innovating function and the company. Without the ability to demonstrate progress toward agreed-upon outcomes, innovation teams won’t be able to secure needed funding for these front-end initiatives. The mission of work at the front end — to decide what to make next, for whom — makes its success (and therefore its measurement) vitally important.</p><p>If you’re struggling with the challenges described above check out our step-by-step <a href="https://commodoreinnovation.co/project-guide/">guide</a> to measuring innovation performance at a project level.</p><p>* Our process has been adapted in practice, based on context and sequences from <em>The paradox of design research</em> (Johnson), <em>User requirements by any means necessary</em> (Don &amp; Petrick), <em>Bringing clarity to the “fuzzy front end”</em> (Rhea), and The Essential Persona Lifecycle (Adlin).</p><p><em>Originally published at </em><a href="https://commodoreinnovation.co/blog/measure-front-end-of-innovation/"><em>commodoreinnovation.co</em></a><em> on June 12, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=41ec512d2dcd" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/companies-struggle-to-measure-well-at-the-front-end-of-innovation-41ec512d2dcd">Companies struggle to measure well at the front end of innovation</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How to Measure Your Innovation Project: A Guide]]></title>
            <link>https://medium.com/dead-reckoning/how-to-measure-your-innovation-project-a-guide-32e400dd2d16?source=rss----263d8aa23e97---4</link>
            <guid isPermaLink="false">https://medium.com/p/32e400dd2d16</guid>
            <category><![CDATA[innovation-management]]></category>
            <category><![CDATA[metrics]]></category>
            <category><![CDATA[innovation-metrics]]></category>
            <category><![CDATA[corporate-innovation]]></category>
            <category><![CDATA[innovation]]></category>
            <dc:creator><![CDATA[Adrienne Brown]]></dc:creator>
            <pubDate>Fri, 14 Sep 2018 17:40:26 GMT</pubDate>
            <atom:updated>2018-09-12T21:57:55.755Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/827/1*yp2DS8b97_4iS4htR11oMg.jpeg" /></figure><p>Since starting Commodore a few months ago, we’ve talked with dozens of innovation practitioners who know how important it is to measure performance, <em>but</em> …! But they’re not sure how to get started. But they’re not sure how to make the case for investing time to measure. But they already have a system … but it doesn’t seem to be useful.</p><p>So we wanted to help. We created a step-by-step guide that’ll work whether you’re starting from scratch, or you have a system in place that needs a tune-up.</p><p>The guide is primarily for people who lead an innovation project in a large organization. (If you’re not sure why the large org context matters, check out the guide. It most decidedly does.)</p><p><strong>We designed the process so you and your team can do it in less than a day, so go </strong><a href="https://commodoreinnovation.co/project-guide-1/"><strong>here</strong></a><strong> to download and try it out.</strong></p><p>Let us know if you have questions or feedback!</p><h3>What about portfolio-level measurement?</h3><p>If you’re responsible for oversight across many projects, or for your organization’s innovation management practices, it’ll be helpful for you, too. If you want to know when our guide to managing innovation portfolios is out, visit <a href="https://commodoreinnovation.co/downloads/">our downloads page</a> and click on the notify me button.</p><p><em>Originally published at </em><a href="https://commodoreinnovation.co/blog/project-measurement-guide/"><em>commodoreinnovation.co</em></a><em> on August 1, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=32e400dd2d16" width="1" height="1" alt=""><hr><p><a href="https://medium.com/dead-reckoning/how-to-measure-your-innovation-project-a-guide-32e400dd2d16">How to Measure Your Innovation Project: A Guide</a> was originally published in <a href="https://medium.com/dead-reckoning">Dead Reckoning</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>