<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Kamal R. Mahtani on Medium]]></title>
        <description><![CDATA[Stories by Kamal R. Mahtani on Medium]]></description>
        <link>https://medium.com/@krmahtani?source=rss-1c30a092cd12------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*L0tbaxITW0BFBGzV.jpg</url>
            <title>Stories by Kamal R. Mahtani on Medium</title>
            <link>https://medium.com/@krmahtani?source=rss-1c30a092cd12------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 05:34:06 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@krmahtani/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[‘Spin’ in reports of clinical research]]></title>
            <link>https://medium.com/@krmahtani/based-on-a-previous-blog-and-now-published-in-the-bmj-evidence-based-medicine-journal-7799e43c5b02?source=rss-1c30a092cd12------2</link>
            <guid isPermaLink="false">https://medium.com/p/7799e43c5b02</guid>
            <category><![CDATA[science]]></category>
            <category><![CDATA[evidence-based-medicine]]></category>
            <category><![CDATA[spin]]></category>
            <category><![CDATA[health]]></category>
            <category><![CDATA[healthcare]]></category>
            <dc:creator><![CDATA[Kamal R. Mahtani]]></dc:creator>
            <pubDate>Fri, 21 Oct 2016 05:36:23 GMT</pubDate>
            <atom:updated>2016-10-21T05:48:07.709Z</atom:updated>
            <content:encoded><![CDATA[<blockquote>Based on a previous blog and now published in the BMJ Evidence Based Medicine Journal . This is the author version.</blockquote><h4>Abstract</h4><p>Clinical research is frequently hampered by flaws in its design or conduct. Such biases have been well documented. However, reports of clinical research may also be biased and present results in a more favourable way than they deserve or downplay harms. Such ‘spin’ in reporting has been demonstrated empirically. This short commentary summarises some of the problems with spin in reports of clinical research as well as signposts to some of the empirical evidence demonstrating its effect.</p><h4>Introduction</h4><p>For many researchers, numbers of publications and the impact those publications make, is the usual currency for measuring professional worth. Furthermore, researchers are increasingly discussing their work in public through mainstream and social media, as more of these opportunities arise. With this increased exposure may come a temptation for researchers to report the results of their findings in a more favourable way than they deserve, that is, to add some spin. However, according to the EQUATOR network, such practice constitutes misleading reporting and they highlight as particularly bad practice misinterpretation of study findings, for example, presenting a study in a more positive way than the actual results reflect or down play harms.[1]</p><h4>Prevalence of spin in clinical research</h4><p>An analysis of 72 randomised controlled trials that reported primary outcomes with statistically ‘non-significant’ results, found that more than 40% of the trials had some form of spin, defined by the authors as the “use of specific reporting strategies, from whatever motive, to highlight that the experimental treatment is beneficial, despite a statistically non-significant difference for the primary outcome, or to distract the reader from statistically non-significant results”.[2] The analysis identified a number of strategies for spin. Some of the most common techniques were focusing reporting on statistically significant results for other analyses, that is, not the primary outcomes; or focusing on another study objective and distracting the reader from a statistically non-significant result. Another analysis, this time involving 107 randomised controlled trials in oncology, similarly found that nearly half of the trials demonstrated some form of spin in either the abstract or the main text.[3]</p><p>Systematic reviews of primary research should, in theory at least, address some of these problems. By seeking the totality of available evidence, interpreting the impact of bias and then synthesising the evidence into a useable form, are powerful tools for informing clinical decisions. However, not all systematic reviews are equal. Non-Cochrane systematic reviews are twice as likely to have positive conclusion statements as Cochrane reviews.[4] Furthermore, non-Cochrane reviews, when matched to an equivalent Cochrane review on the same topic, are more likely to report larger effect sizes with lower precision than the equivalent Cochrane review.[5] In both cases, these findings may well reflect the extent to which methodological complexity is ignored or sidestepped in poorer quality reviews.</p><p>Thus, not all systematic reviews are equal and neither are they exempt from spin. A review of the presence of spin in systematic reviews of psychological therapies showed that spin was present in 27 of the 95 included reviews (28%).[6] Another recent study identified 39 different types of spin that may be found in a systematic review.[7] Thirteen of those were specific to reports of systematic reviews and meta-analyses. When Cochrane systematic review editors and methodologists were asked to rank the most severe types of spin found in the abstracts of reviews, their top three were (1) recommendations for clinical practice not supported by findings in the conclusion, (2) a misleading title and (3) selective reporting.</p><h4>Impacts of spin from clinical research</h4><p>Spin may influence the interpretation of information by clinicians. A randomised controlled trial allocated 150 clinicians to assess a sample of cancer-related abstracts with spin and another 150 clinicians to assess the same abstract with the spin removed.[8] Although the absolute effect size was small, the study found that the presence of spin was significantly more likely to induce the clinicians to report that the treatment was beneficial. Paradoxically, the study also showed that spin caused clinicians to rate the study as being ‘less’ rigorous and they were more likely to want to review the full-text article.</p><p>Dissemination of research findings to the public, for example, through mainstream media, can also be a source of added spin. An analysis of 498 scientific press releases from the EurekAlert! Database identified 70 that referred to two-arm, parallel-group randomised controlled trials.[9] Spin, which included a tendency to put more emphasis on the beneficial effects of a treatment, was identified in 33 (47%) of the press releases. Furthermore, the authors of the analysis found that the main factor associated with spin in a press release was the presence of spin in the abstract conclusion.</p><h4>Motivation for adding spin</h4><p>This is a complex area, to which more relevant research might add clarity. A desire to demonstrate ‘impact’ from one’s work may certainly be one driver. Another may be wishful thinking, the desire to have a treatment that works.[10] Other proposed mechanisms include (1) ignorance of scientific standards, (2) young researchers’ imitation of previous practice, (3) unconscious prejudice or (4) wilful intent to influence readers.7</p><p>Pre-existing conflicts of interest (COI) will almost certainly have some bearing on the presence of spin. As an example, an overview of systematic reviews examined whether financially related COI influenced the overall conclusions from systematic reviews that examined the relationship between the consumption of sugar-sweetened beverages (SSBs) and weight gain or obesity.[11] Of the included studies, 5/6 systematic reviews that disclosed some form of financial COI with the food industry, reported no association between consumption of SSBs and weight gain. In contrast, 10/12 reviews, which reported no potential COI, found that consumption of SSBs could be a risk factor for weight gain.</p><p>While a great deal of discussion focuses on financial COI, relatively less time is spent in recognising the problems that arise from ‘non-financial’ COI (NFCOI) or ‘private interests’.[12] For systematic reviews, these types of conflicts have been defined as ‘a set of circumstances that creates a risk that the primary interest – the quality and integrity of the systematic review – will be unduly influenced by a secondary or competing interest that is not mainly financial’.[13] Examples of NFCOI include strongly held personal beliefs (eg, leading to a possible ‘allegiance bias’), personal relationships, a desire for career advancement or (increasingly possible now) a greater media profile.[13 ,14] All of these have the potential to affect professional judgement and may generate a message that does not convey a fair reflection of the true research findings.</p><p>Unfortunately a significant proportion of clinical research is still littered with various types of bias, which can influence treatments and waste valuable resources.[15 ,16] The added bias of spin, whether motivated by financial, personal or intellectual COI, or even plain ignorance, further complicates the problem. Those who produce research evidence, as well as those who read it, must remain vigilant.</p><p>Acknowledgments</p><p>The author extends thanks to Jeff Aronson, Meena Mahtani and Annette Plüddemann for helpful comments on an earlier draft.</p><p>Footnotes</p><p>Twitter Follow Kamal Mahtani at @krmahtani</p><p>Funding KRM is supported by an NIHR Clinical Lecturer award.</p><h4>Disclaimer</h4><p>The views expressed are those of the author and not necessarily those of the NHS, the NIHR or the Department of Health.</p><p>Competing interests None declared.</p><p>Provenance and peer review Not commissioned; internally peer reviewed.</p><p>Data sharing statement This is an adaptation of a preliminary paper that was posted as a blog: http://blogs.bmj.com/bmj/2016/06/21/kamal-r-mahtani-beware-evidence-spin-an-important-source-of-bias-in-the-reporting-of-clinical-research/</p><h4>References</h4><p>1-The EQUATOR Network|Enhancing the QUAlity and Transparency Of Health Research.http://www.equator-network.org/ (accessed 8 Sep 2016).</p><p>2-Boutron I, Dutton S, Ravaud P, et al. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA2010;303:2058 – 64. doi:10.1001/jama.2010.651</p><p>[CrossRef][Medline][Web of Science]Google Scholar</p><p>3-Vera-Badillo FE, Napoleone M, Krzyzanowska MK, et al. Bias in reporting of randomised clinical trials in oncology. Eur J Cancer 2016;61:29 – 35. doi:10.1016/j.ejca.2016.03.066</p><p>[CrossRef][Medline]Google Scholar</p><p>4-Tricco AC, Tetzlaff J, Pham B, et al. Non-Cochrane vs. Cochrane reviews were twice as likely to have positive conclusion statements: cross-sectional study. J Clin Epidemiol2009;62:380 – 6.e1. doi:10.1016/j.jclinepi.2008.08.008</p><p>[CrossRef][Medline]Google Scholar</p><p>5-Useem J, Brennan A, LaValley M, et al. Systematic differences between Cochrane and non-Cochrane meta-analyses on the same topic: a matched pair analysis. PLoS ONE2015;10:e0144980. doi:10.1371/journal.pone.0144980</p><p>[CrossRef][Medline]Google Scholar</p><p>6-Lieb K, von der Osten-Sacken J, Stoffers-Winterling J, et al. Conflicts of interest and spin in reviews of psychological therapies: a systematic review. BMJ Open 2016;6:e010606.doi:10.1136/bmjopen-2015–010606</p><p>[Abstract/FREE Full text]</p><p>7-Yavchitz A, Ravaud P, Altman DG, et al. A new classification of spin in systematic reviews and meta-analyses was developed and ranked according to the severity. J Clin Epidemiol 2016;75:56 – 65. doi:10.1016/j.jclinepi.2016.01.020</p><p>[CrossRef][Medline]Google Scholar</p><p>8-Boutron I, Altman DG, Hopewell S, et al. Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial. J Clin Oncol 2014;32:4120 – 6. doi:10.1200/JCO.2014.56.7503</p><p>[Abstract/FREE Full text]</p><p>9-Yavchitz A, Boutron I, Bafeta A, et al. Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study. PLoS Med 2012;9:e1001308.doi:10.1371/journal.pmed.1001308</p><p>[CrossRef][Medline]Google Scholar</p><p>10-Landefeld CS, Shojania KG, Auerbach AD. Should we use large scale healthcare interventions without clear evidence that benefits outweigh costs and harms? No. BMJ2008;336:1277. doi:10.1136/bmj.a144</p><p>[FREE Full text]</p><p>11-Bes-Rastrollo M, Schulze MB, Ruiz-Canela M, et al. Financial conflicts of interest and reporting bias regarding the association between sugar-sweetened beverages and weight gain: a systematic review of systematic reviews. PLoS Med 2013;10:e1001578; discussion e1001578. doi:10.1371/journal.pmed.1001578</p><p>[CrossRef][Medline]Google Scholar</p><p>12-PLoS Medicine Editors. Making sense of non-financial competing interests. PLoS Med2008;5:e199.</p><p>[CrossRef][Medline]</p><p>13-RTI International-University of North Carolina Evidence-based Practice Center.Identifying and managing nonfinancial conflicts of interest for systematic reviews. Rockville, MD: Agency for Healthcare Research and Quality (US), 2013.</p><p>14-Munder T, Gerger H, Trelle S, et al. Testing the allegiance bias hypothesis: a meta-analysis. Psychother Res 2011;21:670 – 84. doi:10.1080/10503307.2011.602752</p><p>[CrossRef][Medline]Google Scholar</p><p>15-Chalmers I,Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet 2009;374:86 – 9. doi:10.1016/S0140–6736(09)60329–9</p><p>[CrossRef][Medline][Web of Science]Google Scholar</p><p>16-Berkman ND, Santaguida PL, Viswanathan M, et al. The empirical evidence of bias in trials measuring treatment differences. Rockville, MD: Agency for Healthcare Research and Quality (US), 2014.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7799e43c5b02" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>