<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Jim Woodgett on Medium]]></title>
        <description><![CDATA[Stories by Jim Woodgett on Medium]]></description>
        <link>https://medium.com/@jwoodgett?source=rss-c1e43aefe0b2------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*6gVpX-Na2IEqOsye.jpeg</url>
            <title>Stories by Jim Woodgett on Medium</title>
            <link>https://medium.com/@jwoodgett?source=rss-c1e43aefe0b2------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Wed, 18 Nov 2026 11:14:50 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@jwoodgett/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[In Praise of the Disappearing Art of In-Person Peer Review]]></title>
            <link>https://jwoodgett.medium.com/in-praise-of-the-disappearing-art-of-in-person-peer-review-f68c5e212168?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/f68c5e212168</guid>
            <category><![CDATA[peer-review]]></category>
            <category><![CDATA[virtual-events]]></category>
            <category><![CDATA[science]]></category>
            <category><![CDATA[video-conference-software]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Mon, 12 Aug 2024 22:20:37 GMT</pubDate>
            <atom:updated>2024-08-12T22:43:15.959Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kxHwo-G5rIHhBk_xlWvGng.png" /></figure><p>Scientific research pre-1950 was a far smaller and less organized effort than what is currently offered. As the enormous value of investment in scientific research was realised post-WWII, the amount of money proffered to support research ballooned. Coupled with a significant expansion in post-secondary education with the building of new and enhancements of existing universities, an ecosystem for scientific and other forms of research blossomed, along with the training of a new generation of researchers. But with the increasing expenditures of tax payer funds there was a need to demonstrate accountability and fiscal responsibility. But how best to judge whether somebody’s idea about something very few people had even heard of was more compelling of support than anothers idea? Hence, was born peer review: review of proposals of scientists by scientists. The concept of expert evaluation also extended to scientific journals as these had become the “currency” of scientific production. If an experimental study was conducted, it’s value or likelihood of being correct/useful/appropriately robust could be judged by other scientists, who were engaged (for free) by the journal and remained anonymous to the submitting researchers.</p><p>Many researchers today see peer review as a necessary quality control of scientific research (footnote 1). There are now far more ideas and studies that can be funded or deserve wide attention when published. Success rates of grant applications typically hover between 8–20%, meaning the vast majority of submissions are rejected, despite the intense effort needed to assemble and support them. Though disheartening, few scientists would prefer there to be no review — afterall, there wouldn’t be any increase in funding with elimination of peer review. But this compact between scientists and the punishingly difficult peer review process rests on the confidence of the scientists in the fairness and effectiveness of said process.</p><p>Indeed, there have been many discussions about reforming or improving peer review — both of grant applications and publications — the latter having been distorted into a high-profit margin activity exploited by large publishing houses that charge the submitting scientists substantial fees and yet rely on the free service of their peers to actually conduct the peer review. But journal review is another topic for another day. Arguably, in a world of AI tools, broad internet sharing, near instant publication of pre-prints and the existence of freely accessible repositories (e.g. arXiv, BioRxiv and MedRiv, among many), it shouldn’t matter where a study is “published”, the cream should float to the top over time.</p><p>In any case, it is not as though there haven’t been major changes in grant peer review — the problem is, many of these have been detrimental. Canadian health researchers had a taste of major change when their major federal funding agency rolled out major reforms of programs. These included dispension of peer review panels (groups of scientists working in a particular field who come together to rate grant applications over a 2–3 day period) in favor of asynchronous virtual review. Traditional peer review assigned each expert reviewer 8–10 applications for them to assess and each grant had 2 or 3 reviews. The argument was that if 5 reviewers were assigned, even if they were not in the same room and didn’t interact, then statistically, their overall ranking would be more accurate, less subject to individual bias and therefore lead to a better and fairer outcome. Theoretically, that is, as the new process failed to account for human behaviour. By removing the need to explain and justify a review and ranking to other scientists in the room, the amount of effort and care put into a review inevitably dropped (there is a lot more detail here: <a href="https://medium.com/@jwoodgett/one-step-forward-towards-a-precipice-a464a641b7ab">https://medium.com/@jwoodgett/one-step-forward-towards-a-precipice-a464a641b7ab</a> and a follow up here: <a href="https://medium.com/@jwoodgett/peer-review-and-the-real-cost-of-popularism-or-how-to-get-640-comments-on-an-article-d9522d4cd668">https://medium.com/@jwoodgett/peer-review-and-the-real-cost-of-popularism-or-how-to-get-640-comments-on-an-article-d9522d4cd668</a> ). The result was wildly incongruent rankings and a break in confidence of both the reviewers and the scientists applying (footnote 2). Thanks to a campaign and the support of the then Minister of Health, it was soon scrapped and the old system reinstated.</p><p>That was until the pandemic when it simply wasn’t feasible to gather researchers in a gloomy hotel basement meeting room in Ottawa or Bethesda. And so, the in-person panels moved on-line (in the case of Canadian agencies, using the AMC Gremlin of video conferencing software, MS Teams). This came with some other benefits. Reviewers on the West Coast no longer had to lose an additional travel day (not to mention the associated carbon footprint), there were flight and hotel savings and those with young kids didn’t need to arrange child care. Moreover, the review discussion was done synchronously, a big difference from prior experiments with asynchronous reviews. These benefits are substantive and in the case of several funding agencies were sufficient to retain on-line reviewing after the pandemic had been officially declared over (sad trombone).</p><p>So, is on-line reviewing as good, better or worse than in-person reviewing? If as good or better, then, with the other benefits, it’s a shoo-in. But has this been evaluated? This is not a trivial question to answer because it requires assessment of the quality of grants that are funded. You could use a dart board to adjudicate those grants that meet a given success rate, or ask JD Vance to select a few from the sofa cushions and pick 20% of submitted grants. Whether peer review is effective or not requires determination of whether the best grants were funded — and that is aways going to be subject to some subjectivity.</p><p>Until an agency does a head-head comparison (requiring a duplication of effort, several times), here are some observations and considerations:</p><ol><li>Scientists are busy. They must find time to read and write reviews and then participate in a review panel. We are all distracted and will do other work when we can. This typically doesn’t (or is less likely to) happen at an in-person panel as you don’t know who is looking at you and there is an expectation that you are focused on the task at hand. For many on-line panels the majority of participants not only have microphones muted but also their cameras off at any given time.</li><li>Because you are under the microscope of other colleagues, a reviewer must be prepared to defend their review. Your assessment is being heard by 10–15 other experts and no one wants to look or say something that makes them look foolish. Reputations are made at such panels. Reviewer astuteness, fairness, and objectivity are respected and appreciated as a skill.</li><li>The Chair of the panel is charged with conducting a fair review process. With people in the same room, there is greater influence of the Chair and greater self-awareness of reviewers.</li><li>Discussion is often vital. Especially by panel members who were not assigned a particular application. They are acting as jurors, observing the conduct of the assigned reviewers and can often spot inconsistencies and raise them. When the assigned reviewers are close in score/enthusiasm, the overall score is typically close to the mean of the declared reviewers. However, if initial scores are divergent, the panel is tasked with assessing who has most fairly judged the application. That requires interactivity.</li><li>Everyone on a panel has at least some expertise for every grant being evaluated (that’s why you are there). Discrepant information, overstatements, incorrect assumptions, omissions, etc. can be missed by the assigned reviewers but can be picked up by attentive panel members, if there is discussion.</li><li>Participating on a panel requires time and effort and this is offset by service obligation and new knowledge learned from reading other well constructed grants. But a reviewer only gets out what they put in and if distracted, or allowing themselves to be, will feel less affinity and buy-in for the process.</li><li>While secondary, there is a social aspect to meeting with other researchers. It’s why conferences exist. It builds commeraderie and also provides direct interaction with the grant funding personnel. How many collaborations were sparked by a panel dinner conversation? How many early career researchers made new connections?</li><li>On-line reviewers are more dettached from the applications and less invested in their outcome. This is somewhat akin to the <a href="https://en.wikipedia.org/wiki/Milgram_experiment">Milgram experiment </a>where participants were instructed to press a button that they were told gave another person an electric shock. By distancing their actions from the consequences, they were more harsh/cruel than expected.</li><li>Related to the above, the percentage of grants that are not discussed has edged up in many competitions (e.g. NIH RO1 and CIHR Project Grants). Often greater than 50% do not benefit from even scant discussion. This certainly streamlines the process and increases efficiency and use of time but while other reviewers can “rescue” a streamlined grant for discussion, this is relatively rare. The submitting scientist does get a pair of reviewer reports but no context. Moreover, the content of these reports is not heard by the rest of the panel and errors, etc. can slip through — although these reports are meant to be checked for inappropriate statements by the funding staff. As an aside, when NIH PO1 grants moved from site visits to reverse site visits (that is, the applicants video-conferenced into the review team rather than the reviewers visiting the applicant institution for the evaluation), scores, enthusiasm and success rates dropped. Reduced investment = reduced enthusiasm.</li></ol><p>Each of these positive points is suppressed by on-line peer review where the incentives to be attentive and the penalties for being disengaged are significantly reduced. The reduced investment for on-line review occurs throughout the process, which is, itself, then devalued by the reviewers themselves, as well as the applicants. Of course this doesn’t reduce the application pressure and so there are no outward signs of a problem. But peer review is qualitative: its entire raison d’etre is to afford scientific evaluation of the potential of a proposal and to weigh that against others. If value is extracted from the process, so will its merit.</p><p>So what are the solutions? Perhaps a granting agency will perform a thorough head-to-head comparison of quality. Until then, perhaps virtual and in-person reviewing could be alternated? I’ve a sense this would, in of itself, yield useful information while enjoying partial fiscal and convenience benefits. It seems a small price to pay as opposed to a real possibility of system-wide degradation of peer review quality and function. There is false economy in reducing investment in the peer review process. An average CIHR operating grant costs about $1 million but, more importantly, there is real opportunity cost if the best ideas are not supported. We are scientists, and surely we should not let processes that gate-keep what science is actually performed dodge scientific evaluation themselves?</p><p><em>Footnote 1. It could be argued that not all science needs, and may even be stifled by, peer review. Fred Sanger, double Nobel laureate, published few papers and was largely supported by an institute grant from the Laboratory for Molecular Biology. Peer review tends to reject ideas that don’t conform to dogma, yet those dogma-challenging ideas are how science is tested.</em></p><p><em>Footnote 2. The issues were not a reflection of use of ranking vs rating as other work has shown reviewers ranking can be more accurate than rating: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0292306</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f68c5e212168" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A dosage of champagne]]></title>
            <link>https://jwoodgett.medium.com/a-dosage-of-champagne-426ecd8a31bf?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/426ecd8a31bf</guid>
            <category><![CDATA[champagne]]></category>
            <category><![CDATA[wine-tours]]></category>
            <category><![CDATA[winemaking]]></category>
            <category><![CDATA[france]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Mon, 18 Sep 2023 18:54:41 GMT</pubDate>
            <atom:updated>2023-09-18T19:08:17.900Z</atom:updated>
            <content:encoded><![CDATA[<p>We’re halfway through two weeks in the Reims area of northern France, staying in an apartment attached to a 220 year old chateau with a moat and it’s own lake. It’s been 30+ years since our last holiday in France, in a Gite in Brittany, with two young kids. Seemed like a good getaway for a low pressure, relaxing vacation. Our first Sunday left us struggling to find a place to eat lunch but we ended up in Blancs-Coteaux. We’d forgotten the specificity of restaurant hours and the fact that many in the countryside are closed. When we arrived (via the address on the website) the restaurant was permanently closed, but a helpful local lady pointed us a few blocks away to its new location. A chalk board outside pronounced, “Ouverte Dimanche”. Terre du Craix, please update the address on your website (it’s correct on Apple Maps…).</p><p>The lunch was nice, detailed, quiet. The only noise was from the tractors, tankers full of grape must, and white vans full of pickers (the picking season is short, a few weeks at the end of August/beginning of September when some 120,000 pickers descend on the area from all over Europe). The low hillsides on the road to Blancs-Couteaux were replete with pickers and crates, in 32C sun and no shade. By rule, all grapes for champagne must be hand picked (especially important for the Pinot Noire grapes so that skins aren’t broken to colour the juice). Often, these grapes are pressed within 3 hours of picking.</p><p>Which brings me to the reason for writing. We’ve been very nonchalant about activities on this break, the point was not to cram our days with car journeys or expensive tastings. For a case in point, there’s a cobbled avenue in Épernay lined with champagne houses that seems to cater to wine tours and is likely a very expensive way to get sozzled without learning too much. We did visit the Pommery vineyard in Rheims, known for its deep and extensive chalk cellars and took a self-guided tour. It’s worth a visit although we ended up in the staff parking lot having failed to notice the non-signed visitor entrance. But we largely have stuck to small cafes and small places. Which is why the experience at Chateaux Lamiable (https://www.champagnelamiable.com/fr/) was particularly unexpected and wonderful. We’d booked a tour and bottling experience and were two of four visitors. 15 minutes after the start time, our guide realized the pair from Winnipeg were no shows and tried calling and texting them. She later discovered they’d only just arrived in Paris (Air Canada delay?) and arranged for them to visit later. So it was just us. Then a small Winnebago pulled in with two German visitors. They were only 5 hours early but asked where to park the motor home. They toddled off to wait for the 5pm tour.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*WVf6IirTc6IV2tRVAH5VhQ@2x.jpeg" /></figure><p>The small winery produces 55,000 bottles a year using its own grapes (of 40–50 year old plants) and is located in Tours sur Marne, a Grand Cru designated village. It only started producing champagne about 50 or so years ago and has had its own press for less than that (originally the grapes from the farm were sold to a neighboring winery but, during a low demand season, the neighbor refused to buy and so they decided to embrace to full process). Being on chalk, cellars beneath the property were excavated by hand and chisel and now have a capacity of about 180,000 bottles — just enough to age and store the annual production.</p><p>We arrived on a Monday and the last grapes were picked on the Friday before. The press and initial storage vats were already being cleaned, their years work being complete already. The juice was quietly fermenting in barrels (vented to allow the CO2 to escape). Come January, this first fermentation products will be blended, adjusted with previous year produce to achieve consistency (way most champagne isn’t given a “Year”), some fresh yeast and sugar (depending on the vintner), bottled, metal capped and set on their side in the cellars, usually for about two years (and up to several). Prior to the next step — and what we were here to do — the bottles are riddled, a rotating and steepening process that gradually teases the dead yeast and sediment into the neck. Manual riddling can take several weeks but most places use an automated gyro-pallet that can do the process in about a week. We were taken on a tour of the cellars, the pressing room, the cats and the bottling facility, full of 1st fermentation barrels bubbling off carbon dioxide.</p><p>This is where we were employed — we were each given an inverted, riddled half bottle and inserted these into a brine to freeze the neck 2 cm. After 10 mins, we prized off the cap to expunge the frozen blob of sediment, with thumb ready to halt loss of liquid. Prior to this, we’d been treated with three samples of the same base champagne which had been dosed with different amounts of dosage liquor (a mix of older champagne and sugar) and asked to rank them in order of sweetness. Based on our preferences (mine turned out to be extra brut, my wife’s to be brut —sweeter, party girl) we added the appropriate droplets of the dosage then inserted corks, the wire cage, foil and labels. They’ll be ready for drinking in 3 months (and can be stored for 2–3 years).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*XNh9AIKlLNWQTZFZJrC-wQ@2x.jpeg" /></figure><p>It was a super experience which we’d recommend to anyone. Forget the large champagne houses with their expensive tasting bars and fancy labels. This was an experience of a small family run operation. They employ 20 pickers for 10–15 days but outside of that a team of 3–6 handles the rest of the year, from trimming the vines, blending, bottling to shipping (and entertaining visitors).</p><p>Salut!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=426ecd8a31bf" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Shiny, happy, oblivious science]]></title>
            <link>https://jwoodgett.medium.com/shiny-happy-oblivious-science-177499442be3?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/177499442be3</guid>
            <category><![CDATA[strategy]]></category>
            <category><![CDATA[tricouncils]]></category>
            <category><![CDATA[cihr]]></category>
            <category><![CDATA[vision]]></category>
            <category><![CDATA[science-policy]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Fri, 07 May 2021 17:17:59 GMT</pubDate>
            <atom:updated>2021-05-09T04:03:52.104Z</atom:updated>
            <content:encoded><![CDATA[<p>The government of Canada released a budget on April 19th, 2021, the first for two years. It was, as anticipated, a high spending, deficit projecting budget that clears the ground for pandemic recovery with its centre piece being a national childcare plan (the best part, by far). Given the exemplary role that science has contributed to managing and emerging from the pandemic, hopes were high for some bold scientific investments. Indeed, among a plethora of promises that covered the gamut, that was the rhetoric of the budget document with some $2.2 billion in new money for life sciences over 7 years. But the devil is always in the details and they were buried in over <a href="https://www.budget.gc.ca/2021/report-rapport/toc-tdm-en.html">700 pages of the document</a>. So let’s cut through the declarative statements and get to the bones of the actual investments in science.</p><ol><li>$500 million over 4 years for the Canada Foundation for Innovation — sounds good but in Budget 2018 the CFI budget was supposed to be set up for a $462 million <strong>annualized</strong> budget by 2022–23 (page 93 of the Budget 2018 Budget). This investment is therefore substantially less than anticipated for the promised status quo.</li><li>$400 million over 6 years for a “pan-Canadian genomics strategy” part of which ($210 million) is to fund Genome Canada. This is a bit of a head scratcher — although the use of the word “strategy” is hopeful. As an aside, the tricouncils fund more “genomics” research than Genome Canada (which I ascribe to the success of Genome Canada in mainstreaming genomics — as intended).</li><li>$250 million over 3 years to CIHR to administer a clinical trials fund. No idea how this will work —and that’s according to CIHR staff since they have yet to negotiate with the Treasury Board.</li><li>$250 million over 4 years for a new tricouncil “biomedical research fund”. F*** knows what that means; will come back to it.</li><li>$443.8 million over 10 years for an AI strategy (includes $210.2 million for CIFAR). There’s that word “strategy” again.</li><li>Various bespoke amounts for specific niches of research (includes $30 million over 2 years for pediatric cancer, $20 million over 5 years for a National Institute for Women’s Health Research, $45 million over 3 years for the Stem Cell Network and a basket of other smaller initiatives.</li></ol><p>There’s also money for development of in-country capacity to produce vaccines as, for some unforeseeable reason, it was a tiny mistake to sell off and shut down that sector. Who knew?</p><p>Impressive, eh? So impressive that in their subsequent gushing comments after the release of the budget, various agencies and bodies representing science <strong>FORGOT TO NOTICE THERE ISN’T A RED CENT FOR THE BASE BUDGET OF THE TRICOUNCILS.</strong></p><p>To be fair to the Liberal government, this isn’t the first time they’ve had a brain burp over the tricouncil base budget. They did it in Budget 2017. That had the effect of making the 2018 budget look far more generous, because of the prior neglect. This can be seen in the budget projections released by CIHR after the 2018 budget (the current Liberal government was first elected in late 2015).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*H9pYHN8SFmFxbze2M8sR9w.jpeg" /><figcaption>The slope of this curve is rather linear suggesting governments aren’t as interested in supporting science as they might claim. Chart from CIHR.</figcaption></figure><p>Note the big fat “0” in 2017. Also, note the base budget increase of 0.0000 dollars in FY2022 (you are here). The graph above is the increase on a base of about $1 billion/year for CIHR (give or take as there are flow throughs that scarcely leave a skid mark as they swish through the books on Elgin Street). Do the math and this one agency has received an average of about a 1.5% increase each year for the last decade, much of it restricted to ear-marked initiatives. Cost increases have approximated 2.5–3% (forget true biomedical inflation of about 4–5% as calculated by NIH). So the agency is short about $20 million in its base funding this year, from which it needs to pay its staff, operations, and its current and future funding obligations.</p><p>Wait a sec, you say, what about the $250 million pots each for clinical and basic science? What about them, exactly? There is no indication yet as to how or what these funds can or will be applied to. They are restricted, as is every new science dollar in the budget (it’s as if the government doesn’t trust the agencies to allocate funds). What goes for CIHR is the same for NSERC and SSHRC. In other words, they are staring at a collective hole of $50 million just to stay afloat. The two $250 million pots are also time-limited and that may mean they must be spent within the allocated time frame. For example (from page 157 of Budget 2021) the clinical trials fund will be spent as follows: $34 million in 2021/2; $97 million in 2022/3; and $119 million in 2023/4 (the yearly breakdown for the biomedical research fund is AWOL). CIHR currently invests about $25–30 million/year in clinical trials (difficult to get the exact data) and this comes primarily from the Project Grant budget envelope. So the new fund represents a significant increase to a level more appropriate for a country like Canada. Investigator initiated trials without pharma sponsorship have always been tough here. If done right, this could relieve the Project Grant competition of that $25–30 million (the annual budget for Projects is around $550 million), albeit only for 3 years. But there are no guarantees.</p><p>The biomedical research fund is more difficult to parse. From what I gather, this was something of a surprise to the tricouncils and was perhaps a result of a broken telephone game.</p><blockquote>“We desperately need new funding for basic research — look what this has done for the development of RNA vaccines!” says the tricouncil pitchman.</blockquote><blockquote>“They desperately need new biomedical research funding for vaccines” hears the policy writer.</blockquote><p>But with so little to go on lets at least parse the name of the fund —a new <strong>TRICOUNCIL BIOMEDICAL RESEARCH FUND</strong>. Those Canadian scientists who’ve been around longer than the iPhone will remember that in the late Naughts (around 2009–11) the tricouncils were facing a period of austerity. The Conservative government at the time cut the tricouncil base budgets by 5% and the councils reacted in part like Trump by building walls. If there was a hint of health research in your work, for example you could no longer apply to NSERC or SSHRC. In the former case, this was modified a little to allow research into technologies that might be appied to health, as long as the funds weren’t spent on actual testing on humans. In the case of SSHRC, a cohort of excellent social scientists suddenly found themselves forced to apply to an agency entirely foreign to them that neither had the funding capacity nor the reviewer expertise to fairly adjudicate their proposals. Their ranks were decimated despite some effort by CIHR to accommodate them.</p><p>The newly gate-keepered tricouncils became independent islands where ne’er the twain shall meet. This caused obvious problems in a world where science was increasingly interdisciplinary. Some work-arounds were created such as the Collaborative Health Research Projects (CHRP) program that aimed to bring together health researchers and engineers but the budget was always hopelessly inadequate for the application pressure. This fencing off of research domains was noted by the Fundamental Science Review panel that recommended the tricouncil heads actually work together (good grief!) to support collaborative and interactive research — or at least not to get in the way of it. Budget 2018 then created the New Frontiers Research Fund (NFRF) as a separate ring fenced funding intitiative with its own adjudication methods and “Convergence” portal to support interdisciplinary and high risk research. Most recently, the three amigos have created an <a href="https://cihr-irsc.gc.ca/e/52470.html">interdisciplinary review panel </a>process by which applicants can choose to have their applications vetted by a tricouncil populated group instead of the traditional specific council peer review panels. This is a one year pilot but it remains to be seen how this will be managed in an environment of tightening budgets and very distinct cultures built up during the Dark Ages of tricouncil separatism.</p><h3>It might be noted at this point that the objectives of the interdisciplinary review panel and the existence of NFRF could largely be achieved by lowering the artificial gate-keeping barriers erected in 2010.</h3><p>But, whatever. We are now in a place where either government or the leadership of the funding agencies have abrogated responsibility for a strong and healthy Canadian research backbone. This should be the primary role of the tricouncils as they are the only entities with sustainable and predictable multi-year budgets that are largely isolated from political whim, malice or forgetfulness. Instead, each year, the councils are slowly weakened and any funding provided is decorated in various shades of fettering. Sometimes these are in the form of new, time-limited tricouncil initiatives that provide a temporary respite or bonanza for certain sub-specialties. More often they are in the form of external entities that must repeatedly lobby for funds and proclaim their extraordinary worth, requiring professional lobbyists and marketing campaigns.</p><p>It’s hardly surprising, though, that the neglect of the tricouncil base budget has resulted in the sprouting of numerous off-shoots. The government only has itself to blame for this mess as it is in charge. But this situation has led to a number of concerning outcomes. Science is being increasingly driven by short term thinking; science must be marketable and slick to be granted consideration, rather than be based on true opportunity and need. There is absolutely a role for new initiatives but we are too easily distracted by novelty, charisma and buzz words. There is a real opportunity cost when truly novel discoveries and unexpected observations disappear due to neglect of individual, bright scientists. This state of affairs has largely been avoided in the US where federal science funding is primarily funneled through established institutions (NIH, NSF, NASA, etc.) which may be instructed to develop new initiatives, but must do so within the discipline of an overarching structure that ensures that prioritization of the new does not come at the expense of the existing.</p><p>The Fundamental Science Review in 2017 recognized the splintered and uncoordinated state of Canadian science. It recommended committees to coordinate and structures to enhance interaction. What it failed to do with sufficient clarity was to recommend a rebuild of the federal science support mechanisms to represent the modern reality. Perhaps that would have been too easily dismissed or kicked down the road, but it is clear that in the 4 years since the report that the government has lost the plot and has largely[1] returned to quick hits and the instant gratification of short term thinking.</p><p>Indeed, if it wanted to really have immediate impact, it could have provided some temporary relief to health charity research, which has been evicerated by the loss of donations during the pandemic. While no one doubts the need for Covid-19 research, heart disease, diabetes, Alzheimers, cancer, aging, arthritis, etc. have not gone away and, with the diversion of healthcare resources to ICUs, their delayed treatment will result in a reversal of gains over the past decade. This is why we need a national strategy for scientific research that is not subject to whim and expediency or a couple of buzz words and reinforces the tricouncils as the bedrock of Canadian research efforts. They are less flashy or marketable, but like the uncomplaining and invisible pump that circulates our blood, it is what every other aspect of science in society is built and depends upon.</p><p>[1] Exceptions are the 10 year AI strategy and, possibly, whatever is meant by the pan-Canadian genomics strategy.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=177499442be3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Groundhog Day —an  extended Winter?]]></title>
            <link>https://jwoodgett.medium.com/groundhog-day-an-extended-winter-2f245fcacf9d?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/2f245fcacf9d</guid>
            <category><![CDATA[canada]]></category>
            <category><![CDATA[cihr]]></category>
            <category><![CDATA[science-policy]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Tue, 02 Feb 2021 21:42:49 GMT</pubDate>
            <atom:updated>2021-02-04T14:18:44.204Z</atom:updated>
            <content:encoded><![CDATA[<h3>Groundhog Day —an extended Winter?</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*P8LZq4-H819OFtq1O2vXcA.png" /></figure><p>The Canadian Institutes of Health Research runs two primary funding competitions a year, in the Spring and Fall. The one last Spring (2020) was initially cancelled but the decision reversed and enabled by a switch to virtual reviewing. We’re currently at the tail end of the Fall 2020 competition adjudication (nervous applicants will receive their reviews and scores in the next few weeks) and so the next cycle will begin with “Registration” in early March for the Spring 2021 competition. There’s some irony in the actual application deadline for this falling on April 1st, but what is an agency to do? Today, Canada’s premier health research funding body <a href="https://cihr-irsc.gc.ca/e/52319.html">announced</a> a series of changes to the upcoming competition. The obvious question is, will there be an early Spring? Spoiler, no.</p><p>The changes move forward some important policy corrections such as raising success rates for applications from female scientists based on application percentage (similarly for applications submitted in French). This is similar to the adjustments made to ensure equal success rates for early career researchers introduced a couple of years ago. These elements are still playing catch up to NIH adjustments, but are good to see. They will introduce a few complications as success rates by panel will be impacted and predicting your outcome from a panel ranking will be difficult if within 4–5% points of the average funding rate, especially on smaller panels. But that’s a trivial issue in the name of equitable treatment and if anyone wants to argue that being written by a woman or in French means an inherently poorer grant then you’re also a bigot.</p><p>There is also the return of the “Summary of Progress” section after a 5 year vacation in St. Barts. This is a two page section that is intended for applicants to describe what progress they’ve made, the impact of Covid-19 (do yourself a favour here, keep this part short as it’s hard to find the right balance between a litany of real world challenges that nonetheless won’t interfere with the proposed project and appearing to make excuses — make sure you have someone else read what you’ve written). Oh, and a bit on the budget justification. More on that in just a second.</p><p>The other significant change reflects anticipation of the “Return of the Foundation PIs”. This was a relatively short-lived funding scheme that supposedly aimed to remove multiple grant holding investigators from regular competitions. They were allowed to apply for a single grant for up to 7 years that consolidated their “projects” into a “program” and, if successful, were barred from applying for Project grants (though there were some loopholes). This funding scheme crashed and burned for several reasons including the fact that it was slowing sucking the lifeblood out of the rest of the open competition, it was a deathnell for young scientists and, topping of all that, managed to actively <a href="https://pubmed.ncbi.nlm.nih.gov/31818412/">discriminate</a> against women applicants. The Foundation grant program was therefore <a href="https://cihr-irsc.gc.ca/e/51418.html">sunsetted</a> in 2019. The first cohort of Foundation grantees comprised 150, of which some were ECRs limited to 5 years. There are therefore 131 of the 7 year cohort eligible to apply for Projects (including yours truly). Next year there will be 105 or so, etc. The good news is that this releases $50 million to be added to the coffers of each Project competition, taking each to $325 million (I’m not really clear on the math here in terms of whats released from the Foundation grants but am pretty sure CIHR is not diverting funds away from the open competition).</p><p>The bad news is that there are 131 potential applicants and most of them used to hold multiple grants. Everyone is limited to two new applications per Project competition. In the Fall 2020 Project competition there were 2,360 applications. Assume 200 additional Foundation applications for this next round. Plus, due to the initial plan to cancel the Spring 2020 competition (after applications had been submitted), those applicants who were submitting a “renewal” (that is, had prior grant on a similar topic that was ending in 6 months) were given the option of a one year, full cost extension, which, to the surprise of no one, most accepted willingly. Their only “cost” was they had to sit out the Fall 2020 competition. So, those applicants can also expected to apply en mass on April 1st, 2021. Let’s say there’s 250 (I can’t recall exactly but there are usually around 400 funded grants per competition). So that’s about 2,300 usual applicants, plus 200 ex-Foundation grants plus 250 Spring 2020 extensioners for a total of 2750, or ~20% more than typical. There is an extra $50 million per competition, or 18% more. However, the scoring, hence <strong>fundability</strong>, of those extra 450 grants is highly unlikely to be normally distributed given they are all from previously/currently funded applicants.</p><p>Which brings me back to the budget part of the Summary of Progress report I glossed over. Here it is (emphasis mine):</p><p>“<strong>Budget requested in relation to overall funding held currently or previously: </strong>Contextualize your current application and proposed budget in relation to your overall program of research and funding history. Your narrative must include all funding currently held and pending (as outlined in your CV), including grants received through the course of the recent pandemic funding opportunities. It will be incumbent on you to illustrate clearly to <em>reviewers</em> <strong>why the requested funds are needed</strong>, how they are <strong>distinct</strong> from the funds you currently hold, and how they will advance your research.”</p><p>It’s not at all hard to see why CIHR has inserted this clause. The next 5+ years of competitions are going to face significant pressures for the reasons I just stated — lots of additional applications from previously funded scientists. This holistic budget justification is an attempt to mitigate a great big sucking sound on many, many grant applications. I think it will also lead to additional scrutiny by reviewers. Applicants will be explicitly evaluated on their entire funding portfolio when a new project is being considered. Given that prior to the introduction of the Foundation grant program 71% of CIHR grantees had a single CIHR grant, there won’t be much empathy. A few Foundation awardees had &gt;$1 million per year awards (the <a href="https://cihr-irsc.gc.ca/e/52145.html">average Project grant</a> is $150,000 per year). So expect lots of lopping, like Kill Bill Volume 1+2.</p><p>It’s also worth noting that charity-based research support has taken a substantial beating in the past year with several agencies having to cut existing awards or delay payments. CIHR is a veritable rock in this stormy uncertainty and is undoubtedly feeling the pressure through increased applications.</p><p>There are additional changes coming. Notably: “<strong>removing the across-the-board budget cuts applied to all funded applications starting with the Fall 2021 Project Grant competition</strong> with the intent of providing greater discretion to peer review committees on budget allocations.” This may refer to the introduction of modular budgets (another NIH innovation, albeit quite controversial). The removal of the across-the-board cuts (around 26%!) will be a good thing — it meant budgets were a joke. Panels rarely bothered scrutinizing budgets, knowing the slash that was to come. Applicants tried to include as many $$ as possible, knowing their efforts would be indiscriminately pared back, regardless. How CIHR implements budget modularity will be interesting and surely a concern. More established labs have more experienced and higher salaried technicians. It will be critical not to cause downward pressure on the earnings of such valued people. Likewise, costs of living are significantly different across the land (Vancouver requires an essential umbrella, wellies and scenic sea &amp; mountain view allowance). But that’s for another day.</p><p>To conclude, there are changes coming and they are far more significant than they might appear from the announcement of February 2nd. They will change the complexion and composition of health research supported by CIHR. I’d go as far to say that without a significant increase in investment (specifically in the open Project competitions) by the government, this will lead to large and unpredictable restructuring of Canadian health research.</p><p>Edit: Corrected some of my math thanks to Sylvain Baillet. He might do your taxes if you ask nicely :) Also thanks to John Bergeron for spotting a typo that led me to spot a couple more. Editing, like cockroaches, will survive the apocalypse. (<a href="https://twitter.com/sylvain_baillet/status/1357053111165202432">https://twitter.com/sylvain_baillet/status/1357053111165202432</a>)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2f245fcacf9d" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Back in the CIHR]]></title>
            <link>https://jwoodgett.medium.com/back-in-the-cihr-7feb4e183c3?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/7feb4e183c3</guid>
            <category><![CDATA[covid19]]></category>
            <category><![CDATA[cihr]]></category>
            <category><![CDATA[strategy]]></category>
            <category><![CDATA[research]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Fri, 06 Nov 2020 18:57:23 GMT</pubDate>
            <atom:updated>2020-11-09T15:04:49.580Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/910/1*N4TB7kjlx9r2RQ-VHdDWFg.png" /><figcaption>Let them eat copies of the Strategic Plan</figcaption></figure><p>It’s been awhile since posting anything about the <a href="https://cihr-irsc.gc.ca/e/193.html">Canadian Institutes of Health Research</a> but given there are no other distractions today, November 6th, it seems a good time to do some tallying.</p><p>Firstly, kudos to CIHR for running the once cancelled “Spring 2020” Project Grant competition over the Summer. Looking back, this will go down as the single most important contribution that CIHR could make to mitigating the impact of the pandemic. It could have been very <a href="https://medium.com/@jwoodgett/a-modest-proposal-to-cihr-5488c0ac8aef">different</a> but completing this competition was critical to many health researchers, across the country, along with those who were able to choose to extend by a year rather than submit a renewal. Thanks also to the many reviewers who exchanged windowless Marriott meeting rooms and boiled eggs for review from home activities. We’re now in the midst of the Fall Project Grant competition and subsequent competitions will be back to the usual schedule. It can’t be overstated how important reliable, consistent timing of funding competitions is. Bravo!</p><p>There are 2,364 applications in the current Project Grant round but it isn’t just the principal investigators who are watching, it’s the postdoctoral fellows and graduate students who are looking in the mirror every day and doubting their decision to pursue a research career. This is a generation that was already second guessing its options as science was being questioned, growth was stumbling and the future of biomedical and health research was beginning to look grim. Over the next decade, some 30% of current professors will retire (despite the removal of mandatory retirement ages — there was a lag but it’s now pretty much absorbed). Thousands of opportunities should become available — though don’t count on them. The impact of the pandemic on university revenues, the switch to on-line learning and the inevitable decline in international tuition growth (one of the main drivers by which universities and colleges have offset atrophy of provincial grants) make for a toxic brew for budget planning of many institutions. There will be blood and this will likely come through reduced hiring due to the usual brick wall (and expense) of downsizing tenured positions.</p><p>Still, CIHR is back on the rails and I for one, cannot thank their leadership and staff enough. Indeed, the constraints of working within a government bureaucracy became very apparent over the Summer as staff had to bow to bandwidth limitations, use of Microsoft Teams (which is still the Ford Edsel of video apps) for “security issues” that, apparently were not a concern for the Rest Of The World’s funding agencies (NIH, ERC, etc. are Zoomers).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*LidKMqfiN-Aa8DvlDe1TEw.png" /><figcaption>Adrian, pre and post cut</figcaption></figure><p>It would also be remiss to overlook the head shave of Adrian Mota who had earned the working title of “Excutive VP and Wild Man of Borneo” at CIHR. Mr. Mota (who, it should be noted, is legitimately the Mr. Fixit of CIHR back office machinations, without whom we’d be waiting on funding decisions for longer than Arizona voters) subjected himself to on-live-video hair removal in September in aid of <a href="https://www.cheo.on.ca/en/index.aspx">CHEO</a> and raised over $6,300! Unfortunately, based on a sighting in early November, it looks like there has been significant regrowth , necessitating another depilatory event. Also tip of the hat to Dr. Danika Goosney who not only took the dog clippers to the aforementioned Mr. Fixit but also has a day job running half of NSERC. I mean, with all the cybersecurity threats, all you’d have to do is cut the wifi at their residence in Ottawa and Canadian science would go dark.</p><p>But I digress. My main topic is the CIHR <a href="https://cihr-irsc.gc.ca/e/51508.html">strategic plan</a> (ruh-roh, thought that had fallen off the radar?). CIHR is required by mandate to perform a 5 yearly strategic planning process to lay out a frame work of priorities for the following 5 years. [clench teeth] These haven’t always gone well [/clench teeth]. Unfortunately for CIHR, the year for the next strat plan coincided with the year of the living dead, 2020. There was at least a year of planning, stakeholder consultation, meetings (yes, in freaking person meetings for those with residual memories of the before times) and drafting.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*oLqSHcW8bw_jw3YNMQdAiw.png" /><figcaption>The best laid plans</figcaption></figure><p>The plan was to release the masterpiece sometime in June of 2020. It’s a fairly safe bet to say that the graphics had been compiled, the quality of glossy paper selected and the cover images chosen just before the 🦠 hit the fan in March. If said cover art involved splashes of blood and splatter, then theoretically it could still see the light of day. However, the contents are going to be about as useful to us over the next 5 years as my granddaughter’s Santa list (she has a long list).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*0S4IuuR25eDaDh1W3HWJGg.jpeg" /><figcaption>Wish list for a 4 year old going on 16</figcaption></figure><p>CIHR hasn’t said too much publically about the 2020 Strat Plan but what it has said suggests a, perhaps understandable, mindset of “carry on chaps, we just need a few touch ups”. After all, an expletive ton of work was put into this document, representing the consolidation of the disperate thoughts of thousands of people not exactly known for falling into line. Who knew? Scientists have opinions! What has been said is that there will be an addendum, or something to that effect, that provides context for the impact of the pandemic since the drafting of the plan, adding some additional colour.</p><p>M’kay, that would be akin to attaching an ice fig leaf to a part of the statue of David’s anatomy. You can still see what’s underneath and it’ll be forgotten in a few hours. You might legitimately say that the planning work done over the past 20 months or so is still important and the ideas remain valuable. For sure! But that is not the point. I’ve seen drafts and am supportive. But, you know, COVID-19.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*f46yT2CZnCe6ONgi3x1c2A.png" /><figcaption>Scientifically accurate timeline of the pandemic</figcaption></figure><p>SARS-CoV-2 (apparently also known as the Trump virus) has fundamentally changed the course of the next 5-10 years. Yes, the 1918/19 flu was quickly followed by the roaring Twenties, but that, to be frank, was a very different world. In 2020, the planet has had an overdue and rude awakening. We are slowly realising that Covid-19 is something we will need to learn to live with for at least a couple more years, effective vaccine or not. In addition, the public’s deference to science has changed. Trust in scientists has been shaken. There’s a significant and growing fraction that is disproportionately affected — and it’s largely not us. Scientists in general, and in particular epidemiologists, infectious disease and public health experts, are increasingly being seen as privileged party poopers. Worse, those most affected, along with a politically motivated minority of self-defined “freedom fighters” who struggle to breath through thin fabric but seemingly have no issue with an increasingly warming planet that’s belching smoke from forest fires, note that the very experts who call for restrictions and lock-downs are still being paid, whereas their own jobs and businesses are evaporating.</p><p>In other words, we are entering a long, cold winter that will severely rattle societal make-up and norms. Case counts are increasing in Canada and are clearly not under control. In europe, as well as the smouldering carcass previously known as the United States, the virus is running rampant. A new administration will take the reins there in January — after 10 more weeks of abject neglect and denial. Canada, it hardly needs to be said, is not immune. We are a few weeks behind Europe. <strong>Nothing, nada, nought </strong>that we are doing now provides any confidence that we will avoid their fate. Moreover, the more we try to suppress the virus, the more resistance to it there will be, along with increased social division. This will inevitably be reflected in a building of resentment to government and demands for change. Nevermind the vulnerable, the devastating deaths, the debilitating effects of long term health impairments in those who survive. So with that backdrop, do we really think the public or, for that matter politicians, will turn to the 2020 CIHR strategic plan and think, “All righty then, now there is<strong> </strong>a plan that assures me that Canada’s premier health research agency is on top of the challenges!”</p><p>No.</p><p>I am sure that nothing I or anyone else says now can change the CIHR Strategic Plan, <em>per se, </em>but<em> </em>I would suggest that that current document be quietly posted so that the wholesome ideas therein are placed into the record — and as a reminder of the way we were <strong>but no longer are</strong>. Rather than stapling on an addendum or inserting electron density images of the virus on every other page, the agency should engage in a process reflective of the new realities we will face. The pandemic was entirely predictable, except in its timing. That is a text book failure of health research and policy. We should have been prepared but we weren’t. What was sorely missing was a credible and resiliant plan that built structures that take time to test and to get right. Surely we have learned from that painful lesson? If so, let’s demonstrate that realization by reexamining what CIHR should be doing going forth.</p><p>In other words, what is the role of CIHR in helping to, for example:</p><ol><li>navigate Canada out of the current crisis;</li><li>step up vigilance of emerging pandemic threats;</li><li>open up opportunities for new discoveries about life and threats to it;</li><li>mitigate health effects of climate change;</li><li>invent new healthcare practises that take advantage of the frantic needs of having to adapt to restricted hospitals and clinics;</li><li>address the rising burdens of health due to delayed treatment;</li><li>drill through the incompatible data lakes that obfuscate effective clinical trials;</li><li>discover and validate new anti-microbials to replenish an empty cupboard;</li><li>develop new health surveillance strategies and modelling;</li><li>provide a modern educational path for the next generation of health researchers</li></ol><p>Partial answers to these questions (and many others) might be buried in the Strategic Plan but even if so this is an opportunity for CIHR to redefine its relevance to government and Canadians. The danger in not doing so is to reinforce the idea of ivory tower research that carries on in an alternative world, largely ignoring the people who fund it. This perception would be incredibly dangerous but also deserved if the Plan is “business as usual”. In the outside world, nothing could be further from the truth.</p><p>You might think it premature to call for such a document. We are, after all, not even halfway through the current pandemic. But history has shown, repeatedly, that we soon forget and revert to old habits even if they are demonstrably out of touch. Now is exactly the time to rethink and reimagine. Previously reasonable base assumptions on which the strategic plan was based will dissolve. Moreover, tolerance for substantive change during an emergency is higher. Government funding will tighten (after an infrastructure frenzy to erect mandatory monuments to economic misery), deficits will be employed as weapons for austerity measures. Science will need to re-make its case alongside a field of other priorities. Why not regroup for this and be armed with answers about relevance accompanied by a blueprint for better preparation?</p><p>So, a plea. Please park the “before-Covid” plan and map a new journey, a Marshall Plan for Canadian Health Research. It’s far better we do this ourselves than having alternatives foisted upon us.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7feb4e183c3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A Modest Proposal to CIHR]]></title>
            <link>https://jwoodgett.medium.com/a-modest-proposal-to-cihr-5488c0ac8aef?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/5488c0ac8aef</guid>
            <category><![CDATA[science]]></category>
            <category><![CDATA[government]]></category>
            <category><![CDATA[canada]]></category>
            <category><![CDATA[research]]></category>
            <category><![CDATA[cihr]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Tue, 12 May 2020 13:54:51 GMT</pubDate>
            <atom:updated>2020-11-09T15:11:03.971Z</atom:updated>
            <content:encoded><![CDATA[<h3>A Modest Proposal to CIHR (updated)</h3><p>The CIHR Spring Project competition was running well. By February 5th, 2020 some 2716 applications had been registered and the deadline for submission was March 4th. On March 3rd I received an invitation to return to one of the CIHR Project grant panels that I’d participated in for the past three competitions (they run twice a year). The Spring competition panel was due to sit on May 25–26. On and around March 14th, 2020, much of Canada went into lockdown due to Covid-19. About a week later CIHR reached out to some organizations and floated the idea that they would need to cancel the Spring competition. The hammer dropped on Thursday April 2nd with a <a href="https://cihr-irsc.gc.ca/e/51927.html">note</a> from the President of CIHR, Dr. Michael Strong. In this note the reasons for cancellation were spelled out thus:</p><p><em>“After considering all available options, the Spring 2020 Project Grant competition was cancelled for the following key reasons:</em></p><p><em>*Many of our peer reviewers are clinician scientists and health professionals who have heeded the call to lend a hand, as our country’s health care resources are stretched thin on the ground. It would have been irresponsible for CIHR to divert their attention at this critical time of need.</em></p><p><em>*With researchers following public health advice to curtail travel and self-isolate, carrying out face-to-face peer review for the Spring 2020 Project Grant competition would have been contrary to all public health advice.</em></p><p><em>*Our pool of peer reviewers is comprised of many professors who are now faced with the task of modifying their courses and final exams to an online format. This shift will entail a great deal of work, and we do not want to add to their burden.</em></p><p><em>*The researchers who would typically provide peer review for this competition — and the CIHR staff who would deliver it — are presently occupied with a more important duty: caring for the health and safety of their families and loved ones, which must remain their top priority.</em></p><p><em>*Last, but not least, in keeping with government-wide initiatives to mitigate the spread of COVID-19, CIHR’s physical offices are closed and all work is being done from home. Our priority is to direct our resources to efforts to tackle the government of Canada’s response to COVID-19.”</em></p><p>The Canadian research community, in large part, did not take very kindly to being used as an excuse and many indicated that they’d already agreed to review and would be happy to do so virtually. The cancellation of a major competition was recognized as a disastrous move, leaving many researchers without funding and others with grants due to expire in June. In a muddled set of communications, CIHR announced that grants due to expire in June (plus a few others) would be extended for one year if the applicant so decided. If so, the applicants could not submit to the Fall competition.</p><p>The President released a <a href="https://cihr-irsc.gc.ca/e/51931.html">clarifying statement</a> the following day, April 3rd, with some promises to address the plight of new investigators (no news on that yet). A further <a href="https://cihr-irsc.gc.ca/e/51952.html">communication</a> was issued on May 1st regarding plans for a likely virtual Fall competition. Regardless of the issues with poor communication, the fact is that CIHR pulled the plug on its most significant funding competition, a month after applications had been submitted and panels arranged. These applications sit on the CIHR servers as the agency has indicated applicants can choose to simply have them automatically submitted in the Fall competition.</p><p>To recap, the reasons for the cancellation were: many reviewers are tied up with the pandemic/travel for face to face meetings is not possible/reviewers were too busy with moving lectures on-line and/or looking after family/CIHR staff are working from home. The later <a href="https://cihr-irsc.gc.ca/e/51931.html">clarification</a> implied that CIHR was simply unable to arrange for virtual review: <em>“Rather, it is an operational reality that online review was simply not feasible to meet funding timelines under pandemic conditions.”</em></p><p>All rightly then…. benefit of the doubt, etc. Meanwhile this author chaired a virtual grant panel for the European Research Council in April with ~80 applications that had reviewers from over 10 countries and over 6 time zones.</p><h3>But wait just one minute there bud…</h3><p>On April 23rd, CIHR announced a second, new Covid-19 competition with a budget of $115 million of new money from the federal government. The deadline for applications was May 11th (since revised to May 12 due to another SNAFU) with decisions by June 2nd and funding to start retroactively on May 1st. Number of registrations for submission received? 1865. Significant clinical research emphasis…</p><p>So, within a three week period CIHR went from being incapable of running a virtual competition for ~2400 applications sitting on its servers with reviewers already agreeing to serve over a review period of 2–3 months to deciding to run a virtual competition for ~1800 applications with a call for reviewers over a period of 2–3 weeks. WTAF? This slaps every applicant of the Spring competition across the face with a codfish. An entire competition is sunk without trace causing inevitable repercussions for at least the next 2 or 3 years as the impact reverberates due to loss of confidence and increased application pressure (not to mention the return of the first round of Foundation grantees in Spring 2021).</p><h3><strong>A most graceful solution</strong></h3><p>All is not lost. The decision made to cancel the Spring competition after submission of applications — a decision no other Canadian, nor for that matter most other international funders has made — was done at a time of massive stress and uncertainty. Mistakes happen. Admit it and move on. Time has clearly shown that the agency is perfectly capable of running a large virtual competition. No Canadian researcher will criticize the agency for reversing its decision. We will applaud you! But what about the one year extensions? Those cost $31 million leaving $244 million of the competition envelope. Ask those with extensions if they’d rather have their applications reviewed. Their choice. Grant a 3 month extension to bridge the grants (cost ~$8 million). Delay peer review by 2 or 3 months to July or August. We aren’t exactly going anywhere on vacation! This would also allow completion of the Covid-19 competition. Yes, the competition would be re-jigged by 2-3 months. BIG DEAL. Plan for the Fall competition as is. We can handle the change. We would send cards and flowers and chocolates. It would save the Canadian health research community from the biggest single disruption since the awful reforms of 2014–16. We really do deserve better.</p><h3>A plea to Science Council and Governing Council</h3><p>You can make this work. We, the research community, will bend over backwards to help. Health charities in Canada are under extreme stress. Many will have to forego competitions and cut existing grants. Never has Canadian health research dependent so much on CIHR. Please do the right thing and <strong>RESTORE THE SPRING COMPETITION.</strong></p><p>Thank you.</p><h3><strong>Update, May 28th, 2020</strong></h3><p>Kudos to the leadership of CIHR including Michael Strong, the 13 Scientific Directors, the members of Governing Council and the many behind-the-scene people who listened and acted and <a href="https://cihr-irsc.gc.ca/e/51987.html">restored adjudication</a> of the Spring Project competition. The success of this competition will depend of the many researchers who will step up to review the applications over the next few months, and do it again later in the Fall. <strong>Thank you to all.</strong></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5488c0ac8aef" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Funding, funding everywhere and not a drop to drink]]></title>
            <link>https://jwoodgett.medium.com/funding-funding-everywhere-and-not-a-drop-to-drink-3ef361e2df99?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/3ef361e2df99</guid>
            <category><![CDATA[canada]]></category>
            <category><![CDATA[politics]]></category>
            <category><![CDATA[science]]></category>
            <category><![CDATA[2019-election]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Mon, 22 Jul 2019 18:49:12 GMT</pubDate>
            <atom:updated>2019-07-22T21:12:36.380Z</atom:updated>
            <content:encoded><![CDATA[<p>There’s a federal election in Canada this Fall and all of the political parties are already jockeying for attention of potential voters who are largely focused on enjoying the few months of sunny weather prior to the inevitable freeze. Until the writ drops, the parties are relatively unrestricted in what they communicate and spend on advertising — testing voters to assess what topics might motivate them to vote and, conversely, what might shift their preferences. The current Liberal government took a substantial risk in 2015 by declaring a willingness to go into deficit — a position that separated them from their primary rivals- and which, it turned out, shifted them from #3 to #1 in votes won. Now, after 4 years, the Trudeau government has to battle on its record — with its inevitable positives and negatives. One of the positives was the commissioning of a report on fundamental science which was meant to signal that this government was serious about evidence and saw science and technology to be a path away from stagnation and towards a more prosperous future. This evidence-based approach was extended to appointment of a Chief Science Advisor as well as related positions within Ministries, a clear effort to provide data and education to inform decision-making. Of course, this only goes so far as politics is far from data-driven (aside perhaps polling data). Still, it is a good platform upon which to stand — especially in a world of popularist sentiment, mistrust of experts and outright derision of a free press.</p><p>The fundamental science review was followed by modest to good action in the following budget in 2018. This found a compromise in providing some additional funds (basically stabilizing increases for the next few years at or near to inflation) as well as some new money to fill in the gaps caused by increasing programmatic isolation of the three main funders, the tricouncils. Transformational it was not. It was instead sensible and incremental. At a time of deficit budgets, that’s perhaps not too surprising. But what was bewildering was the government messaging of the increases as if mana from heaven. The hyperbole of language used to describe the funding suggested it was game-changing and returned Canada to its rightful place (wherever that might be). This messaging has persisted since and was nicely contrasted last week by a tweet from our capable Science Minister (a PhD and prior professor):</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*eUo6Fi1T0rX80MCV3rFvnQ.png" /></figure><p><a href="https://twitter.com/KirstyDuncanMP/status/1151959956368842756">https://twitter.com/KirstyDuncanMP/status/1151959956368842756</a></p><p>To put this C$50 million investment in context, Horizon 2020 (the EU science framework that runs from 2014–2020) committed €80 billion and the next framework, Horizon Europe, is expected to come in at €100 billion. The Canadian contribution might be characterized as homeopathic. A few weeks ago, the Canadian Strategy on Dementia was launched by the Minister of Health. The aging population and looming crisis of degenerative disease expected to afflict 66% more Canadians in 10 years than now warranted a grand total of C$50 million over 5 years. An <a href="https://www.theglobeandmail.com/opinion/article-ottawa-has-big-plans-to-lift-the-fog-around-dementia-but-are-they-set/">op-ed in the Globe and Mail</a> calls out the frank inadequacy of this effort. And that is the crux of the problem.</p><p>The world faces many challenges, from political instability, to climate change, to aging demographics to desperate refugees to poverty and homelessness to indigenous health to drug addiction. The answers to these challenges will not come from dropping a few $ million here and there to tick off a box and possibly satisfy a voter. These are large scale problems and they will need large scale resources. So how to fund these challenges?</p><p>Firstly, can we agree that prevention is better than cure, in <strong>every possible way</strong>? From vaccinating against Ebola to providing social safety nets to environmental flood mitigation to earthquake proofing buildings to incentivising low cost housing. These are expensive but not compared to the consequences of such disasters happening, which they invariably do. The same goes for science when it is seen as an investment, a foundation, instead of a cost.</p><p>Secondly, can we focus on the best delivery mechanisms instead of creating new ones to tackle the issues? There are existing charities that work with the homeless, that understand the needs of people, that have answers but not financial resources. In science, we do not need a bespoke agency to deliver a convoluted plan that spreads the impact as thin as a blood smear. We don’t need to worry about agency boundaries and hurdles to interdisciplinarity if the structures are simple and communicative. I’ll not repeat my rant regarding the New Frontiers Research Fund initiatives that *require* projects to be ineligible for tricouncil funding — FFS change the tricouncil eligibility rules! The NFRF is like designing a shoe that doesn’t slip on a banana skin. Pick up the banana!</p><p>Thirdly, these are huge problems that challenge our society. We have a stake in meeting these challenges. We will be a better, more successful society if we overcome these problems. Is that not worth paying for through taxes? Is taxation so politically incorrect that no one is willing to point out that it is the price of civilization, that all boats are raised when we are a better society?</p><p>A last word to the political parties. Justin Trudeau changed the narrative by recognizing austerity was taking us no where and was depressing the aspirations of a large chunk of society. Define the critical issues of our time. Build a plan and a way to pay for it. No one wants to spend their last decade in a nursing home being fed cold spaghetti from a can. No one wants to sleep on a hot air exhaust. No one wants to boil their drinking water (though there is material progress being made here — because of commitment to substantive resources). No one wants to die from a fentenyl overdose. Research solutions and rather than pay them lip service, aim to solve them. That should be our moonshot on earth. It takes time, there are no quick, cheap fixes. Likewise, voters should demand more of their politicians and be prepared to pay for it.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3ef361e2df99" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Let’s Talk CIHR (part 4)]]></title>
            <link>https://jwoodgett.medium.com/lets-talk-cihr-part-4-1df8430d1e31?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/1df8430d1e31</guid>
            <category><![CDATA[strategic-planning]]></category>
            <category><![CDATA[cihr]]></category>
            <category><![CDATA[science]]></category>
            <category><![CDATA[2020]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Tue, 11 Jun 2019 16:17:47 GMT</pubDate>
            <atom:updated>2019-06-27T18:07:07.003Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YQjp0WoJTiovkPcJElxLhw.png" /></figure><p>Links to CIHR Let’s Talk <a href="https://medium.com/@jwoodgett/lets-talk-cihr-part-1-ed17bcc13545">Part 1</a>, <a href="https://medium.com/@jwoodgett/lets-talk-cihr-part-2-c801f9e10a59">Part 2</a> and <a href="https://medium.com/@jwoodgett/lets-talk-cihr-part-3-f5663b59527c">Part 3</a>.</p><p>This is the last input I intend to submit and it concerns the critical Project grant competition. There are two other survey topics on knowledge translation and support of early career investigators that others are much better placed to address. Both are important questions and early career investigators, in particular, remain extremely vulnerable in the current volatility of an under resourced system.</p><p>The Project grant competition forms the primary conduit for CIHR support of health research in Canada. It was born out of the rubble of the old Open Operating Grant Program (OOGP) which was blown up during the “Reform Ages”. That was when the usual biannual OOGP became, for two consecutive years, a single annual competition with one being labelled the “transitional” OOGP. This morphed into Project Scheme 1.0, an unmitigated disaster that managed to simultaneously miss all of its projected goals and assumptions while spraying the small funds available around like a Raptors t-shirt gun. This humunculus of an experiment brought out the worst of reviewers too, with dereliction of duty being rampant once the pressures of not looking like a jerk to your peers was relieved thanks to “virtual review”. Fortunately, the tide was reversed after the second competition when there was a return to face to face panels and more sensible (less obsessively structured) rules for application content and format: Project Grants 2.0. Two years out the remnants of the Reform Age have largely been buried though we still bear the burden of the Common CV as a timely reminder of the legacy of untested experiments*.</p><p>With the pending slow death of the Foundation grant program, the Projects will become the de facto “RO1” equivalent of CIHR, its principle vehicle to adjudicate the best research across the spectrum, twice a year. It does not wear this challege particularly well. In the last competition (<a href="http://www.cihr-irsc.gc.ca/e/51312.html">Fall submission, 2018</a>), there were 371 grants funded out of 2,484 applications. Those fortunate to make the cut were given the honour of forfeiting 23.5% of their approved budgets in across the board cuts. The average term was just under 4.5 years. The current (Spring 2019) competition has 2,447 applications so application pressure has stabilized. Nonetheless, at a 14% success rate, this is too low to avoid stochastic selection of who is funded — especially when panels tends to clump competitive grants into a similar scoring range. A view of historic data confirms the slide.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/766/1*wJ0IDd3jWPQUfydOEYTQ2g.png" /><figcaption>The inexorable decline of success rates of CIHR grants from 2000–2015 (via Michael Hoffman: <a href="https://twitter.com/michaelhoffman/status/1135538355607920640">https://twitter.com/michaelhoffman/status/1135538355607920640</a> from an RTF on this page: <a href="https://open.canada.ca/data/en/dataset/af589454-caf5-4b6f-86ed-c871567c61de">https://open.canada.ca/data/en/dataset/af589454-caf5-4b6f-86ed-c871567c61de</a> ). Note the dead cat bounce at the right is where two discontemporaneous Foundation grant competitions were nailed on. Pillars represent: 1, biomedical; 2, clinical; 3, health systems; 4, population health.</figcaption></figure><p>The solution to this quagmire is to double-down on investment into the Project competition and to consider consolidating strategic initiatives into a similar structure (with ad-hoc expert panels). A universal basic funding mechanism (not basic in the type of research but in commonality of structure) would go a long way to saving administrative funds, level playing fields and ensuring consistent performance.</p><p>As an aside, one of the newer changes to grant adjudication is increased use of “streamlining”. The rationale is that there is no point discussing applications that fall into the lower half as judged by reviewers as these have very little chance of scrambling into the thin air of the funded range. An effect, though, is that panels can be finished in their on-site review task within an hour or so of a second day. Contrast this with NSERC when gallant panelists travail for 4 to 5 days, moving between expert panels. It seems there is an opportunity here. Reviewers still have a substantive review load (usually 9–10 grants) but their on-site time is poorly used.</p><p>I’d also note that in the good old days when success rates were above 20% the President or VP of Research of CIHR would make time to visit the panels, to discuss issues and to thank the reviewers. That stopped around 2007.</p><p>Here are my specific suggestions and answers to the survey:</p><p><strong>The Project Grant Competition does not have pre-defined limits on the duration of a grant or the budget size of a grant. This has historically been in place to ensure that all types of health research can effectively be supported by the program. What advice do you have for CIHR on grant duration or grant budgets in the Project Grant Competition in order to effectively balance funding all types of research grants with supporting an appropriate number of health researchers?</strong></p><p>The Project grant competition is the key plank of CIHR programs and remains seriously under resourced. In practice, grants are 3–5 years in duration, with the majority at 5 years. This is appropriate. Reducing term will simply increase application pressure. It would be beneficial to remove the across the board cuts and perhaps move to a more modular budget. There is also not much evidence that increasing a grant term beyond 5 years is effective. While this removes some reviewing, the idea behind Foundation grants was to fund a program, not a singular project. Since that experiment is ending, it does make sense to eliminate the concept that a Project cannot be renewed. Some science can certainly be conducted in this fashion (and is the norm) but much research is longer term in nature. Competitive renewal (combined with new applications) keeps the level of competition very high.</p><p><strong>The Project Grant Competition peer-review process relies on panels that review proposals in 47 areas of science. What advice do you have for CIHR on the current peer-review process and complement of panels? Are there areas of science or types of research that you feel are not appropriately reviewed within the current complement of panels?</strong></p><p>I would guess grant submitters who have not been recently funded will likely have a few beefs here but the fact is that few grants receive unfair treatment. However, there is insufficient funding to support all of the highly meritorious applications. I like the rule that reviewers serve a maximum of 3 years (6 competitions) if they are deemed competent and that there is ongoing turnover. There may be some areas of research that are under served but that should be reviewed each year. Indeed, I would add all RFP adjudication to the Projects via ad-hoc panels with the same success rates.</p><p><strong>CIHR is dedicated to ensuring there are no systematic biases within its review processes while maintaining a focus on scientific excellence. What advice do you have for CIHR related to the goal of upholding equity and fairness in the review system?</strong></p><p>The on-going training for reviewers is reasonable though the best adjudication and checks of privilege occur at the panels themselves. The Chairs and SOs (and other reviewers) should not tolerate and immediately correct any evidence of bias. The way CIHR treats these incidents leaves much to be desired. Maintaining and publishing statistics on the competitions is a good way of tracking results and telegraphing expectations. CIHR should also realize that they, as an agency, cannot eliminate systematic bias, despite the best intentions. Hence, data can be used to make post-hoc adjustments if necessary.</p><p><strong>What else would you like to tell CIHR related to the Investigator Initiated Research Program and review processes?</strong></p><p>Champion it. Build on it. While there are natural structures and inclinations within the agency to engage in top-down research (and this is appropriate in some cases), the low success rates associated with the Project grants are a gaping wound on the side of CIHR. Efforts to chip away at this fundamental program sends exactly the wrong message. The way to build strategic programs is to meld them with the Project grant adjudication system, with similar standards. The return of face to face review has injected some stability but there is room for improvement and constant innovation. However, the research community is still reeling from the aborted reforms and needs confidence in the primary health research agency. Please don’t deprecate Project grants in any way.</p><p>And that, as they say, is that. You have until June 28th to submit any feedback (see here: <a href="https://letstalk-cihr.ca/">https://letstalk-cihr.ca</a>). Whether the format is helpful or not, it’s hard to complain if you don’t at least engage. There will be some “consensus workshops” in September and a health research summit in December (ahh, December in Ottawa) and then the strategic plan will be rolled out in June 2020. I’ll end with a parting word. CIHR has been through a tumultuous period in the past 5 years. The previous strategic plan from (<a href="http://www.cihr-irsc.gc.ca/e/48964.html">2014–2019</a>) did <strong>nothing</strong> to mitigate the utter disaster of the Age of Reforms. Strategic plans signal intent, a road map of where the priorities will lie. Its structure does not necessarily begat function. After all, the Scientific Directors and other administrators have a large say in implementation and dealing with the realities of the world. The previous plan also consulted widely and, presumably, that feedback was included somewhere. Let’s hope that should significant directional changes be embraced that these have the support and confidence of the research community and are carefully considered rather than being imposed.</p><ul><li>A last word on the Common CV. Part of the frustration is that every. single. field. has. to. be. individually. entered. because the CCV is based on a structured database. So that means the various fields must be used in some sort of collective sorting mechanism, right? Wrong. We have an out of date relational database that is used to derived unmodifiable PDFs full of whitespace. It is in desperate need to be shuttled off this mortal coil.</li></ul><p>Links to CIHR Let’s Talk <a href="https://medium.com/@jwoodgett/lets-talk-cihr-part-1-ed17bcc13545">Part 1</a>, <a href="https://medium.com/@jwoodgett/lets-talk-cihr-part-2-c801f9e10a59">Part 2</a> and <a href="https://medium.com/@jwoodgett/lets-talk-cihr-part-3-f5663b59527c">Part 3</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1df8430d1e31" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Let’s Talk CIHR (Part 3)]]></title>
            <link>https://jwoodgett.medium.com/lets-talk-cihr-part-3-f5663b59527c?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/f5663b59527c</guid>
            <category><![CDATA[science]]></category>
            <category><![CDATA[strategic-planning]]></category>
            <category><![CDATA[cihr]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Mon, 10 Jun 2019 17:00:00 GMT</pubDate>
            <atom:updated>2019-06-10T17:00:00.321Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YQjp0WoJTiovkPcJElxLhw.png" /></figure><p>So now the spotlight is on the Institutes… CIHR has 13 virtual institutes that each have a budget of ~$8 million and change and a mandate to identify gaps in research, create funding competitions (RFAs), consult with the community, etc. They are each run by a Scientific Director (50% position) who also sits on the Science Council of CIHR (along with a few other people and the President and VPR of CIHR). The Institutes have a mixed history and have been the butt of a number of complaints, as well as kudos. In a way they sit between the greater research community and CIHR Central. And that is perhaps key to a major change to their future (who am I kidding, but see Answer 2 below).</p><p>How CIHR is organized: the 13 institutes:</p><p><strong>The existing slate of Institutes, and their mandate areas, were developed during the creation of CIHR in 2000. What advice do you have for CIHR on the slate of Institutes, and corresponding mandate areas, to ensure they effectively address[es] all major areas of health research? If CIHR were to be created today, for example, what slate of institutes would you see as essential for CIHR to meet its mandate?</strong></p><p>The 13 areas still make some degree of sense and fiddling with titles, or even numbers, is not a good use of time or resources. There will always be a community that feels underrepresented but in an era of interdisciplinary research and collaboration, it is less important to have every sector, including the smallest, at the table. By that measure, however, it is incumbent on the existing institutes to be inclusive and not shut areas out due to partial fit or historical happenstance.</p><p><strong>The Institutes are responsible for a variety of activities including identifying strategic priorities and gaps in their mandate areas, designing and implementing strategic funding opportunities, building capacity within particular areas of research, and supporting researchers, groups, and communities, all in collaboration with key partners. What advice do you have for CIHR on the activities and responsibilities of CIHR Institutes?</strong></p><p>The biggest role, in my view, of the institutes is to bring CIHR “central” closer to the research community, for example, via the institute advisory boards. However, the effectiveness of these groups is questionable and the numbers of scientists with any level of input is minimal. A far better use of Institute-associated resources would be to create the Program Officer (PO and SRO) roles that benefit NIH. These are professional administrators who work with the research community to guide applicants, to provide feedback and to do so in an encouraging rather than antagonistic manner. This is perhaps the greatest deficit in CIHR operations and was a recommendation presented to the International Peer Review committee in 2016 or so. CIHR’s argument was this skill level was too expensive. Aside from getting what one pays for, the Institute budgets would be a perfect way to fund and populate a team of CIHR POs.</p><p><strong>What else would you like to tell CIHR related to the Institutes?</strong></p><p>Remove/consolidate a lot of the redundant activities such as 13 newsletters? Make at least 50% of meetings virtual.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f5663b59527c" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Let’s Talk CIHR (part 2)]]></title>
            <link>https://jwoodgett.medium.com/lets-talk-cihr-part-2-c801f9e10a59?source=rss-c1e43aefe0b2------2</link>
            <guid isPermaLink="false">https://medium.com/p/c801f9e10a59</guid>
            <category><![CDATA[science]]></category>
            <category><![CDATA[strategic-plan-2020]]></category>
            <category><![CDATA[cihr]]></category>
            <dc:creator><![CDATA[Jim Woodgett]]></dc:creator>
            <pubDate>Fri, 07 Jun 2019 20:34:34 GMT</pubDate>
            <atom:updated>2019-06-07T20:34:34.478Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YQjp0WoJTiovkPcJElxLhw.png" /></figure><p>In this episode, I’m answering the survey question, “How should CIHR spend its money?”</p><p>Foreword: It is a concern to me to see CIHR stating that 80% of its budget is spent via investigator-initiated programs without being explicit about exactly which programs these are. The Project Grant program is ~$550 million/year. The Foundation program is being wound down. Can the agency at least provide transparent data? This seems to be setting up the research community for an argument between open and strategic. Such divisiveness will end badly. It doesn’t help matters that there have been superficial reviews of the strategic programs. Has anyone spoken with SPOR associated scientists? There is enormous frustration in how this program is administered. It may be doing good work but it needs re-evaluating.</p><p>Re: institute priorities, I will be submitting separate comments on the institutes (in the section: <a href="https://letstalk-cihr.ca/letstalk/survey_tools/cihr-institutes">How CIHR is organized: The 13 Institutes</a>). Their structure is basically in legislation but, fortunately, their role and budget are not. They could play an essential role in helping CIHR to work with the community without having a specific budget (details in separate submission).</p><p>The CIHR survey questions:</p><p><strong>Within its discretionary budget, CIHR has historically directed a <em>large majority</em> of its funds to Investigator Initiated Research based on the rationale that this will generate innovative and timely discoveries, practices and policies. What advice would you give CIHR on an appropriate balance between funding ideas generated within the research community versus funding priorities identified by governments, partners, Institutes and CIHR?</strong></p><p>There is clearly insufficient investment in the investigator-initiated programs. Why? Because the success rate is around 14% and yet the strategic programs tend to be significantly higher. In some cases, no awards are made to a strategic competition which is not only a waste of administrative effort but suggests the concept of the competition was disconnected from the research community. If there was sufficient funding for open competitions, then I’d dedicate 10% for top down competitions. In the current climate, it is very hard to justify any (though I know that is an impossible ask). I’d suggest that all strategic funding could be operated via the Project grant program. Simply set up an ad-hoc panel for specific questions. Set the same success rate. Reduction of support for the open competitions at a time when the Foundation grantees are re-integrating is a recipe for disaster.</p><p><strong>CIHR has consistently funded research platforms in Canada to support excellence in health research. What advice do you have for CIHR on support for national platforms that enable the health research enterprise?</strong></p><p>CFI has a specific budget allocation for major science initiatives such as the Canadian Light Source (the MSI program). Why is CIHR spending its limited funds on this? Support for the Canadian Council on Animal Care, etc. makes sense but could also likely be funded by other means. I’d suggest a line by line review of the platforms — not to say they are not worthy and important, but is CIHR funding the best means of support?</p><p><strong>The allocation of the same $8.6M annual grant budget for each Institute has been in place for more than a decade. What advice do you have for CIHR on the allocation of the grant budgets to CIHR Institutes?</strong></p><p>If Institute budgets are increased it will mean reductions elsewhere. Why do the Institutes need a budget? There is a lot of duplication of effort and evaluation. Their important role can surely be applied to connecting with the research communities and making cases for areas of research that could be supported via a Project grant (with an ad-hoc committee of appropriate experts for each specific research question).</p><p><strong>What else would you like to tell CIHR related to the Budget?</strong></p><p>The current CIHR budget is woefully inadequate to support the quality and amount of research that we are accustomed to. While this is not the direct fault of CIHR, it is critical that CIHR acts with transparency to maintain the highest standards. The recent Reforms debacle could easily be repeated if CIHR chooses to pursue a significantly different direction going forward. The research community is fragile, fatigued and unappreciated. CIHR must realise the pressures and disruptions it will be facing simply in re-integrating the Foundation grantees in the next few years. While it is tempting to be visionary and to propose major change, please recognize the difficult past 3–4 years and temper ambitions accordingly. Without support of researchers, CIHR is simply another office tower in Ottawa.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c801f9e10a59" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>