Monitoring and Evaluation in Science Advocacy

Monitoring, Evaluation, Results, and Learning (MERL) is more than a framework; it is a transformative approach that equips advocacy professionals with the tools needed to measure and demonstrate impact in a complex, evolving field. This document, CASPR Advocacy MERL Handbook, offers a structured pathway for implementing effective MERL strategies within HIV prevention research and beyond. By focusing on real-time insights and continuous learning, it enables advocates to optimize their strategies, engage stakeholders, and make data-driven decisions that reinforce the efficacy of their initiatives. Tailored to the unique challenges of advocacy in public health, this guide provides practical tools for tracking results, documenting successes, and enhancing accountability. It presents flexible MERL strategies adaptable to various contexts, emphasizing the need for a results-based culture to advance public health goals. Readers will find guidance on outcome measurement, participatory evaluation methods, and structured approaches like the Results Chain, SPARC, and the CASPR Outcomes Assessment Tool (COAT), each designed to capture both quantitative and qualitative impacts effectively. For professionals dedicated to advancing HIV prevention and health advocacy, this document is an essential resource. It bridges theory with actionable steps, fostering a deeper commitment to MERL as a foundation for sustainable and impactful advocacy. Through this guide, advocates are empowered to enhance program accountability, strengthen stakeholder engagement, and drive measurable change in public health.

Do you remember when DM&E (Design, Monitoring, and Evaluation) was common? There was a reason for it. Do you sometimes wonder why establishing strong M&E systems is so challenging? Systems that support accountability, learning, and adaptive management? I do! A lot! One key reason is that M&E is often treated as an afterthought! In most cases, M&E comes in after program design and planning. "But we have a logical framework and indicators in the proposal?" Wouldn't it be nice if the M&E system were just that? We must prioritize M&E during the design and planning phase to achieve sustainable change effectively. Here are things you can start doing during the design and planning phase. 🟢 Co-develop the Theory of Change (ToC) Involve M&E staff, program teams, and stakeholders in co-creating the ToC. Define the logic from inputs to impact, and make assumptions explicit. Identify where data is needed to test assumptions and track progress. 🟢 Design SMART indicators aligned with outcomes Use your ToC to identify indicators for outcomes, outputs, and key assumptions. Align with donor frameworks where necessary, but prioritize meaningful indicators for your team and stakeholders. 🟢 Develop a Monitoring and Evaluation Plan Outline what will be measured, how, when, by whom, and using what tools. Include baseline, midline, and endline data collection plans. Plan for real-time or routine monitoring processes (not just evaluations) 🟢 Involve stakeholders in identifying learning questions Ask: What do we need to learn to improve this program as we go? Use these questions to shape your M&E focus beyond just accountability 🟢  Allocate time and budget for M&E activities Don’t treat M&E as an afterthought — it needs adequate resources. Budget for tools, staff, training, evaluations, learning events, and data systems. 🟢 Plan for data use and learning moments Schedule regular review sessions, data sense-making meetings, and reflection workshops in your work plan. Define who needs what data, when, and in what format. PS: What other M&E activities can we engage in during design and planning to ensure our success? ------------------------------------------------------------- Follow me, Florence Randari, for learning and adaptive management tips.

Systems don’t transform in straight lines. Neither should your Monitoring, Evaluation and Learning (MEL). Traditional MEL assumes the world behaves like a spreadsheet... Inputs lead neatly to outputs, outputs to outcomes, outcomes to impact. But systems change doesn’t work like that. It’s dynamic, political, and often unpredictable. The Wasafiri MEL for Systems Change guide reframes the question from “Did we meet our targets?” to “How is the system shifting and what role did we play in that?” Here are a few practical insights from the guide: → Look for signals, not certainty. In complex systems, small shifts like new partnerships, changed narratives, unexpected collaborations, often signal deeper transformation. Instead of waiting for perfect evidence, document those signals as early indicators of momentum. → Embrace multiple perspectives. No single dataset can explain a system. Combine stories, observations, and quantitative data to build a multi-dimensional picture of change. Wasafiri suggests “sensemaking sessions” where stakeholders interpret data together to see patterns others might miss. → Focus on relationships, not just results. Systems shift when relationships shift between communities, institutions, and decision-makers. Track who is talking to whom, who’s influencing policy, and where new alliances are forming. Those changes often precede tangible outcomes. → Think adaptive, not additive. Instead of piling on more indicators, focus on learning loops: what are we learning, how are we adapting, and what new questions are emerging? Wasafiri calls this moving from “proving” to improving. → Revisit your assumptions often. In systems work, yesterday’s truth can become tomorrow’s constraint. Build reflection into your MEL rhythm so your strategy evolves as the context does. The takeaway? If your MEL process still expects linear results in a non-linear world, it’s time to evolve. Because systems don’t transform in straight lines, and neither should your learning. --- 🔥 Join my FREE mailing list to get content straight in your inbox Sign up here: https://lnkd.in/ec8mqV2M #SystemsChange

The smartest investment we made as a nonprofit in 2025? It wasn’t fundraising. It was data. 📊 I say this as someone who often warns about measurability bias. But over the past few years, I’ve become one of the strongest advocates for 𝘥𝘢𝘵𝘢-𝘪𝘯𝘧𝘰𝘳𝘮𝘦𝘥 decision-making. 2025 was New Roots Institute's first full year with a dedicated R&D department, and it has transformed our fundraising, our strategy, and the quality of our programs. For a long time, “number of students reached” was our primary metric. That incentivized us to simply reach more people. We could 𝘵𝘩𝘦𝘰𝘳𝘦𝘵𝘪𝘤𝘢𝘭𝘭𝘺 scale volume, sacrifice program quality, have no strategy around who we were reaching, and still look successful on paper while making limited progress toward ending factory farming. We now evaluate every session, track the efficacy of our campaigns, and identify which tools, training, and support actually help students succeed as organizers and campaigners. That learning feeds directly back into program design and how we support fellows in real time. Our work is complex, relational, and long-term. Embracing monitoring, evaluation, and learning hasn’t flattened that complexity. It’s strengthened our ability to navigate it with nuance. As more nonprofits take on hard-to-measure challenges, I hope we stop treating R&D as a luxury. It’s a commitment to learning, humility, and building organizations that get smarter over time. Is R&D part of your work these days? I’m curious how your organization approaches data. Our fellows are reaching over 𝟯 𝗺𝗶𝗹𝗹𝗶𝗼𝗻 𝗽𝗲𝗼𝗽𝗹𝗲, shifting dining behaviors, and removing plant-milk upcharges. Explore their impact here: https://hubs.ly/Q03YSvbX0 Grateful for our incredible R&D team Sean Rice, Jiwon Joung, and Nichalus Vali who push us, and our movement, to learn faster and adapt smarter. 💜 #Leadership #Nonprofit #Data #MeasurabilityBias #R&D #Impact #Strategy #Evaluation #MovementBuilding

Quotations 📚 “If the conservation community wants to learn and improve, we must understand what is working, what is not, and why.” 📚 “Monitoring and evaluation design is about structuring how, when, and what you measure—not just about collecting data.” 📚 “The most rigorous designs are not always the best—adaptive management requires fit-for-purpose evidence.” 📚 “Monitoring should fill knowledge gaps, test assumptions, and guide adaptive decisions—not just satisfy donors.” 📚 “Process monitoring asks: Are we doing what we said we would? Impact monitoring asks: Are our actions effective?” 📚 “Evaluation serves two purposes—learning and accountability—and the best systems serve both.” Key Points 📚 The guide operationalizes Adaptive Management under the Open Standards for Conservation. 📚 Core decisions in M&E design: 1. Identify audiences and information needs. 2. Decide whether to evaluate process (implementation quality) or impact (effectiveness). 3. Clarify purpose: learning vs accountability (formative vs summative). 4. Assign responsibility: internal, external, or mixed teams. 📚 Monitoring scope: – Define indicators tied to results chains (theory of change). – Balance quantitative (scalable, generalizable) vs qualitative (rich, contextual) data. 📚 Monitoring methods: – No comparisons (non-experimental). – Comparison groups (quasi-experimental). – Control groups (experimental). 📚 Timing: pre-test, post-test, or time-series observations. 📚 Sampling: census vs representative samples; mix quantitative rigor with qualitative richness. 📚 Emphasizes “reasonable certainty” over “irrefutable proof”—tailor design to context, resources, and decision needs. Headlines 📚 “Adaptive Management Needs Evidence, Not Just Data” 📚 “Learning and Accountability Must Both Drive Monitoring” 📚 “Rigorous Design Is Not Always the Right Design” 📚 “From Process to Impact—What You Measure Defines What You Learn” 📚 “Fit-for-Purpose M&E Strengthens Trust and Decision-Making” Action Items (Strategic Moves for CEOs & Leaders) 📚 Align M&E design with audience needs—donors, managers, communities, and internal teams. 📚 Invest in learning-oriented monitoring to test assumptions, not just report outputs. 📚 Adopt mixed-method approaches (quantitative + qualitative) for richer insights. 📚 Use results chains (theory of change) as backbone for indicator design. 📚 Train teams in adaptive management—monitor, evaluate, reflect, adapt. 📚 Scale rigor to context: reserve quasi/experimental designs for pilots, high-risk, or high-investment projects. 📚 Make M&E a strategic leadership tool, not just a compliance exercise. #ExecutiveStrategy #MonitoringAndEvaluation #AdaptiveManagement #LearningCulture #ImpactMeasurement #OrganizationalEffectiveness

New resource hub: Monitoring, Evaluation and Learning (MEL) for systems change. In complex, real-world settings, evaluation needs to do more than report outcomes—it must support learning, reflection, and adaptation as change unfolds. I’ve just launched a new landing page pulling together tools, framings, and practical strategies for complexity-aware MEL. It offers annotated links to open-access resources, and highlights approaches like Theory of Change, rubrics, and participatory evaluation that can help teams reflect, adapt, and make sense of change together. If you're working in sustainability, systems change, or multi-stakeholder initiatives, I hope this collection proves useful. 📄 Monitoring, evaluation and learning (MEL): 🔗 https://lnkd.in/gYRzbbWF #Evaluation #Learning #SystemsThinking #Complexity #AdaptiveManagement #LfSinsights

Baseline → Midline → Endline Over time, I’ve stopped seeing these as three separate donor requirements. They’re really one continuous learning journey—and how you handle them can shape whether a program actually makes a difference. Baseline This is your moment to pause and really understand what’s going on. Are your assumptions in the Theory of Change actually true? Are your targets grounded in reality? When this step is rushed, nothing breaks immediately—but everything that follows is built on shaky ground. Midline This is where honesty matters most. Are things working the way you expected? What’s not going as planned? And what can you still change while it matters? The strongest teams use this moment to adjust, not just report. Endline This is more than closing a project. It’s about understanding the story: what changed, what didn’t, and what we need to do differently next time. When it all connects Something shifts. You move from reporting to learning. From sticking to plans → to adapting them. From activity → to real impact. But the reality? Too often, these moments are treated as isolated tasks—done late, filed away, and forgotten. The reports look good. But the learning gets lost. What really makes the difference It’s not better tools or nicer reports. It’s being intentional about connecting these moments—so evaluation becomes a living process that actually improves decisions and impact. #MEAL #MonitoringAndEvaluation #AdaptiveManagement #DataForImpact