Log in to star items and to see the links to virtual rooms.
- Authors:
-
Hannah Allroggen
(Tetra Tech International Development)
Amy Macmillan (Tetra Tech International Development)
Send message to Authors
- Format:
- Single slot (20 min) presentation
- Mode:
- Presenting in-person
- Location:
- Oval Hall
- Sessions:
- Thursday 21 May, -
Time zone: Europe/London
Short Abstract
This session showcases how evaluation can be intentionally designed to support, inform and influence policy and programme change in complex, contested settings.
Description
This session showcases how evaluation can be intentionally designed to support, inform and influence policy and programme change in complex, contested settings. Drawing on two evaluations, the Food Security Safety Net (FSSN) evaluation in Yemen (2022–2026) and a developmental evaluation aligned with Australian aged care reform, we demonstrate how tailoring evaluation design, questions, timing and outputs to decision windows, and foregrounding value for money / value for investment (VfM/VFI) analysis, increases the likelihood that findings will be taken up by funders and policy makers.
The Yemen evaluation examines whether cash transfers and livelihoods activities delivered by partners (Social Fund for Development, BRIGHTLY consortium, WFP) reduce food insecurity and improve medium term household resilience. The mixed methods design combines before and after Food Consumption Score (FCS) and Reduced Coping Strategy Index (rCSI) comparisons, contribution analysis where attribution is infeasible, Total Cost to Transfer Ratio (TCTR) and VfM assessment, and qualitative interviews to explain why interventions work or do not.
The Australian example discusses how developmental evaluation combined with complexity-aware VFI bridged operational learning and adaptation and future policy decision-making. Particular attention will be paid to how we used participatory methods to support reflection and learning, including in our rubric-based VFI approach, which was grounded in democratic deliberation. Our application of VFI also used a novel approach to considering the diverse types of value created through complex and systems-change initiatives, including the potential value to create future systems change, which is often overlooked.
Accepted paper
Session 1 Thursday 21 May, 2026, -Paper short abstract
Our evaluation has focused on learning for the practical application to programme redesign as well as contribute learning to inform the FCDO's future humanitarian priorities in Yemen and enhance evidence on interventions in similar fragile contexts within the humanitarian-development nexus.
Paper long abstract
Title: How the Food Security Safety Net (FSSN) Evaluation in Yemen is Translating Evidence on Cash and Livelihoods Programmes into FCDO Policy and Programme Change
Our evaluation of the FSSN programme (2022–2026), examines whether the cash transfers and livelihoods support delivered by the Social Fund for Development (SFD), the BRIGHTLY consortium and World Food Programme (WFP) have reduced food insecurity and improved medium-term household resilience in Yemen. Our evaluation has focused on learning for the practical application to programme redesign; the mixed methods evaluation combines before and after Food Consumption Score (FCS) and Reduced Coping Strategy Index (rCSI) comparisons, contribution analysis, Total Cost to Transfer Ratio (TCTR) and value for money assessment. The qualitative element of the research aims to provide answers as to why interventions have been successful or not. We have adapted the evaluation to manage access constraints in the North and South of Yemen (De-facto Authority controlled areas and Internationally Recognised Government areas). We have explicitly designed the evaluation to focus on learning over accountability to inform cost-effective food security approaches amid Yemen’s evolving and volatile context. The evaluation will contribute learning to inform the Foreign, Commonwealth & Development Office’s (FCDO) future humanitarian priorities in Yemen and enhance evidence on interventions in similar fragile contexts within the humanitarian-development nexus.
Relevance to conference theme — Influencing policy and programme change through evaluation:
This session addresses Theme 1: “Influencing policy & programmes” directly by showcasing how an evaluation conducted in one of the world’s most volatile humanitarian contexts has been structured to: (a) generate evidence that speaks to decision windows of policy makers and donors (VfM of cash modalities; transition pathways from emergency cash to livelihoods); (b) barriers to uptake (data access limits from WFP, restricted qualitative research in DFA areas, operational and security constraints). We will demonstrate how method choices (contribution analysis where attribution is infeasible; paired sample FCS comparisons; TCTR) were selected to maximise policy relevance given contextual constraints and reflect on lessons about the scale and limits of influence in fragile settings. We will also discuss how we worked closely with the client to tailor the findings of the evaluation to ensure that the evaluation was providing answers that would help to directly inform policy decisions.
Objective of session and how it will be delivered (20-minute single slot):
We will present the evaluation’s redesign oriented evaluation questions and methodology, highlighting key areas where findings will feed directly into FCDO redesign decisions: targeting and inclusion criteria to better reach the most vulnerable; modality mix and transition design (which combinations of cash transfer types and livelihoods produce sustainable food security and for which groups); and finally value for money and delivery efficiency (TCTR and VfM analysis). Our presentation will be timely and framed around the uncertainty in the FCDO funding landscape and how similar humanitarian programmes in fragile contexts can ensure more effective approaches for the best cost-efficiency.