Short Abstract

We share lessons from engaging diverse stakeholders in a complex theory-based contribution tracing evaluation of a homelessness intervention. We’ll highlight practical approaches and challenges, reflecting on what worked and what we’d do differently in future.

Description

In this session, we describe how we worked with stakeholders from design through to dissemination on a theory-based contribution tracing evaluation. Contribution tracing blends process tracing and contribution analysis evaluation methods to strengthen causal inference within a theory-based approach. Interest in such complexity-appropriate evaluation methods has grown rapidly, accelerated by the UK Government’s 2020 Magenta Book supplement, bringing both new opportunities and new challenges for evaluators.

The evaluation formed part of a ground-breaking Test and Learn programme testing 9 innovative projects which aim to reduce homelessness. The programme was commissioned by the Ministry of Housing, Communities and Local Government and delivered by the Centre for Homelessness Impact. This particular project offered 20 weeks of accommodation to non-UK nationals who are rough sleeping, paired with specialist legal advice to help resolve immigration status issues.

The robustness of complexity-friendly methods relies on two core foundations: (i) strong and credible programme theory, and (ii) systematic, transparent evaluative decision-making. Both require meaningful stakeholder engagement, which can be challenging even in straightforward evaluations. When methods themselves add layers of complexity to the engagement, evaluators must approach stakeholder engagement carefully to avoid weakening the evaluation.

We share our approach to involving diverse stakeholders in theory of change development, user-journey mapping, interim evidence assessment, contribution-story refinement, testing the confirmed contribution story, sharing findings, and collaborative sensemaking. Stakeholders included people with lived experience of homelessness, sector experts, government analysts and policymakers, local authorities and voluntary-sector delivery partners. We will reflect on what worked and where we think we would do things differently in future.