Short Abstract

Evaluating influence requires a careful approach. Doing so for a portfolio is even more complex. We present how we adapted a case based approach to fit the needs of a portfolio of diverse and complex programmes. Adaptations include: rubrics, quality of evidence assessments and cross case analysis.

Description

Evaluating Influencing and Diplomacy Interventions: A Portfolio Approach:

Evaluating influencing and diplomacy interventions requires a tailored approach. Doing so across a portfolio of programmes – some highly complex, others more straightforward – presents an additional layer of challenge.

To address this, and in line with utilisation-focused evaluation principles, Integrity’s Senior MEL Expert, Lamia Renaud, developed and refined a bricolage evaluation approach. First introduced during a UKES webinar in 2025 and later showcased at UKES Glasgow through a poster presentation, the approach has since been revamped to better meet the demands of portfolio-level evaluation.

This session will present how we’ve adapted the initial case based evaluation approach to fit the needs of a portfolio of diverse and complex programmes. The presentation will provide an overview of the bricolage approach and the specific adaptations made for portfolio-level application including the integration of rubrics, quality of evidence assessments and cross case analysis.

The overview will unpack the design elements of our bricolage methodology that integrates diverse data collection and analysis methods, conceptual frameworks, and value systems to remain responsive to context and complexity. Specifically we will explain how each element of the flexible and adaptive approach supported the delivery of the portfolio evaluation. This will include the following methods presentation as well as how well they worked together:

• Outcome Harvesting: Changes in influencing are identified through participatory consultations with key stakeholders. A designated point of contact helps unpack each change and facilitates access to relevant informants.

• Contribution Analysis (CA): CA guides case study development using a postulated Theory of Change. It helps unpack the multiple, often interrelated factors influencing outcomes. CA is particularly useful in cross-case analysis, where it supports the identification of enablers, blockers, and external contributions.

• Appreciative Inquiry (AI): AI supports the discovery and exploration of influencing outcomes by positioning evaluators as allies or critical friends, rather than external auditors. This fosters a more constructive and reflective evaluation environment.

We will then share lessons learned from the implementation of the methodology on a portfolio evaluation, providing insights into lessons learned from adapting a case-based approach to fit portfolio learning needs.