Short Abstract

Through strategic design, the interim evaluation of DSIT's 5G Innovation Regions programme provided actionable insights for ongoing adaptive design. The evaluation provides insights into use of theory-based methods to drive programme improvement, inform policy, and accelerate tech adoption.

Description

Too often, evaluation insights arrive too late in programme delivery to meaningfully influence performance and subsequent impact. This presentation addresses this critical challenge by sharing learnings from KPMG’s interim process and impact evaluations of the Department for Science, Innovation and Technology’s (DSIT) 5G Innovation Regions (5GIR) programme. This programme aims to support places across the UK in adopting advanced wireless technologies, accelerating commercial investment in 5G, and fostering the 5G ecosystem, ultimately driving economic growth.

The core of this presentation focuses on the importance of strategic timing of evaluation components and effective application of theory-based evaluation methods. We will illustrate how these methods and approaches were used to identify what has and hasn’t worked well, and the specific actions needed to either enhance or secure intended outcomes. Crucially, we will also detail how these findings were effectively communicated to relevant stakeholders in a timely way to enable tangible change within the programme.

Through this, the presentation offers tangible examples of how evaluations can be designed to provide timely and actionable insights that actively support adaptive programme design and ultimately improve programme outcomes, particularly for novel and innovative programmes. We will highlight specific lessons from the interim evaluation of 5GIR that may be relevant for other similar programmes, especially those involving technological projects. These findings include insights into novel funding mechanisms, appropriate programme timelines, and the mechanisms needed to effectively drive technology adoption. Finally, we will provide evidence of the policy impact of these findings, demonstrating how lessons learned from the evaluation have directly informed subsequent decision-making by DSIT. This showcases a practical approach to embedding evaluation as a dynamic tool for continuous improvement and strategic adaptation, as well as demonstrating progress towards achieving ultimate impacts.