Making sense of the kaleidoscope: challenges in understanding and evaluating research impact on public policy
Sarah Chaytor
(UCL)
Short abstract
An increasing focus on strengthening the policy impact of research raises complex questions about its assessment. Challenges in definition, attribution, measurement and evolving understanding of effective practice and 'good' policy impede evaluation. What does good look like? How can it be measured?
Long abstract
The past decade has seen an increasing emphasis on understanding and assessing the wider societal impacts of research in the UK. This has included a growing focus on strengthening the impact of research on public policy. However, evaluating such policy impact is highly complex. Policy impact occurs both directly and indirectly, over long-time horizons, and as a result of multiple contributions. Concepts, approaches and outcomes vary across organisational contexts and beneficiaries. Policy impact appears as a ‘kaleidoscope’ of changing pictures and patterns.
Limited data and under-development of metrics make assessment challenging. The diversity of research-policy interactions impedes aggregation from individual case studies into broader assessments. Compounding this, practices aimed at enhancing research impact on policy are still evolving, and knowledge of what is most effective still developing.
In this context, what can we learn about how to conceptualise and articulate research impact on policy? Can we develop frameworks which capture the diverse and multifaceted nature of policy impact? And what does good look like - in impact assessment and for policy impacts themselves?
This panel will feature contributions from academics and policy actors to offer insights drawn from their experiences of knowledge exchange, government and Parliament, and research funding.
Accepted Paper
Short abstract
Long abstract
The past decade has seen an increasing emphasis on understanding and assessing the wider societal impacts of research in the UK. This has included a growing focus on strengthening the impact of research on public policy. However, evaluating such policy impact is highly complex. Policy impact occurs both directly and indirectly, over long-time horizons, and as a result of multiple contributions. Concepts, approaches and outcomes vary across organisational contexts and beneficiaries. Policy impact appears as a ‘kaleidoscope’ of changing pictures and patterns.
Limited data and under-development of metrics make assessment challenging. The diversity of research-policy interactions impedes aggregation from individual case studies into broader assessments. Compounding this, practices aimed at enhancing research impact on policy are still evolving, and knowledge of what is most effective still developing.
In this context, what can we learn about how to conceptualise and articulate research impact on policy? Can we develop frameworks which capture the diverse and multifaceted nature of policy impact? And what does good look like - in impact assessment and for policy impacts themselves?
This panel will feature contributions from academics and policy actors to offer insights drawn from their experiences of knowledge exchange, government and Parliament, and research funding.
Research on research use & its role in metascience
Session 1 Wednesday 2 July, 2025, -