The impacts of Open Science: What we know, what we don’t, what we need
Vincent Traag
(Leiden University)
Nicki Lisa Cole
(Know Center Research)
Tony Ross-Hellauer
(Know Center Research GmbH)
Thomas Klebel
(Know Center Research GmbH)
Grypari Ioanna
Silvia Vignetti
Paper Short Abstract
The EC-funded PathOS project explores the academic, societal, and economic impacts of Open Science. This talk summarises our findings incl. evidence reviews, case studies, new indicators, cost-benefit analyses, as well as impact assessment challenges and recommendations for the future.
Paper Abstract
Open Science is increasingly mainstream, with growing adoption of practices globally. While systems and data sources for monitoring uptake are maturing, research or systems to gauge long-term, real-world impacts remains scattered and uneven, with large gaps in data and knowledge.
Since 2022, the EC-funded PathOS project (https://pathos-project.eu/) has worked to better understand and measure the academic, societal, and economic impacts of Open Science. As the project concludes, this presentation summarises its findings, tools, and recommendations.
Key topics include:
Current evidence of impact: Insights from three PRISMA-guided scoping reviews, covering over 700 studies. Findings from six PathOS case studies will also be discussed to build a picture of the known Key Impact Pathways for Open Science.
Indicators for impact: The PathOS Open Science Indicator Handbook (https://handbook.pathos-project.eu/) provides a “cook book” for measuring Open Science uptake and impact and discusses challenges in attributing impact. We present an overview of the handbook and plans for its sustainability.
Economic methodologies: PathOS is developing and testing a framework for cost-benefit analysis of Open Science interventions (initial concept: https://zenodo.org/records/10277642). Results from two large validation case studies will be available at the conference.
Challenges: Lessons learned include gaps in evidence generation, dataset availability, causal attribution, and synthesising broad Open Science impact insights. Discussion will includes how current developments like the Open Science Monitoring Initiative can contribute to ameliorating these difficulties.
Recommendations: PathOS is currently drafting recommendations for strengthening Open Science impact assessment in the future, which will be presented for the first time in this talk.
Accepted Poster
Paper Short Abstract
Paper Abstract
Open Science is increasingly mainstream, with growing adoption of practices globally. While systems and data sources for monitoring uptake are maturing, research or systems to gauge long-term, real-world impacts remains scattered and uneven, with large gaps in data and knowledge.
Since 2022, the EC-funded PathOS project (https://pathos-project.eu/) has worked to better understand and measure the academic, societal, and economic impacts of Open Science. As the project concludes, this presentation summarises its findings, tools, and recommendations.
Key topics include:
Current evidence of impact: Insights from three PRISMA-guided scoping reviews, covering over 700 studies. Findings from six PathOS case studies will also be discussed to build a picture of the known Key Impact Pathways for Open Science.
Indicators for impact: The PathOS Open Science Indicator Handbook (https://handbook.pathos-project.eu/) provides a “cook book” for measuring Open Science uptake and impact and discusses challenges in attributing impact. We present an overview of the handbook and plans for its sustainability.
Economic methodologies: PathOS is developing and testing a framework for cost-benefit analysis of Open Science interventions (initial concept: https://zenodo.org/records/10277642). Results from two large validation case studies will be available at the conference.
Challenges: Lessons learned include gaps in evidence generation, dataset availability, causal attribution, and synthesising broad Open Science impact insights. Discussion will includes how current developments like the Open Science Monitoring Initiative can contribute to ameliorating these difficulties.
Recommendations: PathOS is currently drafting recommendations for strengthening Open Science impact assessment in the future, which will be presented for the first time in this talk.
Poster session
Session 1 Tuesday 1 July, 2025, -