Short abstract

The VQR has evolved towards a balanced integration of peer review, citation metrics, and AI tools. This study examines key methodological shifts, highlighting recent reforms and the role of AI in supporting research evaluation while ensuring a controlled and transparent use of quantitative metrics.

Long abstract

The Italian Research Quality Assessment (VQR) has played a pivotal role in shaping institutional research strategies and national science policies. Over the years, the methodology and criteria underpinning the VQR have undergone significant modifications, aligning with evolving international research evaluation frameworks. The VQR 2020-2024 introduces major reforms, including the expansion of eligible research outputs and the abandonment of the bibliometric algorithm previously used for the assessment of scientific publications.

This paper examines the evolving evaluation methodologies employed across the four iterations of the VQR conducted to date. Specifically, it highlights a gradual transition from a semi-automated reliance on citation metrics towards an approach where metrics and AI tools serve as complementary instruments to support expert peer review. The study’s findings contribute to the ongoing debate on research evaluation methodologies, reinforcing the argument that metrics should not be entirely discarded but rather used with caution and in a well-balanced manner, particularly in large-scale assessments such as Italy’s periodic research quality evaluation.