A relevant question for the organization of large-scale research assessments is whether bibliometric evaluation and informed peer review yield similar results. In this paper, we draw on the experience of the panel that evaluated It alian research in Economics, Management and Statistics during the national assessment exercise (VQR) relative to the period 2004-2010. We exploit the unique opportunity of studying a sample of 590 journal articles randomly drawn from a population of 5,681 journal articles (out of nearly 12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysis and by informed peer review. In the total sample we find fair to good agreement between informed peer review and bibliometric analysis and absence of statistic al bias between the two. We then discuss the nature, implications, and limitations of this correlation.
Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy / Bertocchi, Graziella; Gambardella, Alfonso; Jappelli, Tullio; Nappi, Carmela; Peracchi, Franco. - In: RESEARCH POLICY. - ISSN 0048-7333. - STAMPA. - 44:2(2015), pp. 451-466. [10.1016/j.respol.2014.08.004]
Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy
BERTOCCHI, Graziella;
2015
Abstract
A relevant question for the organization of large-scale research assessments is whether bibliometric evaluation and informed peer review yield similar results. In this paper, we draw on the experience of the panel that evaluated It alian research in Economics, Management and Statistics during the national assessment exercise (VQR) relative to the period 2004-2010. We exploit the unique opportunity of studying a sample of 590 journal articles randomly drawn from a population of 5,681 journal articles (out of nearly 12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysis and by informed peer review. In the total sample we find fair to good agreement between informed peer review and bibliometric analysis and absence of statistic al bias between the two. We then discuss the nature, implications, and limitations of this correlation.File | Dimensione | Formato | |
---|---|---|---|
rp2015.pdf
Accesso riservato
Descrizione: Articolo principale
Tipologia:
VOR - Versione pubblicata dall'editore
Dimensione
451.23 kB
Formato
Adobe PDF
|
451.23 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris