A relevant question for the organization of large-scale research assessments is whether bibliometric evaluation and informed peer review yield similar results. In this paper, we draw on the experience of the panel that evaluated It alian research in Economics, Management and Statistics during the national assessment exercise (VQR) relative to the period 2004-2010. We exploit the unique opportunity of studying a sample of 590 journal articles randomly drawn from a population of 5,681 journal articles (out of nearly 12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysis and by informed peer review. In the total sample we find fair to good agreement between informed peer review and bibliometric analysis and absence of statistic al bias between the two. We then discuss the nature, implications, and limitations of this correlation.

Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy / Bertocchi, Graziella; Gambardella, Alfonso; Jappelli, Tullio; Nappi, Carmela; Peracchi, Franco. - In: RESEARCH POLICY. - ISSN 0048-7333. - STAMPA. - 44:2(2015), pp. 451-466. [10.1016/j.respol.2014.08.004]

Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy

BERTOCCHI, Graziella;
2015

Abstract

A relevant question for the organization of large-scale research assessments is whether bibliometric evaluation and informed peer review yield similar results. In this paper, we draw on the experience of the panel that evaluated It alian research in Economics, Management and Statistics during the national assessment exercise (VQR) relative to the period 2004-2010. We exploit the unique opportunity of studying a sample of 590 journal articles randomly drawn from a population of 5,681 journal articles (out of nearly 12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysis and by informed peer review. In the total sample we find fair to good agreement between informed peer review and bibliometric analysis and absence of statistic al bias between the two. We then discuss the nature, implications, and limitations of this correlation.
2015
18-set-2014
44
2
451
466
Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy / Bertocchi, Graziella; Gambardella, Alfonso; Jappelli, Tullio; Nappi, Carmela; Peracchi, Franco. - In: RESEARCH POLICY. - ISSN 0048-7333. - STAMPA. - 44:2(2015), pp. 451-466. [10.1016/j.respol.2014.08.004]
Bertocchi, Graziella; Gambardella, Alfonso; Jappelli, Tullio; Nappi, Carmela; Peracchi, Franco
File in questo prodotto:
File Dimensione Formato  
rp2015.pdf

Accesso riservato

Descrizione: Articolo principale
Tipologia: Versione pubblicata dall'editore
Dimensione 451.23 kB
Formato Adobe PDF
451.23 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1062553
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 64
  • ???jsp.display-item.citation.isi??? 63
social impact