It is not easy to rationalize how peer review, as the current grassroots of science, can work based on voluntary contributions of reviewers. There is no rationale to write impartial and thorough evaluations. Consequently, there is no risk in submitting lowquality work by authors. As a result, scientists face a social dilemma: if everyone acts according to his or her own self-interest, low scienti c quality is produced. Still, in practice, reviewers as well as authors invest high e ort in reviews and submissions. We examine how the increased relevance of public good bene ts (journal impact factor), the editorial policy of handling incoming reviews, and the acceptance decisions that take into account reputational information can help the evolution of high-quality contributions from authors. High e ort from the side of reviewers is problematic even if authors cooperate: reviewers are still best o by producing low-quality reviews, which does not hinder scienti c development, just adds random noise and unnecessary costs to it. We show with agent-based simulations that tacit agreements between authors that are based on reciprocity might decrease these costs, but does not result in superior scienti c quality. Our study underlines why certain self-emerged current practices, such as the increased importance of journal metrics, the reputation-based selection of reviewers, and the reputation bias in acceptance work e ciently for scienti c development. Our results nd no answers, however, how the system of peer review with impartial and thorough evaluations could be sustainable jointly with rapid scienti c development

Righi, S. e K., Takacs. "Miracle of Peer Review and Development in Science: An Agent-Based Model" Working paper, CAPPAPERS, Dipartimento di Economia Marco Biagi - Università di Modena e Reggio Emilia, 2016.

Miracle of Peer Review and Development in Science: An Agent-Based Model

Righi,S.;
2016

Abstract

It is not easy to rationalize how peer review, as the current grassroots of science, can work based on voluntary contributions of reviewers. There is no rationale to write impartial and thorough evaluations. Consequently, there is no risk in submitting lowquality work by authors. As a result, scientists face a social dilemma: if everyone acts according to his or her own self-interest, low scienti c quality is produced. Still, in practice, reviewers as well as authors invest high e ort in reviews and submissions. We examine how the increased relevance of public good bene ts (journal impact factor), the editorial policy of handling incoming reviews, and the acceptance decisions that take into account reputational information can help the evolution of high-quality contributions from authors. High e ort from the side of reviewers is problematic even if authors cooperate: reviewers are still best o by producing low-quality reviews, which does not hinder scienti c development, just adds random noise and unnecessary costs to it. We show with agent-based simulations that tacit agreements between authors that are based on reciprocity might decrease these costs, but does not result in superior scienti c quality. Our study underlines why certain self-emerged current practices, such as the increased importance of journal metrics, the reputation-based selection of reviewers, and the reputation bias in acceptance work e ciently for scienti c development. Our results nd no answers, however, how the system of peer review with impartial and thorough evaluations could be sustainable jointly with rapid scienti c development
2016
Luglio
Righi, S.; Takacs, K.
Righi, S. e K., Takacs. "Miracle of Peer Review and Development in Science: An Agent-Based Model" Working paper, CAPPAPERS, Dipartimento di Economia Marco Biagi - Università di Modena e Reggio Emilia, 2016.
File in questo prodotto:
File Dimensione Formato  
Capp_p144.pdf

Open access

Tipologia: Versione pubblicata dall'editore
Dimensione 5.74 MB
Formato Adobe PDF
5.74 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1300508
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact