The emergence of the disruption score provides a new perspective that differs from traditional metrics of citations and novelty in research evaluation. Motivated by current studies on the differences among these metrics, we examine the relationship between disruption scores and citation counts. Intuitively, one would expect disruptive scientific work to be rewarded by high volumes of citations and, symmetrically, impactful work to also be disruptive. A number of recent studies have instead shown that such intuition is often at odds with reality. In this paper, we break down the relationship between impact and disruption with a detailed correlation analysis in two large data sets of publications in Computer Science and Physics. We find that highly disruptive papers tend to receive a higher number of citations than average. Contrastingly, the opposite is not true, as we do not find highly cited papers to be particularly disruptive. Notably, these results qualitatively hold even within individual scientific careers, as we find that—on average—an author’s most disruptive work tends to be well cited, whereas their most cited work does not tend to be disruptive. We discuss the implications of our findings in the context of academic evaluation systems, and show how they can contribute to reconcile seemingly contradictory results in the literature.

Breaking down the relationship between disruption scores and citation counts / Li, Mingtang; Livan, Giacomo; Righi, Simone. - In: PLOS ONE. - ISSN 1932-6203. - 19:12(2024), pp. 1-17. [10.1371/journal.pone.0313268]

Breaking down the relationship between disruption scores and citation counts

Righi, Simone
2024

Abstract

The emergence of the disruption score provides a new perspective that differs from traditional metrics of citations and novelty in research evaluation. Motivated by current studies on the differences among these metrics, we examine the relationship between disruption scores and citation counts. Intuitively, one would expect disruptive scientific work to be rewarded by high volumes of citations and, symmetrically, impactful work to also be disruptive. A number of recent studies have instead shown that such intuition is often at odds with reality. In this paper, we break down the relationship between impact and disruption with a detailed correlation analysis in two large data sets of publications in Computer Science and Physics. We find that highly disruptive papers tend to receive a higher number of citations than average. Contrastingly, the opposite is not true, as we do not find highly cited papers to be particularly disruptive. Notably, these results qualitatively hold even within individual scientific careers, as we find that—on average—an author’s most disruptive work tends to be well cited, whereas their most cited work does not tend to be disruptive. We discuss the implications of our findings in the context of academic evaluation systems, and show how they can contribute to reconcile seemingly contradictory results in the literature.
2024
19-dic-2024
19
12
1
17
Breaking down the relationship between disruption scores and citation counts / Li, Mingtang; Livan, Giacomo; Righi, Simone. - In: PLOS ONE. - ISSN 1932-6203. - 19:12(2024), pp. 1-17. [10.1371/journal.pone.0313268]
Li, Mingtang; Livan, Giacomo; Righi, Simone
File in questo prodotto:
File Dimensione Formato  
journal.pone.0313268.pdf

Open access

Tipologia: VOR - Versione pubblicata dall'editore
Dimensione 2.02 MB
Formato Adobe PDF
2.02 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1367214
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact