BACKGROUND: A quality assessment tool for diagnostic accuracy studies, named QUADAS, has recently been developed. Although QUADAS has been used in several systematic reviews, it has not been formally validated. The objective was to evaluate the validity and usefulness of QUADAS. METHODS: Three reviewers independently rated the quality of 30 studies using QUADAS. We assessed the proportion of agreements between each reviewer and the final consensus rating. This was done for all QUADAS items combined and for each individual item. Twenty reviewers who had used QUADAS in their reviews completed a short structured questionnaire on their experience of QUADAS. RESULTS: Over all items, the agreements between each reviewer and the final consensus rating were 91%, 90% and 85%. The results for individual QUADAS items varied between 50% and 100% with a median value of 90%. Items related to uninterpretable test results and withdrawals led to the most disagreements. The feedback on the content of the tool was generally positive with only small numbers of reviewers reporting problems with coverage, ease of use, clarity of instructions and validity. CONCLUSION: Major modifications to the content of QUADAS itself are not necessary. The evaluation highlighted particular difficulties in scoring the items on uninterpretable results and withdrawals. Revised guidelines for scoring these items are proposed. It is essential that reviewers tailor guidelines for scoring items to their review, and ensure that all reviewers are clear on how to score studies. Reviewers should consider whether all QUADAS items are relevant to their review, and whether additional quality items should be assessed as part of their review.

Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies / Whiting, Pf; Weswood, Me; Rutjes, A; Reitsma, Jb; Bossuyt, Pn; Kleijnen, J. - In: BMC MEDICAL RESEARCH METHODOLOGY. - ISSN 1471-2288. - (2006).

Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies

Rutjes A;
2006-01-01

Abstract

BACKGROUND: A quality assessment tool for diagnostic accuracy studies, named QUADAS, has recently been developed. Although QUADAS has been used in several systematic reviews, it has not been formally validated. The objective was to evaluate the validity and usefulness of QUADAS. METHODS: Three reviewers independently rated the quality of 30 studies using QUADAS. We assessed the proportion of agreements between each reviewer and the final consensus rating. This was done for all QUADAS items combined and for each individual item. Twenty reviewers who had used QUADAS in their reviews completed a short structured questionnaire on their experience of QUADAS. RESULTS: Over all items, the agreements between each reviewer and the final consensus rating were 91%, 90% and 85%. The results for individual QUADAS items varied between 50% and 100% with a median value of 90%. Items related to uninterpretable test results and withdrawals led to the most disagreements. The feedback on the content of the tool was generally positive with only small numbers of reviewers reporting problems with coverage, ease of use, clarity of instructions and validity. CONCLUSION: Major modifications to the content of QUADAS itself are not necessary. The evaluation highlighted particular difficulties in scoring the items on uninterpretable results and withdrawals. Revised guidelines for scoring these items are proposed. It is essential that reviewers tailor guidelines for scoring items to their review, and ensure that all reviewers are clear on how to score studies. Reviewers should consider whether all QUADAS items are relevant to their review, and whether additional quality items should be assessed as part of their review.
Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies / Whiting, Pf; Weswood, Me; Rutjes, A; Reitsma, Jb; Bossuyt, Pn; Kleijnen, J. - In: BMC MEDICAL RESEARCH METHODOLOGY. - ISSN 1471-2288. - (2006).
Whiting, Pf; Weswood, Me; Rutjes, A; Reitsma, Jb; Bossuyt, Pn; Kleijnen, J
File in questo prodotto:
File Dimensione Formato  
2006_Whiting_Westwood_Rutjes_BMC-Validation-Quadas.pdf

Riservato

Dimensione 239.09 kB
Formato Adobe PDF
239.09 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1286683
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 624
  • ???jsp.display-item.citation.isi??? ND
social impact