Objective: To develop and seek consensus from procedure experts on the metrics that best characterise a reference robot-assisted radical prostatectomy (RARP) and determine if the metrics distinguished between the objectively assessed RARP performance of experienced and novice urologists, as identifying objective performance metrics for surgical training in robotic surgery is imperative for patient safety. Materials and methods: In Study 1, the metrics, i.e. 12 phases of the procedure, 81 steps, 245 errors and 110 critical errors for a reference RARP were developed and then presented to an international Delphi panel of 19 experienced urologists. In Study 2, 12 very experienced surgeons (VES) who had performed >500 RARPs and 12 novice urology surgeons performed a RARP, which was video recorded and assessed by two experienced urologists blinded as to subject and group. Percentage agreement between experienced urologists for the Delphi meeting and Mann–Whitney U- and Kruskal–Wallis tests were used for construct validation of the newly identified RARP metrics. Results: At the Delphi panel, consensus was reached on the appropriateness of the metrics for a reference RARP. In Study 2, the results showed that the VES performed ~4% more procedure steps and made 72% fewer procedure errors than the novices (P = 0.027). Phases VIIa and VIIb (i.e. neurovascular bundle dissection) best discriminated between the VES and novices. Limitations: VES whose performance was in the bottom half of their group demonstrated considerable error variability and made five-times as many errors as the other half of the group (P = 0.006). Conclusions: The international Delphi panel reached high-level consensus on the RARP metrics that reliably distinguished between the objectively scored procedure performance of VES and novices. Reliable and valid performance metrics of RARP are imperative for effective and quality assured surgical training.

Objective assessment of intraoperative skills for robot-assisted radical prostatectomy (RARP): results from the ERUS Scientific and Educational Working Groups Metrics Initiative / Mottrie, A.; Mazzone, E.; Wiklund, P.; Graefen, M.; Collins, J. W.; De Groote, R.; Dell'Oglio, P.; Puliatti, S.; Gallagher, A. G.. - In: BJU INTERNATIONAL. - ISSN 1464-4096. - 128:1(2021), pp. 103-111. [10.1111/bju.15311]

Objective assessment of intraoperative skills for robot-assisted radical prostatectomy (RARP): results from the ERUS Scientific and Educational Working Groups Metrics Initiative

Puliatti S.;
2021

Abstract

Objective: To develop and seek consensus from procedure experts on the metrics that best characterise a reference robot-assisted radical prostatectomy (RARP) and determine if the metrics distinguished between the objectively assessed RARP performance of experienced and novice urologists, as identifying objective performance metrics for surgical training in robotic surgery is imperative for patient safety. Materials and methods: In Study 1, the metrics, i.e. 12 phases of the procedure, 81 steps, 245 errors and 110 critical errors for a reference RARP were developed and then presented to an international Delphi panel of 19 experienced urologists. In Study 2, 12 very experienced surgeons (VES) who had performed >500 RARPs and 12 novice urology surgeons performed a RARP, which was video recorded and assessed by two experienced urologists blinded as to subject and group. Percentage agreement between experienced urologists for the Delphi meeting and Mann–Whitney U- and Kruskal–Wallis tests were used for construct validation of the newly identified RARP metrics. Results: At the Delphi panel, consensus was reached on the appropriateness of the metrics for a reference RARP. In Study 2, the results showed that the VES performed ~4% more procedure steps and made 72% fewer procedure errors than the novices (P = 0.027). Phases VIIa and VIIb (i.e. neurovascular bundle dissection) best discriminated between the VES and novices. Limitations: VES whose performance was in the bottom half of their group demonstrated considerable error variability and made five-times as many errors as the other half of the group (P = 0.006). Conclusions: The international Delphi panel reached high-level consensus on the RARP metrics that reliably distinguished between the objectively scored procedure performance of VES and novices. Reliable and valid performance metrics of RARP are imperative for effective and quality assured surgical training.
2021
128
1
103
111
Objective assessment of intraoperative skills for robot-assisted radical prostatectomy (RARP): results from the ERUS Scientific and Educational Working Groups Metrics Initiative / Mottrie, A.; Mazzone, E.; Wiklund, P.; Graefen, M.; Collins, J. W.; De Groote, R.; Dell'Oglio, P.; Puliatti, S.; Gallagher, A. G.. - In: BJU INTERNATIONAL. - ISSN 1464-4096. - 128:1(2021), pp. 103-111. [10.1111/bju.15311]
Mottrie, A.; Mazzone, E.; Wiklund, P.; Graefen, M.; Collins, J. W.; De Groote, R.; Dell'Oglio, P.; Puliatti, S.; Gallagher, A. G.
File in questo prodotto:
File Dimensione Formato  
Objective assessment of intraoperative skills forrobot-assisted radical prostatectomy (RARP).pdf

Open access

Tipologia: Versione pubblicata dall'editore
Dimensione 477.19 kB
Formato Adobe PDF
477.19 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1249011
Citazioni
  • ???jsp.display-item.citation.pmc??? 14
  • Scopus 40
  • ???jsp.display-item.citation.isi??? 35
social impact