1. Interobserver Variability in the International Study Group for Pancreatic Surgery (ISGPS)-Defined Complications After Pancreatoduodenectomy: An International Cross-Sectional Multicenter Study.
- Author
-
Hendriks TE, Balduzzi A, van Dieren S, Suurmeijer JA, Salvia R, Stoop TF, Del Chiaro M, Mieog SD, Nielen M, Zani S Jr, Nussbaum D, Hackert T, Izbicki JR, Javed AA, Hewitt DB, Koerkamp BG, de Wilde RF, Miao Y, Jiang K, Nakata K, Nakamura M, Jang JY, Lee M, Ferrone CR, Shrikhande SV, Chaudhari VA, Busch OR, Siriwardena AK, Strobel O, Werner J, Bonsing BA, Marchegiani G, and Besselink MG
- Subjects
- Humans, Cross-Sectional Studies, Male, Female, Middle Aged, Aged, Pancreaticoduodenectomy adverse effects, Observer Variation, Postoperative Complications epidemiology, Postoperative Complications etiology
- Abstract
Objective: To determine the interobserver variability for complications of pancreatoduodenectomy as defined by the International Study Group for Pancreatic Surgery (ISGPS) and others., Background: Good interobserver variability for the definitions of surgical complications is of major importance in comparing surgical outcomes between and within centers. However, data on interobserver variability for pancreatoduodenectomy-specific complications are lacking., Methods: International cross-sectional multicenter study including 52 raters from 13 high-volume pancreatic centers in 8 countries on 3 continents. Per center, 4 experienced raters scored 30 randomly selected patients after pancreatoduodenectomy. In addition, all raters scored 6 standardized case vignettes. This variability and the "within centers" variability were calculated for 2-fold scoring (no complication/grade A vs grade B/C) and 3-fold scoring (no complication/grade A vs grade B vs grade C) of postoperative pancreatic fistula, postpancreatoduodenectomy hemorrhage, chyle leak, bile leak, and delayed gastric emptying. Interobserver variability is presented with Gwet AC-1 measure for agreement., Results: Overall, 390 patients after pancreatoduodenectomy were included. The overall agreement rate for the standardized cases vignettes for 2-fold scoring was 68% (95% CI: 55%-81%, AC1 score: moderate agreement), and for 3-fold scoring 55% (49%-62%, AC1 score: fair agreement). The mean "within centers" agreement for 2-fold scoring was 84% (80%-87%, AC1 score; substantial agreement)., Conclusions: The interobserver variability for the ISGPS-defined complications of pancreatoduodenectomy was too high even though the "within centers" agreement was acceptable. Since these findings will decrease the quality and validity of clinical studies, ISGPS has started efforts aimed at reducing the interobserver variability., Competing Interests: The authors report no conflicts of interest., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)
- Published
- 2024
- Full Text
- View/download PDF