Search

Objectives: The aim of this study was to determine the accuracy and interrater reliability of (1) point-of-care ultrasound (POCUS) image interpretation for identification of intussusception and (2) reliability of secondary signs associated with intussusception among experts compared with novice POCUS reviewers., Methods: We conducted a planned secondary analysis of a prospective, convenience sample of children aged 3 months to 6 years who were evaluated with POCUS for intussusception across 17 international pediatric emergency departments between October 2018 and December 2020. A random sample of 100 POCUS examinations was reviewed by novice and expert POCUS reviewers. The primary outcome was identification of the presence or absence of intussusception. Secondary outcomes included intussusception size and the presence of trapped free fluid or echogenic foci. Accuracy was summarized using sensitivity and specificity, which were estimated via generalized mixed effects logistic regression. Interrater reliability was summarized via Light's κ statistics with bootstrapped standard errors (SEs). Accuracy and reliability of expert and novice POCUS reviewers were compared., Results: Eighteen expert and 16 novice POCUS reviewers completed the reviews. The average expert sensitivity was 94.5% (95% confidence interval [CI], 88.6-97.5), and the specificity was 94.3% (95% CI, 90.3-96.7), significantly higher than the average novice sensitivity of 84.7% (95% CI, 74.3-91.4) and specificity of 80.4% (95% CI, 72.4, 86.7). κ was significantly greater for expert (0.679, SE 0.039) compared with novice POCUS reviewers (0.424, SE 0.044; difference 0.256, SE 0.033). For our secondary outcome measure of intussusception size, κ was significantly greater for experts (0.661, SE 0.038) compared with novices (0.397, SE 0.041; difference 0.264, SE 0.029). Interrater reliability was weak for expert and minimal for novice reviewers regarding the detection of trapped free fluid and echogenic foci., Conclusions: Expert POCUS reviewers demonstrate high accuracy and moderate interrater reliability when identifying intussusception via image interpretation and perform better than novice reviewers., Competing Interests: Disclosure: The authors declare no conflict of interest., (Copyright © 2022 Wolters Kluwer Health, Inc. All rights reserved.)

Abstract: Over the last 2 decades, the use of point-of-care ultrasound (POCUS) in pediatric emergency medicine (PEM) has grown exponentially. In 2014, a group of PEM POCUS leaders met and formed the P2Network. The P2Network provides a platform to build collaborative relationships and share expertise among members from various countries and practice settings. It works with educators and researchers within and outside of the field to advance POCUS practice in PEM. As an organization, the P2Network promotes the evidence-based application of POCUS to facilitate and improve care in the PEM setting and addresses issues related to integration of the PEM POCUS practitioner in this nascent field. The P2Network is building and augmenting its infrastructure for PEM POCUS research and education and has already made some progress in the areas, with published manuscripts and ongoing clinical research studies under its sponsorship. Future goals include developing a PEM POCUS research agenda, formalizing teaching and assessment of PEM POCUS skills, and implementing multicenter research studies on potentially high impact applications., Competing Interests: Disclosure: The authors declare no conflict of interest., (Copyright © 2021 Wolters Kluwer Health, Inc. All rights reserved.)