Search

Background: The Bethesda System for Reporting Thyroid Cytology (TBSRTC) recommended for the interpretation of needle aspiration cytology of the thyroid, is the most widely used worldwide. Studies have shown that the disagreement between observers, especially in the Bethesda III and IV diagnostic categories, is not insignificant at 10%–40%. In the TBSRTC 2023 version, some definitions were removed and simplified, and molecular pathology was proposed as a complement to cytopathology. The current availability of molecular tests is limited because they can be performed in a few centers and are expensive. Therefore, our study investigated intra- and inter-observer agreement according to TBSRTC 2023 using only immunohistochemically BRAFV600E antibodies. Materials and Methods: The study included 173 cases with aspiration cytology evaluated between 2019 and 2022. The immunohistochemical procedure applied BRAFV600E (RM8) monoclonal antibody to cell block sections. All slides were assessed and categorized by three different observers. Data were interpreted using Cohen’s kappa and Fleiss’s kappa test in the Statistical Package for Social Sciences Windows 2021 program. Results: For the applied RM8 antibody, sensitivity was 64.71% and specificity was 87.27%. In terms of diagnostic categories, inter-observer agreement was good for Bethesda II (K = 0.606) and moderate for Bethesda III (K = 0.429), Bethesda IV (K = 0.523), Bethesda V (K = 0,464), and Bethesda VI (K = 0.544), respectively. Conclusion: In conclusion, the study reveals that the 2023 version of TBSRTC provides improvement, especially in the categories of uncertain diagnosis, but is still insufficient to improve cytological diagnostic accuracy, at which point molecular analyses become even more important.

Background: The Bethesda System for Reporting Thyroid Cytology (TBSRTC) recommended for the interpretation of needle aspiration cytology of the thyroid, is the most widely used worldwide. Studies have shown that the disagreement between observers, especially in the Bethesda III and IV diagnostic categories, is not insignificant at 10%–40%. In the TBSRTC 2023 version, some definitions were removed and simplified, and molecular pathology was proposed as a complement to cytopathology. The current availability of molecular tests is limited because they can be performed in a few centers and are expensive. Therefore, our study investigated intra- and inter-observer agreement according to TBSRTC 2023 using only immunohistochemically BRAFV600E antibodies. Materials and Methods: The study included 173 cases with aspiration cytology evaluated between 2019 and 2022. The immunohistochemical procedure applied BRAFV600E (RM8) monoclonal antibody to cell block sections. All slides were assessed and categorized by three different observers. Data were interpreted using Cohen's kappa and Fleiss's kappa test in the Statistical Package for Social Sciences Windows 2021 program. Results: For the applied RM8 antibody, sensitivity was 64.71% and specificity was 87.27%. In terms of diagnostic categories, inter-observer agreement was good for Bethesda II (K = 0.606) and moderate for Bethesda III (K = 0.429), Bethesda IV (K = 0.523), Bethesda V (K = 0,464), and Bethesda VI (K = 0.544), respectively. Conclusion: In conclusion, the study reveals that the 2023 version of TBSRTC provides improvement, especially in the categories of uncertain diagnosis, but is still insufficient to improve cytological diagnostic accuracy, at which point molecular analyses become even more important. [ABSTRACT FROM AUTHOR]

Purpose: Contrast-enhanced mammography (CEM) is an innovative imaging tool for breast cancer detection, involving intravenous injection of a contrast medium and the assessment of lesion enhancement in two phases: early and delayed. The aim of the study was to analyze the topographic concordance of lesions detected in the early- versus delayed phase acquisitions. Materials and methods: Approved by the Ethics Committee (No. 118/20), this prospective study included 100 women with histopathological confirmed breast neoplasia (B6) at the Radiodiagnostics Department of the Maggiore della Carità Hospital of Novara, Italy from May 1, 2021, to October 17, 2022. Participants underwent CEM examinations using a complete protocol, encompassing both early- and delayed image acquisitions. Three experienced radiologists blindly analyzed the CEM images for contrast enhancement to determine the topographic concordance of the identified lesions. Two readers assessed the complete study (protocol A), while one reader assessed the protocol without the delayed phase (protocol B). The average glandular dose (AGD) of the entire procedure was also evaluated. Results: The analysis demonstrated high concordance among the three readers in the topographical identification of lesions within individual quadrants of both breasts, with a Cohen's κ > 0.75, except for the lower inner quadrant of the right breast and the retro-areolar region of the left breast. The mean whole AGD was 29.2 mGy. The mean AGD due to CEM amounted to 73% of the whole AGD (21.2 mGy). The AGD attributable to the delayed phase of CEM contributed to 36% of the whole AGD (10.5 mGy). Conclusions: As we found no significant discrepancy between the readings of the two protocols, we conclude that delayed-phase image acquisition in CEM does not provide essential diagnostic benefits for effective disease management. Instead, it contributes to unnecessary radiation exposure. [ABSTRACT FROM AUTHOR]

Introduction Axial spondyloarthritis has characteristic clinical features such as enthesitis, sacroiliitis and spondylitis, and extra-articular manifestations. Sacroiliitis (SI) occurs as a result of inflammation of the sacroiliac joint. Magnetic resonance imaging (MRI) of sacroiliac (SI) joints is used to detect early sacroiliitis. Sometimes, there can be variations in the interpretation of MRI findings of the SI joint among observers. Our aim was to investigate the inter-observer agreement among the observers. Materials and methods The study included the MRI results of 1150 patients who were diagnosed with active or chronic sacroiliitis based on the findings from sacroiliac MRIs, or whose MRI was deemed indicative of sacroiliitis by the rheumatologist. 1150 MRIs were re-evaluated by a different and expert radiologist. Results Out of the total 1150 patients investigated within the scope of this study. A statistically significant disparity emerged between the assessments provided by the expert radiologists and those obtained from outsourced radiologist evaluations. Conclusion The diagnosis of spondyloarthropathy may be delayed for some reasons. If the patient's clinic and MRI report are not consistent, the patient should not be removed from follow-up.

(1) Background: In giant cell arteritis (GCA), the assessment of cranial arteries using [18F]fluorodeoxyglucose ([18F]FDG) positron emission tomography (PET) combined with low-dose computed tomography (CT) may be challenging due to low image quality. This study aimed to investigate the effect of prolonged acquisition time on the diagnostic performance of [18F]FDG PET/CT in GCA. (2) Methods: Patients with suspected GCA underwent [18F]FDG-PET imaging with a short acquisition time (SAT) and long acquisition time (LAT). Two nuclear medicine physicians (NMPs) reported the presence or absence of GCA according to the overall image impression (gestalt) and total vascular score (TVS) of the cranial arteries. Inter-observer agreement and intra-observer agreement were assessed. (3) Results: In total, 38 patients were included, of whom 20 were diagnosed with GCA and 18 were without it. Sensitivity and specificity for GCA on SAT scans were 80% and 72%, respectively, for the first NMP, and 55% and 89% for the second NMP. On the LAT scans, these values were 65% and 83%, and 75% and 83%, respectively. When using the TVS, LAT scans showed especially increased specificity (94% for both NMPs). Observer agreement was higher on the LAT scans compared with that on the SAT scan. (4) Conclusions: LAT combined with the use of the TVS may decrease the number of false-positive assessments of [18F]FDG PET/CT. Additionally, LAT and TVS may increase both inter and intra-observer agreement. [ABSTRACT FROM AUTHOR]

Abstract Background Veterinary telemedicine has only been adopted to some degree. One aspect that needs to be evaluated is clinical examinations using video. The objective of this study was to evaluate agreement between a traditional physical clinical examination and a clinical examination using recorded video using finishing pigs with umbilical outpouchings (umbilical hernias, cysts, and abscesses) as the study unit. A total of 102 finisher pigs with umbilical outpouchings were clinically examined and recorded on video. Four experienced pig veterinarians were allowed to examine each pig for approximately 10 min and were individually asked to fill out a predesigned clinical record. Approximately 1 month after the physical examinations, the veterinarians individually reexamined all 102 pigs in a blinded manner, utilizing the video recordings and filling in a predesigned clinical record. Results For all measurements using a ruler, a high Pearson correlation coefficient was observed between physical and video examinations (range 0.69–0.95). In comparison, the visual bodyweight estimation had a lower Pearson correlation coefficient (range 0.57–0.64). Substantial to almost perfect agreement was observed between the physical and video examinations for abnormal weight distribution on any leg, restricted gait movements, lameness, signs of pain, fitness for transportation, presence of wounds, and categorization of the number of wounds > 4 cm2 on the umbilical outpouching (mean Kappa range 0.67–0.87). Fair agreement was observed for the presence of perineal soiling, ear wounds, pendulation of umbilical outpouching, umbilical outpouching touching the legs, skin not movable over the umbilical outpouching, and umbilical outpouching wound characteristics: type, presence of crusts, active bleeding, thick wound edges, connective tissue (mean Kappa range 0.21–0.40). Slight agreement was observed for umbilical outpouching characteristics: shape, macroscopic vascularization of the skin covering the outpouching, and the presence of scars, excoriations, and fistulas (mean Kappa range 0.10–0.20). Poor agreement was observed for the presence of granulation tissue (mean Kappa = − 0.05). Conclusions The agreement between a physical clinical examination and a clinical examination using recorded video of the same pig varies from poor to almost perfect, depending on the clinical sign and the executing veterinarian.

The diagnostic value of Bosniak classification based on contrast enhanced ultrasound (CEUS) on complex cystic renal mass (CRM) was compared among different observers. From 2012 to 2022, 212 complex CRMs, confirmed by pathology or at least 1-year imaging follow-up, were enrolled. The CEUS images of CRM were retrospectively analyzed by two reviewers with different experience in kidney CEUS examination, and each lesion was given the categorizations according the Bosniak ver. 2015 and ver. 2019, respectively. There was good inter-observer agreement (k = 0.689; p

Purpose: To assess the consistency of Ovarian-Adnexal Reporting and Data System (O-RADS) lexicon interpretation between senior and junior sonologists and to investigate its impact on O-RADS classification and diagnostic performance. Methods: We prospectively studied 620 patients with adnexal lesions, all of whom underwent transvaginal or transrectal ultrasound performed by a senior sonologist (R1) who selected the O-RADS lexicon description and O-RADS category for the lesion after the examination. Meanwhile, the junior sonologist (R2) analyzed the images retained by R1 and divided the lesion in the same way. Pathological findings were used as a reference standard. kappa (к) statistics were used to assess the interobserver agreement. Results: Of the 620 adnexal lesions, 532 were benign and 88 were malignant. When using the O-RADS lexicon, R1 and R2 had almost perfect agreement regarding lesion category, external contour of solid lesions, presence of papillary inside cystic lesions, and fluid echogenicity (к: 0.81–1.00). Substantial agreement in solid components, acoustic shadow, vascularity and O-RADS categories (к: 0.61–0.80). Consistency in classifying classic benign lesions in the O-RADS category was only moderate (к = 0.535). No significant difference in diagnostic performance between them using O-RADS (P = 0.1211). Conclusion: There was good agreement between senior and junior sonologists in the interpretation of the O-RADS lexicon and in the classification of O-RADS, except for a moderate agreement in the interpretation and classification of classic benign lesions. Differences in O-RADS category delineation between sonologists had no significant effect on the diagnostic performance of O-RADS. [ABSTRACT FROM AUTHOR]

Background: There is relatively scarce data on the computed tomography (CT) detection of gastrointestinal (GI) involvement in gallbladder cancer (GBC). We aim to assess the GI involvement in GBC on CT and propose a CT-based classification. Methods: This retrospective study comprized consecutive patients with GBC who underwent contrast-enhanced computed tomography (CECT) for staging between January 2019 and April 2022. Two radiologists evaluated the CT images independently for the morphological type of GBC and the presence of GI involvement. GI involvement was classified into probable involvement, definite involvement and GI fistulization. The incidence of GI involvement and the association of GI involvement with the morphological type of GBC was evaluated. In addition, the inter-observer agreement for GI involvement was assessed. Results: Over the study period, 260 patients with GBC were evaluated. Forty-three (16.5%) patients had GI involvement. Probable GI involvement, definite GI involvement and GI fistulization were seen in 18 (41.9%), 19 (44.2%) and six (13.9%) patients, respectively. Duodenum was the most common site of involvement (55.8%), followed by hepatic flexure (23.3%), antropyloric region (9.3%) and transverse colon (2.3%). There was no association between GI involvement and morphological type of GBC. There was substantial to near-perfect agreement between the two radiologists for the overall GI involvement (k = 0.790), definite GI involvement (k = 0.815) and GI fistulization (k = 0.943). There was moderate agreement (k = 0.567) for probable GI involvement. Conclusion: GBC frequently involves the GI tract and CT can be used to categorize the GI involvement. However, the proposed CT classification needs validation. [ABSTRACT FROM AUTHOR]

Copyright of Sakarya Tıp Dergisi is the property of Sakarya Tip Dergisi and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Background: Online adaptive MR-guided radiotherapy allows for the reduction of safety margins in dose escalated treatment of rectal tumors. With the use of smaller margins, precise tumor delineation becomes more critical. In the present study we investigated the impact of rectal ultrasound gel filling on interobserver variability in delineation of primary rectal tumor volumes. Methods: Six patients with locally advanced rectal cancer were scanned on a 1.5 T MRI-Linac without (MRI_e) and with application of 100 cc of ultrasound gel transanally (MRI_f). Eight international radiation oncologists expert in the treatment of gastrointestinal cancers delineated the gross tumor volume (GTV) on both MRI scans. MRI_f scans were provided to the participating centers after MRI_e scans had been returned. Interobserver variability was analyzed by either comparing the observers’ delineations with a reference delineation (approach 1) and by building all possible pairs between observers (approach 2). Dice Similarity Index (DICE) and 95 % Hausdorff-Distance (95 %HD) were calculated. Results: Rectal ultrasound gel filling was well tolerated by all patients. Overall, interobserver agreement was superior in MRI_f scans based on median DICE (0.81 vs 0.74, p

Background and Aim: Although MRI is the preferred method with high diagnostic sensitivity for disc herniation, definitive diagnosis based on MRI image interpretation is still a major challenge. The aim of this study was to evaluate the clinical and morphological findings in different MRI sequences and then assessment of the agreement between different observers. Materials and Methods: In this descriptive-analytical study, different MRI sequences of 224 patients with disc herniation were analyzed and diagnosed separately by two radiologists. The morphological type of disc herniation and the location of the involved disc were diagnosed and finally, the diagnostic agreement between the observers was assessed. Results: A total of 224 patients (124 women and 100 men) with disc herniation were included in the study. On average 40% of the cases were bulge, 38% protrusion, 13% extrusion and 9% sequestration. There was complete agreement between the observers in the determination of anatomical location, but in regard to morphological type, we found a kappa agreement coefficient of 0.45 between the observers. Conclusion: T1 weight sequence is helpful in the diagnosis of the bulging hernia. The agreement between the observers was moderate (k = 0.45) and there was no agreement between the physicians on the morphological level of the extrusion and sequestration hernia. Use of other diagnostic methods besides MRI, integrated and continuous training of methods for interpreting MRI images based on Best Evidence Medical Education are recommended.

Background: Veterinary telemedicine has only been adopted to some degree. One aspect that needs to be evaluated is clinical examinations using video. The objective of this study was to evaluate agreement between a traditional physical clinical examination and a clinical examination using recorded video using finishing pigs with umbilical outpouchings (umbilical hernias, cysts, and abscesses) as the study unit. A total of 102 finisher pigs with umbilical outpouchings were clinically examined and recorded on video. Four experienced pig veterinarians were allowed to examine each pig for approximately 10 min and were individually asked to fill out a predesigned clinical record. Approximately 1 month after the physical examinations, the veterinarians individually reexamined all 102 pigs in a blinded manner, utilizing the video recordings and filling in a predesigned clinical record. Results: For all measurements using a ruler, a high Pearson correlation coefficient was observed between physical and video examinations (range 0.69–0.95). In comparison, the visual bodyweight estimation had a lower Pearson correlation coefficient (range 0.57–0.64). Substantial to almost perfect agreement was observed between the physical and video examinations for abnormal weight distribution on any leg, restricted gait movements, lameness, signs of pain, fitness for transportation, presence of wounds, and categorization of the number of wounds > 4 cm2 on the umbilical outpouching (mean Kappa range 0.67–0.87). Fair agreement was observed for the presence of perineal soiling, ear wounds, pendulation of umbilical outpouching, umbilical outpouching touching the legs, skin not movable over the umbilical outpouching, and umbilical outpouching wound characteristics: type, presence of crusts, active bleeding, thick wound edges, connective tissue (mean Kappa range 0.21–0.40). Slight agreement was observed for umbilical outpouching characteristics: shape, macroscopic vascularization of the skin covering the outpouching, and the presence of scars, excoriations, and fistulas (mean Kappa range 0.10–0.20). Poor agreement was observed for the presence of granulation tissue (mean Kappa = − 0.05). Conclusions: The agreement between a physical clinical examination and a clinical examination using recorded video of the same pig varies from poor to almost perfect, depending on the clinical sign and the executing veterinarian. [ABSTRACT FROM AUTHOR]

Asymptomatic variations (AV) in bones and teeth are widely used in biological anthropology, particularly to understand intra- and inter-population affinities. This study focuses on the first step of any study: the repeatability and reproducibility of the method implemented. Using the Kappa coefficient, the reliability of 198 variables divided into three anatomical areas (cranial, post-cranial and teeth) was analyzed. The sample used was selected among the best represented and best preserved individuals of the Notre-Dame-du-Bourg osteo-archaeological collection (Digne-les-Bains, medieval and modern period). The analyses were performed after four rounds of scoring (three observers), and when more than 20 observations of polymorphic variations were obtained. The quality of agreement was established according to the Fleiss et al. scale (2003). Although missing data were a hindrance in this study, several proposals were made to overcome the problem. We also highlight and discuss the fact that experience has an impact on the observation of qualitative variables. The outcome is a proposal for a protocol based on selecting repeatable and reproducible AVs to normalize comparisons between studies in both osteoarchaeological and forensic contexts.

Abstract Objectives To assess the usefulness of linked color imaging (LCI), a recently developed image‐enhanced endoscopy technique, in the endoscopic diagnosis of eosinophilic esophagitis (EoE). Methods Thirty white light images (WLIs) and 30 WLI+LCI images collected from patients with and without EoE were randomly and blindly reviewed by 10 endoscopists, including four experts (Exs) and six non‐Exs. Edema, ring, exudate furrows, and strictures were rated on the adjusted EoE endoscopic reference score; the diagnosis of EoE was assessed. Using the kappa value, inter‐ and intra‐observer agreements were analyzed among endoscopists. Results WLI+LCI images had a higher diagnostic accuracy for EoE than WLIs (0.85 vs. 0.70, respectively), especially in non‐Exs or endoscopists with no experience with EoE patients. Inter‐observer agreement for WLI+LCI images statistically surpassed WLIs for furrows (kappa, 0.73 vs. 0.67, respectively; p = 0.0013), stricture (kappa, 0.51 vs. 0.39, respectively; p = 0.0072), and diagnosis (kappa, 0.67 vs. 0.57, respectively; p < 0.0001) of EoE. The increase in inter‐observer agreement in WLI+LCI images allowed for a reduction in the differences between the Exs and non‐Ex endoscopists. Intra‐observer agreement for WLI+LCI images surpassed WLIs for a ring (kappa, 0.62 vs. 0.43, p = 0.0052), and a similar trend was found in exudates, furrows, and diagnosis irrespective of the Exs or non‐Exs. Conclusions LCI can contribute to the improvement of the endoscopic diagnosis for EoE, with “moderate” to “substantial” consistency, by enhancing the visibility of abnormal findings, leading to reduced diagnostic disparities among endoscopists.

Lung ultrasound (LUS) allows for the detection of a series of manifestations of COVID-19, such as B-lines and consolidations. The objective of this work was to study the inter-rater reliability (IRR) when detecting signs associated with COVID-19 in the LUS, as well as the performance of the test in a longitudinal or transverse orientation. Thirty-three physicians with advanced experience in LUS independently evaluated ultrasound videos previously acquired using the ULTRACOV system on 20 patients with confirmed COVID-19. For each patient, 24 videos of 3 s were acquired (using 12 positions with the probe in longitudinal and transverse orientations). The physicians had no information about the patients or other previous evaluations. The score assigned to each acquisition followed the convention applied in previous studies. A substantial IRR was found in the cases of normal LUS (κ = 0.74), with only a fair IRR for the presence of individual B-lines (κ = 0.36) and for confluent B-lines occupying < 50% (κ = 0.26) and a moderate IRR in consolidations and B-lines > 50% (κ = 0.50). No statistically significant differences between the longitudinal and transverse scans were found. The IRR for LUS of COVID-19 patients may benefit from more standardized clinical protocols. [ABSTRACT FROM AUTHOR]

Background/Aim: T2 weighted magnetic resonance (MR) imaging is the gold standard for locally advanced rectal cancer (LARC) staging. The potential benefit of functional imaging, as diffusion-weighted MR (DWI) and positron emission tomography-computed tomography (PET-CT), could be considered for treatment intensification strategies. Dose intensification resulted in better pathological complete response (pCR) rates. This study evaluated the inter-observer agreement between two radiation oncologists, and the difference in gross tumor volume (GTV) delineation in simulation-CT, T2-MR, DWIMR, and PET-CT in patients with LARC. Patients and Methods: Two radiation oncologists prospectively delineated GTVs of 24 patients on simul-CT (CTGTV), T2-weighted MR (T2GTV), echo planar b1000 DWI (DWIGTV) and PET-CT (PETGTV). Observers' agreement was assessed using Dice index. Kruskal-Wallis test assessed differences between methods. Results: Mean CTGTV, T2GTV, DWIGTV, and PETGTV were 41.3±26.9 cc, 25.9±15.2 cc, 21±14.8 cc, and 37.7±27.7 cc for the first observer, and 42.2±27.9 cc, 27.6±16.9 cc, 19.9±14.9cc, and 34.8±24.3 cc for the second observer, respectively. Mean Dice index was 0.85 for CTGTV, 0.84 for T2GTV, 0.82 for DWIGTV, and 0.89 for PETGTV, representative of almost perfect agreement. Kruskal-Wallis test showed a statistically significant difference between methods (p=0.009). Dunn test showed there were differences between DWIGTV vs. PETGTV (p=0.040) and DWIGTV vs. CTGTV (p=0.008). Conclusion: DWI resulted in smaller volume delineation compared to CT, T2-MR, and PET-CT functional images. Almost perfect agreements were reported for each imaging modality between two observers. DWI-MR seems to remain the optimal strategy for boost volume delineation for dose escalation in patients with LARC. [ABSTRACT FROM AUTHOR]

Objective(s): Accurate detection and competent management of thyroid nodules, as a common disease, basically depends on the reliability of the ultrasonography (US) report. In this research, we evaluated inter and intra-observer variation among ultrasonography reporters, based on ACR-TIRADS.Methods: In this retrospective study, 345 thyroid US images of 150 patients were reviewed. Three clinicians with at least 6-year experience in thyroid US reviewed the images twice at 6-8 weeks’ intervals. Composition, echogenicity, shape, margin, and echogenic foci based on ACR-TIRADS were reported, independently. Inter and intra-observer variations were calculated based on Cohen’s Kappa statistics.Results: 345 ultrasonography images of 150 patients with thyroid nodules (83 women and 67 men) with a mean age of 65 years were reviewed. Moderate to the substantial intra-observer agreement was achieved with the highest Kapa value in the category of shape (k=0.61-0.77). For TIRADS level, the moderate intra-observer agreement was observed (k=0.42-0.46). Inter-observer agreement for the US category of thyroid nodules was obtained slightly to moderate. Composition (k=0.42 and 0.51) and echogenicity (k=0.45 and 0.46) showed the highest overall agreement and margin showed the lowest overall agreement (k=0.18 and 0.19). In assessing TIRADS level of nodules, a fair agreement was obtained (k=0.23 and 0.29) .Conclusion: Moderate to substantial intra-observer agreement and slight to moderate inter-observer variation for evaluation of thyroid nodules; shows the need for a computer-aided diagnosis system based on artificial intelligence to assist our physicians in differentiating thyroid nodule characteristics based on explicit image features. An additional training course based on ACR-TIRADS for physicians can be another useful recommendation.

Summary: Background: Pancreatic cancer is an aggressive malignancy and a leading cause of cancer death worldwide; its lethality is partly linked to the difficulty of early diagnosis. Modern devices for endoscopic ultrasound-guided fine-needle biopsy (EUS-FNB) were recently developed to improve targeting and sampling of small lesions, but innovative technologies for microscopic assessment are still lacking. Ex vivo fluorescence confocal laser microscopy (FCM) is a new digital tool for real-time microscopic assessment of fresh unfixed biological specimens, avoiding conventional histological slide preparation and potentially being highly appealing for EUS-FNB specimens. Methods: This study evaluated the possible role of FCM for immediate evaluation of pancreatic specimens from EUS-FNB. It involved comparison of the interobserver agreement between the new method and standard histological analysis during international multicenter sharing of digital images. Digital images from 25 cases of EUS-FNB obtained with real-time FCM technology and 25 paired digital whole-slide images from permanent conventional paraffin sections were observed by 10 pathologists from different Institutions in Europe, Japan, and the United States, in a blinded manner. The study evaluated 500 observations regarding adequacy, morphological clues, diagnostic categories, and final diagnosis. Findings: Statistical analysis showed substantial equivalence in the interobserver agreement among pathologists using the two techniques. There was also good inter-test agreement in determining sample adequacy and when assigning a diagnostic category. Among morphological features, nuclear enlargement was the most reproducible clue, with very good inter-test agreement. Interpretation: Findings in this study are from international multicenter digital sharing and are published here for the first time. Considering the advantages of FCM digital diagnostics in terms of reduced time and unaltered sample maintenance, the ex vivo confocal laser microscopy may effectively improve traditional EUS-FNB diagnostics, with significant implications for planning modern diagnostic workflow for pancreatic tumors. Funding: This study was not supported by any funding source.

Camera traps are a popular tool in terrestrial wildlife research due to their low costs, easy operability, and usefulness for studying a wide array of species and research questions. The vast numbers of images they generate often require multiple human data extractors, yet accuracy and inter-observer variance are rarely considered. We compared results from 10 observers who processed the same set of multi-species camera trap images (n = 11,560) from seven sites. We quantified inter-observer agreement and variance for (1) the number of mammals identified, (2) the number of images saved, (3) species identification accuracy and the types of mistakes made, and (4) counts of herbivore groups and individuals. We analysed the influence of observer experience, species distinctiveness and camera location. Observers varied significantly regarding image processing rates, the number of mammals found and images saved, and species misidentifications. Only one observer detected all 22 mammals (range: 18–22, n = 10). Experienced observers processed images up to 4.5 times faster and made less mistakes regarding species detection and identification. Missed species were mostly small mammals (56.5%) while misidentifications were most common among species with low phenotypic distinctiveness. Herbivore counts had high to very high variances with mainly moderate agreement across observers. Observers differed in how they processed images and what they recorded. Our results raise important questions about the reliability of data extracted by multiple observers. Inter-observer bias, observer-related variables, species distinctiveness and camera location are important considerations if camera trapping results are to be used for population estimates or biodiversity assessments. [ABSTRACT FROM AUTHOR]

Tumor infiltrating lymphocytes (TILs) have predictive and prognostic potential in HER2‐positive breast cancer (HER2 + BC). Due to tumor heterogeneity, guidelines recommend evaluation on full tumor‐sections over biopsies, but aren't clear regarding tissue microarrays (TMAs). Herein, we investigate the inter‐observer agreement of TILs assessment in HER2 + BC on full‐sections and TMAs using a standardized method. Two pathologists assessed TILs using HE full‐sections and TMAs from 244 patients with HER2 + BC. TILs were assessed in 10% intervals; values <10% evaluated as 0%, 1% or 5%. Levels of agreement were evaluated using intraclass‐coefficient (ICC), Kappa statistics and concordance analysis. For inter‐observer agreement for full‐sections, ICC was 0.93 (95% CI 0.89–0.95) and Kappa was 0.75, corresponding to acceptable and moderate agreement respectively. For TMAs, ICC was 0.73 (95% CI: 0.62–0.81) and Kappa 0.33, corresponding to unacceptable agreement. For association in matched TMA and full‐sections, ICC was 0.64 (95% CI 0.55–0.71) and Lin's concordance correlation coefficient was 0.63 (95% CI 0.55–0.71), corresponding to unacceptable agreement. There is acceptable inter‐observer agreement of TILs assessment on full‐sections but not TMAs and discrepancy between full‐sections and TMAs. TMA preparation must include consideration for representation of both entire tumor area and tumor‐microenvironment to correctly define prognostic and predictive values of potential immuno‐related biomarkers. [ABSTRACT FROM AUTHOR]

Bernice Engeltjes,1,2 Ageeth Rosman,2 Loes CM Bertens,3 Eveline Wouters,4 Doug Cronie,2 Fedde Scheele1,5 1Athena Institute for Transdisciplinary Research, Faculty of Science, VU University, Amsterdam, the Netherlands; 2Department of Healthcare Studies, Rotterdam University of Applied Sciences, Rotterdam, the Netherlands; 3Department of Obstetrics and Gynecology, Erasmus MC, University Medical Centre Rotterdam, Rotterdam, the Netherlands; 4Department of Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, the Netherlands; 5Department of Healthcare Education, OLVG Teaching Hospital, Amsterdam, the NetherlandsCorrespondence: Bernice EngeltjesDepartment of Healthcare Studies, Rotterdam University of Applied Sciences, Rotterdam, the NetherlandsTel +31 6 41804881Email engeltjesbernice@gmail.comBackground: Safety and efficiency of emergency care can be optimized with a triage system which uses urgency to prioritize care. The Dutch Obstetric Telephone Triage System (DOTTS) was developed to provide a basis for assessing urgency of unplanned obstetric care requests by telephone. Reliability and validity are important components in evaluating such (obstetric) triage systems.Objective: To determine the reliability of Dutch Obstetric Telephone Triage, by calculating the inter-rater and intra-rater reliability.Methods: To evaluate the urgency levels of DOTTS by testing inter-rater and intra-rater reliability, 90 vignettes of possible requests were developed. Nineteen participants, from hospitals where DOTTS had been implemented, rated in two rounds a set of ten vignettes. The five urgency levels and five presenting symptoms had an equal spread and had to be entered in accordance with DOTTS per vignette. Urgency levels were dichotomized into high urgency and intermediate urgency. Inter-rater reliability was rated as degree of agreement between two different participants with the same vignette. Intra-rater reliability was rated as agreement by the same participants at different moments in time. The degree of inter-rater and intra-rater reliability was tested using weighted Cohen’s Kappa and ICC.Results: The agreement of urgency level between participants in accordance with predefined urgency level per vignette was 90.5% (95% CI 87.5– 93.6) [335 of 370]. Agreement of urgency level between participants was 88.5% (95% CI 84.9– 93.0) [177 of 200] and 84.9% (95% CI 78.3– 91.4) after re-rating [101 of 119]. Inter-rater reliability of DOTTS expressed as Cohen’s Kappa was 0.77 and as ICC 0.87; intra-rater reliability of DOTTS expressed as Cohen’s Kappa was 0.70 and as ICC 0.82.Conclusion: Inter-rater and intra-rater reliability of DOTTS showed substantial correlation, and is comparable to other studies. Therefore, DOTTS is considered reliable.Keywords: obstetrics, triage system, inter-observer agreement, intra-observer agreement, undertriage and overtriage

Abstract Background Use of 11C-Choline PET/CT is gaining ground in detecting hyperfunctioning parathyroid glands in primary hyperparathyroidism. The purpose of this study was to evaluate the robustness of 11C-Choline PET/CT by assessing intra- and inter-observer agreement to determine whether the method was reader sensitive and therefore should only be performed at highly specialised sites with a high number of cases. PET/CT images of 40 patients diagnosed with primary hyperparathyroidism were anonymised and evaluated three times by three readers: an expert reader and two non-experts (non-experts were experienced in PET/CT imaging, but not in 11C-Choline PET/CT in the setting of primary hyperparathyroidism). Number of hyperfunctioning parathyroid glands, location relative to the thyroid gland and confidence of each assessment (low, moderate or high) were noted, and intra- and inter-observer agreement calculated using Fleiss’ kappa method. Sensitivities and specificities of the non-experts were calculated using the expert reader as gold standard. Results Intra-observer agreement was ‘good’ to ‘near perfect’ for all readers. Inter-observer agreement was good between non-experts and the expert, with kappa values ≥ 0.74. Sensitivities between non-experts and the expert were high, > 81%, when assessing which side and 75% when assessing thyroid quadrant. All specificities were > 94%. Reader certainties were ‘high’ in > 80% of cases for the expert and > 70% and > 65%, respectively for the two non-experts. Conclusion 11C-Choline PET/CT is not reader sensitive for the localisation of hyperfunctioning parathyroid glands and may therefore be safely implemented at sites that have a moderate number of cases. Access to a cyclotron laboratory is, however, a necessity for the production of 11C-Choline. The study was conducted in accordance with the Helsinki 2 declaration and The International Council for Harmonisation Guideline for Good Clinical Practice (ICH_GCP) clinical trial, approved by the Research Ethics Committee of the Capital Region of Denmark (Journal-nr.:H-18012490, date of approval: 18 June 2018) and the Danish Medicines Agency (EudraCT no. 2018-000726-63, date of approval: 6 June 2018). The GCP unit in Eastern Denmark has carried out regular monitoring of the trial according to GCP (ID: 2018-1050).

Background: Transesophageal echocardiography (TEE) is the gold standard for the detection of valvular vegetations (VV). Differentiating small VV from degenerative changes is challenging and prone to inter‐observer variability. We evaluated inter‐observer agreement regarding aortic (AV) and mitral valve (MV) findings on TEEs ordered for suspected infective endocarditis (IE). Methods: A total of 349 consecutive TEEs were evaluated. Studies were classified as "definite, possible, or no" IE with valve masses classified further by morphology. Nine faculty echocardiographers scored randomly selected TEEs of the AV (N = 38) and MV (N = 35). Inter‐reader variability was calculated using the Fleiss/Scott Kappa (Kf). Results: Positive blood cultures were present in 81% and 45% had definite IE by the modified Duke criteria. There was moderate reader agreement regarding the presence of a valvular mass for both the AV (Kf =.41, 95% CI [.30–.53]) and MV (Kf =.49, 95% CI [.34–.65]). For diagnosis of IE, there was fair agreement for the AV (Kf =.29, 95% CI [.18–.42]) and moderate agreement for the MV (Kf =.53, 95% CI [.36–.70]). Masses described as large, multi‐lobulated, or pedunculated were more frequently categorized as clinical IE, (p <.006, both valves), however those with filamentous lesions were not (p <.001, both valves). Conclusions: In a large academic center, the inter‐observer agreement for the presence of a left sided valvular mass was moderate and agreement regarding the final diagnosis of IE was fair to moderate, with better agreement among readers evaluating the MV. Lesion morphology is associated with the clinical diagnosis of IE. [ABSTRACT FROM AUTHOR]

Simple Summary: Canine hip dysplasia is an important orthopedic disorder in veterinary medicine. In addition to body weight, fat intake, rapid growth, and hormonal changes, heredity is one of its underlying factors. Diagnosis of hip dysplasia under one year of age would help veterinarians to plan proper preventive/therapeutic methods and exclude dysplastic dogs from breeding programs to reduce the incidence of the disease in future generations. Therefore, having an accurate method for the early diagnosis of dysplastic dogs is an important subject, and a limited number of screening methods are used globally. Assessment of the accuracy of these methods can be examined with intra- and inter-observer studies. In this study, we aimed to assess the inter-observer agreements of the eight radiographic parameters from four different radiographic projections between five experienced observers (two of them certified scrutineers for canine hip dysplasia) to evaluate the reproducibility of the protocols. In our study, high inter-observer agreements were recorded for measurable values such as angle measurements, whereas the results of the subjective grading were low. Thus, it can be deduced that quantitative parameters are reliable values and a combination of these values with other screening programs such as clinical examinations might increase the accuracy of the examinations. Canine hip dysplasia is a complex and multifactorial disease. The early diagnosis of dysplastic dogs under one year of age helps veterinarians to plan proper preventive/therapeutic methods. Having an accurate screening method increases the chance of the early detection of dysplasia. The goal of our study was to assess the inter-observer reliability of eight radiographic parameters in four-month-old Rottweilers. Radiographs of the 28 Rottweilers were investigated by five experienced observers. The radiographs were taken in ventrodorsal view with extended legs, frog-leg ventrodorsal view, distraction view, and dorsal acetabular rim view. Four quantitative parameters such as Norberg angle (NA), distraction index (DI), dorsal acetabular rim slope (DARS), and center edge angle (CEA) and four qualitative parameters such as sclerosis of the cranial acetabular rim (SCAR), location of the center of the femoral head (LCFH), grading of the degenerative joint disease (GDJD), and grading of the dorsal acetabular rim (GDAR) were evaluated. High inter-observer agreements were recorded for quantitative values, whereas the inter-observer agreement of the qualitative parameters was low. It can be deduced that the evaluated quantitative parameters are reliable, and a combination of these methods with clinical examinations might increase the accuracy of the examinations. [ABSTRACT FROM AUTHOR]

• Visual examination of pectus excavatum is subjective to observer disagreements. • Disagreements are more pronounced among patients with a high Haller index. • Disagreements could impact work-up and treatment strategy, urging standardization. Among patients suspected of pectus excavatum, visual examination is a key aspect of diagnosis and, moreover, guides work-up and treatment strategy. This study evaluated the inter-observer and intra-observer agreement of visual examination and diagnosis of pectus excavatum among experts. Three-dimensional surface images of consecutive patients suspected of pectus excavatum were reviewed in a multi-center setting. Interactive three-dimensional images were evaluated for the presence of pectus excavatum, asymmetry, flaring, depth of deformity, cranial onset, overall severity and morphological subtype through a questionnaire. Observers were blinded to all clinical patient information, completing the questionnaire twice per subject. Agreement was analyzed by kappa statistics. Fifty-eight subjects with a median age of 15.5 years (interquartile range: 14.1–18.2) were evaluated by 5 (cardio)thoracic surgeons. Pectus excavatum was visually diagnosed in 55% to 95% of cases by different surgeons, revealing considerable inter-observer differences (kappa: 0.50; 95%-confidence interval [CI]: 0.41–0.58). All other items demonstrated inter-observer kappa's of 0.25–0.37. Intra-observer analyses evaluating the presence of pectus excavatum demonstrated a kappa of 0.81 (95%-CI: 0.72–0.91), while all other items showed intra-observer kappa's of 0.36–0.68. Visual examination and diagnosis of pectus excavatum yields considerable inter-observer and intra-observer disagreements. As this variation in judgement could impact work-up and treatment strategy, objective standardization is urged. III. [ABSTRACT FROM AUTHOR]

(1) Background: Concentric ring artifacts in reconstructed SPECT images indicate the presence of detector non-uniformity in gamma camera systems. The identification of these artifacts is generally visual and not quantitative. The aim of our study was to evaluate observer assessments of the presence of concentric rings in reconstructed SPECT phantom images and to verify whether quantitative texture analysis can detect such artifacts, which are detrimental to accurate tumor detection. (2) Methods: Test data were acquired as part of the quarterly quality assurance program using a standardized SPECT phantom containing solid spheres, solid rods, and a water solution of 99mTc. Forty separate SPECT acquisitions were analyzed to assess the presence of ring artifacts. Two experienced medical physicists independently reviewed transaxial images and graded the severity of artifacts on a five-point scale. Quantitative radiomic features were computed for volumes of interest located in the uniform phantom section. In addition to these, radial contrast ( R C o n t r a s t ) and radial root-mean-square contrast ( R R M S C ) were also calculated and derived from the radial profile of summed slices transformed into polar coordinates. (3) Results: Artifacts were considered sufficiently severe to warrant camera re-tuning in 10 rod sections, 17 sphere sections, and 16 uniform sections. In the uniform sections, there was "good agreement" for inter-observer and intra-rater assessments (κ = 0.66, Fisher exact p < 0.0001 and κ = 0.61, and Fisher exact p = 0.001, respectively). The two radial features agreed significantly (p < 0.001) with visual severity judgment of ring artifacts in uniform sections and were selected as informative about the presence of ring artifacts by LASSO approach. The increased magnitude of R C o n t r a s t and R R M S C correlated significantly with increasingly severe artifact scores (ρ = 0.65–0.66, p < 0.0001). (4) Conclusions: There was good agreement between the physicists with respect to the presence of circular ring artifacts in uniform sections of SPECT quality assurance scans, with the artifacts accurately detected by radial contrast and noise-to-signal ratio measurements. [ABSTRACT FROM AUTHOR]

Abstract Background The METastasis Reporting and Data System for Prostate Cancer (MET-RADS-P) guidelines are designed to enable reproducible assessment in detecting and quantifying metastatic disease response using whole-body magnetic resonance imaging (WB-MRI) in patients with advanced prostate cancer (APC). The purpose of our study was to evaluate the inter-observer agreement of WB-MRI examination reports produced by readers of different expertise when using the MET-RADS-P guidelines. Methods Fifty consecutive paired WB-MRI examinations, performed from December 2016 to February 2018 on 31 patients, were retrospectively examined to compare reports by a Senior Radiologist (9 years of experience in WB-MRI) and Resident Radiologist (after a 6-months training) using MET-RADS-P guidelines, for detection and for primary/dominant and secondary response assessment categories (RAC) scores assigned to metastatic disease in 14 body regions. Inter-observer agreement regarding RAC score was evaluated for each region by using weighted-Cohen’s Kappa statistics (K). Results The number of metastatic regions reported by the Senior Radiologist (249) and Resident Radiologist (251) was comparable. For the primary/dominant RAC pattern, the agreement between readers was excellent for the metastatic findings in cervical, dorsal, and lumbosacral spine, pelvis, limbs, lungs and other sites (K:0.81–1.0), substantial for thorax, retroperitoneal nodes, other nodes and liver (K:0.61–0.80), moderate for pelvic nodes (K:0.56), fair for primary soft tissue and not assessable for skull due to the absence of findings. For the secondary RAC pattern, agreement between readers was excellent for the metastatic findings in cervical spine (K:0.93) and retroperitoneal nodes (K:0.89), substantial for those in dorsal spine, pelvis, thorax, limbs and pelvic nodes (K:0.61–0.80), and moderate for lumbosacral spine (K:0.44). Conclusions We found inter-observer agreement between two readers of different expertise levels to be excellent in bone, but mixed in other body regions. Considering the importance of bone metastases in patients with APC, our results favor the use of MET-RADS-P in response to the growing clinical need for monitoring of metastasis in these patients.

ABSTRACT BACKGROUND: The accuracy of magnetic resonance imaging (MRI) for making the diagnosis of subscapularis tears presents wide variation in the literature and there are few prospective studies. OBJECTIVE: To compare the findings from MRI and arthroscopy for diagnosing subscapularis tears. DESIGN AND SETTING: Diagnostic test study performed in a tertiary care hospital. METHODS: We included patients who underwent arthroscopic rotator cuff repair and who had firstly undergone high magnetic field MRI without contrast. The images were independently evaluated by a shoulder surgeon and two musculoskeletal radiologists. Sensitivity, specificity, positive and negative predictive values, accuracy and inter and intra-observer agreement were calculated. RESULTS: MRIs on 200 shoulders were evaluated. The incidence of subscapularis tears was 69.5% (41.5% partial and 28.0% full-thickness). The inter and intra-observer agreement was moderate for detection of subscapularis tears. The shoulder surgeon presented sensitivity of 51.1% to 59.0% and specificity of 91.7% to 94.4%. The radiologists showed sensitivity of 83.5% to 87.1% and specificity of 41% to 45.9%. Accuracy ranged from 60.5% to 73.0%. CONCLUSION: The 1.5-T MRIs without contrast showed mean sensitivity of 70.2% and mean specificity of 61.9% for detection of subscapularis tears. Sensitivity was higher for the musculoskeletal radiologists, while specificity was higher for the shoulder surgeon. The mean accuracy was 67.6%, i.e. lower than that of rotator cuff tears overall.

Abstract Background Whole body magnetic resonance imaging (MRI) is now incorporated into international guidance for imaging patients with multiple myeloma. The aim of this study was to investigate inter-observer agreement of triple reported baseline whole-body MRI in myeloma and highlight potential pitfalls. Methods Fifty-seven patients with symptomatic myeloma at first presentation or relapse and planned for autologous stem cell transplant were included. All patients completed baseline whole body MRI within 2 weeks prior to starting treatment. Each scan was reported independently by 3 radiologists using a defined scoring system. Differences in observer scores were compared using analysis of variance (ANOVA) and inter-observer agreement assessed using intra class correlation coefficient (ICC). Results There was no significant difference in mean observer scores for whole skeleton and ICC demonstrated excellent inter-observer agreement at 0.91. ICC varied between skeletal regions with spine, pelvis and ribs showing good inter-observer agreement, whereas skull and long bones were moderate. Scans with variation in observer scores were re-examined and cause of discrepancies identified. This information was used to describe potential anatomical pitfalls in reporting . Conclusion Whole-body MRI has excellent inter-observer agreement in reporting symptomatic myeloma at baseline. Inter-observer agreement varied between skeletal regions highlighting specific areas of difficulty.

Lung ultrasound (LUS) allows for the detection of a series of manifestations of COVID-19, such as B-lines and consolidations. The objective of this work was to study the inter-rater reliability (IRR) when detecting signs associated with COVID-19 in the LUS, as well as the performance of the test in a longitudinal or transverse orientation. Thirty-three physicians with advanced experience in LUS independently evaluated ultrasound videos previously acquired using the ULTRACOV system on 20 patients with confirmed COVID-19. For each patient, 24 videos of 3 s were acquired (using 12 positions with the probe in longitudinal and transverse orientations). The physicians had no information about the patients or other previous evaluations. The score assigned to each acquisition followed the convention applied in previous studies. A substantial IRR was found in the cases of normal LUS (κ = 0.74), with only a fair IRR for the presence of individual B-lines (κ = 0.36) and for confluent B-lines occupying < 50% (κ = 0.26) and a moderate IRR in consolidations and B-lines > 50% (κ = 0.50). No statistically significant differences between the longitudinal and transverse scans were found. The IRR for LUS of COVID-19 patients may benefit from more standardized clinical protocols.

Background: The plasma cell disease is been studying by the whole-body MRI technology. However, the time requested to learn this radiological technique is unknown. Purpose: To esteem, quantitatively and qualitatively, the essential time to learn the whole-body MRI diffusion-weighted imaging with background body signal suppression in patients with plasma cell disease. Materials and methods: Between January 2015 and February 2017, three readers in-training with different levels of experience examined the anonymised and randomised whole-body MRI images of 52 patients with a diagnosis of plasma cell disease and analysed their morphological (T1w, T2w with and without fat suppression) and functional sequences. Reports of an expert radiologist were considered the standard of reference. Images were analysed in two sessions, during which each reader was timed. Readers reported the number of segments with lesions and staged the disease using the Durie–Salmon PLUS staging system. Weighted Cohen's ĸ and Z-test were used to compare the trainees' reports with those of the expert radiologist, and learning curves were drawn up to show changes between the two sessions. Results: Weighted Cohen's ĸ of number of lesioned segments increased from 0.536 ± 0.123 to 0.831 ± 0.129 (Prob > Z under 0.005), thus approaching the goal of ĸ > 0.8. Trainees reached the level of experienced radiologist in terms of time by the 33rd patient. Agreement concerning the Durie–Salmon PLUS increased from 0.536 ± 0.123 to 0.831 ± 0.129 (Prob > Z under 0.005). Conclusions: The findings of this study demonstrate that whole-body MRI with DWIBS can be learned in about 80 reports and leads to a high level of inter-observer concordance when using the Durie–Salmon PLUS staging system. [ABSTRACT FROM AUTHOR]

Abstract Purpose To evaluate the optimal tracer uptake time, the minimal amount of radioactivity and the inter-observer agreement for 11C-choline positron emission tomography/computed tomography (PET/CT) in patients with primary hyperparathyroidism (pHPT). Methods Twenty-one patients with biochemically proven pHPT were retrospectively studied after injection of 6.3 ± 1.2 MBq/kg 11C-choline. PET data of the first nine patients, scanned for up to 60 min, were reconstructed in 10-min frames from 10- to 60-min postinjection (p.i.), mimicking varying 11C-choline uptake times. Parathyroid adenoma to background contrast ratios were calculated and compared, using standardized uptake values (SUVs). Data was reconstructed with varying scan durations (1, 2.5, 5, and 10 min) at 20–30-min p.i. (established optimal uptake time), mimicking less administered radioactivity. To establish the minimal required radioactivity, the SUVs in the shorter scan durations (1, 2.5, and 5 min) were compared to the 10-min scan duration to determine whether increased variability and/or statistical differences were observed. Four observers analyzed the 11C-choline PET/CT in four randomized rounds for all patients. Results SUVpeak of the adenoma decreased from 30 to 40 p.i. onwards. All adenoma/background contrast ratios did not differ from 20- to 30-min p.i. onwards. The SUVs of adenoma in the scan duration of 1, 2.5, and 5 min all differed significantly from the same SUV in the 10-min scan duration (all p = 0.012). However, the difference in absolute SUV adenoma values was well below 10% and therefore not considered clinically significant. The inter-observer analysis showed that the Fleiss’ kappa of the 1-min scan were classified as “moderate,” while these values were classified as “good” in the 2.5-, 5-, and 10-min scan duration. Observers scored lower certainty scores in the 1- and 2.5-min scans compared to the 5- and 10-min scan durations. Conclusion The optimal time to start PET/CT scanning in patients with pHPT is 20 min after mean injection of 6.3 MBq/kg 11C-choline, with a recommended scan duration of at least 5 min. Alternatively, the radioactivity dose can be lowered by 50% while keeping a 10-min scan duration without losing the accuracy of 11C-choline PET/CT interpretation.

Background Intestinal ultrasound [IUS] is a promising and non-invasive cross-sectional imaging modality in the diagnosis and monitoring of ulcerative colitis [UC]. Unlike endoscopy, where standardized scoring for evaluation of disease activity is widely used, scoring for UC with IUS is currently unavailable. Therefore, we conducted a study to assess the reliability of IUS in UC among expert sonographists in order to identify robust parameters. Methods Thirty patients with both clinically active [25] and quiescent [five] UC were included. Six expert sonographers first agreed upon key IUS parameters and grading, including bowel wall thickness [BWT], colour Doppler signal [CDS], inflammatory fat [i-fat], loss of bowel wall stratification [BWS], loss of haustrations and presence of lymph nodes. Thirty video-recorded cases were blindly reviewed. Results Inter-observer agreement was almost perfect for BWT (intra-class correlation coefficient [ICC]: 0.96) and substantial for CDS [κ = 0.63]. Agreement was moderate for presence of lymph nodes [κ = 0.41] and fair for presence of i-fat [κ = 0.36], BWS [κ = 0.24] and loss of haustrations [κ = 0.26]. Furthermore, there was substantial agreement for presence of disease activity on IUS [κ = 0.77] and almost perfect agreement for disease severity [ICC: 0.93]. Most individual parameters showed a strong association with IUS disease activity as measured by the six readers. Conclusion IUS is a reliable imaging modality to assess disease activity and severity in UC. Important individual parameters such as BWT and CDS are reliable and could be incorporated in a future UC scoring index. Standardized acquisition and assessment of UC utilizing IUS with established reliability is important to expand the use of IUS globally. [ABSTRACT FROM AUTHOR]

Background: Use of 11C-Choline PET/CT is gaining ground in detecting hyperfunctioning parathyroid glands in primary hyperparathyroidism. The purpose of this study was to evaluate the robustness of 11C-Choline PET/CT by assessing intra- and inter-observer agreement to determine whether the method was reader sensitive and therefore should only be performed at highly specialised sites with a high number of cases. PET/CT images of 40 patients diagnosed with primary hyperparathyroidism were anonymised and evaluated three times by three readers: an expert reader and two non-experts (non-experts were experienced in PET/CT imaging, but not in 11C-Choline PET/CT in the setting of primary hyperparathyroidism). Number of hyperfunctioning parathyroid glands, location relative to the thyroid gland and confidence of each assessment (low, moderate or high) were noted, and intra- and inter-observer agreement calculated using Fleiss' kappa method. Sensitivities and specificities of the non-experts were calculated using the expert reader as gold standard. Results: Intra-observer agreement was 'good' to 'near perfect' for all readers. Inter-observer agreement was good between non-experts and the expert, with kappa values ≥ 0.74. Sensitivities between non-experts and the expert were high, > 81%, when assessing which side and 75% when assessing thyroid quadrant. All specificities were > 94%. Reader certainties were 'high' in > 80% of cases for the expert and > 70% and > 65%, respectively for the two non-experts. Conclusion: 11C-Choline PET/CT is not reader sensitive for the localisation of hyperfunctioning parathyroid glands and may therefore be safely implemented at sites that have a moderate number of cases. Access to a cyclotron laboratory is, however, a necessity for the production of 11C-Choline. The study was conducted in accordance with the Helsinki 2 declaration and The International Council for Harmonisation Guideline for Good Clinical Practice (ICH_GCP) clinical trial, approved by the Research Ethics Committee of the Capital Region of Denmark (Journal-nr.:H-18012490, date of approval: 18 June 2018) and the Danish Medicines Agency (EudraCT no. 2018-000726-63, date of approval: 6 June 2018). The GCP unit in Eastern Denmark has carried out regular monitoring of the trial according to GCP (ID: 2018-1050). [ABSTRACT FROM AUTHOR]

Background: Oral lichen planus (OLP) is a common chronic inflammatory condition with an undefined malignant transformation potential. There have been many attempts at providing a specific definition of OLP without conclusive outcomes. A new set of diagnostic criteria was proposed in 2016 by the American Academy of Oral and Maxillofacial Pathology (AAOMP) in an endeavour to resolve this issue, and this has not yet been evaluated. This study aimed to assess the utility of AAOMP proposed criteria for the diagnosis of OLP.Methods: Five pathologists blindly assessed a cohort of 215 digital whole slide images (WSI) obtained from haematoxylin and eosin-stained microscopic slides. Forty-six WSI were included twice to assess the intra-observer agreement. Included cases were diagnosed clinically as either OLP or oral lichenoid reaction. Each pathologist was asked to utilize the AAOMP histopathological criteria while assessing slides. The variations in diagnoses were assessed by unweighted kappa statistics.Results: The level of intra-observer agreement was very good (0.801 to 0.899). The level of inter-observer agreement among the observers varied from good (0.658) to very good (0.842) when the responses were categorized as evident/compatible OLP versus no OLP and was good (0.62 to 0.725) when the responses were categorized as evident OLP, versus compatible OLP, versus no OLP. The clinico-pathological correlation was 87.6%.Conclusion: A reliable level of agreement can be achieved by pathologists for the diagnosis of OLP using the AAOMP criteria for differentiation between lichenoid and other conditions. There are still limitations in discriminating OLP from oral lichenoid lesions microscopically. [ABSTRACT FROM AUTHOR]

Abstract Background Differentiating sepsis from the systemic inflammatory response syndrome (SIRS) in critical care patients is challenging, especially before serious organ damage is evident, and with variable clinical presentations of patients and variable training and experience of attending physicians. Our objective was to describe and quantify physician agreement in diagnosing SIRS or sepsis in critical care patients as a function of available clinical information, infection site, and hospital setting. Methods We conducted a post hoc analysis of previously collected data from a prospective, observational trial (N = 249 subjects) in intensive care units at seven US hospitals, in which physicians at different stages of patient care were asked to make diagnostic calls of either SIRS, sepsis, or indeterminate, based on varying amounts of available clinical information (clinicaltrials.gov identifier: NCT02127502). The overall percent agreement and the free-marginal, inter-observer agreement statistic kappa (κ free) were used to quantify agreement between evaluators (attending physicians, site investigators, external expert panelists). Logistic regression and machine learning techniques were used to search for significant variables that could explain heterogeneity within the indeterminate and SIRS patient subgroups. Results Free-marginal kappa decreased between the initial impression of the attending physician and (1) the initial impression of the site investigator (κ free 0.68), (2) the consensus discharge diagnosis of the site investigators (κ free 0.62), and (3) the consensus diagnosis of the external expert panel (κ free 0.58). In contrast, agreement was greatest between the consensus discharge impression of site investigators and the consensus diagnosis of the external expert panel (κ free 0.79). When stratified by infection site, κ free for agreement between initial and later diagnoses had a mean value + 0.24 (range − 0.29 to + 0.39) for respiratory infections, compared to + 0.70 (range + 0.42 to + 0.88) for abdominal + urinary + other infections. Bioinformatics analysis failed to clearly resolve the indeterminate diagnoses and also failed to explain why 60% of SIRS patients were treated with antibiotics. Conclusions Considerable uncertainty surrounds the differential clinical diagnosis of sepsis vs. SIRS, especially before organ damage has become highly evident, and for patients presenting with respiratory clinical signs. Our findings underscore the need to provide physicians with accurate, timely diagnostic information in evaluating possible sepsis.

Histopathologic assessment of melanocytic neoplasms is the current gold standard of diagnosis. However, there are well recognized limitations including inter-observer diagnostic discordance. This study aimed to determine if integrating dermoscopy with histopathology of melanocytic neoplasms impacts diagnosis and improves inter-observer agreement. We conducted a prospective cohort study in a pigmented lesion clinic. Consecutive melanocytic lesions were identified for biopsy based on atypical gross or dermoscopic features. Standardized immunohistochemistry and levels were ordered on each specimen. The cases were randomized. Three dermatopathologists blinded to the clinical impression assessed each lesion. The cases were then re-randomized and re-assessed with addition of gross clinical and dermoscopic images. Inter-rater reliability (IRR) using Fleiss' kappa statistic revealed an increase from 0.447 without to 0.496 with dermoscopy amongst all dermatopathologists. The kappa increased from 0.495 before to 0.511 with dermoscopy in separating high-grade atypia or melanoma from moderate atypia or less. In 16 of 136 cases, at least 2 of 3 dermatopathologists favored a diagnosis of melanoma only after dermoscopy. In total, the consensus grade of atypia changed in 24.3% (33/ 136) of cases thereby representing changes to excisional margins and patient follow up. This study is limited by the cohort size. Dermoscopy significantly impacts diagnosis and improves identification of early melanomas in high risk populations and improves inter-observer agreement. [ABSTRACT FROM AUTHOR]

Objective: The aim of this research was to assess the quality and inter- and intra-observer agreement of tracings obtained by three different techniques for uterine contraction monitoring: the external tocodynamometer (TOCO), the intrauterine pressure catheter (IUPC) and a recently introduced method based on electrohysterography (EHG).Study Design: We included 150 uterine activity registrations from a previous prospective observational study (W3 study), conducted at Máxima Medical Centre in Veldhoven, the Netherlands. Term singleton pregnant women were simultaneously monitored with TOCO, IUPC and EHG during labor. Six clinicians, blinded to the source (TOCO, IUPC, or EHG) and subject, evaluated all tracings that were subsequently presented in random order. They annotated contractions and assigned each tracing a score for interpretability of 2 (good), 1 (moderate) or 0 (poor). To evaluate inter-observer agreement, we calculated kappa values for the qualitative assessment, and intraclass correlation coefficients (ICC) for the number of contractions annotated by clinicians. Four clinicians repeated this procedure to evaluate intra-observer agreement.Results: IUPC tracings received the highest quality rating, with a mean score of 1.95, followed by a mean score of 1.60 for EHG and 0.80 for TOCO (p < 0.05). Mean weighted kappa values were 0.63 for TOCO and 0.45 for EHG. The average number of contractions that was picked up by clinicians was 59.8 for the intrauterine pressure catheter, 49.8 for EHG and 26.4 for TOCO. The ICC of the intrauterine pressure catheter was significantly higher than the external methods, regarding both inter- and intra-observer agreement (0.98 and 0.99 respectively).Conclusion: IUPC recordings scored best regarding quality, inter- and intra-observer agreement. However, due to safety issues, in many countries this technique is not used anymore. The quality of TOCO was rated as poor and many contractions were missed as compared to the gold standard. From a clinical interpretational point of view, EHG is favorable to TOCO. EHG recordings were assigned higher quality scores, but with less agreement between clinicians. An explanation could be that EHG is a relatively new technique, while IUPC and the TOCO are being used for decades. Building experience with EHG (training) is therefore recommended. [ABSTRACT FROM AUTHOR]

Introduction: The purpose of this study was to examine the ability of a surgeon to predict survival of a total hip replacement (THR) based on the patient's diagnosis, demographics, postoperative activity level and the surgical technique. Methods: 4 experienced hip surgeons were asked to predict the longevity of 131 Charnley THRs, performed by the senior author (GH) 22–35 years ago, by providing them with pre- and postoperative radiographs, and data concerning patient's diagnosis, demographics, postoperative activity level and the surgical technique. This process was repeated 3 months later. Results: There was only a slight agreement between the majority of the predictions and actual outcome. The inter-observer agreement was also slight and intra-observer agreement ranged from slight to moderate. Conclusion: We confirmed that surgeons are unable to determine the life expectancy of the implants of a THR, based on the aforementioned data, because there are other non-identified factors that affect the survivorship of a THR. For this reason, regular follow-up remains the safest way to evaluate patients' clinical picture and the evolution of radiographic changes, if there are any, in order to accurately advise patients and decide on the appropriate time for revision. [ABSTRACT FROM AUTHOR]

Classification schemes for reporting thyroid cytology of fine needle aspiration (FNA) of thyroid nodules are largely used in clinical practice, but the level of inter-observer agreement among cytopathologists is poorly acknowledged. The present study aimed to explore the inter-observer agreement among the experienced authors of the 2014 Italian Consensus for Classification and Reporting of Thyroid Cytology (ICCRTC). A stratified randomization was performed in order to obtain a sample homogeneously distributed and representative of all ICCRTC classes. Four high-experience raters were randomly selected among the extensors of the Italian consensus. They independently reviewed 60 FNA samples blindly of the initial cytological report and clinical features. Their overall agreement was evaluated according to Fleiss' kappa. The overall inter-observer agreement was moderate (κ 0.46). Specifically, a good agreement was found when the samples were consistent for malignancy (TIR5) or were not adequate for diagnosis (TIR1) (κ 0.67 and κ 0.73, respectively). A moderate agreement was present for suspicious-for-malignant category (TIR4), and a fair agreement was recorded in the two intermediate ones (TIR3A and TIR3B) (κ 0.36 and κ 0.35, respectively). For clinical purposes, the agreement was good (κ 0.74) in differentiating cases with surgical indication (TIR4/TIR5) from those in which surgery is not essential or requires limited extension (TIR3B/TIR3A/TIR2). In conclusion, the present study confirms the reliability of ICCRTC. These data represent a reference for cytopathologists using this system and are useful for the practice of clinicians and surgeons. [ABSTRACT FROM AUTHOR]

volume (GTV) on T2-magnetic resonance imaging (MRI) and apparent diffusion coefficient (ADC) maps, assessing volumes and inter-observer agreement between two observers. Patients and Methods: A radiologist and a radiation oncologist delineated GTV on T2 (T2GTV) and ADC (ADCGTV) sequences. Dice similarity index (DICE) and Bland–Altman analysis were used to estimated concordance. Results: Mean T2GTV and ADCGTV volumes were 43.84±71.47 cc and 37.28±68.92 cc according to the radiologist, and 43.4±70.44 cc and 36.65±69.21 cc according to the radiation oncologist. ADC led to statistically significantly smaller volumes compared to T2. The mean DICE index was 0.86 for T2GTV and 0.84 for ADCGTV. The Bland–Altman plots globally showed concordance. Conclusion: GTV delineation was smaller in the ADC maps compared to T2-MRI, reaching an almost perfect agreement between observers. Thanks to this acceptable variability, adding functional imaging might provide more information for tumor delineation, improving reproducibility for image-guided adaptive radiotherapy. [ABSTRACT FROM AUTHOR]

Study Question: What is the inter-observer agreement among embryologists for decision to freeze blastocysts of borderline morphology and can it be improved with a modified grading system?Summary Answer: The inter-observer agreement among embryologists deciding whether to freeze blastocysts of marginal morphology was low and was not improved by a modified grading system.What Is Known Already: While previous research on inter-observer variability on the decision of which embryo to transfer from a cohort of blastocysts is good, the impact of grading variability regarding decision to freeze borderline blastocysts has not been investigated. Agreement for inner cell mass (ICM) and trophectoderm (TE) grade is only fair, factors which contribute to the grade that influences decision to freeze.Study Design, Size, Duration: This was a prospective study involving 18 embryologists working at four different IVF clinics within a single organisation between January 2019 and July 2019.Participants/materials, Setting, Methods: All embryologists currently practicing blastocyst grading at a multi-site organisation were invited to participate. The survey was comprised of blastocyst images in three planes and asked (i) the likelihood of freezing and (ii) whether the blastocyst would be frozen based on visual assessment. Blastocysts varied by quality and were categorised as either top (n = 20), borderline (n = 60) or non-viable/degenerate quality (n = 20). A total of 1800 freeze decisions were assessed. To assess the impact of grading criteria on inter-observer agreement for decision to freeze, the survey was taken once when the embryologists used the Gardner criteria and again 6 months after transitioning to a modified Gardner criterion with four grades for ICM and TE. The fourth grade was introduced with the aim to promote higher levels of agreement for the clinical usability decision when the blastocyst was of marginal quality.Main Results and the Role Of Chance: The inter-observer agreement for decision to freeze was near perfect (kappa 1.0) for top and non-viable/degenerate quality blastocysts, and this was not affected by the blastocysts grading criteria used (top quality; P = 0.330 and non-viable/degenerate quality; P = 0.18). In contrast, the cohort of borderline blastocysts received a mixed freeze rate (average 52.7%) during the first survey, indicative of blastocysts that showed uncertain viability and promoting significant disagreement for decision to freeze among the embryologists (kappa 0.304). After transitioning to a modified Gardner criteria with an additional grading tier, the average freeze rate increased (64.8%; P < 0.0001); however, the inter-observer agreement for decision to freeze was unchanged (kappa 0.301). Therefore, significant disagreement for decision to freeze among embryologists is an ongoing issue not resolved by the two grading criteria assessed here.Limitations, Reasons For Caution: Blastocyst assessment was performed from time-lapse images in three planes, rather than with a microscope in the laboratory. The inter-observer agreement for decision to freeze may be lower for embryologists working in different clinics with different grading protocols.Wider Implications Of the Findings: The decision to freeze a blastocyst with borderline morphology is a common clinical issue that has the potential to arise for any patient during blastocyst culture. Disagreement for decision to freeze these blastocysts, and therefore clinical usability in frozen embryo transfer cycles, affects consistency in patient care due to a potential impact on cumulative live birth rates, as well as financial, emotional and time costs associated with the frozen embryo transfer cycles. We demonstrate significant disagreement for decision to freeze borderline blastocysts among embryologists using the same grading scheme within a large multisite organisation, a phenomenon which was not improved with a modified grading system. Decision-making around borderline embryos is an area requiring further research, especially as studies continue to demonstrate the reduced but modest live birth rates for low quality blastocysts (Grade C). These results provide support for emerging technology for embryo assessment, such as artificial intelligence.Study Funding/competing Interest(s): None declared.Trial Registration Number: Not applicable. [ABSTRACT FROM AUTHOR]

A preoperative reliable classification system between clinical and computed tomography (CT) findings to better plan surgery in acute complicated diverticulitis (ACD) is lacking. We studied the inter-observer agreement of CT scan data and their concordance with the preoperative clinical findings and the adherence with the intraoperative status using a new classification of diverticular disease (CDD). 152 patients operated on for acute complicated diverticulitis (ACD) were retrospectively enrolled. All patients were studied with CT scan within 24 h before surgery and CT images were blinded reanalyzed by 2 couples of radiologists (A/B). Kappa value evaluated the inter-observer agreement between radiologists and the concordance between CDD, preoperative clinical findings and findings at operation. Univariate and multivariate analysis were used to evaluate the predicting values of CT classification and CDD stage at surgery on postoperative outcomes. Overall inter-observer agreement for the CDD was high, with a kappa value of 0.905 (95% CI = 0.850–0.960) for observers A and B, while the concordance between radiological and surgical findings was weak (kappa values = 0.213 and 0,248, respectively and 95% CI = 0.106 to 0.319 and 95% CI = 0.142 to 0.355, respectively). When overall morbidity, mortality and the need of a terminal colostomy were considered as main endpoints no concordance was observed between surgical and radiological findings and the CDD (P=NS). The need for a more accurate classification of ACD, able to better stage this emergency, and to provide surgeons with reliable information for the best treatment is advocated. [ABSTRACT FROM AUTHOR]

Purpose: Contractions in non-pregnant uterine can be assessed by visual inspection of transvaginal ultrasound (TVUS). Many authors have used this method to extract features like contraction frequency and direction. However, visual inspection is a subjective method and the outcome is dependent on the sonographers and video analysts. In this study, we wanted to see which uterine feature is reproducible enough, in terms of inter-observer agreement, to serve as a reliable control for future research. Methods: Six observers assessed 80 TVUS videos, and rated video quality, contraction frequency, direction and timing. One observer assessed operating time. A Fleiss' kappa (κ) or an intra-class correlation (ICC) was calculated to determine the inter-observer agreement of all features. Results: The inter-observer agreement in frequency was substantial (ICC = 0.68). Conversely, there was just slight to fair agreement in contraction timing and direction and in video quality: ICC = 0.26, κ = 0.17 and κ = 0.16, respectively. Overall, agreement among technical engineers was better than between medical professionals. The level of agreement was correlated with video quality, phase of the menstrual cycle and individual patient (all χ2 with p < 0.00). The time to analyze one video ranged between 6 and 20 min. Conclusions: This study shows that visual inspection of TVUS videos is a fairly reproducible method to assess contraction frequency. However, the operating time is too extensive to implement this method in daily practice. Automated methods could offer a solution for this problem in the future. [ABSTRACT FROM AUTHOR]