Search

Abstract Background Medical text, as part of an electronic health record, is an essential information source in healthcare. Although natural language processing (NLP) techniques for medical text are developing fast, successful transfer into clinical practice has been rare. Especially the hospital domain offers great potential while facing several challenges including many documents per patient, multiple departments and complex interrelated processes. Methods In this work, we survey relevant literature to identify and classify approaches which exploit NLP in the clinical context. Our contribution involves a systematic mapping of related research onto a prototypical patient journey in the hospital, along which medical documents are created, processed and consumed by hospital staff and patients themselves. Specifically, we reviewed which dataset types, dataset languages, model architectures and tasks are researched in current clinical NLP research. Additionally, we extract and analyze major obstacles during development and implementation. We discuss options to address them and argue for a focus on bias mitigation and model explainability. Results While a patient’s hospital journey produces a significant amount of structured and unstructured documents, certain steps and documents receive more research attention than others. Diagnosis, Admission and Discharge are clinical patient steps that are researched often across the surveyed paper. In contrast, our findings reveal significant under-researched areas such as Treatment, Billing, After Care, and Smart Home. Leveraging NLP in these stages can greatly enhance clinical decision-making and patient outcomes. Additionally, clinical NLP models are mostly based on radiology reports, discharge letters and admission notes, even though we have shown that many other documents are produced throughout the patient journey. There is a significant opportunity in analyzing a wider range of medical documents produced throughout the patient journey to improve the applicability and impact of NLP in healthcare. Conclusions Our findings suggest that there is a significant opportunity to leverage NLP approaches to advance clinical decision-making systems, as there remains a considerable understudied potential for the analysis of patient journey data.

Abstract The Sparsely Annotated Region and Organ Segmentation (SAROS) dataset was created using data from The Cancer Imaging Archive (TCIA) to provide a large open-access CT dataset with high-quality annotations of body landmarks. In-house segmentation models were employed to generate annotation proposals on randomly selected cases from TCIA. The dataset includes 13 semantic body region labels (abdominal/thoracic cavity, bones, brain, breast implant, mediastinum, muscle, parotid/submandibular/thyroid glands, pericardium, spinal cord, subcutaneous tissue) and six body part labels (left/right arm/leg, head, torso). Case selection was based on the DICOM series description, gender, and imaging protocol, resulting in 882 patients (438 female) for a total of 900 CTs. Manual review and correction of proposals were conducted in a continuous quality control cycle. Only every fifth axial slice was annotated, yielding 20150 annotated slices from 28 data collections. For the reproducibility on downstream tasks, five cross-validation folds and a test set were pre-defined. The SAROS dataset serves as an open-access resource for training and evaluating novel segmentation models, covering various scanner vendors and diseases.

Abstract A poor nutritional status is associated with worse pulmonary function and survival in people with cystic fibrosis (pwCF). CF transmembrane conductance regulator modulators can improve pulmonary function and body weight, but more data is needed to evaluate its effects on body composition. In this retrospective study, a pre-trained deep-learning network was used to perform a fully automated body composition analysis on chest CTs from 66 adult pwCF before and after receiving elexacaftor/tezacaftor/ivacaftor (ETI) therapy. Muscle and adipose tissues were quantified and divided by bone volume to obtain body size-adjusted ratios. After receiving ETI therapy, marked increases were observed in all adipose tissue ratios among pwCF, including the total adipose tissue ratio (+ 46.21%, p

Abstract Chronic Obstructive Pulmonary Disease (COPD) is characterized by progressive and irreversible airflow limitation, with individual body composition influencing disease severity. Severe emphysema worsens symptoms through hyperinflation, which can be relieved by bronchoscopic lung volume reduction (BLVR). To investigate how body composition, assessed through CT scans, impacts outcomes in emphysema patients undergoing BLVR. Fully automated CT-based body composition analysis (BCA) was performed in patients with end-stage emphysema receiving BLVR with valves. Post-interventional muscle and adipose tissues were quantified, body size-adjusted, and compared to baseline parameters. Between January 2015 and December 2022, 300 patients with severe emphysema underwent endobronchial valve treatment. Significant improvements were seen in outcome parameters, which were defined as changes in pulmonary function, physical performance, and quality of life (QoL) post-treatment. Muscle volume remained stable (1.632 vs. 1.635 for muscle bone adjusted ratio (BAR) at baseline and after 6 months respectively), while bone adjusted adipose tissue volumes, especially total and pericardial adipose tissue, showed significant increase (2.86 vs. 3.00 and 0.16 vs. 0.17, respectively). Moderate to strong correlations between bone adjusted muscle volume and weaker correlations between adipose tissue volumes and outcome parameters (pulmonary function, QoL and physical performance) were observed. Particularly after 6-month, bone adjusted muscle volume changes positively corresponded to improved outcomes (ΔForced expiratory volume in 1 s [FEV1], r = 0.440; ΔInspiratory vital capacity [IVC], r = 0.397; Δ6Minute walking distance [6MWD], r = 0.509 and ΔCOPD assessment test [CAT], r = −0.324; all p 10, respectively). BCA results among patients divided by the minimal clinically important difference for forced expiratory volume of the first second (FEV1) showed significant differences in bone-adjusted muscle and intramuscular adipose tissue (IMAT) volumes and their respective changes after 6 months (ΔMuscle, BAR% −5 vs. 3.4 and ΔIMAT, BAR% −0.62 vs. 0.60 for groups with ΔFEV1 ≤ 100 mL vs > 100 mL). Altered body composition, especially increased muscle volume, is associated with functional improvements in BLVR-treated patients.

Background & Aims: Body composition assessment (BCA) parameters have recently been identified as relevant prognostic factors for patients with hepatocellular carcinoma (HCC). Herein, we aimed to investigate the role of BCA parameters for prognosis prediction in patients with HCC undergoing transarterial chemoembolization (TACE). Methods: This retrospective multicenter study included a total of 754 treatment-naïve patients with HCC who underwent TACE at six tertiary care centers between 2010–2020. Fully automated artificial intelligence-based quantitative 3D volumetry of abdominal cavity tissue composition was performed to assess skeletal muscle volume (SM), total adipose tissue (TAT), intra- and intermuscular adipose tissue, visceral adipose tissue, and subcutaneous adipose tissue (SAT) on pre-intervention computed tomography scans. BCA parameters were normalized to the slice number of the abdominal cavity. We assessed the influence of BCA parameters on median overall survival and performed multivariate analysis including established estimates of survival. Results: Univariate survival analysis revealed that impaired median overall survival was predicted by low SM (p

Abstract A novel software, DiffTool, was developed in-house to keep track of changes made by board-certified radiologists to preliminary reports created by residents and evaluate its impact on radiological hands-on training. Before (t0) and after (t2−4) the deployment of the software, 18 residents (median age: 29 years; 33% female) completed a standardized questionnaire on professional training. At t2−4 the participants were also requested to respond to three additional questions to evaluate the software. Responses were recorded via a six-point Likert scale ranging from 1 (“strongly agree”) to 6 (“strongly disagree”). Prior to the release of the software, 39% (7/18) of the residents strongly agreed with the statement that they manually tracked changes made by board-certified radiologists to each of their radiological reports while 61% were less inclined to agree with that statement. At t2−4, 61% (11/18) stated that they used DiffTool to track differences. Furthermore, we observed an increase from 33% (6/18) to 44% (8/18) of residents who agreed to the statement “I profit from every corrected report”. The DiffTool was well accepted among residents with a regular user base of 72% (13/18), while 78% (14/18) considered it a relevant improvement to their training. The results of this study demonstrate the importance of providing a time-efficient way to analyze changes made to preliminary reports as an additive for professional training.

Introduction: Perihilar cholangiocarcinoma (PHCC) is a rare malignancy with limited survival prediction accuracy. Artificial intelligence (AI) and digital pathology advancements have shown promise in predicting outcomes in cancer. We aimed to improve prognosis prediction for PHCC by combining AI-based histopathological slide analysis with clinical factors. Methods: We retrospectively analyzed 317 surgically treated PHCC patients (January 2009–December 2018) at the University Hospital of Essen. Clinical data, surgical details, pathology, and outcomes were collected. Convolutional neural networks (CNN) analyzed whole-slide images. Survival models incorporated clinical and histological features. Results: Among 142 eligible patients, independent survival predictors were tumor grade (G), tumor size (T), and intraoperative transfusion requirement. The CNN-based model combining clinical and histopathological features demonstrates proof of concept in prognosis prediction, limited by histopathological complexity and feature extraction challenges. However, the CNN-based model generated heatmaps assisting pathologists in identifying areas of interest. Conclusion: AI-based digital pathology showed potential in PHCC prognosis prediction, though refinement is necessary for clinical relevance. Future research should focus on enhancing AI models and exploring novel approaches to improve PHCC patient prognosis prediction.

Abstract Background We present FHIR-PYrate, a Python package to handle the full clinical data collection and extraction process. The software is to be plugged into a modern hospital domain, where electronic patient records are used to handle the entire patient’s history. Most research institutes follow the same procedures to build study cohorts, but mainly in a non-standardized and repetitive way. As a result, researchers spend time writing boilerplate code, which could be used for more challenging tasks. Methods The package can improve and simplify existing processes in the clinical research environment. It collects all needed functionalities into a straightforward interface that can be used to query a FHIR server, download imaging studies and filter clinical documents. The full capacity of the search mechanism of the FHIR REST API is available to the user, leading to a uniform querying process for all resources, thus simplifying the customization of each use case. Additionally, valuable features like parallelization and filtering are included to make it more performant. Results As an exemplary practical application, the package can be used to analyze the prognostic significance of routine CT imaging and clinical data in breast cancer with tumor metastases in the lungs. In this example, the initial patient cohort is first collected using ICD-10 codes. For these patients, the survival information is also gathered. Some additional clinical data is retrieved, and CT scans of the thorax are downloaded. Finally, the survival analysis can be computed using a deep learning model with the CT scans, the TNM staging and positivity of relevant markers as input. This process may vary depending on the FHIR server and available clinical data, and can be customized to cover even more use cases. Conclusions FHIR-PYrate opens up the possibility to quickly and easily retrieve FHIR data, download image data, and search medical documents for keywords within a Python package. With the demonstrated functionality, FHIR-PYrate opens an easy way to assemble research collectives automatically.

Abstract Background We investigated about optimization of contrast media (CM) dose or radiation dose in thoracoabdominal computed tomography angiography (CTA) by automated tube voltage selection (ATVS) system configuration and CM protocol adaption. Methods In six minipigs, CTA-optimized protocols were evaluated regarding objective (contrast-to-noise ratio, CNR) and subjective (6 criteria assessed by Likert scale) image quality. Scan parameters were automatically adapted by the ATVS system operating at 90-kV semi-mode and configured for standard, CM saving, or radiation dose saving (image task, quality settings). Injection protocols (dose, flow rate) were adapted manually. This approach was tested for normal and simulated obese conditions. Results Radiation exposure (volume-weighted CT dose index) for normal (obese) conditions was 2.4 ± 0.7 (5.0 ± 0.7) mGy (standard), 4.3 ± 1.1 (9.0 ± 1.3) mGy (CM reduced), and 1.7 ± 0.5 (3.5 ± 0.5) mGy (radiation reduced). The respective CM doses for normal (obese) settings were 210 (240) mgI/kg, 155 (177) mgI/kg, and 252 (288) mgI/kg. No significant differences in CNR (normal; obese) were observed between standard (17.8 ± 3.0; 19.2 ± 4.0), CM-reduced (18.2 ± 3.3; 20.5 ± 4.9), and radiation-saving CTAs (16.0 ± 3.4; 18.4 ± 4.1). Subjective analysis showed similar values for optimized and standard CTAs. Only the parameter diagnostic acceptability was significantly lower for radiation-saving CTA compared to the standard CTA. Conclusions The CM dose (-26%) or radiation dose (-30%) for thoracoabdominal CTA can be reduced while maintaining objective and subjective image quality, demonstrating the feasibility of the personalization of CTA scan protocols. Key points • Computed tomography angiography protocols could be adapted to individual patient requirements using an automated tube voltage selection system combined with adjusted contrast media injection. • Using an adapted automated tube voltage selection system, a contrast media dose reduction (-26%) or radiation dose reduction (-30%) could be possible

Abstract Background Personalized therapy planning remains a significant challenge in advanced colorectal cancer care, despite extensive research on prognostic and predictive markers. A strong correlation of sarcopenia or overall body composition and survival has been described. Here, we explore whether automated assessment of body composition and liver metastases from standard of care CT images can add to clinical parameters in personalized survival risk prognostication. Methods We retrospectively analysed clinical imaging data from 85 patients (50.6% female, mean age 58.9 SD 12.2 years) with colorectal cancer and synchronous liver metastases. Pretrained deep learning models were used to assess body composition and liver metastasis geometry from abdominal CT images before the initiation of systemic treatment. Abdominal muscle‐to‐bone ratio (MBR) was calculated by dividing abdominal muscle volume by abdominal bone volume. MBR was compared with body mass index (BMI), abdominal muscle volume, and abdominal muscle volume divided by height squared. Differences in overall survival based on body composition and liver metastasis parameters were compared using Kaplan–Meier survival curves. Results were correlated with clinical and biomarker data to develop a machine learning model for survival risk prognostication. Results The MBR, unlike abdominal muscle volume or BMI, was significantly associated with overall survival (HR 0.39, 95% CI: 0.19–0.80, P = 0.009). The MBR (P = 0.022), liver metastasis surface area (P = 0.01) and primary tumour sidedness (P = 0.007) were independently associated with overall survival in multivariate analysis. Body composition parameters did not correlate with KRAS mutational status or primary tumour sidedness. A prediction model based on MBR, liver metastasis surface area and primary tumour sidedness achieved a concordance index of 0.69. Conclusions Automated segmentation enables to extract prognostic parameters from routine imaging data for personalized survival modelling in advanced colorectal cancer patients.

Background: This study aimed to evaluate the impact of an AI-assisted fracture detection program on radiology residents’ performance in pediatric and adult trauma patients and assess its implications for residency training. Methods: This study, conducted retrospectively, included 200 radiographs from participants aged 1 to 95 years (mean age: 40.7 ± 24.5 years), encompassing various body regions. Among these, 50% (100/200) displayed at least one fracture, totaling one hundred thirty-five fractures, assessed by four radiology residents with different experience levels. A machine learning algorithm was employed for fracture detection, and the ground truth was established by consensus among two experienced senior radiologists. Fracture detection accuracy, reporting time, and confidence were evaluated with and without AI support. Results: Radiology residents’ sensitivity for fracture detection improved significantly with AI support (58% without AI vs. 77% with AI, p < 0.001), while specificity showed minor improvements (77% without AI vs. 79% with AI, p = 0.0653). AI stand-alone performance achieved a sensitivity of 93% with a specificity of 77%. AI support for fracture detection significantly reduced interpretation time for radiology residents by an average of approximately 2.6 s (p = 0.0156) and increased resident confidence in the findings (p = 0.0013). Conclusion: AI support significantly enhanced fracture detection sensitivity among radiology residents, particularly benefiting less experienced radiologists. It does not compromise specificity and reduces interpretation time, contributing to improved efficiency. This study underscores AI’s potential in radiology, emphasizing its role in training and interpretation improvement.

Abstract The precise preoperative calculation of functional liver volumes is essential prior major liver resections, as well as for the evaluation of a suitable donor for living donor liver transplantation. The aim of this study was to develop a fully automated, reproducible, and quantitative 3D volumetry of the liver from standard CT examinations of the abdomen as part of routine clinical imaging. Therefore, an in-house dataset of 100 venous phase CT examinations for training and 30 venous phase ex-house CT examinations with a slice thickness of 5 mm for testing and validating were fully annotated with right and left liver lobe. Multi-Resolution U-Net 3D neural networks were employed for segmenting these liver regions. The Sørensen-Dice coefficient was greater than 0.9726 ± 0.0058, 0.9639 ± 0.0088, and 0.9223 ± 0.0187 and a mean volume difference of 32.12 ± 19.40 ml, 22.68 ± 21.67 ml, and 9.44 ± 27.08 ml compared to the standard of reference (SoR) liver, right lobe, and left lobe annotation was achieved. Our results show that fully automated 3D volumetry of the liver on routine CT imaging can provide reproducible, quantitative, fast and accurate results without needing any examiner in the preoperative work-up for hepatobiliary surgery and especially for living donor liver transplantation.

Abstract The complex process of manual biomarker extraction from body composition analysis (BCA) has far restricted the analysis of SARS-CoV-2 outcomes to small patient cohorts and a limited number of tissue types. We investigate the association of two BCA-based biomarkers with the development of severe SARS-CoV-2 infections for 918 patients (354 female, 564 male) regarding disease severity and mortality (186 deceased). Multiple tissues, such as muscle, bone, or adipose tissue are used and acquired with a deep-learning-based, fully-automated BCA from computed tomography images of the chest. The BCA features and markers were univariately analyzed with a Shapiro–Wilk and two-sided Mann–Whitney-U test. In a multivariate approach, obtained markers were adjusted by a defined set of laboratory parameters promoted by other studies. Subsequently, the relationship between the markers and two endpoints, namely severity and mortality, was investigated with regard to statistical significance. The univariate approach showed that the muscle volume was significant for female (p severity ≤ 0.001, p mortality ≤ 0.0001) and male patients (p severity = 0.018, p mortality ≤ 0.0001) regarding the severity and mortality endpoints. For male patients, the intra- and intermuscular adipose tissue (IMAT) (p ≤ 0.0001), epicardial adipose tissue (EAT) (p ≤ 0.001) and pericardial adipose tissue (PAT) (p ≤ 0.0001) were significant regarding the severity outcome. With the mortality outcome, muscle (p ≤ 0.0001), IMAT (p ≤ 0.001), EAT (p = 0.011) and PAT (p = 0.003) remained significant. For female patients, bone (p ≤ 0.001), IMAT (p = 0.032) and PAT (p = 0.047) were significant in univariate analyses regarding the severity and bone (p = 0.005) regarding the mortality. Furthermore, the defined sarcopenia marker (p ≤ 0.0001, for female and male) was significant for both endpoints. The cardiac marker was significant for severity (pfemale = 0.014, pmale ≤ 0.0001) and for mortality (pfemale ≤ 0.0001, pmale ≤ 0.0001) endpoint for both genders. The multivariate logistic regression showed that the sarcopenia marker was significant (p severity = 0.006, p mortality = 0.002) for both endpoints (ORseverity = 0.42, 95% CIseverity: 0.23–0.78, ORmortality = 0.34, 95% CImortality: 0.17–0.67). The cardiac marker showed significance (p = 0.018) only for the severity endpoint (OR = 1.42, 95% CI 1.06–1.90). The association between BCA-based sarcopenia and cardiac biomarkers and disease severity and mortality suggests that these biomarkers can contribute to the risk stratification of SARS-CoV-2 patients. Patients with a higher cardiac marker and a lower sarcopenia marker are at risk for a severe course or death. Whether those biomarkers hold similar importance for other pneumonia-related diseases requires further investigation.

Abstract Patients with neuroendocrine tumors of gastro-entero-pancreatic origin (GEP-NET) experience changes in fat and muscle composition. Dual-energy X-ray absorptiometry (DXA) and bioelectrical impedance analysis (BIA) are currently used to analyze body composition. Changes thereof could indicate cancer progression or response to treatment. This study examines the correlation between CT-based (computed tomography) body composition analysis (BCA) and DXA or BIA measurement. 74 GEP-NET-patients received whole-body [68Ga]-DOTATOC-PET/CT, BIA, and DXA-scans. BCA was performed based on the non-contrast-enhanced, 5 mm, whole-body-CT images. BCA from CT shows a strong correlation between body fat ratio with DXA (r = 0.95, ρC = 0.83) and BIA (r = 0.92, ρC = 0.76) and between skeletal muscle ratio with BIA: r = 0.81, ρC = 0.49. The deep learning-network achieves highly accurate results (mean Sørensen-Dice-score 0.93). Using BCA on routine Positron emission tomography/CT-scans to monitor patients’ body composition in the diagnostic workflow can reduce additional exams whilst substantially amplifying measurement in slower progressing cancers such as GEP-NET.

Objective: The aim of this study was to investigate the diagnostic accuracy of a radiomics analysis based on a fully automated segmentation and a simplified and robust MR imaging protocol to provide a comprehensive analysis of the genetic profile and grading of cerebral gliomas for everyday clinical use. Methods: MRI examinations of 217 therapy-naïve patients with cerebral gliomas, each comprising a non-contrast T1-weighted, FLAIR and contrast-enhanced T1-weighted sequence, were included in the study. In addition, clinical and laboratory parameters were incorporated into the analysis. The BraTS 2019 pretrained DeepMedic network was used for automated segmentation. The segmentations generated by DeepMedic were evaluated with 200 manual segmentations with a DICE score of 0.8082 ± 0.1321. Subsequently, the radiomics signatures were utilized to predict the genetic profile of ATRX, IDH1/2, MGMT and 1p19q co-deletion, as well as differentiating low-grade glioma from high-grade glioma. Results: The network provided an AUC (validation/test) for the differentiation between low-grade gliomas vs. high-grade gliomas of 0.981 ± 0.015/0.885 ± 0.02. The best results were achieved for the prediction of the ATRX expression loss with AUCs of 0.979 ± 0.028/0.923 ± 0.045, followed by 0.929 ± 0.042/0.861 ± 0.023 for the prediction of IDH1/2. The prediction of 1p19q and MGMT achieved moderate results, with AUCs of 0.999 ± 0.005/0.711 ± 0.128 for 1p19q and 0.854 ± 0.046/0.742 ± 0.050 for MGMT. Conclusion: This fully automated approach utilizing simplified MR protocols to predict the genetic profile and grading of cerebral gliomas provides an easy and efficient method for non-invasive tumor decoding.