Search

Objective: To evaluate whether psychiatric discharge summaries (DS) generated with ChatGPT-4 from electronic health records (EHR) can match the quality of DS written by psychiatric residents., Methods: At a psychiatric primary care hospital, we compared 20 inpatient DS, written by residents, to those written with ChatGPT-4 from pseudonymized residents' notes of the patients' EHRs and a standardized prompt. 8 blinded psychiatry specialists rated both versions on a custom Likert scale from 1 to 5 across 15 quality subcategories. The primary outcome was the overall rating difference between the two groups. The secondary outcomes were the rating differences at the level of individual question, case, and rater., Results: Human-written DS were rated significantly higher than AI (mean ratings: human 3.78, AI 3.12, p < 0.05). They surpassed AI significantly in 12/15 questions and 16/20 cases and were favored significantly by 7/8 raters. For "low expected correction effort", human DS were rated as 67 % favorable, 19 % neutral, and 14 % unfavorable, whereas AI-DS were rated as 22 % favorable, 33 % neutral, and 45 % unfavorable. Hallucinations were present in 40 % of AI-DS, with 37.5 % deemed highly clinically relevant. Minor content mistakes were found in 30 % of AI and 10 % of human DS. Raters correctly identified AI-DS with 81 % sensitivity and 75 % specificity., Discussion: Overall, AI-DS did not match the quality of resident-written DS but performed similarly in 20% of cases and were rated as favorable for "low expected correction effort" in 22% of cases. AI-DS lacked most in content specificity, ability to distill key case information, and coherence but performed adequately in conciseness, adherence to formalities, relevance of included content, and form., Conclusion: LLM-written DS show potential as templates for physicians to finalize, potentially saving time in the future., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Introduction: Data collection often relies on time-consuming manual inputs, with a vast amount of information embedded in unstructured texts such as patients' medical records and clinical notes. Our study aims to develop a pipeline that combines active learning (AL) and NLP techniques to enhance data extraction in an acute ischemic stroke cohort., Materials and Methods: Consecutive acute ischemic stroke patients who received reperfusion therapies at IRCCS Humanitas Research Hospital were included. The Italian NLP Bidirectional Encoder Representations from Transformers (BERT) model was trained with AL to automatically extract clinical variables from electronic health text. Simulated active learning performances were evaluated on a set of labels representing patients' comorbidities, comparing Bayesian Uncertainty Sampling by Disagreement (BALD) and random text selection. Prognostic models predicting patients' functional outcomes using Gradient Boosting were trained on manually labelled and semi-automatically extracted data and their performance was compared., Results: The active learning process initially showed null performance until around 20% of texts were labelled, possibly due to root layers freezing in the BERT model, yet overall, active learning improves model learning efficiency across most comorbidities. Prognostic modelling showed no significant difference in performance between models trained on manually labelled versus semi-automatically extracted data, indicating effective prediction capabilities in both settings., Conclusions: We developed an efficient language model to automate the extraction of clinical data from Italian unstructured health texts in a cohort of ischemic stroke patients. In a preliminary analysis, we demonstrated its potential applicability for enhancing prediction model accuracy., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Objective: This study aimed to assess the utilisation, benefits, and challenges associated with Electronic Health Records (EHR) and e-prescribing systems in Australian Community Pharmacies, focusing on their integration into daily practice and the impacts on operational efficiency, while also gathering qualitative insights from community pharmacists., Methods: A mixed-methods online survey was carried out among community pharmacists throughout Australia to assess the utilisation of EHR and e-prescribing systems, including the benefits and challenges associated with their use. Data was analysed based on pharmacists' age, gender, and practice location (metropolitan vs. regional). The chi-square test was applied to examine the relationship between these demographic factors and the utilisation and operational challenges of EHR and e-prescribing systems., Results: The survey engaged 120 Australian community pharmacists. Of the participants, 67 % reported usability and efficiency issues with EHR systems. Regarding e-prescribing, 58 % of pharmacists faced delays due to slow software performance, while 42 % encountered errors in data transmission. Despite these challenges, the benefits of e-prescribing were evident, with 79 % of respondents noting the elimination of illegible prescriptions and 40 % observing a reduction in their workload. Issues with prescription quantity discrepancies and the reprinting process were highlighted, indicating areas for improvement in workflow and system usability. The analysis revealed no significant statistical relationship between the utilisation and challenges of EHR and e-prescribing systems with the demographic variables of age, gender and location (p > 0.05), emphasising the necessity for healthcare solutions that address the needs of all pharmacists regardless of specific demographic segments., Conclusion: In Australian community pharmacies, EHR and e-prescribing may enhance patient care but come with challenges such as data completeness, technical issues, and usability concerns. Implementing successful integration relies on user-centric design, standardised practices, and robust infrastructure. While demanding for pharmacists, the digital transition improves efficiency and quality of care. Ensuring user-friendly tools is crucial for the smooth utilisation of digital health., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier B.V. All rights reserved.)

Background: Cancer registries link a large number of electronic health records reported by medical institutions to already registered records of the matching individual and tumor. Records are automatically linked using deterministic and probabilistic approaches; machine learning is rarely used. Records that cannot be matched automatically with sufficient accuracy are typically processed manually. For application, it is important to know how well record linkage approaches match real-world records and how much manual effort is required to achieve the desired linkage quality. We study the task of linking reported records to the matching registered tumor in cancer registries., Methods: We compare the tradeoff between linkage quality and manual effort of five machine learning methods (logistic regression, random forest, gradient boosting, neural network, and a stacked method) to a deterministic baseline. The record linkage methods are compared in a two-class setting (no-match/ match) and a three-class setting (no-match/ undecided/ match). A cancer registry collected and linked the dataset consisting of categorical variables matching 145,755 reported records with 33,289 registered tumors., Results: In the two-class setting, the gradient boosting, neural network, and stacked models have higher accuracy and F 1 score (accuracy: 0.968-0.978, F 1 score: 0.983-0.988) than the deterministic baseline (accuracy: 0.964, F 1 score: 0.980) when the same records are manually processed (0.89% of all records). In the three-class setting, these three machine learning methods can automatically process all reported records and still have higher accuracy and F 1 score than the deterministic baseline. The linkage quality of the machine learning methods studied, except for the neural network, increase as the number of manually processed records increases., Conclusion: Machine learning methods can significantly improve linkage quality and reduce the manual effort required by medical coders to match tumor records in cancer registries compared to a deterministic baseline. Our results help cancer registries estimate how linkage quality increases as more records are manually processed., Competing Interests: Declaration of Competing Interest The authors declare that they have no conflicts of interest., (Copyright © 2024 The Authors. Published by Elsevier B.V. All rights reserved.)

Background: The electronic health record (EHR), including standardized structures and languages, represents an important data source for nurses, to continually update their individual and shared perceptual understanding of clinical situations. Registered nurses' utilization of nursing standards, such as standardized nursing care plans and language in EHRs, has received little attention in the literature. Further research is needed to understand nurses' care planning and documentation practice., Aims: This study aimed to describe the experiences and perceptions of nurses' EHR documentation practices utilizing standardized nursing care plans including standardized nursing language, in the daily documentation of nursing care for patients living in special dementia-care units in nursing homes in Norway., Methods: A descriptive qualitative study was conducted between April and November 2021 among registered nurses working in special dementia care units in Norwegian nursing homes. In-depth interviews were conducted, and data was analyzed utilizing reflexive thematic analysis with a deductive orientation. Findings Four themes were generated from the analysis. First, the knowledge, skills, and attitude of system users were perceived to influence daily documentation practice. Second, management and organization of documentation work, internally and externally, influenced motivation and engagement in daily documentation processes. Third, usability issues of the EHR were perceived to limit the daily workflow and the nurses' information-needs. Last, nursing standards in the EHR were perceived to contribute to the development of documentation practices, supporting and stimulating ethical awareness, cognitive processes, and knowledge development., Conclusion: Nurses and nursing leaders need to be continuously involved and engaged in EHR documentation to safeguard development and implementation of relevant nursing standards., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Background: Care plans documented by nurses in electronic health records (EHR) are a rich source of data to generate knowledge and measure the impact of nursing care. Unfortunately, there is a lack of integration of these data in clinical data research networks (CDRN) data trusts, due in large part to nursing care being documented with local vocabulary, resulting in non-standardized data. The absence of high-quality nursing care plan data in data trusts limits the investigation of interdisciplinary care aimed at improving patient outcomes., Objective: To map local nursing care plan terms for patients' problems and goals in the EHR of one large health system to the standardized nursing terminologies (SNTs), NANDA International (NANDA-I), and Nursing Outcomes Classification (NOC)., Methods: We extracted local problems and goals used by nurses to document care plans from two hospitals. After removing duplicates, the terms were independently mapped to NANDA-I and NOC by five mappers. Four nurses who regularly use the local vocabulary validated the mapping., Results: 83% of local problem terms were mapped to NANDA-I labels and 93% of local goal terms were mapped to NOC labels. The nurses agreed with 95% of the mapping. Local terms not mapped to labels were mapped to the domains or classes of the respective terminologies., Conclusion: Mapping local vocabularies used by nurses in EHRs to SNTs is a foundational step to making interoperable nursing data available for research and other secondary purposes in large data trusts. This study is the first phase of a larger project building, for the first time, a pipeline to standardize, harmonize, and integrate nursing care plan data from multiple Florida hospitals into the statewide CDRN OneFlorida+ Clinical Research Network data trust., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier B.V. All rights reserved.)

Aim: To identify the key requirements and challenges to interoperability between patient portals and electronic health records (EHRs)., Introduction: Patient portals provide patients with access to their health information directly from EHRs within hospitals, primary care centres and general practices (GPs). Patient portals offer many benefits to patients including improved communication with healthcare providers and care coordination. However, many challenges exist with the integration and automatic and secure sharing of information between EHRs and patient portals. It is critical that countries learn from international experiences to successfully develop interoperable national patient portals., Methods: A scoping review methodology was undertaken. A search strategy using index terms and keywords was applied across four key databases, an additional grey literature search was also run. The identified studies were screened by two reviewers to determine eligibility against defined inclusion criteria. Data were abstracted from the eligible studies and reviewed to identify the key requirements and challenges to interoperability of patient portals with EHRs., Results: After screening 3,462 studies, 34 were included across 11 countries. Of the 29 unique patient portals studied, few offered patients access to their entire healthcare record across multiple sites and a number of different functionalities were available. Key interoperability requirements and challenges identified were: Data Sharing Incentives & Supports; Heterogenous Organisations & Information Systems; Data Storage & Management; Available Information & Functionalities; Data Formats & Standards; Identification of Individuals; User Access, Control & Consent; and Security & Privacy., Conclusion: Seamless exchange of health information across patient portals and EHRs required organisational and individual factors, as well as technical considerations. Interorganisational collaboration and engagement of key stakeholders to determine standards and guidelines for consent and sharing of information, as well as technical standards and security measures were recommended., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background: Correctly structured problem lists in electronic health records (EHRs) offer major benefits to patient care. Without structured lists, diagnosis information is often scatteredly documented in free text, which may contribute to errors and inefficient information retrieval. This study aims to assess whether EHRs with correctly structured problem lists result in better and faster clinical decision-making compared to non-curated problem lists., Methods: Two versions of two patient records (A and B) were created in an EHR training environment: one version included diagnosis information structured and coded on the problem list ("correctly structured problem list"), the other version had missing problem list diagnoses and diagnosis information partly documented in free text ("non-curated problem list"). In this single-blinded crossover randomized controlled trial, healthcare providers, who can prescribe medications, from two Dutch university medical center locations first evaluated a randomized version of patient A, then B. Participants were asked to motivate their answer to two medication prescription questions. One (test) question required information similarly presented in both record versions. The second (comparison) question required information documented on problem lists and/or in notes. The primary outcome measure was the correctness of the motivated answer to the comparison question. Secondary outcome measure was the time to answer and motivate both questions correctly., Results: As planned, 160 participants enrolled. Two were excluded for not meeting inclusion criteria. Correctly structured problem lists increased providers' ability to answer the comparison question correctly (56.3 % versus 33.5 %, McNemar odds ratio 2.80 (1.65-4.93) 95 %-CI). Median time to answer both questions correctly was significantly lower for EHRs with correctly structured problem lists (Wilcoxon-signed-rank test p = 0.00002, with incorrect answers coded equally at slowest time)., Conclusions: Correctly structured problem lists lead to better and faster clinical decision-making. Increased structured problem lists usage may be warranted for which implementation policies should be developed., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved.)

Introduction: Identifying patient safety events using electronic health records (EHRs) and automated machine learning-based detection methods can help improve the efficiency and quality of healthcare service provision., Objective: This study aimed to systematically review machine learning-based methods and techniques, as well as their results for patient safety event management using EHRs., Methods: We reviewed the studies that focused on machine learning techniques, including automatic prediction and detection of patient safety events and medical errors through EHR analysis to manage patient safety events. The data were collected by searching Scopus, PubMed (Medline), Web of Science, EMBASE, and IEEE Xplore databases., Results: After screening, 41 papers were reviewed. Support vector machine (SVM), random forest, conditional random field (CRF), and bidirectional long short-term memory with conditional random field (BiLSTM-CRF) algorithms were mostly applied to predict, identify, and classify patient safety events using EHRs; however, they had different performances. BiLSTM-CRF was employed in most of the studies to extract and identify concepts, e.g., adverse drug events (ADEs) and adverse drug reactions (ADRs), as well as relationships between drug and severity, drug and ADEs, drug and ADRs. Recurrent neural networks (RNN) and BiLSTM-CRF had the best results in detecting ADEs compared to other patient safety events. Linear classifiers and Naive Bayes (NB) had the highest performance for ADR detection. Logistic regression had the best results in detecting surgical site infections. According to the findings, the quality of articles has non-significantly improved in recent years, but they had low average scores., Conclusions: Machine learning can be useful in automatic detection and prediction of patient safety events. However, most of these algorithms have not yet been externally validated or prospectively tested. Therefore, further studies are required to improve the performance of these automated systems., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier B.V. All rights reserved.)

Introduction: Electronic health records (EHR) are of great value for clinical research. However, EHR consists primarily of unstructured text which must be analysed by a human and coded into a database before data analysis- a time-consuming and costly process limiting research efficiency. Natural language processing (NLP) can facilitate data retrieval from unstructured text. During AssistMED project, we developed a practical, NLP tool that automatically provides comprehensive clinical characteristics of patients from EHR, that is tailored to clinical researchers needs., Material and Methods: AssistMED retrieves patient characteristics regarding clinical conditions, medications with dosage, and echocardiographic parameters with clinically oriented data structure and provides researcher-friendly database output. We validate the algorithm performance against manual data retrieval and provide critical quantitative and qualitative analysis., Results: AssistMED analysed the presence of 56 clinical conditions, medications from 16 drug groups with dosage and 15 numeric echocardiographic parameters in a sample of 400 patients hospitalized in the cardiology unit. No statistically significant differences between algorithm and human retrieval were noted. Qualitative analysis revealed that disagreements with manual annotation were primarily accounted to random algorithm errors, erroneous human annotation and lack of advanced context awareness of our tool., Conclusions: Current NLP approaches are feasible to acquire accurate and detailed patient characteristics tailored to clinical researchers' needs from EHR. We present an in-depth description of an algorithm development and validation process, discuss obstacles and pinpoint potential solutions, including opportunities arising with recent advancements in the field of NLP, such as large language models., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background: Similar to other countries around the world, China has incorporated the recording of electronic health data into its national strategy. After the completion of the decentralized construction phase, the construction of electronic health records in China has reached the stages of integration, sharing, and utilization. "Vertical integration" is the premise and foundation of "shared utilization" of electronic health records within the medical consortium, but it is also a bottleneck in realizing this goal., Objective: The main purpose of this paper is to find out the key factors affecting the vertical integration of electronic health records in the medical consortiums, and to clarify the impact mechanism of these key factors, so as to provide reference for improving relevant policies., Methods: In this study, an index system of influencing factors is established for cross-institutional vertical integration of electronic health records within a medical consortium, identifying key influencing factors using the combined fuzzy-DEMATEL-ASIM method and revealing the influence relationship and action mechanism among the key influencing factors using a multi-layer hierarchical influence structure model., Results: There are 32 factors influencing the vertical integration of electronic health records in the medical consortium, 17 of which are key factors. According to the hierarchical structure of key influencing factors, they can be divided into three categories: surface-level factors, middle-level factors and deep-level factors., Conclusions: In practice, these key factors should be prioritized for improvement and optimization to promote integration projects. In the future, we should focus on key influencing factors to precisely implement policies, such as introducing special promotion policies, unifying development planning, changing health insurance payment methods, establishing sharing standards, and raising public awareness., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Introduction: Asthma is one of the commonest chronic conditions in the world. Subtypes of asthma have been defined, typically from clinical datasets on small, well-characterised subpopulations of asthma patients. We sought to define asthma subtypes from large longitudinal primary care electronic health records (EHRs) using cluster analysis., Methods: In this retrospective cohort study, we extracted asthma subpopulations from the Optimum Patient Care Research Database (OPCRD) to robustly train and test algorithms, and externally validated findings in the Secure Anonymised Information Linkage (SAIL) Databank. In both databases, we identified adults with an asthma diagnosis code recorded in the three years prior to an index date. Train and test datasets were selected from OPCRD using an index date of Jan 1, 2016. Two internal validation datasets were selected from OPCRD using index dates of Jan 1, 2017 and 2018. Three external validation datasets were selected from SAIL using index dates of Jan 1, 2016, 2017 and 2018. Each dataset comprised 50,000 randomly selected non-overlapping patients. Subtypes were defined by applying multiple correspondence analysis and k-means cluster analysis to the train dataset, and were validated in the internal and external validation datasets., Results: We defined six asthma subtypes with clear clinical interpretability: low inhaled corticosteroid (ICS) use and low healthcare utilisation (30% of patients); low-to-medium ICS use (36%); low-to-medium ICS use and comorbidities (12%); varied ICS use and comorbid chronic obstructive pulmonary disease (4%); high (10%) and very high ICS use (7%). The subtypes were replicated with high accuracy in internal (91-92%) and external (84-86%) datasets., Conclusion: Asthma subtypes derived and validated in large independent EHR databases were primarily defined by level of ICS use, level of healthcare use, and presence of comorbidities. This has important clinical implications towards defining asthma subtypes, facilitating patient stratification, and developing more personalised monitoring and treatment strategies., Competing Interests: Declaration of Competing Interest The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: David Price has advisory board membership with AstraZeneca, Boehringer Ingelheim, Chiesi, Mylan, Novartis, Regeneron Pharmaceuticals, Sanofi Genzyme, Thermofisher; consultancy agreements with Airway Vista Secretariat, AstraZeneca, Boehringer Ingelheim, Chiesi, EPG Communication Holdings ltd, FIECON ltd, Fieldwork International, GlaxoSmithKline, Mylan, Mundipharma, Novartis, OM Pharma SA, PeerVoice, Phadia AB, Spirosure Inc, Strategic North Limited, Synapse Research Management Partners S.L., Talos Health Solutions, Theravance and WebMD Global LLC; grants and unrestricted funding for investigator-initiated studies (conducted through Observational and Pragmatic Research Institute Pte ltd) from AstraZeneca, Boehringer Ingelheim, Chiesi, Mylan, Novartis, Regeneron Pharmaceuticals, Respiratory Effectiveness Group, Sanofi Genzyme, Theravance and UK National Health Service; payment for lectures/speaking engagements from AstraZeneca, Boehringer Ingelheim, Chiesi, Cipla, GlaxoSmithKline, Kyorin, Mylan, Mundipharma, Novartis, Regeneron Pharmaceuticals and Sanofi Genzyme; payment for travel/accommodation/meeting expenses from AstraZeneca, Boehringer Ingelheim, Mundipharma, Mylan, Novartis, Thermofisher; stock/stock options from AKL Research and Development ltd which produces phytopharmaceuticals; owns 74 % of the social enterprise Optimum Patient Care ltd (Australia and UK) and 92.61 % of Observational and Pragmatic Research Institute Pte ltd (Singapore); 5 % shareholding in Timestamp which develops adherence monitoring technology; is peer reviewer for grant committees of the UK Efficacy and Mechanism Evaluation programme, and Health Technology Assessment; and was an expert witness for GlaxoSmithKline. All other authors have no conflict of interest to declare., (Copyright © 2022 The Author(s). Published by Elsevier B.V. All rights reserved.)

Background: Cognitive tests and biomarkers are the key information to assess the severity and track the progression of Alzheimer's' disease (AD) and AD-related dementias (AD/ADRD), yet, both are often only documented in clinical narratives of patients' electronic health records (EHRs). In this work, we aim to (1) assess the documentation of cognitive tests and biomarkers in EHRs that can be used as real-world endpoints, and (2) identify, extract, and harmonize the different commonly used cognitive tests from clinical narratives using natural language processing (NLP) methods into categorical AD/ADRD severity., Methods: We developed a rule-based NLP pipeline to extract the cognitive tests and biomarkers from clinical narratives in AD/ADRD patients' EHRs. We aggregated the extracted results to the patient level and harmonized the cognitive test scores into severity categories using cutoffs determined based on both relevant literature and domain knowledge of AD/ADRD clinicians., Results: We identified an AD/ADRD cohort of 48,912 patients from the University of Florida (UF) Health system and identified 7 measurements (6 cognitive tests and 1 biomarker) that are frequently documented in our data. Our NLP pipeline achieved an overall F1-score of 0.9059 across the 7 measurements. Among the 6 cognitive tests, we were able to harmonize 4 cognitive test scores into severity categories, and the population characteristics of patients with different severity were described. We also identified several factors related to the availability of their documentation in EHRs., Conclusion: This study demonstrates that our NLP pipelines can extract cognitive tests and biomarkers of AD/ADRD accurately for downstream studies. Although, the documentation of cognitive tests and biomarkers in EHRs appears to be low, RWD is still an important resource for AD/ADRD research. Nevertheless, providing standardized approach to document cognitive tests and biomarkers in EHRS are also warranted., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Objective: To develop deep learning models to recognize ophthalmic examination components from clinical notes in electronic health records (EHR) using a weak supervision approach., Methods: A corpus of 39,099 ophthalmology notes weakly labeled for 24 examination entities was assembled from the EHR of one academic center. Four pre-trained transformer-based language models (DistilBert, BioBert, BlueBert, and ClinicalBert) were fine-tuned to this named entity recognition task and compared to a baseline regular expression model. Models were evaluated on the weakly labeled test dataset, a human-labeled sample of that set, and a human-labeled independent dataset., Results: On the weakly labeled test set, all transformer-based models had recall > 0.93, with precision varying from 0.815 to 0.843. The baseline model had lower recall (0.769) and precision (0.682). On the human-annotated sample, the baseline model had high recall (0.962, 95 % CI 0.955-0.067) with variable precision across entities (0.081-0.999). Bert models had recall ranging from 0.771 to 0.831, and precision >=0.973. On the independent dataset, precision was 0.926 and recall 0.458 for BlueBert. The baseline model had better recall (0.708, 95 % CI 0.674-0.738) but worse precision (0.399, 95 % CI -0.352-0.451)., Conclusion: We developed the first deep learning system to recognize eye examination components from clinical notes, leveraging a novel opportunity for weak supervision. Transformer-based models had high precision on human-annotated labels, whereas the baseline model had poor precision but higher recall. This system may be used to improve cohort and feature identification using free-text notes.Our weakly supervised approach may help amass large datasets of domain-specific entities from EHRs in many fields., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Background: Preserving brain health is a critical priority in primary care, yet screening for these risk factors in face-to-face primary care visits is challenging to scale to large populations. We aimed to develop automated brain health risk scores calculated from data in the electronic health record (EHR) enabling population-wide brain health screening in advance of patient care visits., Methods: This retrospective cohort study included patients with visits to an outpatient neurology clinic at Massachusetts General Hospital, between January 2010 and March 2021. Survival analysis with an 11-year follow-up period was performed to predict the risk of intracranial hemorrhage, ischemic stroke, depression, death and composite outcome of dementia, Alzheimer's disease, and mild cognitive impairment. Variables included age, sex, vital signs, laboratory values, employment status and social covariates pertaining to marital, tobacco and alcohol status. Random sampling was performed to create a training (70%) set for hyperparameter tuning in internal 5-fold cross validation and an external hold-out testing (30%) set of patients, both stratified by age. Risk ratios for high and low risk groups were evaluated in the hold-out test set, using 1000 bootstrapping iterations to calculate 95% confidence intervals (CI)., Results: The cohort comprised 17,040 patients with an average age of 49 ± 15.6 years; majority were males (57 %), White (78 %) and non-Hispanic (80 %). The low and high groups average risk ratios [95 % CI] were: intracranial hemorrhage 0.46 [0.45-0.48] and 2.07 [1.95-2.20], ischemic stroke 0.57 [0.57-0.59] and 1.64 [1.52-1.69], depression 0.68 [0.39-0.74] and 1.29 [0.78-1.38], composite of dementia 0.27 [0.26-0.28] and 3.52 [3.18-3.81] and death 0.24 [0.24-0.24] and 3.96 [3.91-4.00]., Conclusions: Simple risk scores derived from routinely collected EHR accurately quantify the risk of developing common neurologic and psychiatric diseases. These scores can be computed automatically, prior to medical care visits, and may thus be useful for large-scale brain health screening., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier B.V. All rights reserved.)

Background: With the still larger scale of electronic health records (EHRs), their implementation has become increasingly complex. In this study, we focus on one large-scale EHR - Epic., Purpose: We analyze the Epic implementations in Denmark and Finland to understand how healthcare professionals experience this large-scale EHR., Method: The study is based on documentary analysis. The analyzed documents include user surveys, assessment reports, material from project partners, and research papers., Results: The Danish and Finnish Epic implementations are still troubled five and three years, respectively, after the first go-live. In Denmark, the business case and implementation process have been sharply criticized. The correction of usability problems and unstable system integrations have been slow, the time required to perform common clinical tasks has increased, and 32% of the users remain dissatisfied or very dissatisfied with the system. In Finland, the physicians and nurses experience improved technical performance but inferior usability and reduced work support compared to the EHR they used before Epic; only 4.7% (physicians) and 7.3% (nurses) agree that patient information is easy to access, and only 9.3% (physicians) and 26.2% (nurses) agree that Epic helps improve the quality of care., Conclusion: The post-implementation experiences from the two implementations contradict pre-implementation expectations. Specifically, the consequences of using Epic have become salient only after go-live. As a result, the implementing organizations and their users have predominantly found themselves in a reactive mode of fending off problems rather than a proactive mode of realizing benefits., (Copyright © 2022. Published by Elsevier B.V.)

Electronic health record (EHR) systems are powerful tools that enhance healthcare quality. They improve efficiency, enable data exchange, and ensure authorized access to patient information. In 2022, the World Health Organization Regional Office for Europe (WHO EURO) conducted a survey to assess the digital health capabilities of the 53 Member States. This article provides a sub-regional analysis of the status of EHR systems and major barriers to their implementation, their readiness for information sharing, and the access and re-use of EHR data. Generally, EHR implementation and national data exchange are at an advanced stage in the region, though achievements and challenges vary across subregions. While more Member States in the Eastern, Western, and Southern Europe subregions reported having centralized national EHR systems, the situation is more diverse in Northern Europe and the Asian subregions, where both centralized and decentralized EHR systems are in use. Significant barriers to EHR implementation, including funding, technical capacity, competing priorities, and lack of interoperability standards are frequently cited, while others like demand, knowledge or acceptance challenges are not reported as significant. Significant barriers were reported the most by the Central Asia subregion, while barriers had least significance in Western Europe. Five out of the six subregions reported a wide adoption of national strategies and have dedicated agencies to ensure interoperability and secure data exchange. However, only 29 Member States have established legal requirements for healthcare providers to adopt EHR systems that conform to national standards for both clinical terminology and electronic messaging, with this being most notable in Western, Eastern, and Northern Europe, and the lowest percentage of Member States in Central Asia. All Member States of the six sub regions have passed privacy and data protection legislation. The use of EHR data is widely regulated, with only five remaining Member States of WHO Europe to develop EHR legislation distributed across subregions (Southern Europe, Western and Central Asia). Looking ahead, Member States are encouraged to define national legislation governing EHR systems and their use, while ensuring the interconnectivity of the local and regional EHR systems. Sustainable funding should be allocated to the development and maintenance of these systems. Efforts should also focus on creating comprehensive roadmaps for the full implementation of health data standards, addressing interoperability at local and regional levels, and developing quality management systems for testing and certification. Additionally, monitoring and evaluation should be conducted to assess whether EHRs are contributing to national health objectives. Finally, engaging patients and intersectoral partners will be key to developing a more patient-centered approach, ensuring that EHR systems meet patient needs and expectations., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. This publication has been produced with the financial assistance of the European Union. The contents of this publication can in no way be taken to reflect the views of the European Union., (Copyright © 2024. Published by Elsevier B.V.)

Background: Cross-organizational access to shared electronic health records can enhance integrated, people-centered health services. However, a gap remains between these potential benefits and the limited support currently offered by electronic health records. The Valkyrie research project aims to bridge this gap by developing a technical prototype of an architecture to promote healthcare service coordination., Objective: To inform the Valkyrie project, we aimed to evaluate approaches for healthcare professionals' access to electronic health records across healthcare providers and identify factors influencing the success and failure of these approaches., Materials and Methods: Using the Joanna Briggs Institute guidance for scoping reviews, searches were conducted in six research databases and grey literature, without limitations on year or language. Papers selected for full-text review were analyzed, and data was extracted using standardized forms that reflected the population, concept, and context framework and the categorization model used in the qualitative analysis of the barriers and facilitators reported in the included papers., Results: Among the 290 identified papers, five were deemed eligible for full-text review. The included papers were heterogeneous in country, year of publication, study setting, implementation level, and access approaches to electronic health records, highlighting various techniques, from federated to centralized, for accessing shared electronic health records., Discussion and Conclusion: The review did not identify one single superior access approach. However, a hybrid approach incorporating components from the different approaches combined with emerging technologies may benefit the Valkyrie project. The key facilitators were identified as improved information quality and flexible and easy access. In contrast, lack of trust and poor information quality were significant barriers to successful cross-organizational access to electronic health records. Future research should explore alternative access approaches, considering information quality, user training, and collegial trust across healthcare providers., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024. Published by Elsevier B.V.)

Objective: Symptoms are significant kind of phenotypes for managing and controlling of the burst of acute infectious diseases, such as COVID-19. Although patterns of symptom clusters and time series have been considered the high potential prediction factors for the prognosis of patients, the elaborated subtypes and their progression patterns based on symptom phenotypes related to the prognosis of COVID-19 patients still need be detected. This study aims to investigate patient subtypes and their progression patterns with distinct features of outcome and prognosis., Methods: This study included a total of 14,139 longitudinal electronic medical records (EMRs) obtained from four hospitals in Hubei Province, China, involving 2,683 individuals in the early stage of COVID-19 pandemic. A deep representation learning model was developed to help acquire the symptom profiles of patients. K-means clustering algorithm is used to divide them into distinct subtypes. Subsequently, symptom progression patterns were identified by considering the subtypes associated with patients upon admission and discharge. Furthermore, we used Fisher's test to identify significant clinical entities for each subtype., Results: Three distinct patient subtypes exhibiting specific symptoms and prognosis have been identified. Particularly, Subtype 0 includes 44.2% of the whole and is characterized by poor appetite, fatigue and sleep disorders; Subtype 1 includes 25.6% cases and is characterized by confusion, cough with bloody sputum, encopresis and urinary incontinence; Subtype 2 includes 30.2% cases and is characterized by dry cough and rhinorrhea. These three subtypes demonstrate significant disparities in prognosis, with the mortality rates of 4.72%, 8.59%, and 0.25% respectively. Furthermore, symptom cluster progression patterns showed that patients with Subtype 0 who manifest dark yellow urine, chest pain, etc. in the admission stage exhibit an elevated risk of transforming into the more severe subtypes with poor outcome, whereas those presenting with nausea and vomiting tend to incline towards entering the milder subtype., Conclusion: This study has proposed a clinical meaningful approach by utilizing the deep representation learning and real-world EMR data containing symptom phenotypes to identify the COVID-19 subtypes and their progression patterns. The results would be potentially useful to help improve the precise stratification and management of acute infectious diseases., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background and Objectives: The importance of clinical natural language processing (NLP) has increased with the adoption of electronic health records (EHRs). One of the critical tasks in clinical NLP is named entity recognition (NER). Clinical NER in the Serbian language is a severely under-researched area. The few approaches that have been proposed so far are based on rules or machine-learning models with hand-crafted features, while current state-of-the-art models have not been explored. The objective of this paper is to assess the performance of state-of-the-art NER methods on clinical narratives in the Serbian language., Materials and Methods: We designed an experimental setup for a comprehensive evaluation of state-of-the-art NER models. The gold standard corpus we used for the evaluation is comprised of discharge summaries from the Clinic for Nephrology at the University Clinical Center of Serbia. The following models were evaluated: conditional random fields (CRF), multilingual transformers (BERT Multilingual and XLM RoBERTa), and long short-term memory (LSTM) recurrent neural networks, and their ensembles. In addition, we investigated the necessity of the pretraining task of transformer based models and the use of pretrained word embeddings with LSTM model., Results: Our results show that individually CRF had the best precision, the pretrained BERT Multilingual model had the best recall values, and the LSTM model had the best F1 score. The best performance was achieved by combining the existing models in a majority voting ensemble with an F1 score of 0.892. The presented results are similar to the inter annotator agreement on our gold standard corpus and are comparable to existing state-of-the-art results for clinical NER reported in literature., Conclusion: Existing state-of-the-art models can provide viable results for clinical named entity recognition when applied to languages with the complexity of the Serbian language without major modifications., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Background: Adverse Drug Events (ADE) are key information present in unstructured portions of Electronic Health Records. These pose a significant challenge in healthcare, ranging from mild discomfort to severe complications, and can impact patient safety and treatment outcomes., Methods: We explore the influence of domain shift between a set of dummy clinical notes and a real-world hospital corpus of Japanese clinical notes of breast cancer treatment when extracting ADEs from free text. We annotated a subset of the hospital dataset and used it to fine-tune a Named Entity Recognition (NER) model, initially trained with the set of dummy documents. We used increasing amounts of the annotated data and evaluated the impact on the model's performance. Additionally, we examined the extracted information to identify combinations of drugs that are likely to cause ADEs., Results: We show that domain adaptation can significantly improve model performance in the new domain, as by feeding a small subset of 100 documents for the fine-tuning process we saw a 40% improvement in model performance. However, we also noticed diminishing returns when fine-tuning the model with a larger dataset. For instance, by feeding eight times more data, we only saw further 18% improvement in extraction performance., Conclusion: While variations in writing style and vocabulary in clinical corpora can significantly impact the quality of NER results. We show that domain adaptation can be of great aid in mitigating these discrepancies and achieving better performance. Yet, while providing in-domain data to a model helps, there are diminishing returns when fine-tuning with large amounts of data., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Objective: Accurate diagnoses and personalized treatments in medicine rely on identifying causality. However, existing causal discovery algorithms often yield inconsistent results due to distinct learning mechanisms. To address this challenge, we introduce MINDMerge, a multi-causal investigation and discovery framework designed to synthesize causal graphs from various algorithms., Methods: MINDMerge integrates five causal models to reconcile inconsistencies arising from different algorithms. Employing credibility weighting and a novel cycle-breaking mechanism in causal networks, we initially developed and tested MINDMerge using three synthetic networks. Subsequently, we validated its effectiveness in discovering risk factors and predicting acute kidney injury (AKI) using two electronic medical records (EMR) datasets, eICU Collaborative Research Database and MIMIC-III Database. Causal reasoning was employed to analyze the relationships between risk factors and AKI. The identified causal risk factors of AKI were used in building a prediction model, and the prediction model was evaluated using the area under the receiver operating characteristics curve (AUC) and recall., Results: Synthetic data experiments demonstrated that our model outperformed significantly in capturing ground-truth network structure compared to other causal models. Application of MINDMerge on real-world data revealed direct connections of pulmonary disease, hypertension, diabetes, x-ray assessment, and BUN with AKI. With the identified variables, AKI risk can be inferred at the individual level based on established BNs and prior information. Compared against existing benchmark models, MINDMerge maintained a higher AUC for AKI prediction in both internal (AUC: 0.832) and external network validations (AUC: 0.861)., Conclusion: MINDMerge can identify causal risk factors of AKI, serving as a valuable diagnostic tool for clinical decision-making and facilitating effective intervention., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Introduction: Delays in discharging patients from Acute Medical Units hamper patient flows throughout the hospital. The decision to discharge a patient is mainly based on the patients' physiological condition, but may vary between physicians. An objective decision-support system based on patients' physiological data may help minimizing unnecessary delays in discharge. The aim of this proof-of-concept study is to assess the feasibility of predicting whether patients in an Acute Medical Unit are physiologically fit-for-discharge using machine learning with commonly available hospital data. Furthermore, this study investigated how long before actual time of discharge from the Acute Medical Unit we could predict discharge fitness. Also, the predictive importance of features extracted from these data was assessed., Methods: Electronic Medical Records of patients who participated in a Randomized Controlled Trial conducted in an Acute Medical Unit were used retrospectively (N = 199). Only commonly available hospital data were used. Logistic Regression and Random Forest models were applied to predict every hour whether patients were physiologically fit-for-discharge. Nested 5-fold cross-validation with 5 repeats was used to optimize the model hyperparameters and to estimate the predictive performances., Results: Physiological discharge fitness was predictable with reasonable performance for Logistic Regression (mean AUROC: 0.67) and Random Forest (mean AUROC: 0.69). For an intuitively chosen classification threshold of 0.8, mean specificity was 93.3 % and sensitivity 14.1 %. Models could predict physiological discharge fitness more than 24 h earlier than actual time of discharge for most patients who were correctly predicted to be fit-for-discharge. Patient characteristics, vital signs and laboratory results were shown to be important predictors., Conclusion: This proof-of-concept study showed that it is feasible to predict with machine learning whether patients in an Acute Medical Unit are physiologically fit-for-discharge using commonly available hospital data., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Background: Digital healthcare aims to deliver on the quadruple aim: enhance patient experiences, improve population health, reduce costs and improve provider experiences. Despite large investments, it is unclear how advancing digital health enables these healthcare aims., Objective: Our objectives were to: 1) measure the correlation between digital capability and health system outcomes mapped to the quadruple aim, and 2) measure the longitudinal impact of electronic medical record implementations upon health system outcomes., Materials and Methods: We undertook two studies: 1) Digital health correlational study investigating the association among healthcare system capability and healthcare aims, and 2) Digital hospital longitudinal study investigating outcomes pre and post electronic medical record implementation., Results: Digital health capability was associated with lower staff turnover. Digitising healthcare services was associated with decreased medication errors, decreased nosocomial infections, increased hospital activity, and a transient increase in staff leave., Discussion: These results suggest positive impacts on the population health and healthcare costs aim, minimal impacts on the provider experience aim and no observed impacts to the patient experience aim., Conclusion: These findings should provide confidence to healthcare decision-makers investing in digital health., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Objective: Observational studies using electronic health record (EHR) databases often face challenges due to unspecific clinical codes that can obscure detailed medical information, hindering precise data analysis. In this study, we aimed to assess the feasibility of refining these unspecific condition codes into more specific codes in a Dutch general practitioner (GP) EHR database by leveraging the available clinical free text., Methods: We utilized three approaches for text classification-search queries, semi-supervised learning, and supervised learning-to improve the specificity of ten unspecific International Classification of Primary Care (ICPC-1) codes. Two text representations and three machine learning algorithms were evaluated for the (semi-)supervised models. Additionally, we measured the improvement achieved by the refinement process on all code occurrences in the database., Results: The classification models performed well for most codes. In general, no single classification approach consistently outperformed the others. However, there were variations in the relative performance of the classification approaches within each code and in the use of different text representations and machine learning algorithms. Class imbalance and limited training data affected the performance of the (semi-)supervised models, yet the simple search queries remained particularly effective. Ultimately, the developed models improved the specificity of over half of all the unspecific code occurrences in the database., Conclusions: Our findings show the feasibility of using information from clinical text to improve the specificity of unspecific condition codes in observational healthcare databases, even with a limited range of machine-learning techniques and modest annotated training sets. Future work could investigate transfer learning, integration of structured data, alternative semi-supervised methods, and validation of models across healthcare settings. The improved level of detail enriches the interpretation of medical information and can benefit observational research and patient care., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Introduction: Accurate evaluation of exacerbation frequency is an essential part of COPD assessment. But relying on just the prior-year exacerbation history may not capture the full picture of risk given the inherent year-to-year fluctuations in exacerbation rates. This study aimed to evaluate the predictive performance of models incorporating the 3-year exacerbation history based on electronic medical record., Materials and Methods: This retrospective cohort study included 86,501 COPD hospitalized patients in Beijing from 2008 to 2014. The annual frequency of COPD exacerbation hospitalizations over a 3-year period after the index hospitalization was calculated, with patients segmented into seven distinct exacerbation trajectory groups. Logistic regression was used to evaluate the predictive capability of the 3-year exacerbation history for exacerbation readmission in the fourth year. Predictors included age, sex, comorbidities, and exacerbation hospitalization in previous 1-3 years. Model performance was evaluated using area under the receiver operating characteristic curve (AUC)., Results: Of the studied patients, 56.5% were men, and the mean age (SD) was 73.8 (10.3) years. The overall readmission rate for COPD exacerbation was 0.31 per person-year, with only 3.8% of patients persistently readmitted over three consecutive years. The 3-year trajectory of exacerbation frequency was associated with exacerbation risk in the fourth year. Compared to just the prior year, the inclusion of a 3-year exacerbation hospitalization history notably improved prediction accuracy, with AUC elevating from 0.731 (0.724-0.739) to 0.786 (0.779-0.792)., Conclusion: These results unveil the fluctuating nature of COPD exacerbation hospitalization frequency across years and demonstrate that integrating a more comprehensive 3-year exacerbation history significantly refines the prediction model for future risk, thus providing a more nuanced and actionable insight for clinical care., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

UK Biobank (UKB) is widely employed to investigate mental health disorders and related exposures; however, its applicability and relevance in a clinical setting and the assumptions required have not been sufficiently and systematically investigated. Here, we present the first validation study using secondary care mental health data with linkage to UKB from Oxford - Clinical Record Interactive Search (CRIS) focusing on comparison of demographic information, diagnostic outcome, medication record and cognitive test results, with missing data and the implied bias from both resources depicted. We applied a natural language processing model to extract information embedded in unstructured text from clinical notes and attachments. Using a contingency table we compared the demographic information recorded in UKB and CRIS. We calculated the positive predictive value (PPV, proportion of true positives cases detected) for mental health diagnosis and relevant medication. Amongst the cohort of 854 subjects, PPVs for any mental health diagnosis for dementia, depression, bipolar disorder and schizophrenia were 41.6%, and were 59.5%, 12.5%, 50.0% and 52.6%, respectively. Self-reported medication records in UKB had general PPV of 47.0%, with the prevalence of frequently prescribed medicines to each typical mental health disorder considerably different from the information provided by CRIS. UKB is highly multimodal, but with limited follow-up records, whereas CRIS offers a longitudinal high-resolution clinical picture with more than ten years of observations. The linkage of both datasets will reduce the self-report bias and synergistically augment diverse modalities into a unified resource to facilitate more robust research in mental health., (Copyright © 2022 The Authors. Published by Elsevier B.V. All rights reserved.)

Background: Electronic health records are a valuable asset for research, but their use is challenging due to inconsistencies of records, heterogeneous formats and the distribution over multiple, non-integrated information systems. Hence, specialized health data engineering and data science expertise are required to enable research. To facilitate secondary use of clinical routine data collected in our intensive care wards, we developed a scalable approach, consisting of cohort generation, variable filtering and data extraction steps., Objective: With this report we share our workflow of data request, cohort identification and data extraction. We present an algorithm for automatic data extraction from our critical care information system (CCIS) that can be adapted to other object-oriented data bases., Methods: We introduced a data request process with functionalities for automated identification of patient cohorts and a specialized hierarchical data structure that supports filtering relevant variables from the CCIS and further systems for the specified cohorts. The data extraction algorithm takes patient pseudonyms and variable lists as inputs. Algorithms are implemented in Python, leveraging the PySpark framework running on our data lake infrastructure., Results: Our data request process is in operational use since June 2022. Since then we have served 121 projects with 148 service requests in total. We discuss the hierarchical structure and the frequently used data items of our CCIS in detail and present an application example, including cohort selection, data extraction and data transformation into an analyses-ready format., Conclusions: Using clinical routine data for secondary research is challenging and requires an interdisciplinary team. We developed a scalable approach that automates steps for cohort identification, data extraction and common data pre-processing steps. Additionally, we facilitate data harmonization, integration and consult on typical data analysis scenarios, machine learning algorithms and visualizations in dashboards., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Background and Objective: Primary care providers (PCPs) use poorly organized patient information in electronic health records (EHR) within a limited time when treating patients with chronic pain. Clinical decision support (CDS) tools assist PCPs by synthesizing patient information and prompting guideline-concordant treatment decisions. A CDS tool- Chronic Pain OneSheet was developed through a user-centered design process to support PCP's decision-making for patients with chronic noncancer pain. OneSheet aggregates relevant patient information in one place in the EHR. OneSheet also guides PCPs in completing guideline-recommended opioid risk management tasks, tracking patient treatments, and documenting pain-related symptoms. Our objective was to identify barriers, facilitators, and recommendations to increase OneSheet use for chronic noncancer pain management in primary care., Methods: We conducted 19 qualitative interviews with PCPs from two academic health systems who had access to OneSheet in their EHR. Interview transcripts were coded to identify common themes using a modified thematic approach., Results: PCPs identified several barriers to using OneSheet, including limited time to address patient needs associated with multiple chronic conditions, resistance to changing established workflows, and complex OneSheet display. PCPs reported several facilitators to using OneSheet, such as OneSheet's ability to serve as a hub for chronic pain data, easy access to features that facilitate completing mandatory tasks and improved planning for certain patient visits. PCPs recommended prioritizing access to commonly used features, adding display customization capabilities, and expanding access to patients and other team members to increase OneSheet use., Conclusion: Our findings highlight the importance of acknowledging the PCP workflow and task load when designing CDS tools. Future CDS tools should balance the extent of information provided with assisting PCPs to fulfill mandatory tasks. Expanding CDS tools to multiple care team members and patients can also lead to higher use by facilitating data entry, leading to more streamlined care delivery., Competing Interests: Declaration of competing interest The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: [Christopher A. Harle discloses past research grant funding for studies of information technology to support pain care to his institution from Security Risk Solutions, Inc. and the Agency for Healthcare Research and Quality. Christopher A. Harle also discloses personal fees from Indiana Health Information Exchange, personal fees from New York eHealth Collaborative, personal fees from RTI International, outside the submitted work. Olena Mazurenko discloses past and current research grant funding for studies of information technology to support pain care to her institution from Security Risk Solutions, Inc. and the Agency for Healthcare Research and Quality. Meredith C.B. Adams and Robert W. Hurley are supported by National Institutes of Health funding through the NIH K08 EB022631, U24 NS115708, and R33 DA046085. Joshua R. Vest is a founder and equity holder in Uppstroms Inc., a health technology company. The other authors have no conflicts to report]., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background: Despite the recognized benefits of integrating patient perspectives into healthcare design and clinical decision support, theoretical approaches and standardized methods are lacking. Various strategies, such as developing pathways, have evolved to address these challenges. Previous research emphasized the need for a framework for care pathways that includes theoretical principles, extensive user involvement, and data from electronic health records to bridge the gap between different fields and disciplines. Standardizing the representation of the patient perspective could facilitate its sharing across healthcare organizations and domains and its integration into journal systems, shifting the balance of power from the provider to the patient., Objectives: This study aims to 1) Identify research approaches taken to develop patient-centred, integrated, care pathways supported by electronic health records 2) Propose a socio-technical framework for designing patient-centred care pathways across multiple healthcare levels that integrates the voice of the patient with the knowledge of the care provider and technological perspectives., Methods: This study conducted a scoping review following the Joanna Briggs Institute guidelines and PRISMA-ScR protocol. The databases PubMed, Scopus, Web of Science, ProQuest, IEEE, and Google Scholar were searched using a key term search strategy including variations of patient-centred, integrated care, pathway, framework and model to identify relevant studies. Eligible articles included peer-reviewed literature documenting methodologies for mapping patient-centred, integrated care pathways in healthcare service design., Results: This review summarizes the application of care pathway modelling practices across various areas of healthcare innovation. The search resulted in 410 studies, with 16 articles included after the full review and grey literature search., Conclusions: Our research illustrated incorporating patient perspectives into modelling care pathways and healthcare service design. Regardless of the medical domain, our methodology proposes an approach for modelling patient-centred, integrated care pathways across the care continuum, including using electronic health records to support the pathways., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Background: Standardized Nursing Languages (SNLs) have enabled nursing assessments and care to be better documented and visible in electronic health records (EHRs). However, its implementation is challenging and heterogeneous across clinical settings. This study aimed to demonstrate the challenges experienced by members of a European nursing organization, ACENDIO, in implementing SNLs in documentation systems across countries and offer recommendations about its use., Material and Methods: The study was executed in two phases. First, an online survey was distributed among ACENDIO members. Second, members participated in two expert panels. Discussions were recorded, and thematic analysis was performed to formulate challenges and recommendations on the use of SNLs., Results: The findings highlight that nurses across Europe are faced with several issues with current documentation systems in clinical settings, limited education on SNLs, and challenges in research on SNLs. Nurses, managers, vendors, educators and researchers should work closely together to face the challenges in the implementation of SNLs in electronic documentation systems., Conclusion: To fully utilize the beneficial effects of the use of SNLs, the call to action is to develop comprehensive collaborations of nursing practice, education, and research., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Introduction: The need for dental data in healthcare services and the inadequacy of paper records due to their inherent limitations have led to a shift towards electronic dental record systems (EDR). Implementing EDR comes with numerous barriers and challenges. Therefore, this research was conducted to identify the implementation barriers and facilitators for EDRs., Methods: This descriptive-analytical cross-sectional study was conducted on dentists working in public and private clinics in Tehran, Iran. A questionnaire consisting of three sections was designed to collect data on the demographic information of dentists, the barriers in five categories including financial barriers (6 questions), organizational barriers (11 questions), technical barriers (5 questions), personal barriers (3 questions), and ethical and legal barriers (6 questions), as well as facilitators for the implementation of EDR (15 questions) based on the literature, using a five-point Likert scale. 130 dentists from 60 dental clinics participated in the study. The data were analyzed using descriptive statistics (calculating frequency distribution, mean, and standard deviation). The mean scores were classified into four categories based on quartiles from very low importance to very high importance including very low importance (mean ≤ 1.25), low importance (1.25 ≥ mean < 2.5), important (2.5 ≥ mean < 3.75), and very high importance (mean ≥ 3.75). Finally, each of the barriers and facilitators among user dentists and non-user dentists was compared using the Mann-Whitney U test. The data were analyzed using SPSS software., Results: The findings indicate that dentists consider all barriers and challenges in implementing EDR to be important, and all the proposed facilitators for addressing these challenges to be very important. Among these important barriers are the rapid turnover of managers and policymakers at higher levels (3.69 out of 5) as a personal barrier, legal issues related to electronic records (3.65 out of 5) as an ethical-legal barrier, the lack of necessary standards for data exchange between different systems (3.64 out of 5) as a technical barrier, dentists' limited awareness of the benefits of this system (3.63 out of 5) as a personal barrier, and the lack of suitable legal infrastructure for EDR implementation (3.62 out of 5) as an ethical-legal barrier. Additionally, among the very important facilitators, training dentists and staff on EDR (4.31 out of 5) is noteworthy., Conclusion: To address the important barriers to EDR implementation, including legal-ethical barriers, legal institutions, and regulators must establish relevant laws and regulations to overcome these obstacles. Furthermore, if system users learn about the features, goals, benefits, and positive impact of EDR on their work and gain the necessary awareness, their resistance to changes will decrease, and their interest and readiness to accept EDR will increase., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Introduction: Kazakhstan has made significant strides in digital health implementation since 2013, transitioning from paper-based systems to wide implementation of digital solutions. However, challenges persist, notably the misalignment between existing data collection requirements and ongoing digital transformations. To address this obstacle, the development of a new digital-friendly requirements for health data collection at provider levels was initiated., Material and Methods: A comparative analysis of all existing requirements on health and care data collection set a foundation for further actions. A dedicated technical working group, established by the Ministry of Healthcare, oversaw this process, while several specialized expert groups participated in detailed discussions to ensure alignment with healthcare needs. We took as a basis the legislative act enforcing use of data forms inherited from pre-digital era. Data elements from most used forms were cataloged, checked for consistency, and standardized. ISO 13940 standard guided transformation of rigid paper-based forms into flexible digital-friendly data sets., Results: Analysis of the healthcare legislation reveals significant optimization opportunities. We categorized 157 forms into four groups by their content and role and focusing on clinical and administrative records for transformation. Data elements' analysis led to developing 209 standardized classifications with data values. 83 data sets, encompassing clinical and administrative domains, were developed to substitute 63 (out of 157) forms. Therefore, the foundation for better data and structure interoperability was set., Discussion: The top-down approach to digital health standardization, combined with open market policies, results in inconsistent data collection practices. Developed data sets align with the goal of developing the national Electronic Health Records system as enabler for interoperability and adds a bottom-up perspective to digital health standardization. This effort addresses the lack of guidance for digital data model development, however additional efforts required to change the current practice and finalize the national legislation transformation into digital-friendly mode., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. All conclusions or suggestions expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations. The authors alone are responsible for the views expressed in this publication, and those views do not necessarily represent the views, decisions, or policies of the World Health Organization., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background and Objective: The Internet of Medical Things (IoMT) has revolutionized telemedicine by enabling the remote monitoring and management of patient care. Nevertheless, the process of regeneration presents the difficulty of effectively prioritizing the information of emergency patients in light of the extensive amount of data generated by several integrated health care devices. The main goal of this study is to be improving the procedure of prioritizing emergency patients by implementing the Real-time Triage Optimization Framework (RTOF), an innovative method that utilizes diverse data from the Internet of Medical Things (IoMT)., Methods: The study's methodology utilized a variety of Internet of Medical Things (IoMT) data, such as sensor data and texts derived from electronic medical records. Tier 1 supplies sensor and textual data, and Tier 3 imports textual data from electronic medical records. We employed our methodologies to handle and examine data from a sample of 100,000 patients afflicted with hypertension and heart disease, employing artificial intelligence algorithms. We utilized five machine-learning algorithms to enhance the accuracy of triage., Results: The RTOF approach has remarkable efficacy in a simulated telemedicine environment, with a triage accuracy rate of 98%. The Random Forest algorithm exhibited superior performance compared to the other approaches under scrutiny. The performance characteristics attained were an accuracy rate of 98%, a precision rate of 99%, a sensitivity rate of 98%, and a specificity rate of 100%. The findings show a significant improvement compared to the present triage methods., Conclusions: The efficiency of RTOF surpasses that of existing triage frameworks, showcasing its significant ability to enhance the quality and efficacy of telemedicine solutions. This work showcases substantial enhancements compared to existing triage approaches, while also providing a scalable approach to tackle hospital congestion and optimize resource allocation in real-time. The results of our study emphasize the capacity of RTOF to mitigate hospital overcrowding, expedite medical intervention, and enable the creation of adaptable telemedicine networks. This study highlights potential avenues for further investigation into the integration of the Internet of Medical Things (IoMT) with machine learning to develop cutting-edge medical technologies., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background and Purpose: Hospital staff's acceptance of an integrated Electronic Health Records system (EHR) is a critical success factor to exploit the benefits EHRs can offer. This study employs a repeated cross-sectional design to differentiate between the enablers and barriers of EHR acceptance prior to EHR implementation and those that arise over time by testing a theoretical model specifically tailored to the EHR context., Methods: A repeated cross-sectional design, consisting of one measurement of staff's acceptance before and two after EHR implementation, was employed in a Belgian hospital. To test the theoretical model, partial least squares structural equation modelling (PLS-SEM) was used. Furthermore, partial least squares multigroup analyses (PLS-MGA) and permutation tests were applied to examine whether the relations in the model vary significantly over time., Results: The formulated model explains up to 80 % of the variance in hospital staff's attitude towards the EHR. The extent to which the EHR leads to administrative simplification outperforms the core technology acceptance variables. Furthermore, support was found for the significant role of implementation factors (i.e. communication quality and training) and prior IT experiences in explaining EHR acceptance. Finally, the results show significant evolutions in path coefficients over time. An important trade-off between effort expectancy and performance expectancy was revealed, meaning effort expectancy is the most important determinant of hospital staff's attitude towards the EHR, but once the EHR has been implemented performance expectancy becomes more important., Conclusions: The results of testing the hypothesized model reveal the importance of taking into account hospital staff's perception of the extent to which the EHR generates administrative simplification, a combination of implementation factors, and attitude towards technology in general when assessing the acceptance of an EHR. Moreover, the results highlight the importance of conducting repeated cross-sectional or longitudinal technology acceptance research as relations between core variables vary significantly over time, which implies hospital management and healthcare technology providers should adjust their policy throughout the various implementation stages., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Introduction: Benchmarking intensive care units for audit and feedback is frequently based on comparing actual mortality versus predicted mortality. Traditionally, mortality prediction models rely on a limited number of input variables and significant manual data entry and curation. Using automatically extracted electronic health record data may be a promising alternative. However, adequate data on comparative performance between these approaches is currently lacking., Methods: The AmsterdamUMCdb intensive care database was used to construct a baseline APACHE IV in-hospital mortality model based on data typically available through manual data curation. Subsequently, new in-hospital mortality models were systematically developed and evaluated. New models differed with respect to the extent of automatic variable extraction, classification method, recalibration usage and the size of collection window., Results: A total of 13 models were developed based on data from 5,077 admissions divided into a train (80%) and test (20%) cohort. Adding variables or extending collection windows only marginally improved discrimination and calibration. An XGBoost model using only automatically extracted variables, and therefore no acute or chronic diagnoses, was the best performing automated model with an AUC of 0.89 and a Brier score of 0.10., Discussion: Performance of intensive care mortality prediction models based on manually curated versus automatically extracted electronic health record data is similar. Importantly, our results suggest that variables typically requiring manual curation, such as diagnosis at admission and comorbidities, may not be necessary for accurate mortality prediction. These proof-of-concept results require replication using multi-centre data., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024. Published by Elsevier B.V.)

Background: Improved survival of patients after acute coronary syndromes, population growth, and overall life expectancy rise have led to a significant increase in the proportion of patients with stable coronary artery disease (CAD), creating a significant load on the entire healthcare system. The disease often progresses with the development of many complications while significantly increasing the likelihood of hospitalization. Developing and applying a machine learning model for predicting hospitalizations of patients with CAD to an inpatient medical facility will allow for close monitoring of high-risk patients, early preventive interventions, and optimized medical care., Aims: Development and external validation of personalized models for predicting the preventable hospitalizations of patients with stable CAD and its complications using ML algorithms and data of real-world clinical practice., Methods: 135,873 depersonalized electronic health records of 49,103 patients with stable CAD were included in the study. Anthropometric measurements, physical examination results, laboratory, instrumental, anamnestic, and socio-demographic data, widely used in routine medical practice, were considered as potential predictors, a total of 73 features. Logistic regression, decision tree-based methods including gradient boosting (AdaBoost, LightGBM, XGBoost, CatBoost) and bagging (RandomForest and ExtraTrees), discriminant analysis (LinearDiscriminant, QuadraticDiscriminant), and naive Bayes classifier were compared. External validation was performed on the data of a separate region., Results: The best results and stability to external validation data were shown by the CatBoost model with an AUC of 0.875 (95% CI 0.865-0.885) for the internal testing and 0.872 (95% CI 0.856-0.886) for the external validation. The best model showed good performance evaluated through AUROC, Brier score and standardized net benefit (for the target NPV threshold) for the validation dataset that was only slightly similar to the train data., Conclusion: The metrics of the best model were superior to previously published studies. The results of external validation demonstrated the relative stability of the model to new data from another region that confirms the possibility of the model's application in real clinical practice., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Purpose: The literature suggests predictive technology applications in health care would benefit from physician and manager input during design and development. The aim was to explore the needs and preferences of physician managers regarding the role of predictive analytics in decision support for patients with the highly complex yet common combination of multiple chronic conditions of cardiovascular (Heart) and kidney (Nephrology) diseases and diabetes (HND)., Methods: This qualitative study employed an experience-based co-design model comprised of three data gathering phases: 1. Patient mapping through non-participant observations informed by process mining of electronic health records data, 2. Semi-structured experience-based interviews, and 3. A co-design workshop. Data collection was conducted with physician managers working at or collaborating with the HND center, Danderyd University Hospital (DSAB), in Stockholm, Sweden. HND center is an integrated practice unit offering comprehensive person-centered multidisciplinary care to stabilize disease progression, reduce visits, and develop treatment strategies that enables a transition to primary care., Results: Interview and workshop data described a complex challenge due to the interaction of underlying pathophysiologies and the subsequent need for multiple care givers that hindered care continuity. The HND center partly met this challenge by coordinating care through multiple interprofessional and interdisciplinary shared decision-making interfaces. The large patient datasets were difficult to operationalize in daily practice due to data entry and retrieval issues. Predictive analytics was seen as a potentially effective approach to support decision-making, calculate risks, and improve resource utilization, especially in the context of complex chronic care, and the HND center a good place for pilot testing and development. Simplicity of visual interfaces, a better understanding of the algorithms by the health care professionals, and the need to address professional concerns, were identified as key factors to increase adoption and facilitate implementation., Conclusions: The HND center serves as a comprehensive integrated practice unit that integrates different medical disciplinary perspectives in a person-centered care process to address the needs of patients with multiple complex comorbidities. Therefore, piloting predictive technologies at the same time with a high potential for improving care represents an extreme, demanding, and complex case. The study findings show that health care professionals' involvement in the design of predictive technologies right from the outset can facilitate the implementation and adoption of such technologies, as well as enhance their predictive effectiveness and performance. Simplicity in the design of predictive technologies and better understanding of the concept and interpretation of the algorithms may result in implementation of predictive technologies in health care. Institutional efforts are needed to enhance collaboration among the health care professionals and IT professionals for effective development, implementation, and adoption of predictive analytics in health care., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Background: The long-term survival of a population assigned to a hospital can be essential to anticipate, manage, and provide appropriate hospital healthcare resources or lead preventive actions for high-risk mortality individuals. In this study, we discriminate which electronic health record variables are most relevant to predict the long-term survival of a population, and apply the results to identify high-risk mortality groups., Materials and Methods: A prospective cohort study was conducted on a population of 113,403 individuals alive on July 1st, 2018 from the General Hospital of Castellón (Spain). Considering electronic health record patients' variables and survival days from the start date of the study, a Kaplan-Meier analysis and a multivariate Cox regression model were performed, and a risk score based on Cox coefficients was applied to predict survival over 3 years., Results: All significant covariates from the Cox model (91.5% c-index) were associated with increased mortality risk. Using the proposed risk score, Kaplan-Meier curves show that survival probability in the 3rd year is 99.23% (95% confidence interval (CI) 99.18-99.29) for the low-risk, 91.21% (95% CI 90.67-91.76) for medium-risk, 76.52% (95% CI 75.59-77.46) for the high-risk, and 48.61 % (95% CI 46.85-50.36) for the very high-risk groups., Discussion: The Cox model obtained is highly predictive, and it has been found that some electronic health record variables little studied to date, such as Clinical Risk Groups, have a strong impact on survival. Regarding clinical application, the proposed risk score is particularly useful for identifying high-risk subpopulations within a large population., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)