Search

Objectives: With an increasing focus on the digitalization of health and care settings, there is significant scope to learn from international approaches to promote concerted adoption of electronic health records., Materials and Methods: We review three large-scale initiatives from Australia, Canada, and England, and extract common lessons for future health and social care transformation strategy., Results: We discuss how, despite differences in contexts, concerted adoption enables sharing of experience and learning to streamline the digital transformation of health and care., Discussion and Conclusion: Concerted adoption can be accelerated through building communities of expertise and partnerships promoting knowledge transfer and circulation of expertise; commonalities in geographical and cultural contexts; and commonalities in technological systems., (© The Author(s) 2024. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For permissions, please email: journals.permissions@oup.com.)

Objectives: Artificial intelligence (AI)-based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest., Materials and Methods: We performed semistructured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations, and Macroenvironmental factors framework., Results: We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs., Discussion: Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure., Conclusion: The socio-organizational factors affecting performance of diagnostic AI are under-researched and require attention and further research., (© The Author(s) 2023. Published by Oxford University Press on behalf of the American Medical Informatics Association.)

Objectives: To identify interventions implemented in hospital electronic prescribing systems and the outcome measures used to monitor their impact., Methods: We systematically searched CINAHL, EMBASE, Google Scholar and Medline using keywords in three strands: (i) population: hospital inpatient or emergency department; (ii) intervention: electronic prescribing functionality; and (iii) outcome: antimicrobial stewardship. The interventions were grouped into six themes: alerts, order sets, restriction of access, mandated documentation, embedded guidelines and automatic prescription stop. The outcome measures were organized into those that measure the quality or quantity of prescribing or clinical decision support (CDS) activity. The impact of each intervention reported was grouped into a positive, negative or no change., Results: A total of 28 studies were eligible for inclusion. There were 28 different interventions grouped into the six themes. Alerts visible to the practitioner in the electronic health record (EHR) were most frequently implemented ( n  = 11/28). Twenty different outcome measures were identified, divided into quality ( n  = 13/20) and quantity outcomes ( n  = 4/20) and CDS activity ( n  = 3/20). One-third of outcomes reported across the 28 studies showed positive change (34.4%, n  = 42/122) and 61.4% ( n  = 75/122) showed no change., Conclusions: The most frequently implemented interventions were alerts, the majority of which were to influence behaviour or decision-making of the practitioner within the EHR. Quality outcomes were most frequently selected by researchers. The review supports previous research that larger well-designed randomized studies are needed to investigate the impact of interventions on AMS and outcome measures to be standardized., (© The Author(s) 2022. Published by Oxford University Press on behalf of British Society for Antimicrobial Chemotherapy.)

Background: The Global Digital Exemplar (GDE) Programme is a national initiative to promote digitally enabled transformation in English provider organizations. The Programme applied benefits realization management techniques to promote and demonstrate transformative outcomes. This work was part of an independent national evaluation of the GDE Programme., Aims: We explored how benefits realization management was approached and conceptualized in the GDE Programme., Methods: We conducted a series of 36 longitudinal case studies of provider organizations participating in the GDE Programme, 12 of which were in depth. Data collection included a combination of 628 interviews (with implementation staff in provider organizations, national programme management staff, and suppliers), 499 documents (of national and local implementation plans and lessons learned), and 190 nonparticipant observations (of national and local programme management meetings to develop insights into the broader context of benefits realization activities, tensions arising, and how these were negotiated). Data were coded drawing on a sociotechnical framework developed in related work and thematically analyzed, initially within and then across cases, with the help of NVivo 11 software., Results: Most stakeholders broadly agreed with the rationale of benefits realization in the GDE Programme to show due diligence that public money was appropriately spent, and to develop an evidence base supporting the value of digitally enabled transformation. Differing national and local reporting purposes, however, created tensions. Central requirements, for progress reporting and tracking high-level benefits, had limited perceived local value and were seen to impose an unnecessary burden on provider organizations. This was accentuated by the lack of harmonization of reporting requirements to different stakeholders (which differed in content and timing). There were tensions between the desire for early evidence of outcomes and the slow processes of infrastructural change (which created problems of attribution of benefits to causes as benefits emerged gradually and over long timeframes), and also between reporting immediately visible local changes and showing how these flowed through to high level organization wide benefits (eg, in terms of health outcomes or cost savings/return on investment). The attempt to fulfill these diverging agendas and informational needs within a single reporting tool had limited success. These difficulties were mitigated by efforts to simplify reporting requirements and to support targeted collection of key national outcome measures. Although progress was hampered by an initial lack of benefits realization expertise in provider organizations, some providers subsequently retained these skills for their own change management purposes., Conclusions: There is a need to recognize the limitations and cost of benefits realization management practices in the context of healthcare digitalization where benefits may materialize over long timeframes and in unanticipated ways. Although diverse stakeholder information needs may create tensions, prior agreement about rationales for collecting information and a targeted approach to tracking local and high-level benefits may enhance local relevance, reduce perceived reporting burdens, and improve acceptance/effectiveness. A single integrated reporting mechanism is unlikely to fulfill both national and local requirements., (© The Author(s) 2021. Published by Oxford University Press on behalf of the American Medical Informatics Association.)

Objective: The Global Digital Exemplar (GDE) Program is a national attempt to accelerate digital maturity in healthcare providers through promoting knowledge transfer across the English National Health Service (NHS). "Blueprints"-documents capturing implementation experience-were intended to facilitate this knowledge transfer. Here we explore how Blueprints have been conceptualized, produced, and used to promote interorganizational knowledge transfer across the NHS., Materials and Methods: We undertook an independent national qualitative evaluation of the GDE Program. This involved collecting data using semistructured interviews with implementation staff and clinical leaders in provider organizations, nonparticipant observation of meetings, and key documents. We also attended a range of national meetings and conferences, interviewed national program managers, and analyzed a range of policy documents. Our analysis drew on sociotechnical principles, combining deductive and inductive methods., Results: Data comprised 508 interviews, 163 observed meetings, and analysis of 325 documents. We found little evidence of Blueprints being adopted in the manner originally conceived by national program managers. However, they proved effective in different ways to those planned. As well as providing a helpful initial guide to a topic, we found that Blueprints served as a method of identifying relevant expertise that paved the way for subsequent discussions and richer knowledge transfers amongst provider organizations. The primary value of Blueprinting, therefore, seemed to be its role as a networking tool. Members of different organizations came together in developing, applying, and sustaining Blueprints through bilateral conversations-in some circumstances also fostering informal communities of practice., Conclusions: Blueprints may be effective in facilitating knowledge transfer among healthcare organizations, but need to be accompanied by other evolving methods, such as site visits and other networking activities, to iteratively transfer knowledge and experience., (© The Author(s) 2021. Published by Oxford University Press on behalf of the American Medical Informatics Association.)

Objective: To identify approaches of using stand-alone and more integrated hospital ePrescribing systems to promote and support the appropriate use of antibiotics, and identify gaps in order to inform future efforts in this area., Methods: A systematic scoping review of the empirical literature from 1997 until 2015, searching the following databases: MEDLINE, EMBASE, Cochrane Database of Systematic Reviews, Google Scholar, Clinical Trials, International Standard Randomised Controlled Trial Number Registry, Economic Evaluation database and International Prospective Register of Systematic Reviews. Search terms related to different components of systems, hospital settings and antimicrobial stewardship. Two reviewers independently screened papers and mutually agreed papers for inclusion. We undertook an interpretive synthesis., Key Findings: We identified 143 papers. The majority of these were single-centre observational studies from North American settings with a wide range of system functionalities. Most evidence related to computerised decision support (CDS) and computerised physician order entry (CPOE) functionalities, of which many were extensively customised. We also found some limited work surrounding integration with laboratory results, pharmacy systems and organisational surveillance. Outcomes examined included healthcare professional performance, patient outcomes and health economic evaluations. We found at times conflicting conclusions surrounding effectiveness, which may be due to heterogeneity of populations, technologies and outcomes studied. Reports of unintended consequences were limited., Conclusions: Interventions are centred on CPOE and CDS, but also include additional functionality aiming to support various facets of the medicines management process. Wider organisational dimensions appear important to supporting adoption. Evaluations should consider processes, clinical, economic and safety outcomes in order to generate generalisable insights into safety, effectiveness and cost-effectiveness., (© 2016 Royal Pharmaceutical Society.)

Objective: To understand the evolving market of commercial off-the-shelf Computerized Physician Order Entry (CPOE) and Computerized Decision Support (CDS) applications and its effects on their uptake and implementation in English hospitals., Methods: Although CPOE and CDS vendors have been quick to enter the English market, uptake has been slow and uneven. To investigate this, the authors undertook qualitative ethnography of vendors and adopters of hospital CPOE/CDS systems in England. The authors collected data from semi-structured interviews with 11 individuals from 4 vendors, including the 2 most entrenched suppliers, and 6 adopter hospitals, and 21 h of ethnographic observation of 2 user groups, and 1 vendor event. The research and analysis was informed by insights from studies of the evolution of technology fields and the emergence of generic COTS enterprise solutions., Results: Four key themes emerged: (1) adoption of systems that had been developed outside of England, (2) vendors' configuration and customization strategies, (3) localized adopter practices vs generic systems, and (4) unrealistic adopter demands. Evidence for our over-arching finding concerning the current immaturity of the market was derived from vendors' strategies, adopters' reactions to the technology, and policy makers' incomplete insights., Conclusions: The CPOE/CDS market in England is still in an emergent phase. The rapid entrance of diverse products, triggered by federal policy initiatives, has resulted in premature adoption of systems that do not yet adequately meet the needs of hospitals. Vendors and adopters lacked understanding of how to design and implement generic solutions to meet diverse user needs., (© The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.)

Objective: We aimed to explore stakeholder views, attitudes, needs, and expectations regarding likely benefits and risks resulting from increased structuring and coding of clinical information within electronic health records (EHRs)., Materials and Methods: Qualitative investigation in primary and secondary care and research settings throughout the UK. Data were derived from interviews, expert discussion groups, observations, and relevant documents. Participants (n=70) included patients, healthcare professionals, health service commissioners, policy makers, managers, administrators, systems developers, researchers, and academics., Results: Four main themes arose from our data: variations in documentation practice; patient care benefits; secondary uses of information; and informing and involving patients. We observed a lack of guidelines, co-ordination, and dissemination of best practice relating to the design and use of information structures. While we identified immediate benefits for direct care and secondary analysis, many healthcare professionals did not see the relevance of structured and/or coded data to clinical practice. The potential for structured information to increase patient understanding of their diagnosis and treatment contrasted with concerns regarding the appropriateness of coded information for patients., Conclusions: The design and development of EHRs requires the capture of narrative information to reflect patient/clinician communication and computable data for administration and research purposes. Increased structuring and/or coding of EHRs therefore offers both benefits and risks. Documentation standards within clinical guidelines are likely to encourage comprehensive, accurate processing of data. As data structures may impact upon clinician/patient interactions, new models of documentation may be necessary if EHRs are to be read and authored by patients.

Objective: Computerized decision support systems (CDSS) are commonly deployed to support prescribing, although over-riding of alerts by prescribers remains a concern. We aimed to understand how general practitioners (GPs) interact with prescribing CDSS in order to inform deliberation on how better to support prescribing decisions in primary care., Materials and Methods: Quantitative and qualitative analysis of interactions between GPs, patients, and computer systems using multi-channel video recordings of 112 primary care consultations with eight GPs in three UK practices., Results: 132 prescriptions were issued in the course of 73 of the consultations, of which 81 (61%) attracted at least one alert. Of the total of 117 alerts, only three resulted in the GP checking, but not altering, the prescription. CDSS provided information and safety alerts at the point of generating a prescription. This was 'too much, too late' as the majority of the 'work' of prescribing occurred prior to using the computer. By the time an alert appeared, the GP had formulated the problem(s), potentially spent several minutes considering, explaining, negotiating, and reaching agreement with the patient about the proposed treatment, and had possibly given instructions and printed an information leaflet., Discussion: CDSS alerts do not coincide with the prescribing workflow throughout the whole GP consultation. Current systems interrupt to correct decisions that have already been taken, rather than assisting formulation of the management plan., Conclusions: CDSS are likely to be more acceptable and effective if the prescribing support is provided much earlier in the process of generating a prescription.