Search

Objective We describe the Clickbusters initiative implemented at Vanderbilt University Medical Center (VUMC), which was designed to improve safety and quality and reduce burnout through the optimization of clinical decision support (CDS) alerts. Materials and Methods We developed a 10-step Clickbusting process and implemented a program that included a curriculum, CDS alert inventory, oversight process, and gamification. We carried out two 3-month rounds of the Clickbusters program at VUMC. We completed descriptive analyses of the changes made to alerts during the process, and of alert firing rates before and after the program. Results Prior to Clickbusters, VUMC had 419 CDS alerts in production, with 488 425 firings (42 982 interruptive) each week. After 2 rounds, the Clickbusters program resulted in detailed, comprehensive reviews of 84 CDS alerts and reduced the number of weekly alert firings by more than 70 000 (15.43%). In addition to the direct improvements in CDS, the initiative also increased user engagement and involvement in CDS. Conclusions At VUMC, the Clickbusters program was successful in optimizing CDS alerts by reducing alert firings and resulting clicks. The program also involved more users in the process of evaluating and improving CDS and helped build a culture of continuous evaluation and improvement of clinical content in the electronic health record.

Objective The goals of this study are to describe the value and impact of Project HealthDesign (PHD), a program of the Robert Wood Johnson Foundation that applied design thinking to personal health records, and to explore the applicability of the PHD model to another challenging translational informatics problem: the integration of AI into the healthcare system. Materials and Methods We assessed PHD’s impact and value in 2 ways. First, we analyzed publication impact by calculating a PHD h-index and characterizing the professional domains of citing journals. Next, we surveyed and interviewed PHD grantees, expert consultants, and codirectors to assess the program’s components and the potential future application of design thinking to artificial intelligence (AI) integration into healthcare. Results There was a total of 1171 unique citations to PHD-funded work (collective h-index of 25). Studies citing PHD span medical, legal, and computational journals. Participants stated that this project transformed their thinking, altered their career trajectory, and resulted in technology transfer into the commercial sector. Participants felt, in general, that the approach would be valuable in solving contemporary challenges integrating AI in healthcare including complex social questions, integrating knowledge from multiple domains, implementation, and governance. Conclusion Design thinking is a systematic approach to problem-solving characterized by cooperation and collaboration. PHD generated significant impacts as measured by citations, reach, and overall effect on participants. PHD’s design thinking methods are potentially useful to other work on cyber–physical systems, such as the use of AI in healthcare, to propose structural or policy-related changes that may affect adoption, value, and improvement of the care delivery system.

Objective The study sought to provide physicians, informaticians, and institutional policymakers with an introductory tutorial about the history of medical documentation, sources of clinician burnout, and opportunities to improve electronic health records (EHRs). We now have unprecedented opportunities in health care, with the promise of new cures, improved equity, greater sensitivity to social and behavioral determinants of health, and data-driven precision medicine all on the horizon. EHRs have succeeded in making many aspects of care safer and more reliable. Unfortunately, current limitations in EHR usability and problems with clinician burnout distract from these successes. A complex interplay of technology, policy, and healthcare delivery has contributed to our current frustrations with EHRs. Fortunately, there are opportunities to improve the EHR and health system. A stronger emphasis on improving the clinician’s experience through close collaboration by informaticians, clinicians, and vendors can combine with specific policy changes to address the causes of burnout. Target audience This tutorial is intended for clinicians, informaticians, policymakers, and regulators, who are essential participants in discussions focused on improving clinician burnout. Learners in biomedicine, regardless of clinical discipline, also may benefit from this primer and review. Scope We include (1) an overview of medical documentation from a historical perspective; (2) a summary of the forces converging over the past 20 years to develop and disseminate the modern EHR; and (3) future opportunities to improve EHR structure, function, user base, and time required to collect and extract information.

Our goal is to summarize the collective experience of 15 organizations in dealing with uncoordinated efforts that result in unnecessary delays in understanding, predicting, preparing for, containing, and mitigating the COVID-19 pandemic in the US. Response efforts involve the collection and analysis of data corresponding to healthcare organizations, public health departments, socioeconomic indicators, as well as additional signals collected directly from individuals and communities. We focused on electronic health record (EHR) data, since EHRs can be leveraged and scaled to improve clinical care, research, and to inform public health decision-making. We outline the current challenges in the data ecosystem and the technology infrastructure that are relevant to COVID-19, as witnessed in our 15 institutions. The infrastructure includes registries and clinical data networks to support population-level analyses. We propose a specific set of strategic next steps to increase interoperability, overall organization, and efficiencies

ObjectiveUnderstanding how to identify the social determinants of health from electronic health records (EHRs) could provide important insights to understand health or disease outcomes. We developed a methodology to capture 2 rare and severe social determinants of health, homelessness and adverse childhood experiences (ACEs), from a large EHR repository.Materials and MethodsWe first constructed lexicons to capture homelessness and ACE phenotypic profiles. We employed word2vec and lexical associations to mine homelessness-related words. Next, using relevance feedback, we refined the 2 profiles with iterative searches over 100 million notes from the Vanderbilt EHR. Seven assessors manually reviewed the top-ranked results of 2544 patient visits relevant for homelessness and 1000 patients relevant for ACE.Resultsword2vec yielded better performance (area under the precision-recall curve [AUPRC] of 0.94) than lexical associations (AUPRC = 0.83) for extracting homelessness-related words. A comparative study of searches for the 2 phenotypes revealed a higher performance achieved for homelessness (AUPRC = 0.95) than ACE (AUPRC = 0.79). A temporal analysis of the homeless population showed that the majority experienced chronic homelessness. Most ACE patients suffered sexual (70%) and/or physical (50.6%) abuse, with the top-ranked abuser keywords being “father” (21.8%) and “mother” (15.4%). Top prevalent associated conditions for homeless patients were lack of housing (62.8%) and tobacco use disorder (61.5%), while for ACE patients it was mental disorders (36.6%–47.6%).ConclusionWe provide an efficient solution for mining homelessness and ACE information from EHRs, which can facilitate large clinical and genetic studies of these social determinants of health.

Objective To assess the state of readiness for the adoption of paperless labeling among a nationally representative sample of pharmacies, including chain pharmacies, independent retail pharmacies, hospitals, and other rural or urban dispensing sites. Methods Both quantitative and qualitative analyses were used to analyze responses to a cross-sectional survey disseminated to American Pharmacists Association pharmacists nationwide. The survey assessed factors related to pharmacists' attitudinal readiness (ie, perceptions of impact) and pharmacies' structural readiness (eg, availability of electronic resources, internet access) for the paperless labeling initiative. Results We received a total of 436 survey responses (6% response rate) from pharmacists representing 44 US states and territories. Across the spectrum of settings we studied, pharmacists had work access to computers, printers, fax machines and access to the internet or intranet. Approximately 79% of respondents believed that the initiative would improve the adequacy of drug information available in their work site and 95% believed it would either not change (33%) or would improve (62%) communication to patients. Overall, respondents' comments supported advancing the initiative; however, some comments revealed reservations regarding corporate or pharmacy buy-in, success of implementation, and ease of adoption. Conclusions This is the first nationwide study to report about pharmacists' perspectives on paperless labeling. In general, pharmacists believe they are ready and that their pharmacies are well equipped for the transition to paperless labeling. Further exploration of perspectives from product label manufacturers and corporate pharmacy offices is needed to understand fully what will be necessary to complete this transition.

Objective To examine the financial impact health information exchange (HIE) in emergency departments (EDs). Materials and Methods We studied all ED encounters over a 13-month period in which HIE data were accessed in all major emergency departments Memphis, Tennessee. HIE access encounter records were matched with similar encounter records without HIE access. Outcomes studied were ED-originated hospital admissions, admissions for observation, laboratory testing, head CT, body CT, ankle radiographs, chest radiographs, and echocardiograms. Our estimates employed generalized estimating equations for logistic regression models adjusted for admission type, length of stay, and Charlson co-morbidity index. Marginal probabilities were used to calculate changes in outcome variables and their financial consequences. Results HIE data were accessed in approximately 6.8% of ED visits across 12 EDs studied. In 11 EDs directly accessing HIE data only through a secure Web browser, access was associated with a decrease in hospital admissions (adjusted odds ratio (OR)=0.27; p

Explicit guidelines are needed to develop safe and effective patient portals. This paper proposes general principles, policies, and procedures for patient portal functionality based on MyHealthAtVanderbilt (MHAV), a robust portal for Vanderbilt University Medical Center. We describe policies and procedures designed to govern popular portal functions, address common user concerns, and support adoption. We present the results of our approach as overall and function-specific usage data. Five years after implementation, MHAV has over 129,800 users; 45% have used bi-directional messaging; 52% have viewed test results and 45% have viewed other medical record data; 30% have accessed health education materials; 39% have scheduled appointments; and 29% have managed a medical bill. Our policies and procedures have supported widespread adoption and use of MHAV. We believe other healthcare organizations could employ our general guidelines and lessons learned to facilitate portal implementation and usage.

Objective The goal of this study was to develop an in-depth understanding of how a health information exchange (HIE) fits into clinical workflow at multiple clinical sites. Materials and Methods The ethnographic qualitative study was conducted over a 9-month period in six emergency departments (ED) and eight ambulatory clinics in Memphis, Tennessee, USA. Data were collected using direct observation, informal interviews during observation, and formal semi-structured interviews. The authors observed for over 180 h, during which providers used the exchange 130 times. Results HIE-related workflow was modeled for each ED site and ambulatory clinic group and substantial site-to-site workflow differences were identified. Common patterns in HIE-related workflow were also identified across all sites, leading to the development of two role-based workflow models: nurse based and physician based. The workflow elements framework was applied to the two role-based patterns. An in-depth description was developed of how providers integrated HIE into existing clinical workflow, including prompts for HIE use. Discussion Workflow differed substantially among sites, but two general role-based HIE usage models were identified. Although providers used HIE to improve continuity of patient care, patient–provider trust played a significant role. Types of information retrieved related to roles, with nurses seeking to retrieve recent hospitalization data and more open-ended usage by nurse practitioners and physicians. User and role-specific customization to accommodate differences in workflow and information needs may increase the adoption and use of HIE. Conclusion Understanding end users' perspectives towards HIE technology is crucial to the long-term success of HIE. By applying qualitative methods, an in-depth understanding of HIE usage was developed.

Objective Health information exchange (HIE) systems are being developed across the nation. Understanding approaches taken by existing successful exchanges can help new exchange efforts determine goals and plan implementations. The goal of this study was to explore characteristics of use and users of a successful regional HIE. Design We used a mixed-method analysis, consisting of cross-sectional audit log data, semi-structured interviews, and direct observation in a sample of emergency departments and ambulatory safety net clinics actively using HIE. For each site, we measured overall usage trends, user logon statistics, and data types accessed by users. We also assessed reasons for use and outcomes of use. Results Overall, users accessed HIE for 6.8% of all encounters, with higher rates of access for repeat visits, for patients with comorbidities, for patients known to have data in the exchange, and at sites providing HIE access to both nurses and physicians. Discharge summaries and test reports were the most frequently accessed data in the exchange. Providers consistently noted retrieving additional history, preventing repeat tests, comparing new results to retrieved results, and avoiding hospitalizations as a consequence of HIE access. Conclusion HIE use in emergency departments and ambulatory clinics was focused on patients where missing information was believed to be present in the exchange and was related to factors including the roles of people with access, the setting, and other site-specific issues that impacted the overall breadth of routine system use. These data should form an important foundation as other sites embark upon HIE implementation.

Clinical documentation is central to patient care. The success of electronic health record system adoption may depend on how well such systems support clinical documentation. A major goal of integrating clinical documentation into electronic heath record systems is to generate reusable data. As a result, there has been an emphasis on deploying computer-based documentation systems that prioritize direct structured documentation. Research has demonstrated that healthcare providers value different factors when writing clinical notes, such as narrative expressivity, amenability to the existing workflow, and usability. The authors explore the tension between expressivity and structured clinical documentation, review methods for obtaining reusable data from clinical notes, and recommend that healthcare providers be able to choose how to document patient care based on workflow and note content needs. When reusable data are needed from notes, providers can use structured documentation or rely on post-hoc text processing to produce structured data, as appropriate.

The objective of this review was to describe methods used to study and model workflow. The authors included studies set in a variety of industries using qualitative, quantitative and mixed methods. Of the 6221 matching abstracts, 127 articles were included in the final corpus. The authors collected data from each article on researcher perspective, study type, methods type, specific methods, approaches to evaluating quality of results, definition of workflow and dependent variables. Ethnographic observation and interviews were the most frequently used methods. Long study durations revealed the large time commitment required for descriptive workflow research. The most frequently discussed technique for evaluating quality of study results was triangulation. The definition of the term “workflow” and choice of methods for studying workflow varied widely across research areas and researcher perspectives. The authors developed a conceptual framework of workflow-related terminology for use in future research and present this model for use by other researchers.

Medication information is one of the most important types of clinical data in electronic medical records. It is critical for healthcare safety and quality, as well as for clinical research that uses electronic medical record data. However, medication data are often recorded in clinical notes as free-text. As such, they are not accessible to other computerized applications that rely on coded data. We describe a new natural language processing system (MedEx), which extracts medication information from clinical notes. MedEx was initially developed using discharge summaries. An evaluation using a data set of 50 discharge summaries showed it performed well on identifying not only drug names (F-measure 93.2%), but also signature information, such as strength, route, and frequency, with F-measures of 94.5%, 93.9%, and 96.0% respectively. We then applied MedEx unchanged to outpatient clinic visit notes. It performed similarly with F-measures over 90% on a set of 25 clinic visit notes.

Objective: Clinical notes, typically written in natural language, often contain substructure that divides them into sections, such as “History of Present Illness” or “Family Medical History.” The authors designed and evaluated an algorithm (“SecTag”) to identify both labeled and unlabeled (implied) note section headers in “history and physical examination” documents (“H&P notes”). Design: The SecTag algorithm uses a combination of natural language processing techniques, word variant recognition with spelling correction, terminology-based rules, and naive Bayesian scoring methods to identify note section headers. Eleven physicians evaluated SecTag's performance on 319 randomly chosen H&P notes. Measurements: The primary outcomes were the algorithm's recall and precision in identifying all document sections and a predefined list of twenty-nine major sections. A secondary outcome was to evaluate the algorithm's ability to recognize the correct start and end boundaries of identified sections. Results: The SecTag algorithm identified 16,036 total sections and 7,858 major sections. Physician evaluators classified 15,329 as true positives and identified 160 sections omitted by SecTag. The recall and precision of the SecTag algorithm were 99.0 and 95.6% for all sections, 98.6 and 96.2% for major sections, and 96.6 and 86.8% for unlabeled sections. The algorithm determined the correct starting and ending text boundaries for 94.8% of labeled sections and 85.9% of unlabeled sections. Conclusions: The SecTag algorithm accurately identified both labeled and unlabeled sections in history and physical documents. This type of algorithm may assist in natural language processing applications, such as clinical decision support systems or competency assessment for medical trainees.

To facilitate the future implementation of an electronic prescribing system, this case study modeled prescription management processes in various primary care settings. The Vanderbilt e-prescribing design team conducted initial interviews with clinic managers, physicians and nurses, and then represented the sequences of steps carried out to complete prescriptions in activity diagrams. The diagrams covered outpatient prescribing for patients during a clinic visit and between clinic visits. Practice size, practice setting, and practice specialty type influenced the prescribing processes used. The model developed may be useful to others engaged in building or tailoring an e-prescribing system to meet the specific workflows of various clinic settings.

Previous investigators have defined clinical interface terminology as a systematic collection of health care–related phrases (terms) that supports clinicians' entry of patient-related information into computer programs, such as clinical “note capture” and decision support tools. Interface terminologies also can facilitate display of computer-stored patient information to clinician-users. Interface terminologies “interface” between clinicians' own unfettered, colloquial conceptualizations of patient descriptors and the more structured, coded internal data elements used by specific health care application programs. The intended uses of a terminology determine its conceptual underpinnings, structure, and content. As a result, the desiderata for interface terminologies differ from desiderata for health care–related terminologies used for storage (e.g., SNOMED-CT®), information retrieval (e.g., MeSH), and classification (e.g., ICD9-CM®). Necessary but not sufficient attributes for an interface terminology include adequate synonym coverage, presence of relevant assertional knowledge, and a balance between pre- and post-coordination. To place interface terminologies in context, this article reviews historical goals and challenges of clinical terminology development in general and then focuses on the unique features of interface terminologies.

Objectives: Web-based applications have been developed that allow patients to enter their own information into secure personal health records. These applications are being promoted as a means of providing patients and providers with universal access to updated medical information. The authors evaluated the functionality and utility of a selection of personal health records. Design: A targeted search strategy was used to identify eleven Web sites promoting different personal health records. Specific criteria related to the entry and display of data elements were developed to evaluate the functionality of each PHR. Information abstracted from an actual case was used to create a series of representative PHRs. Output generated for review was evaluated to assess the accuracy and completeness of clinical information related to the diagnosis and treatment of specific disorders. Results: The PHRs selected for review employed data entry methods that limited the range and content of patient-entered information related to medical history, medications, laboratory tests, diagnostic studies, and immunizations. Representative PHRs created with information abstracted from an actual case displayed varying amounts of information at basic and comprehensive levels of representation. Conclusions: Currently available PHRs demonstrate limited functionality. The data entry, validation, and information display methods they employ may limit their utility as representations of medical information.

Perl Programming for Biologists. By D. Curtis Jamison . Hoboken, NJ: John Wiley & Sons, Inc., 2003; 191 pages; $42.95 D. Curtis Jamison, PhD, an associate professor in the School of Computational Science at George Mason University in Manassas, Virginia, wrote the book Perl Programming for Biologists . Perl is an open-source interpreted scripting language originally designed for Unix systems programming by Larry Wall about 25 years ago. Due in large part to its powerful regular expressions for pattern matching and its accessibility for nonprogrammers, Perl has become the most popular programming language in bioinformatics. The goal of this book is to provide the reader with the background and tools necessary to write scripts of immediate practical value to his or her work. It is Dr. Jamison's long-held desire to see full integration of computer technology into the experimental protocol that he brings to Perl Programming for Biologists . That desire translates into a very accessible text, which any biomedical researcher lacking programming experience would find a quick and painless primer. This book clearly targets that audience, and in so doing is too elementary for most researchers with intermediate or advanced programming experience. Furthermore, …

Handheld Computers for Doctors. By Mohammad Al-Ubaydli . West Sussex, England: John Wiley & Sons, Ltd., 2003; $35 Mohammad Al-Ubaydli, MD, a Visiting Research Fellow at the National Center for Biotechnology Information (NCBI) in Washington, DC, recently has published an information guide entitled Handheld Computers for Doctors . A handheld computer, also known as a personal digital assistant (PDA), is defined in this report as “a computer that is small enough to hold in your hand, or keep in your pocket.” This book addresses four main topics: What is a handheld computer? What utility does it provide for personal organization and clinical information management? What are some practical applications of networked handhelds in the clinical setting? How does an individual become a successful handheld computer project champion? The book is arranged into three sections that are well organized to address these questions. The first section, termed Why Star Trek Is Science Past , is clearly targeted at clinicians who are skeptical about the technology or who recently became new users of handheld computers. Dr. Al-Ubaydli provides insight into choosing basic hardware and software, and covers both Palm and PocketPC handheld computer environments. Some of the general functions covered include personal organization (calendar, address book, and notepad), …