Search

BackgroundIn Peru, a majority of individuals bypass primary care facilities even for routine services. Efforts to strengthen primary care must be informed by understanding of current practice. We conducted a time motion assessment in primary care facilities in Lima with the goals of assessing the feasibility of this method in an urban health care setting in Latin America and of providing policy makers with empirical evidence on the use of health care provider time in primary care.MethodsThis cross-sectional continuous observation time motion study took place from July - September 2019. We used two-stage sampling to draw a sample of shifts for doctors, nurses, and midwives in primary health facilities and applied the Work Observation Method by Activity Timing tool to capture type and duration of provider activities over a 6-h shift. We summarized time spent on patient care, paper and electronic record-keeping, and non-work (personal and inactive) activities across provider cadres. Observations are weighted by inverse probability of selection.ResultsTwo hundred seventy-five providers were sampled from 60 facilities; 20% could not be observed due to provider absence (2% schedule error, 8% schedule change, 10% failure to appear). One hundred seventy-four of the 220 identified providers consented (79.1%) and were observed for a total of 898 h of provider time comprising 30,312 unique tasks. Outpatient shifts included substantial time on patient interaction (110, 82, and 130 min for doctors, nurses, and midwives respectively) and on paper records (132, 97, and 141 min) on average. Across all shifts, 1 in 6 h was spent inactive or on personal activities. Two thirds of midwives used computers compared to half of nurses and one third of doctors.ConclusionsThe time motion study is a feasible method to capture primary care operations in Latin American countries and inform health system strengthening. In the case of Lima, absenteeism undermines health worker availability in primary care facilities, and inactive time further erodes health workforce availability. Productive time is divided between patient-facing activities and a substantial burden of paper-based record keeping for clinical and administrative purposes. Electronic health records remain incompletely integrated within routine care, particularly beyond midwifery.

BackgroundHealth information systems are central to strong health systems. They assist with patient and program management, quality improvement, disease surveillance, and strategic use of information. Many donors have worked to improve health information systems, particularly by supporting the introduction of electronic health information systems (EHIS), which are considered more responsive and more efficient than older, paper-based systems. As many donor-driven programs are increasing their focus on country ownership, sustainability of these investments is a key concern. This analysis explores the potential sustainability of EHIS investments in Malawi, Zambia and Zimbabwe, originally supported by the United States President's Emergency Plan for AIDS Relief (PEPFAR).MethodsUsing a framework based on sustainability theories from the health systems literature, this analysis employs a qualitative case study methodology to highlight factors that may increase the likelihood that donor-supported initiatives will continue after the original support is modified or ends.ResultsFindings highlight commonalities around possible determinants of sustainability. The study found that there is great optimism about the potential for EHIS, but the perceived risks may result in hesitancy to transition completely and parallel use of paper-based systems. Full stakeholder engagement is likely to be crucial for sustainability, as well as integration with other activities within the health system and those funded by development partners. The literature suggests that a sustainable system has clearly-defined goals around which stakeholders can rally, but this has not been achieved in the systems studied. The study also found that technical resource constraints - affecting system usage, maintenance, upgrades and repairs - may limit EHIS sustainability even if these other pillars were addressed.ConclusionsThe sustainability of EHIS faces many challenges, which could be addressed through systems' technical design, stakeholder coordination, and the building of organizational capacity to maintain and enhance such systems. All of this requires time and attention, but is likely to enhance long-term outcomes.

BackgroundHealth information systems are central to strong health systems. They assist with patient and program management, quality improvement, disease surveillance, and strategic use of information. Many donors have worked to improve health information systems, particularly by supporting the introduction of electronic health information systems (EHIS), which are considered more responsive and more efficient than older, paper-based systems. As many donor-driven programs are increasing their focus on country ownership, sustainability of these investments is a key concern. This analysis explores the potential sustainability of EHIS investments in Malawi, Zambia and Zimbabwe, originally supported by the United States President's Emergency Plan for AIDS Relief (PEPFAR).MethodsUsing a framework based on sustainability theories from the health systems literature, this analysis employs a qualitative case study methodology to highlight factors that may increase the likelihood that donor-supported initiatives will continue after the original support is modified or ends.ResultsFindings highlight commonalities around possible determinants of sustainability. The study found that there is great optimism about the potential for EHIS, but the perceived risks may result in hesitancy to transition completely and parallel use of paper-based systems. Full stakeholder engagement is likely to be crucial for sustainability, as well as integration with other activities within the health system and those funded by development partners. The literature suggests that a sustainable system has clearly-defined goals around which stakeholders can rally, but this has not been achieved in the systems studied. The study also found that technical resource constraints - affecting system usage, maintenance, upgrades and repairs - may limit EHIS sustainability even if these other pillars were addressed.ConclusionsThe sustainability of EHIS faces many challenges, which could be addressed through systems' technical design, stakeholder coordination, and the building of organizational capacity to maintain and enhance such systems. All of this requires time and attention, but is likely to enhance long-term outcomes.

BackgroundUptake of HIV pre-exposure prophylaxis (PrEP) remains low among transgender people as compared to other subgroups, despite high rates of HIV acquisition. In California, Latinx people comprise 40% of the population and Latina transgender women experience some of the highest burden of HIV of any subgroup, indicating a critical need for appropriate services. With funding from the California HIV/AIDS Research Programs, this academic-community partnership developed, implemented, and evaluated a PrEP project that co-located HIV services with gender affirming care in a Federally Qualified Heath Center (FQHC). Trans and Latinx staff led intervention adaptation and activities.MethodsThis paper engages qualitative methods to describe how a PrEP demonstration project- Triunfo- successfully engaged Spanish-speaking transgender Latinas in services. We conducted 13 in-depth interviews with project participants and five interviews with providers and clinic staff. Interviews were conducted in Spanish or English. We conducted six months of ethnographic observation of intervention activities and recorded field notes. We conducted thematic analysis.ResultsBeneficial elements of the intervention centered around three intertwined themes: creating trusted space, providing comprehensive patient navigation, and offering social support "entre nosotras" ("between us women/girls"). The combination of these factors contributed to the intervention's success supporting participants to initiate and persist on PrEP, many of whom had previously never received healthcare. Participants shared past experiences with transphobia and concerns around discrimination in a healthcare setting. Developing trust proved foundational to making participants feel welcome and "en casa/ at home" in the healthcare setting, which began from the moment participants entered the clinic and continued throughout their interactions with staff and providers. A gender affirming, bilingual clinician and peer health educators (PHE) played a critical part in intervention development, participant recruitment, and patient navigation.ConclusionsOur research adds nuance to the existing literature on peer support services and navigation by profiling the multifaced roles that PHE served for participants. PHE proved instrumental to empowering participants to overcome structural and other barriers to healthcare, successfully engaging a group who previously avoided healthcare in clinical settings.

BackgroundIn 2020, the Health Resources and Services Administration's HIV/AIDS Bureau funded an initiative to promote implementation of rapid antiretroviral therapy initiation in 14 HIV treatment settings across the U.S. The goal of this initiative is to accelerate uptake of this evidence-based strategy and provide an implementation blueprint for other HIV care settings to reduce the time from HIV diagnosis to entry into care, for re-engagement in care for those out of care, initiation of treatment, and viral suppression. As part of the effort, an evaluation and technical assistance provider (ETAP) was funded to study implementation of the model in the 14 implementation sites.MethodThe ETAP has used implementation science methods framed by the Dynamic Capabilities Model integrated with the Conceptual Model of Implementation Research to develop a Hybrid Type II, multi-site mixed-methods evaluation, described in this paper. The results of the evaluation will describe strategies associated with uptake, implementation outcomes, and HIV-related health outcomes for patients.DiscussionThis approach will allow us to understand in detail the processes that sites to implement and integrate rapid initiation of antiretroviral therapy as standard of care as a means of achieving equity in HIV care.

The evolving COVID-19 pandemic has unevenly affected academic medical centers (AMCs), which are experiencing resource-constraints and liquidity challenges while at the same time facing high pressures to improve patient access and clinical outcomes. Technological advancements in the field of data analytics can enable AMCs to achieve operational efficiencies and improve bottom-line expectations. While there are vetted analytical tools available to track physician productivity, there is a significant paucity of analytical instruments described in the literature to adequately track clinical and financial productivity of physician assistants (PAs) and nurse practitioners (NPs) employed at AMCs. Moreover, there is no general guidance on the development of a dashboard to track PA/NP clinical and financial productivity at the individual, department, or enterprise level. At our institution, there was insufficient tracking of PA/NP productivity across many clinical areas within the enterprise. Thus, the aim of the project is to leverage our institution's existing visualization tools coupled with the right analytics to track PA/NP productivity trends using a dashboard report.MethodsWe created an intuitive and customizable highly visual clinical/financial analytical dashboard to track productivity of PAs/NPs employed at our AMC.ResultsThe APP financial and clinical dashboard is organized into two main components. The volume-based key performance indicators (KPIs) included work relative value units (wRVUs), gross charges, collections (payments), and payer-mix. The session utilization (KPIs) included (e.g., new versus return patient ratios, encounter type, visit volume, and visits per session by provider). After successful piloting, the dashboard was deployed across multiple specialty areas and results showed improved data transparency and reliable tracking of PAs/NPs productivity across the enterprise. The dashboard analytics were also helpful in assessing PA/NP recruitment requests, independent practice sessions, and performance expectations.ConclusionTo our knowledge, this is the first paper to highlight steps AMCs can take in developing, validating, and deploying a financial/clinical dashboard specific to PAs/NPs. However, empirical research is needed to assess the impact of qualitative and quantitative dashboards on provider engagement, revenue, and quality of care.

BackgroundSepsis affects 1.7 million patients in the US annually, is one of the leading causes of mortality, and is a major driver of US healthcare costs. African American/Black and LatinX populations experience higher rates of sepsis complications, deviations from standard care, and readmissions compared with Non-Hispanic White populations. Despite clear evidence of structural racism in sepsis care and outcomes, there are no prospective interventions to mitigate structural racism in sepsis care, nor are we aware of studies that report reductions in racial inequities in sepsis care as an outcome. Therefore, we will deliver and evaluate a coalition-based intervention to equip health systems and their surrounding communities to mitigate structural racism, driving measurable reductions in inequities in sepsis outcomes. This paper presents the theoretical foundation for the study, summarizes key elements of the intervention, and describes the methodology to evaluate the intervention.MethodsOur aims are to: (1) deliver a coalition-based leadership intervention in eight U.S. health systems and their surrounding communities; (2) evaluate the impact of the intervention on organizational culture using a longitudinal, convergent mixed methods approach, and (3) evaluate the impact of the intervention on reduction of racial inequities in three clinical outcomes: a) early identification (time to antibiotic), b) clinical management (in-hospital sepsis mortality) and c) standards-based follow up (same-hospital, all-cause sepsis readmissions) using interrupted time series analysis.DiscussionThis study is aligned with calls to action by the NIH and the Sepsis Alliance to address inequities in sepsis care and outcomes. It is the first to intervene to mitigate effects of structural racism by developing the domains of organizational culture that are required for anti-racist action, with implications for inequities in complex health outcomes beyond sepsis.

BackgroundAnganwadi Workers (AWWs) are a group of 1.4 million community health workers that operate throughout rural India as a part of the Integrated Child Development Services program. AWWs are responsible for disseminating key health information regarding nutrition, family planning, and immunizations to the women and children in their catchment area, while maintaining detailed registers that track key beneficiary data, updates on health status, and supply inventory beneficiaries. There is a need to understand how AWWs spend their time on all of these activities given all of their responsibilities, and the factors that are associated with their time use.MethodsThis cross-sectional study conducted in Madhya Pradesh, collected time use data from AWWs using a standard approach in which we asked participants how much time they spent on various activities. Additionally, we estimated a logistic regression model to elucidate what AWW characteristics are associated with time use.ResultsWe found that AWWs spend substantial amounts of time on administrative tasks, such as filling out their paper registers. Additionally, we explored the associations between various AWW characteristics and their likelihood of spending the expected amount of time on preschool work, filling out their registers, feeding children, and conducting home visits. We found a positive significant association between AWW education and their likelihood of filling out their registers.ConclusionsAWWs spend substantial amounts of time on administrative tasks, which could take away from their ability to spend time on providing direct care. Additionally, future research should explore why AWW characteristics matter and how such factors can be addressed to improve AWWs' performance and should explore the associations between Anganwadi Center characteristics and AWW time use.

BackgroundAnganwadi Workers (AWWs) are a group of 1.4 million community health workers that operate throughout rural India as a part of the Integrated Child Development Services program. AWWs are responsible for disseminating key health information regarding nutrition, family planning, and immunizations to the women and children in their catchment area, while maintaining detailed registers that track key beneficiary data, updates on health status, and supply inventory beneficiaries. There is a need to understand how AWWs spend their time on all of these activities given all of their responsibilities, and the factors that are associated with their time use.MethodsThis cross-sectional study conducted in Madhya Pradesh, collected time use data from AWWs using a standard approach in which we asked participants how much time they spent on various activities. Additionally, we estimated a logistic regression model to elucidate what AWW characteristics are associated with time use.ResultsWe found that AWWs spend substantial amounts of time on administrative tasks, such as filling out their paper registers. Additionally, we explored the associations between various AWW characteristics and their likelihood of spending the expected amount of time on preschool work, filling out their registers, feeding children, and conducting home visits. We found a positive significant association between AWW education and their likelihood of filling out their registers.ConclusionsAWWs spend substantial amounts of time on administrative tasks, which could take away from their ability to spend time on providing direct care. Additionally, future research should explore why AWW characteristics matter and how such factors can be addressed to improve AWWs' performance and should explore the associations between Anganwadi Center characteristics and AWW time use.

BackgroundPayers and policy makers across the international healthcare market are increasingly using publicly available summary measures to designate providers as "high-performing", but no consistently-applied approach exists to identifying high performers. This paper uses publicly available data to examine how different classification approaches influence which providers are designated as "high-performers".MethodsWe conducted a quantitative analysis of cross-sectional publicly-available performance data in the U.S. We used 2014 Minnesota Community Measurement data from 58 medical groups to classify performance across 4 domains: quality (two process measures of cancer screening and 2 composite measures of chronic disease management), total cost of care, access (a composite CAHPS measure), and patient experience (3 CAHPS measures). We classified medical groups based on performance using either relative thresholds or absolute values of performance on all included measures.ResultsUsing relative thresholds, none of the 58 medical groups achieved performance in the top 25% or 35% in all 4 performance domains. A relative threshold of 40% was needed before one group was classified as high-performing in all 4 domains. Using absolute threshold values, two medical groups were classified as high-performing across all 4 domains. In both approaches, designating "high performance" using fewer domains led to more groups designated as high-performers, though there was little to moderate concordance across identified "high-performing" groups.ConclusionsClassification of medical groups as high performing is sensitive to the domains of performance included, the classification approach, and choice of threshold. With increasing focus on achieving high performance in healthcare delivery, the absence of a consistently-applied approach to identify high performers impedes efforts to reliably compare, select and reward high-performing providers.

BackgroundStudies have noted variations in the cost-effectiveness of school-located influenza vaccination (SLIV), but little is known about how SLIV's cost-effectiveness may vary by targeted age group (e.g., elementary or secondary school students), or vaccine consent process (paper-based or web-based). Further, SLIV's cost-effectiveness may be impacted by its spillover effect on practice-based vaccination; prior studies have not addressed this issue.MethodsWe performed a cost-effectiveness analysis on two SLIV programs in upstate New York in 2015-2016: (a) elementary school SLIV using a stepped wedge design with schools as clusters (24 suburban and 18 urban schools) and (b) secondary school SLIV using a cluster randomized trial (16 suburban and 4 urban schools). The cost-per-additionally-vaccinated child (i.e., incremental cost-effectiveness ratio (ICER)) was estimated by dividing the incremental SLIV intervention cost by the incremental effectiveness (i.e., the additional number of vaccinated students in intervention schools compared to control schools). We performed deterministic analyses, one-way sensitivity analyses, and probabilistic analyses.ResultsThe overall effectiveness measure (proportion of children vaccinated) was 5.7 and 5.5 percentage points higher, respectively, in intervention elementary (52.8%) and secondary schools (48.2%) than grade-matched control schools. SLIV programs vaccinated a small proportion of children in intervention elementary (5.2%) and secondary schools (2.5%). In elementary and secondary schools, the ICER excluding vaccine purchase was $85.71 and $86.51 per-additionally-vaccinated-child, respectively. When additionally accounting for observed spillover impact on practice-based vaccination, the ICER decreased to $80.53 in elementary schools -- decreasing substantially in secondary schools. (to $53.40). These estimates were higher than the published practice-based vaccination cost (median = $25.50, mean = $45.48). Also, these estimates were higher than our 2009-2011 urban SLIV program mean costs ($65) due to additional costs for use of a new web-based consent system ($12.97 per-additionally-vaccinated-child) and higher project coordination costs in 2015-2016. One-way sensitivity analyses showed that ICER estimates were most sensitive to the SLIV effectiveness.ConclusionsSLIV raises vaccination rates and may increase practice-based vaccination in primary care practices. While these SLIV programs are effective, to be as cost-effective as practice-based vaccination our SLIV programs would need to vaccinate more students and/or lower the costs for consent systems and project coordination.Trial registrationClinicalTrials.gov NCT02227186 (August 25, 2014), updated NCT03137667 (May 2, 2017).

BACKGROUND: There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed. DISCUSSION: There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the Value Equation, provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

BackgroundStudies have noted variations in the cost-effectiveness of school-located influenza vaccination (SLIV), but little is known about how SLIV's cost-effectiveness may vary by targeted age group (e.g., elementary or secondary school students), or vaccine consent process (paper-based or web-based). Further, SLIV's cost-effectiveness may be impacted by its spillover effect on practice-based vaccination; prior studies have not addressed this issue.MethodsWe performed a cost-effectiveness analysis on two SLIV programs in upstate New York in 2015-2016: (a) elementary school SLIV using a stepped wedge design with schools as clusters (24 suburban and 18 urban schools) and (b) secondary school SLIV using a cluster randomized trial (16 suburban and 4 urban schools). The cost-per-additionally-vaccinated child (i.e., incremental cost-effectiveness ratio (ICER)) was estimated by dividing the incremental SLIV intervention cost by the incremental effectiveness (i.e., the additional number of vaccinated students in intervention schools compared to control schools). We performed deterministic analyses, one-way sensitivity analyses, and probabilistic analyses.ResultsThe overall effectiveness measure (proportion of children vaccinated) was 5.7 and 5.5 percentage points higher, respectively, in intervention elementary (52.8%) and secondary schools (48.2%) than grade-matched control schools. SLIV programs vaccinated a small proportion of children in intervention elementary (5.2%) and secondary schools (2.5%). In elementary and secondary schools, the ICER excluding vaccine purchase was $85.71 and $86.51 per-additionally-vaccinated-child, respectively. When additionally accounting for observed spillover impact on practice-based vaccination, the ICER decreased to $80.53 in elementary schools -- decreasing substantially in secondary schools. (to $53.40). These estimates were higher than the published practice-based vaccination cost (median = $25.50, mean = $45.48). Also, these estimates were higher than our 2009-2011 urban SLIV program mean costs ($65) due to additional costs for use of a new web-based consent system ($12.97 per-additionally-vaccinated-child) and higher project coordination costs in 2015-2016. One-way sensitivity analyses showed that ICER estimates were most sensitive to the SLIV effectiveness.ConclusionsSLIV raises vaccination rates and may increase practice-based vaccination in primary care practices. While these SLIV programs are effective, to be as cost-effective as practice-based vaccination our SLIV programs would need to vaccinate more students and/or lower the costs for consent systems and project coordination.Trial registrationClinicalTrials.gov NCT02227186 (August 25, 2014), updated NCT03137667 (May 2, 2017).

BackgroundThis paper identifies and describes measures of constructs relevant to the adoption or implementation of innovations (i.e., new policies, programs or practices) at the organizational-level. This work is intended to advance the field of dissemination and implementation research by aiding scientists in the identification of existing measures and highlighting methodological issues that require additional attention.MethodsWe searched for published studies (1973-2013) in 11 bibliographic databases for quantitative, empirical studies that presented outcome data related to adoption and/or implementation of an innovation. Included studies had to assess latent constructs related to the "inner setting" of the organization, as defined by the Consolidated Framework for Implementation Research.ResultsOf the 76 studies included, most (86%) were cross sectional and nearly half (49%) were conducted in health care settings. Nearly half (46%) involved implementation of evidence-based or "best practice" strategies; roughly a quarter (26%) examined use of new technologies. Primary outcomes most often assessed were innovation implementation (57%) and adoption (34%); while 4% of included studies assessed both outcomes. There was wide variability in conceptual and operational definitions of organizational constructs. The two most frequently assessed constructs included "organizational climate" and "readiness for implementation." More than half (55%) of the studies did not articulate an organizational theory or conceptual framework guiding the inquiry; about a third (34%) referenced Diffusion of Innovations theory. Overall, only 46% of articles reported psychometric properties of measures assessing latent organizational characteristics. Of these, 94% (33/35) described reliability and 71% (25/35) reported on validity.ConclusionsThe lack of clarity associated with construct definitions, inconsistent use of theory, absence of standardized reporting criteria for implementation research, and the fact that few measures have demonstrated reliability or validity were among the limitations highlighted in our review. Given these findings, we recommend that increased attention be devoted toward the development or refinement of measures using common psychometric standards. In addition, there is a need for measure development and testing across diverse settings, among diverse population samples, and for a variety of types of innovations.

BackgroundThis paper identifies and describes measures of constructs relevant to the adoption or implementation of innovations (i.e., new policies, programs or practices) at the organizational-level. This work is intended to advance the field of dissemination and implementation research by aiding scientists in the identification of existing measures and highlighting methodological issues that require additional attention.MethodsWe searched for published studies (1973-2013) in 11 bibliographic databases for quantitative, empirical studies that presented outcome data related to adoption and/or implementation of an innovation. Included studies had to assess latent constructs related to the "inner setting" of the organization, as defined by the Consolidated Framework for Implementation Research.ResultsOf the 76 studies included, most (86%) were cross sectional and nearly half (49%) were conducted in health care settings. Nearly half (46%) involved implementation of evidence-based or "best practice" strategies; roughly a quarter (26%) examined use of new technologies. Primary outcomes most often assessed were innovation implementation (57%) and adoption (34%); while 4% of included studies assessed both outcomes. There was wide variability in conceptual and operational definitions of organizational constructs. The two most frequently assessed constructs included "organizational climate" and "readiness for implementation." More than half (55%) of the studies did not articulate an organizational theory or conceptual framework guiding the inquiry; about a third (34%) referenced Diffusion of Innovations theory. Overall, only 46% of articles reported psychometric properties of measures assessing latent organizational characteristics. Of these, 94% (33/35) described reliability and 71% (25/35) reported on validity.ConclusionsThe lack of clarity associated with construct definitions, inconsistent use of theory, absence of standardized reporting criteria for implementation research, and the fact that few measures have demonstrated reliability or validity were among the limitations highlighted in our review. Given these findings, we recommend that increased attention be devoted toward the development or refinement of measures using common psychometric standards. In addition, there is a need for measure development and testing across diverse settings, among diverse population samples, and for a variety of types of innovations.

BackgroundThere is a broad consensus that addictive behaviors tend to be chronic and relapsing. But for field studies of substance users, successfully tracking, locating, and following up with a representative sample of subjects is a challenge.MethodsThe purpose of this paper is to provide a general overview of how current technological aids can support and improve the quality of longitudinal research on substance use disorders. The review is grouped into four domains: (1) tracking and locating, (2) prompting/engaging, (3) incentivizing, and (4) collecting data.Results & conclusionsAlthough the technologies described in this review will be modified or replaced over time, our findings suggest that incorporating some or all of these currently available approaches may improve research efficiency, follow-up rates, and data quality.

BackgroundThere is a broad consensus that addictive behaviors tend to be chronic and relapsing. But for field studies of substance users, successfully tracking, locating, and following up with a representative sample of subjects is a challenge.MethodsThe purpose of this paper is to provide a general overview of how current technological aids can support and improve the quality of longitudinal research on substance use disorders. The review is grouped into four domains: (1) tracking and locating, (2) prompting/engaging, (3) incentivizing, and (4) collecting data.Results & conclusionsAlthough the technologies described in this review will be modified or replaced over time, our findings suggest that incorporating some or all of these currently available approaches may improve research efficiency, follow-up rates, and data quality.

BackgroundPatient portals may lead to enhanced disease management, health plan retention, changes in channel utilization, and lower environmental waste. However, despite growing research on patient portals and their effects, our understanding of the organizational dynamics that explain how effects come about is limited.MethodsThis paper uses qualitative methods to advance our understanding of the organizational dynamics that influence the impact of a patient portal on organizational performance and patient health. The study setting is Kaiser Permanente, the world's largest not-for-profit integrated delivery system, which has been using a portal for over ten years. We interviewed eighteen physician leaders and executives particularly knowledgeable about the portal to learn about how they believe the patient portal works and what organizational factors affect its workings. Our analytical framework centered on two research questions. (1) How does the patient portal impact care delivery to produce the documented effects?; and (2) What are the important organizational factors that influence the patient portal's development?ResultsWe identify five ways in which the patient portal may impact care delivery to produce reported effects. First, the portal's ability to ease access to services improves some patients' satisfaction as well as changes the way patients seek care. Second, the transparency and activation of information enable some patients to better manage their care. Third, care management may also be improved through augmented patient-physician interaction. This augmented interaction may also increase the 'stickiness' of some patients to their providers. Forth, a similar effect may be triggered by a closer connection between Kaiser Permanente and patients, which may reduce the likelihood that patients will switch health plans. Finally, the portal may induce efficiencies in physician workflow and administrative tasks, stimulating certain operational savings and deeper involvement of patients in medical decisions. Moreover, our analysis illuminated seven organizational factors of particular importance to the portal's development--and thereby ability to impact care delivery: alignment with financial incentives, synergy with existing IT infrastructure and operations, physician-led governance, inclusive decision making and knowledge sharing, regional flexibility to implementation, continuous innovation, and emphasis on patient-centered design.ConclusionsThese findings show how organizational dynamics enable the patient portal to affect care delivery by summoning organization-wide support for and use of a portal that meets patient needs.

BackgroundPatient portals may lead to enhanced disease management, health plan retention, changes in channel utilization, and lower environmental waste. However, despite growing research on patient portals and their effects, our understanding of the organizational dynamics that explain how effects come about is limited.MethodsThis paper uses qualitative methods to advance our understanding of the organizational dynamics that influence the impact of a patient portal on organizational performance and patient health. The study setting is Kaiser Permanente, the world's largest not-for-profit integrated delivery system, which has been using a portal for over ten years. We interviewed eighteen physician leaders and executives particularly knowledgeable about the portal to learn about how they believe the patient portal works and what organizational factors affect its workings. Our analytical framework centered on two research questions. (1) How does the patient portal impact care delivery to produce the documented effects?; and (2) What are the important organizational factors that influence the patient portal's development?ResultsWe identify five ways in which the patient portal may impact care delivery to produce reported effects. First, the portal's ability to ease access to services improves some patients' satisfaction as well as changes the way patients seek care. Second, the transparency and activation of information enable some patients to better manage their care. Third, care management may also be improved through augmented patient-physician interaction. This augmented interaction may also increase the 'stickiness' of some patients to their providers. Forth, a similar effect may be triggered by a closer connection between Kaiser Permanente and patients, which may reduce the likelihood that patients will switch health plans. Finally, the portal may induce efficiencies in physician workflow and administrative tasks, stimulating certain operational savings and deeper involvement of patients in medical decisions. Moreover, our analysis illuminated seven organizational factors of particular importance to the portal's development--and thereby ability to impact care delivery: alignment with financial incentives, synergy with existing IT infrastructure and operations, physician-led governance, inclusive decision making and knowledge sharing, regional flexibility to implementation, continuous innovation, and emphasis on patient-centered design.ConclusionsThese findings show how organizational dynamics enable the patient portal to affect care delivery by summoning organization-wide support for and use of a portal that meets patient needs.

BackgroundLittle information exists on the technical assistance needs of local indigenous organizations charged with managing HIV care and treatment programs funded by the US President's Emergency Plan for AIDS Relief (PEPFAR). This paper describes the methods used to adapt the Primary Care Assessment Tool (PCAT) framework, which has successfully strengthened HIV primary care services in the US, into one that could strengthen the capacity of local partners to deliver priority health programs in resource-constrained settings by identifying their specific technical assistance needs.MethodsQualitative methods and inductive reasoning approaches were used to conceptualize and adapt the new Clinical Assessment for Systems Strengthening (ClASS) framework. Stakeholder interviews, comparisons of existing assessment tools, and a pilot test helped determine the overall ClASS framework for use in low-resource settings. The framework was further refined one year post-ClASS implementation.ResultsStakeholder interviews, assessment of existing tools, a pilot process and the one-year post- implementation assessment informed the adaptation of the ClASS framework for assessing and strengthening technical and managerial capacities of health programs at three levels: international partner, local indigenous partner, and local partner treatment facility. The PCAT focus on organizational strengths and systems strengthening was retained and implemented in the ClASS framework and approach. A modular format was chosen to allow the use of administrative, fiscal and clinical modules in any combination and to insert new modules as needed by programs. The pilot led to refined pre-visit planning, informed review team composition, increased visit duration, and restructured modules. A web-based toolkit was developed to capture three years of experiential learning; this kit can also be used for independent implementation of the ClASS framework.ConclusionsA systematic adaptation process has produced a qualitative framework that can inform implementation strategies in support of country led HIV care and treatment programs. The framework, as a well-received iterative process focused on technical assistance, may have broader utility in other global programs.

BackgroundLittle information exists on the technical assistance needs of local indigenous organizations charged with managing HIV care and treatment programs funded by the US President's Emergency Plan for AIDS Relief (PEPFAR). This paper describes the methods used to adapt the Primary Care Assessment Tool (PCAT) framework, which has successfully strengthened HIV primary care services in the US, into one that could strengthen the capacity of local partners to deliver priority health programs in resource-constrained settings by identifying their specific technical assistance needs.MethodsQualitative methods and inductive reasoning approaches were used to conceptualize and adapt the new Clinical Assessment for Systems Strengthening (ClASS) framework. Stakeholder interviews, comparisons of existing assessment tools, and a pilot test helped determine the overall ClASS framework for use in low-resource settings. The framework was further refined one year post-ClASS implementation.ResultsStakeholder interviews, assessment of existing tools, a pilot process and the one-year post- implementation assessment informed the adaptation of the ClASS framework for assessing and strengthening technical and managerial capacities of health programs at three levels: international partner, local indigenous partner, and local partner treatment facility. The PCAT focus on organizational strengths and systems strengthening was retained and implemented in the ClASS framework and approach. A modular format was chosen to allow the use of administrative, fiscal and clinical modules in any combination and to insert new modules as needed by programs. The pilot led to refined pre-visit planning, informed review team composition, increased visit duration, and restructured modules. A web-based toolkit was developed to capture three years of experiential learning; this kit can also be used for independent implementation of the ClASS framework.ConclusionsA systematic adaptation process has produced a qualitative framework that can inform implementation strategies in support of country led HIV care and treatment programs. The framework, as a well-received iterative process focused on technical assistance, may have broader utility in other global programs.

Abstract Background Deaf and hard-of-hearing (Deaf/HH) individuals have been underserved before and during emergencies. This paper will assess Deaf/HH related emergency preparedness training needs for state emergency management agencies and deaf-serving community-based organizations (CBOs). Methods Four approaches were used: 1) a literature review; 2) results from 50 key informant (KI) interviews from state and territorial-level emergency management and public health agencies; 3) results from 14 KI interviews with deaf-serving CBOs in the San Francisco Bay Area; and 4) a pilot program evaluation of an emergency responder training serving the Deaf/HH in one urban community. Results Results from literature review and state and territorial level KIs indicate that there is a substantive gap in emergency preparedness training on serving Deaf/HH provided by state agencies. In addition, local KI interviews with 14 deaf-serving CBOs found gaps in training within deaf-serving CBOs. These gaps have implications for preparing for and responding to all-hazards emergencies including weather-related or earthquake-related natural disasters, terrorist attacks, and nuclear-chemical disasters. Conclusion Emergency preparedness trainings specific to responding to or promoting preparedness of the Deaf/HH is rare, even for state agency personnel, and frequently lack standardization, evaluation, or institutionalization in emergency management infrastructure. This has significant policy and research implications. Similarly, CBOs are not adequately trained to serve the needs of their constituents.

Abstract Background Health information technology can enhance self-management and quality of life for patients with chronic disease and overcome healthcare barriers for patients with limited English proficiency. After a randomized controlled trial of a multilingual automated telephone self-management support program (ATSM) improved patient-centered dimensions of diabetes care in safety net clinics, we collaborated with a nonprofit Medicaid managed care plan to translate research into practice, offering ATSM as a covered benefit and augmenting ATSM to promote medication activation. This paper describes the protocol of the Self-Management Automated and Real-Time Telephonic Support Project (SMARTSteps). Methods/Design This controlled quasi-experimental trial used a wait-list variant of a stepped wedge design to enroll 362 adult health plan members with diabetes who speak English, Cantonese, or Spanish and receive care at 4 publicly-funded clinics. Through language-stratified randomization, participants were assigned to four intervention statuses: SMARTSteps-ONLY, SMARTSteps-PLUS, or wait-list for either intervention. In addition to usual primary care, intervention participants received 27 weekly calls in their preferred language with rotating queries and response-triggered education about self-care, medication adherence, safety concerns, psychological issues, and preventive services. Health coaches from the health plan called patients with out-of-range responses for collaborative goal setting and action planning. SMARTSteps-PLUS also included health coach calls to promote medication activation, adherence and intensification, if triggered by ATSM-reported non-adherence, refill non-adherence from pharmacy claims, or suboptimal cardiometabolic indicators. Wait-list patients crossed-over to SMARTSteps-ONLY or -PLUS at 6 months. For participants who agreed to structured telephone interviews at baseline and 6 months (n = 252), primary outcomes will be changes in quality of life and functional status with secondary outcomes of 6-month changes in self-management behaviors/efficacy and patient-centered processes of care. We will also evaluate 6-month changes in cardiometabolic (HbA1c, blood pressure, and LDL) and utilization indicators for all participants. Discussion Outcomes will provide evidence regarding real-world implementation of ATSM within a Medicaid managed care plan serving safety net settings. The evaluation trial will provide insight into translating and scaling up health information technology interventions for linguistically and culturally diverse vulnerable populations with chronic disease. Trial Registration ClinicalTrials.gov: NCT00683020

BackgroundHealth administrative data are frequently used for health services and population health research. Comparative research using these data has been facilitated by the use of a standard system for coding diagnoses, the International Classification of Diseases (ICD). Research using the data must deal with data quality and validity limitations which arise because the data are not created for research purposes. This paper presents a list of high-priority methodological areas for researchers using health administrative data.MethodsA group of researchers and users of health administrative data from Canada, the United States, Switzerland, Australia, China and the United Kingdom came together in June 2005 in Banff, Canada to discuss and identify high-priority methodological research areas. The generation of ideas for research focussed not only on matters relating to the use of administrative data in health services and population health research, but also on the challenges created in transitioning from ICD-9 to ICD-10. After the brain-storming session, voting took place to rank-order the suggested projects. Participants were asked to rate the importance of each project from 1 (low priority) to 10 (high priority). Average ranks were computed to prioritise the projects.ResultsThirteen potential areas of research were identified, some of which represented preparatory work rather than research per se. The three most highly ranked priorities were the documentation of data fields in each country's hospital administrative data (average score 8.4), the translation of patient safety indicators from ICD-9 to ICD-10 (average score 8.0), and the development and validation of algorithms to verify the logic and internal consistency of coding in hospital abstract data (average score 7.0).ConclusionThe group discussions resulted in a list of expert views on critical international priorities for future methodological research relating to health administrative data. The consortium's members welcome contacts from investigators involved in research using health administrative data, especially in cross-jurisdictional collaborative studies or in studies that illustrate the application of ICD-10.

BackgroundCost-effectiveness acceptability curves (CEACs) describe the probability that a new treatment or intervention is cost-effective. The net benefit regression framework (NBRF) allows cost-effectiveness analysis to be done in a simple regression framework. The objective of the paper is to illustrate how net benefit regression can be used to construct a CEAC.MethodsOne hundred patients referred for ambulatory monitoring with syncope or presyncope were randomized to a one-month external loop recorder (n = 49) or 48-hour Holter monitor (n = 51). The primary endpoint was symptom-rhythm correlation during monitoring. Direct costs were calculated based on the 2003 Ontario Health Insurance Plan (OHIP) fee schedule combined with hospital case costing of labour, materials, service and overhead costs for diagnostic testing and related equipment.ResultsIn the loop recorder group, 63.27% of patients (31/49) had symptom recurrence and successful activation, compared to 23.53% in the Holter group (12/51). The cost in US dollars for loop recording was 648.50 dollars and 212.92 dollars for Holter monitoring. The incremental cost-effectiveness ratio (ICER) of the loop recorder was 1,096 dollars per extra successful diagnosis. The probability that the loop recorder was cost-effective compared to the Holter monitor was estimated using net benefit regression and plotted on a CEAC. In a sensitivity analysis, bootstrapping was used to examine the effect of distributional assumptions.ConclusionThe NBRF is straightforward to use and interpret. The resulting uncertainty surrounding the regression coefficient relates to the CEAC. When the link from the regression's p-value to the probability of cost-effectiveness is tentative, bootstrapping may be used.

BackgroundHealth administrative data are frequently used for health services and population health research. Comparative research using these data has been facilitated by the use of a standard system for coding diagnoses, the International Classification of Diseases (ICD). Research using the data must deal with data quality and validity limitations which arise because the data are not created for research purposes. This paper presents a list of high-priority methodological areas for researchers using health administrative data.MethodsA group of researchers and users of health administrative data from Canada, the United States, Switzerland, Australia, China and the United Kingdom came together in June 2005 in Banff, Canada to discuss and identify high-priority methodological research areas. The generation of ideas for research focussed not only on matters relating to the use of administrative data in health services and population health research, but also on the challenges created in transitioning from ICD-9 to ICD-10. After the brain-storming session, voting took place to rank-order the suggested projects. Participants were asked to rate the importance of each project from 1 (low priority) to 10 (high priority). Average ranks were computed to prioritise the projects.ResultsThirteen potential areas of research were identified, some of which represented preparatory work rather than research per se. The three most highly ranked priorities were the documentation of data fields in each country's hospital administrative data (average score 8.4), the translation of patient safety indicators from ICD-9 to ICD-10 (average score 8.0), and the development and validation of algorithms to verify the logic and internal consistency of coding in hospital abstract data (average score 7.0).ConclusionThe group discussions resulted in a list of expert views on critical international priorities for future methodological research relating to health administrative data. The consortium's members welcome contacts from investigators involved in research using health administrative data, especially in cross-jurisdictional collaborative studies or in studies that illustrate the application of ICD-10.

BackgroundCost-effectiveness acceptability curves (CEACs) describe the probability that a new treatment or intervention is cost-effective. The net benefit regression framework (NBRF) allows cost-effectiveness analysis to be done in a simple regression framework. The objective of the paper is to illustrate how net benefit regression can be used to construct a CEAC.MethodsOne hundred patients referred for ambulatory monitoring with syncope or presyncope were randomized to a one-month external loop recorder (n = 49) or 48-hour Holter monitor (n = 51). The primary endpoint was symptom-rhythm correlation during monitoring. Direct costs were calculated based on the 2003 Ontario Health Insurance Plan (OHIP) fee schedule combined with hospital case costing of labour, materials, service and overhead costs for diagnostic testing and related equipment.ResultsIn the loop recorder group, 63.27% of patients (31/49) had symptom recurrence and successful activation, compared to 23.53% in the Holter group (12/51). The cost in US dollars for loop recording was 648.50 dollars and 212.92 dollars for Holter monitoring. The incremental cost-effectiveness ratio (ICER) of the loop recorder was 1,096 dollars per extra successful diagnosis. The probability that the loop recorder was cost-effective compared to the Holter monitor was estimated using net benefit regression and plotted on a CEAC. In a sensitivity analysis, bootstrapping was used to examine the effect of distributional assumptions.ConclusionThe NBRF is straightforward to use and interpret. The resulting uncertainty surrounding the regression coefficient relates to the CEAC. When the link from the regression's p-value to the probability of cost-effectiveness is tentative, bootstrapping may be used.