Search

Abstract Background The Expert Recommendations for Implementing Change (ERIC) project developed a compilation of implementation strategies that are intended to standardize reporting and evaluation. Little is known about the application of ERIC in low- and middle-income countries (LMICs). We systematically reviewed the literature on the use and specification of ERIC strategies for health intervention implementation in LMICs to identify gaps and inform future research. Methods We searched peer-reviewed articles published through March 2023 in any language that (1) were conducted in an LMIC and (2) cited seminal ERIC articles or (3) mentioned ERIC in the title or abstract. Two co-authors independently screened all titles, abstracts, and full-text articles, then abstracted study, intervention, and implementation strategy characteristics of included studies. Results The final sample included 60 studies describing research from all world regions, with over 30% published in the final year of our review period. Most studies took place in healthcare settings (n = 52, 86.7%), while 11 (18.2%) took place in community settings and four (6.7%) at the policy level. Across studies, 548 distinct implementation strategies were identified with a median of six strategies (range 1–46 strategies) included in each study. Most studies (n = 32, 53.3%) explicitly matched implementation strategies used for the ERIC compilation. Among those that did, 64 (87.3%) of the 73 ERIC strategies were represented. Many of the strategies not cited included those that target systems- or policy-level barriers. Nearly 85% of strategies included some component of strategy specification, though most only included specification of their action (75.2%), actor (57.3%), and action target (60.8%). A minority of studies employed randomized trials or high-quality quasi-experimental designs; only one study evaluated implementation strategy effectiveness. Conclusions While ERIC use in LMICs is rapidly growing, its application has not been consistent nor commonly used to test strategy effectiveness. Research in LMICs must better specify strategies and evaluate their impact on outcomes. Moreover, strategies that are tested need to be better specified, so they may be compared across contexts. Finally, strategies targeting policy-, systems-, and community-level determinants should be further explored. Trial registration PROSPERO, CRD42021268374.

Abstract Background Existing implementation measures developed in high-income countries may have limited appropriateness for use within low- and middle-income countries (LMIC). In response, researchers at Johns Hopkins University began developing the Mental Health Implementation Science Tools (mhIST) in 2013 to assess priority implementation determinants and outcomes across four key stakeholder groups—consumers, providers, organization leaders, and policy makers—with dedicated versions of scales for each group. These were field tested and refined in several contexts, and criterion validity was established in Ukraine. The Consumer and Provider mhIST have since grown in popularity in mental health research, outpacing psychometric evaluation. Our objective was to establish the cross-context psychometric properties of these versions and inform future revisions. Methods We compiled secondary data from seven studies across six LMIC—Colombia, Myanmar, Pakistan, Thailand, Ukraine, and Zambia—to evaluate the psychometric performance of the Consumer and Provider mhIST. We used exploratory factor analysis to identify dimensionality, factor structure, and item loadings for each scale within each stakeholder version. We also used alignment analysis (i.e., multi-group confirmatory factor analysis) to estimate measurement invariance and differential item functioning of the Consumer scales across the six countries. Results All but one scale within the Provider and Consumer versions had Cronbach’s alpha greater than 0.8. Exploratory factor analysis indicated most scales were multidimensional, with factors generally aligning with a priori subscales for the Provider version; the Consumer version has no predefined subscales. Alignment analysis of the Consumer mhIST indicated a range of measurement invariance for scales across settings (R 2 0.46 to 0.77). Several items were identified for potential revision due to participant nonresponse or low or cross- factor loadings. We found only one item, which asked consumers whether their intervention provider was available when needed, to have differential item functioning in both intercept and loading. Conclusion We provide evidence that the Consumer and Provider versions of the mhIST are internally valid and reliable across diverse contexts and stakeholder groups for mental health research in LMIC. We recommend the instrument be revised based on these analyses and future research examine instrument utility by linking measurement to other outcomes of interest.

Abstract Background The Consolidated Framework for Implementation Research (CFIR) is a determinants framework that may require adaptation or contextualization to fit the needs of implementation scientists in low- and middle-income countries (LMICs). The purpose of this review is to characterize how the CFIR has been applied in LMIC contexts, to evaluate the utility of specific constructs to global implementation science research, and to identify opportunities to refine the CFIR to optimize utility in LMIC settings. Methods A systematic literature review was performed to evaluate the use of the CFIR in LMICs. Citation searches were conducted in Medline, CINAHL, PsycINFO, CINAHL, SCOPUS, and Web of Science. Data abstraction included study location, study design, phase of implementation, manner of implementation (ex., data analysis), domains and constructs used, and justifications for use, among other variables. A standardized questionnaire was sent to the corresponding authors of included studies to determine which CFIR domains and constructs authors found to be compatible with use in LMICs and to solicit feedback regarding ways in which CFIR performance could be improved for use in LMICs. Results Our database search yielded 504 articles, of which 34 met final inclusion criteria. The studies took place across 21 countries and focused on 18 different health topics. The studies primarily used qualitative study designs (68%). Over half (59%) of the studies applied the CFIR at study endline, primarily to guide data analysis or to contextualize study findings. Nineteen (59%) of the contacted authors participated in the survey. Authors unanimously identified culture and engaging as compatible with use in global implementation research. Only two constructs, patient needs and resources and individual stages of change were commonly identified as incompatible with use. Author feedback centered on team level influences on implementation, as well as systems characteristics, such as health system architecture. We propose a “Characteristics of Systems” domain and eleven novel constructs be added to the CFIR to increase its compatibility for use in LMICs. Conclusions These additions provide global implementation science practitioners opportunities to account for systems-level determinants operating independently of the implementing organization. Newly proposed constructs require further reliability and validity assessments. Trial registration PROSPERO, CRD42018095762

Abstract Background Interventions to alleviate stigma are demonstrating effectiveness across a range of conditions, though few move beyond the pilot phase, especially in low- and middle-income countries (LMICs). Implementation science offers tools to study complex interventions, understand barriers to implementation, and generate evidence of affordability, scalability, and sustainability. Such evidence could be used to convince policy-makers and donors to invest in implementation. However, the utility of implementation research depends on its rigor and replicability. Our objectives were to systematically review implementation studies of health-related stigma reduction interventions in LMICs and critically assess the reporting of implementation outcomes and intervention descriptions. Methods PubMed, CINAHL, PsycINFO, and EMBASE were searched for evaluations of stigma reduction interventions in LMICs reporting at least one implementation outcome. Study- and intervention-level characteristics were abstracted. The quality of reporting of implementation outcomes was assessed using a five-item rubric, and the comprehensiveness of intervention description and specification was assessed using the 12-item Template for Intervention Description and Replication (TIDieR). Results A total of 35 eligible studies published between 2003 and 2017 were identified; of these, 20 (57%) used qualitative methods, 32 (91%) were type 1 hybrid effectiveness-implementation studies, and 29 (83%) were evaluations of once-off or pilot implementations. No studies adopted a formal theoretical framework for implementation research. Acceptability (20, 57%) and feasibility (14, 40%) were the most frequently reported implementation outcomes. The quality of reporting of implementation outcomes was low. The 35 studies evaluated 29 different interventions, of which 18 (62%) were implemented across sub-Saharan Africa, 20 (69%) focused on stigma related to HIV/AIDS, and 28 (97%) used information or education to reduce stigma. Intervention specification and description was uneven. Conclusion Implementation science could support the dissemination of stigma reduction interventions in LMICs, though usage to date has been limited. Theoretical frameworks and validated measures have not been used, key implementation outcomes like cost and sustainability have rarely been assessed, and intervention processes have not been presented in detail. Adapted frameworks, new measures, and increased LMIC-based implementation research capacity could promote the rigor of future stigma implementation research, helping the field deliver on the promise of stigma reduction interventions worldwide.

Abstract Background Prevention interventions for people living with HIV/AIDS are an important component of HIV programs. We report the results of a pilot evaluation of a four-hour, clinic-based training for healthcare providers in South Africa on HIV prevention assessments and messages. This pre/post pilot evaluation examined whether the training was associated with providers delivering more prevention messages. Methods Seventy providers were trained at four public primary care clinics with a high volume of HIV patients. Pre- and post-training patient exit surveys were conducted using Audio-Computer Assisted Structured Interviews. Seven provider appropriate messaging outcomes and one summary provider outcome were compared pre- and post-training using Poisson regression. Results Four hundred fifty-nine patients pre-training and 405 post-training with known HIV status were interviewed, including 175 and 176 HIV positive patients respectively. Among HIV positive patients, delivery of all appropriate messages by providers declined post-training. The summary outcome decreased from 56 to 50%; adjusted rate ratio 0.92 (95% CI = 0.87–0.97). Sensitivity analyses adjusting for training coverage and time since training detected fewer declines. Among HIV negative patients the summary score was stable at 32% pre- and post-training; adjusted rate ratio 1.05 (95% CI = 0.98–1.12). Conclusions Surprisingly, this training was associated with a decrease in prevention messages delivered to HIV positive patients by providers. Limited training coverage and delays between training and post-training survey may partially account for this apparent decrease. A more targeted approach to prevention messages may be more effective.