Search

Background: The Drug and Violence Resistance Educational Program (Programa Educacional de Resistência às Drogas e à Violência – PROERD) is the most widely implemented prevention program in Brazil and this study evaluated the reasons and ways in which PROERD instructors change the program, affecting its implementation fidelity. Methods: This qualitative method study used three data sources: semi-structured interviews with 19 police officers (PROERD instructors), fidelity forms completed by the instructors, and the researcher's observations of 30 lessons, followed by thematic analysis. Results: Strong evidence shows that instructors adapt the program, in general, because they experienced that some activities do not work when implemented as they were created by the developers. The main reasons to adapt the program were categorized into two groups: intrinsic and extrinsic reasons. The cultural reality and school performance of students and the support and infrastructure of the school were the extrinsic reasons, and instructors' performance was the intrinsic reason. Conclusion: In order to make PROERD feasible for students and schools, instructors change the program in an unstructured way, often not following the curriculum. Therefore, PROERD will hardly have a positive effect for Brazilian students. [ABSTRACT FROM AUTHOR]

The purpose of this study was to evaluate the psychometric properties of the Self-Assessment Survey (SAS) 4.0, an updated measure assessing implementation fidelity of positive behavioral interventions and supports (PBIS). A total of 627 school personnel from 33 schools in six U.S. states completed the SAS 4.0 during the 2021–2022 school year. We evaluated data demonstrating the measure's reliability (internal consistency, interrater reliability between PBIS team and non-team members), internal structure, and convergent validity for assessing implementation of Tier 1, 2, and 3 systems. We found strong internal consistency (overall and across subscales) and evidence regarding the internal structure as a four-factor measure. In addition, we found the SAS 4.0 (overall score and subscales) to be statistically significantly correlated with another widely used and empirically evaluated PBIS fidelity measure, the Tiered Fidelity Inventory (TFI). We found a statistically significant correlation between the SAS 4.0 and the SAS 3.0 for the Schoolwide Systems subscale but not other subscales. We discuss limitations given the current sample and describe implications for how PBIS teams can use the measure for school improvement and decision making. [ABSTRACT FROM AUTHOR]

Background: Approximately 15% of births worldwide result in life-threatening complications during pregnancy, delivery, or postpartum. Comprehensive Emergency Management of Obstetric and Newborn Care (CEmONC) is intended as one of the measures for maternal healthcare services to reduce the high burden with regard to childbirth complications. However, its state of implementation fidelity has not been well investigated. Therefore, this study aimed to evaluate the implementation fidelity of CEmONC services at University of Gondar Comprehensive Specialized Hospital, Ethiopia. Method: A case-study design with an embedded mixed method was employed. Adherence, quality of delivery, and participant responsiveness dimensions from Carroll's conceptual framework were used in this evaluation. Four hundred four exit interviews, 423 retrospective document reviews and 10 key informants were conducted. Moreover, a binary logistic regression model was fitted. The qualitative data were transcribed, translated, coded, and analysed using a thematic analysis approach. The overall implementation fidelity of the CEmONC was judged based on the pre-seated judgmental criteria. Results: Overall the implementation fidelity of the CEmONC service was 75.5%. Quality of delivery, participant responsiveness and adherence were 72.7%, 76.6% and 77.2% respectively. Signal functions like parenteral antibiotics and removal of retained products were insufficiently performed against the recommended protocols which was also evidenced by the key informant interviews. Healthcare providers' respect for the clients was less. Age ≥ 35 years (AOR = 0.48, 95% CI: 0.24,0.98), educational status of college and above (AOR = 2.61, 95% CI: 1.46,4.66), being government employed (AOR = 1.85, 95% CI: 1.08,3.18), having ANC follow-up (AOR = 5.50, 95% CI: 1.83, 16.47) and grand multigravida (AOR = 2.17, 95% CI: 1.08, 4.38) were factors significantly associated with participant responsiveness towards the services. Conclusions: The overall implementation fidelity of the CEmONC services was implemented in good fidelity. Moreover, the quality of delivery was judged as implemented in fair fidelity. Parenteral antibiotics and removal of retained products were not found to be sufficiently performed. Respect for the clients was insufficiently delivered. Therefore, it is recommended that parenteral antibiotics drugs be adequately provided and training for healthcare providers regarding compassionate and respectful care shall be facilitated. Moreover, healthcare providers are strongly recommended to adhere to the recommended guidelines. [ABSTRACT FROM AUTHOR]

Response to intervention (RTI) is a valuable framework for providing effective and equitable educational opportunities to all students; however, recent research indicates that RTI programs are not achieving their potential for promoting student learning. As schools develop, implement, and sustain RTI systems, they would benefit from the addition of collaborative support provided by professionals knowledgeable about the RTI framework, including specific elements of this model such as evidence-based practices and progress monitoring assessments. We describe the process and outcomes of a university–school partnership aimed at developing and implementing an RTI program for reading at the Tier 1 level. [ABSTRACT FROM AUTHOR]

Abstract Background Approximately 15% of births worldwide result in life-threatening complications during pregnancy, delivery, or postpartum. Comprehensive Emergency Management of Obstetric and Newborn Care (CEmONC) is intended as one of the measures for maternal healthcare services to reduce the high burden with regard to childbirth complications. However, its state of implementation fidelity has not been well investigated. Therefore, this study aimed to evaluate the implementation fidelity of CEmONC services at University of Gondar Comprehensive Specialized Hospital, Ethiopia. Method A case-study design with an embedded mixed method was employed. Adherence, quality of delivery, and participant responsiveness dimensions from Carroll’s conceptual framework were used in this evaluation. Four hundred four exit interviews, 423 retrospective document reviews and 10 key informants were conducted. Moreover, a binary logistic regression model was fitted. The qualitative data were transcribed, translated, coded, and analysed using a thematic analysis approach. The overall implementation fidelity of the CEmONC was judged based on the pre-seated judgmental criteria. Results Overall the implementation fidelity of the CEmONC service was 75.5%. Quality of delivery, participant responsiveness and adherence were 72.7%, 76.6% and 77.2% respectively. Signal functions like parenteral antibiotics and removal of retained products were insufficiently performed against the recommended protocols which was also evidenced by the key informant interviews. Healthcare providers’ respect for the clients was less. Age ≥ 35 years (AOR = 0.48, 95% CI: 0.24,0.98), educational status of college and above (AOR = 2.61, 95% CI: 1.46,4.66), being government employed (AOR = 1.85, 95% CI: 1.08,3.18), having ANC follow-up (AOR = 5.50, 95% CI: 1.83, 16.47) and grand multigravida (AOR = 2.17, 95% CI: 1.08, 4.38) were factors significantly associated with participant responsiveness towards the services. Conclusions The overall implementation fidelity of the CEmONC services was implemented in good fidelity. Moreover, the quality of delivery was judged as implemented in fair fidelity. Parenteral antibiotics and removal of retained products were not found to be sufficiently performed. Respect for the clients was insufficiently delivered. Therefore, it is recommended that parenteral antibiotics drugs be adequately provided and training for healthcare providers regarding compassionate and respectful care shall be facilitated. Moreover, healthcare providers are strongly recommended to adhere to the recommended guidelines.

In this article, we describe the conceptualization and development of the Secondary Transition Fidelity Assessment (STFA), a measure intended for use by high school leadership teams to examine secondary programs and practices demonstrated by research to lead to meaningful outcomes for secondary students with and without disabilities. We describe our conceptualization and development efforts, which resulted in a measure with six critical features: adolescent engagement, district-level capacity, school-level capacity, community engagement, family engagement, and professional capacity. Based on stakeholder feedback, we revised the STFA and developed an instruction manual and action planning guide to support the self-evaluation of secondary programs and practices using data from the STFA. Recommendations for the field related to research, policy, and practice are provided. [ABSTRACT FROM AUTHOR]

Abstract Background Malaria is still a disease of global public health importance and children under-five years of age are the most vulnerable to the disease. Nigeria adopted the “test and treat” strategy in the national malaria guidelines as one of the ways to control malaria transmission. The level of adherence to the guidelines is an important indicator for the success or failure of the country’s roadmap to malaria elimination by 2030. This study aimed to assess the fidelity of implementation of the national guidelines on malaria diagnosis for children under-five years and examine its associated moderating factors in health care facilities in Rivers State, Nigeria. Methods This was a descriptive, cross-sectional study conducted in Port Harcourt metropolis. Data were collected from 147 public, formal private and informal private health care facilities. The study used a questionnaire developed based on Carroll’s Conceptual Framework for Implementation Fidelity. Frequency, mean and median scores for implementation fidelity and its associated factors were calculated. Associations between fidelity and the measured predictors were examined using Mann Whitney U test, Kruskal Wallis test, and multiple linear regression modelling using robust estimation of errors. Regression results are presented in adjusted coefficient (β) and 95% confidence intervals. Results The median (IQR) score fidelity score for all participants was 65% (43.3, 85). Informal private facilities (proprietary patent medicine vendors) had the lowest fidelity scores (47%) compared to formal private (69%) and public health facilities (79%). Intervention complexity had a statistically significant inverse relationship to implementation fidelity (β = − 1.89 [− 3.42, − 0.34]). Increase in participant responsiveness (β = 8.57 [4.83, 12.32]) and the type of malaria test offered at the facility (e.g., RDT vs. no test, β = 16.90 [6.78, 27.03]; microscopy vs. no test, β = 21.88 [13.60, 30.16]) were positively associated with fidelity score. Conclusions This study showed that core elements of the “test and treat” strategy, such as testing all suspected cases with approved diagnostic methods before treatment, are still not fully implemented by health facilities. There is a need for strategies to increase fidelity, especially in the informal private health sector, for malaria elimination programme outcomes to be achieved.

Background: Malaria is still a disease of global public health importance and children under-five years of age are the most vulnerable to the disease. Nigeria adopted the "test and treat" strategy in the national malaria guidelines as one of the ways to control malaria transmission. The level of adherence to the guidelines is an important indicator for the success or failure of the country's roadmap to malaria elimination by 2030. This study aimed to assess the fidelity of implementation of the national guidelines on malaria diagnosis for children under-five years and examine its associated moderating factors in health care facilities in Rivers State, Nigeria. Methods: This was a descriptive, cross-sectional study conducted in Port Harcourt metropolis. Data were collected from 147 public, formal private and informal private health care facilities. The study used a questionnaire developed based on Carroll's Conceptual Framework for Implementation Fidelity. Frequency, mean and median scores for implementation fidelity and its associated factors were calculated. Associations between fidelity and the measured predictors were examined using Mann Whitney U test, Kruskal Wallis test, and multiple linear regression modelling using robust estimation of errors. Regression results are presented in adjusted coefficient (β) and 95% confidence intervals. Results: The median (IQR) score fidelity score for all participants was 65% (43.3, 85). Informal private facilities (proprietary patent medicine vendors) had the lowest fidelity scores (47%) compared to formal private (69%) and public health facilities (79%). Intervention complexity had a statistically significant inverse relationship to implementation fidelity (β = − 1.89 [− 3.42, − 0.34]). Increase in participant responsiveness (β = 8.57 [4.83, 12.32]) and the type of malaria test offered at the facility (e.g., RDT vs. no test, β = 16.90 [6.78, 27.03]; microscopy vs. no test, β = 21.88 [13.60, 30.16]) were positively associated with fidelity score. Conclusions: This study showed that core elements of the "test and treat" strategy, such as testing all suspected cases with approved diagnostic methods before treatment, are still not fully implemented by health facilities. There is a need for strategies to increase fidelity, especially in the informal private health sector, for malaria elimination programme outcomes to be achieved. [ABSTRACT FROM AUTHOR]

Restorative practices (RP) implementation requires substantial adult buy-in, time, leadership support, and resources. Limited studies have examined the implementation of RP from the perspectives of different groups of school professionals (e.g. teachers, paraprofessionals, and non-classroom staff) and their perceptions of RP implementation climate (i.e. support, efficacy, use). Fewer studies have investigated such differences in perceptions of RP support, efficacy, and utilization among school professionals at varying school levels (e.g. elementary, middle, and high school). We applied an exploratory, descriptive study design to better understand RP implementation among varying school roles and levels using a district-wide RP survey among school adults (N = 392) in a midsize urban school district in the Northeast. Perceptions of RP implementation differed by professional role, where paraprofessionals have similar levels of RP use and support compared to classroom teachers but indicate the lowest level of RP efficacy. Additionally, non-classroom staff reported the highest levels of RP support compared to paraprofessionals and teachers. Across school levels and implementation domains (support, efficacy, and use), elementary school staff reported the highest or most positive perceptions of RP implementation compared to middle and high school staff. Implications for implementing RP amongst various school roles, contexts, and levels are discussed. [ABSTRACT FROM AUTHOR]

Evidence-based practice (EBP) fidelity, understood as the extent to which a program is implemented as the developers intended, is a key implementation variable which likely relates to consumer outcomes. However, studies that track fidelity longitudinally and at large scale are uncommon, and finding reliable predictors of fidelity has proven to be a complex challenge. Further, attitudes toward EBP are a potentially important predictor of fidelity, but results across the literature have been mixed. The purpose of the present study is to use data from the ongoing implementation and dissemination of the SafeCare model to better understand (1) the characteristics of SafeCare implementation fidelity trajectories, and (2) whether individual level factors predict differences in fidelity and fidelity trajectories, especially provider attitudes toward EBP. The analyses reported here include 14,778 observed fidelity sessions by 868 providers in 172 agencies. We use multilevel modeling to examine fidelity, fidelity trajectories over time, and several potential individual-level predictors of fidelity, including demographics, work history, and attitudes toward EBP. We found: (1) that SafeCare fidelity begins high at baseline (93.85% on average); (2) that SafeCare fidelity displays a statistically significant trend of positive linear growth, even among those with less positive attitudes; and (3) that positive attitudes are associated with slightly higher fidelity on average and at baseline, while negative attitudes are associated with slightly lower fidelity on average and at baseline. To our knowledge, this is the largest longitudinal analysis of EBP fidelity in a child welfare program to date, and our findings support the notion that intensive coaching supports which are titrated over time can be sufficient to ensure sustained high fidelity, at least in some cases. Further, these findings indicate that robust training and coaching processes can ensure high fidelity and fidelity growth even among providers with less positive attitudes toward EBP. [ABSTRACT FROM AUTHOR]

Purpose: Treatment adherence is a central component of implementation fidelity and key to our understanding of client outcomes. This study examines treatment adherence in the Neurosequential Model of Therapeutics (NMT) and four functional outcomes among a sample of adopted youth: sensory integration, self-regulation, and relational and cognitive functioning. Methods: The sample includes 178 youth receiving supportive services from a U.S. adoption service provider. Regression analysis was used to examine clinician adherence to NMT recommendations and child outcomes. Results: Most (61.24%) of the essential or therapeutic treatment recommendations were carried out with majority adherence. A key finding is the predictive relationship between adherence to treatment recommendations and improvement in child outcomes at T2, controlling for all other variables in the model. Conclusions: Findings illustrate the importance of treatment adherence in promoting positive outcomes for children engaged in NMT. Implications are discussed regarding clinician training and reducing barriers to treatment adherence. [ABSTRACT FROM AUTHOR]

The article addresses the issue of underpowered trials in evaluating new care models, particularly in randomized controlled trials (RCTs). It highlights challenges like implementation issues and incomplete engagement, leading to ambiguous results. It suggests strategies for improving trial power, including cautious estimation of effect sizes, anticipating uptake challenges, using preparatory studies and others.

Background: Despite the large amount of leadership and implementation theories and recommendations, healthcare services continue to struggle with efficiently incorporating new knowledge. The questioning of conventional leadership approaches in healthcare organizations prompted us to investigate how frontline leaders comprehend their own implementation intentions and actions, and how these intentions and actions may impact the implementation of clinical guidelines in mental healthcare in Norway. Methods: Employing a theory-driven qualitative design, we conducted nine semi-structured interviews with frontline leaders who had recently led implementation of clinical guidelines for the treatment of psychosis in mental health. We employed Systematic Text Condensation, informed by Normalization Process Theory, to structure and analyze the data and used fidelity scales to measure the degree of implementation and distinguish between leaders' levels of success in implementation. Results: Frontline leaders in units that achieved high success in implementation described their intentions and actions differently, from those with less success. The former group's actions aligned more closely with the constructs of the Normalization Process Theory compared to the latter group when describing their actions. Frontline leaders leading units with a high degree of implementation success describe relation-orientation, trust, and providing adaptive space for staff members to take initiative. In contrast, those leading units with less implementation success describe more control and guidance of co-operators and place more emphasize on information and knowledge. Conclusion: Differences in how frontline leaders describe their actions and intentions to achieve clinical guideline implementation suggest that the leadership approach of these frontline leaders is an important factor to consider when planning and conducting implementation. To better understand the implementation process, it is important to pay attention to how frontline leaders customize their leadership approaches to the dynamics of complex organizations, and how they interact with their team and superiors. Plain Language Summary: Despite the large amount of available implementation theories and recommendations, healthcare services continue to struggle with efficiently incorporating new and better practice. The clinicians' closest leader, the Frontline leader, is considered to be in a unique position to manage and enable implementation in the complex healthcare system. The current study's aim was to improve our understanding of what these leaders do, and how they operate, to enable the implementation of clinical guidelines. We interviewed nine mental health service leaders in Norway with experience of leading implementation of clinical guideline during the last 3 years. We found a variety of leaders' intentions and actions regarding their involvement in the process and how they relate to their staff and superiors. Frontline leaders that lead units with high degree of implementation success described actions according to all four constructs of the Normalization Process Theory (Coherence, Cognitive participation, Collective action and Reflexive monitoring), while frontline leaders with less implementation success had more fragmented descriptions. Successful leaders appear to be more relation-oriented compared to those in less successful units. This suggests that leaders should focus on inter-personal dynamics, in addition to more concrete implementation interventions, to succeed. We recommend to take the leadership actions and intentions identified in this study into consideration when planning and evaluating implementation projects and leadership programs, as well as when recruiting frontline leaders. [ABSTRACT FROM AUTHOR]

Abstract Background Assessing the fidelity of intervention components enables researchers to make informed judgements about the influence of those components on the observed outcome. The ‘Implementing work-related Mental health guidelines in general PRacticE’ (IMPRovE) trial is a hybrid III trial aiming to increase adherence to the ‘Clinical Guidelines for the diagnosis and management of work-related mental health conditions in general practice’. IMPRovE is a multifaceted intervention, with one of the central components being academic detailing (AD). This study describes the fidelity to the protocol for the AD component of the IMPRovE intervention. Method All AD sessions for the trial were audio-recorded and a sample of 22% were randomly selected for fidelity assessment. Fidelity was assessed using a tailored proforma based on the Modified Conceptual Framework for fidelity assessment, measuring duration, coverage, frequency and content. A descriptive analysis was used to quantify fidelity to the protocol and a content analysis was used to elucidate qualitative aspects of fidelity. Results A total of eight AD sessions were included in the fidelity assessment. The average fidelity score was 89.2%, ranging from 80 to 100% across the eight sessions. The sessions were on average 47 min long and addressed all of the ten chapters in the guideline. Of the guideline chapters, 9 were frequently discussed. The least frequently discussed chapter related to management of comorbid conditions. Most general practitioner (GP) participants used the AD sessions to discuss challenges with managing secondary mental conditions. In line with the protocol, opinion leaders who delivered the AD sessions largely offered evidence-based strategies aligning with the clinical guideline recommendations. Conclusions/implications The IMPRovE AD intervention component was delivered to high fidelity. The sessions adhered to the intended duration, coverage, frequency, and content allowing participating GPs to comprehend the implementation of the guideline in their own practice. This study also demonstrates that the Modified Conceptual Fidelity Framework with a mixed methods approach can support the assessment of implementation fidelity of a behavioural intervention in general practice. The findings enhance the trustworthiness of reported outcomes from IMPRovE and show that assessing fidelity is amenable for AD and should be incorporated in other studies using AD. Trial registration Australian New Zealand Clinical Trials Registry ACTRN 12620001163998, November 2020.

AbstractThe impact of educational programs on student learning is contingent upon the quality and fidelity of their implementations. Yet, the most reliable method of implementation monitoring, direct observation, may be infeasible for large-scale efficacy studies. Here, we use log-file data from an efficacy study assessing the impact of gamified learning technologies on algebraic knowledge to measure the fidelity of implementations remotely within and across multiple programs. We employ exploratory-data-analysis to identify measures of fidelity, multilevel models to evaluate which levels of implementation contexts (i.e. classrooms, teachers, students) were associated with variance in fidelity metrics, and latent profile analysis to identify high and low-fidelity contexts. These analyses illustrate how log-file data may be used to remotely monitor and evaluate the implementations of online learning platforms. [ABSTRACT FROM AUTHOR]

Copyright of Pedagogische Studien is the property of Vereniging Onderwijsresearch and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Background: Few studies have investigated the effects of teacher training and continued support on teachers' delivery of evidence-based HIV prevention programs. We examined these factors in a national implementation study of an evidence-based HIV risk reduction intervention for adolescents in the sixth grade in the Bahamas. Methods: Data were collected from 126 grade 6 teachers and 3,118 students in 58 government elementary schools in the Bahamas in 2019–2021. This is a Hybrid Type III implementation study guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) model. Teachers attended 2-day training workshops. Trained school coordinators and peer mentors provided biweekly monitoring and mentorship. We used mixed-effects models to assess the effects of teacher training and continued support on implementation fidelity. Results: Teachers who received training in-person or both in-person and online taught the most core activities (27.0 and 27.2 of 35), versus only online training (21.9) and no training (14.9) (F = 15.27, p <.001). Teachers with an "excellent" or "very good" school coordinator taught more core activities than those with a "satisfactory" coordinator or no coordinator (29.2 vs. 27.8 vs. 19.3 vs. 14.8, F = 29.20, p <.001). Teachers with a "very good" mentor taught more core activities and sessions than those with a "satisfactory" mentor or no mentor (30.4 vs. 25.0 vs. 23.1; F = 7.20; p <.01). Teacher training, implementation monitoring, peer mentoring, teachers' self-efficacy, and school-level support were associated with implementation fidelity, which in turn was associated with improved student outcomes (HIV/AIDS knowledge, preventive reproductive health skills, self-efficacy, and intention to use protection). Conclusion: Teachers receiving in-person training and those having higher-rated school coordinator and mentor support taught a larger number of HIV prevention core activities. Effective teacher training, implementation monitoring, and peer mentoring are critical for improving implementation fidelity and student outcomes. [ABSTRACT FROM AUTHOR]

Background: Assessing the fidelity of intervention components enables researchers to make informed judgements about the influence of those components on the observed outcome. The 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial is a hybrid III trial aiming to increase adherence to the 'Clinical Guidelines for the diagnosis and management of work-related mental health conditions in general practice'. IMPRovE is a multifaceted intervention, with one of the central components being academic detailing (AD). This study describes the fidelity to the protocol for the AD component of the IMPRovE intervention. Method: All AD sessions for the trial were audio-recorded and a sample of 22% were randomly selected for fidelity assessment. Fidelity was assessed using a tailored proforma based on the Modified Conceptual Framework for fidelity assessment, measuring duration, coverage, frequency and content. A descriptive analysis was used to quantify fidelity to the protocol and a content analysis was used to elucidate qualitative aspects of fidelity. Results: A total of eight AD sessions were included in the fidelity assessment. The average fidelity score was 89.2%, ranging from 80 to 100% across the eight sessions. The sessions were on average 47 min long and addressed all of the ten chapters in the guideline. Of the guideline chapters, 9 were frequently discussed. The least frequently discussed chapter related to management of comorbid conditions. Most general practitioner (GP) participants used the AD sessions to discuss challenges with managing secondary mental conditions. In line with the protocol, opinion leaders who delivered the AD sessions largely offered evidence-based strategies aligning with the clinical guideline recommendations. Conclusions/implications: The IMPRovE AD intervention component was delivered to high fidelity. The sessions adhered to the intended duration, coverage, frequency, and content allowing participating GPs to comprehend the implementation of the guideline in their own practice. This study also demonstrates that the Modified Conceptual Fidelity Framework with a mixed methods approach can support the assessment of implementation fidelity of a behavioural intervention in general practice. The findings enhance the trustworthiness of reported outcomes from IMPRovE and show that assessing fidelity is amenable for AD and should be incorporated in other studies using AD. Trial registration: Australian New Zealand Clinical Trials Registry ACTRN 12620001163998, November 2020. [ABSTRACT FROM AUTHOR]

Abstract Background An on-site pharmacist (OSP) intervention was implemented which sought to improve medication management within residential aged care facilities (RACFs) in the Australian Capital Territory, Australia. The objectives of this mixed methods study were to evaluate the implementation fidelity of the OSP intervention and to determine the moderating factors which influenced delivery of this intervention. Methods This convergent parallel mixed methods study was underpinned by Hasson’s conceptual framework for implementation fidelity. Implementation fidelity for seven intervention RACFs was quantitatively assessed using three quantitative data sets: (1) range of OSP intervention activities delivered; (2) random sample of 10% of medication reviews assessed for quality; (3) proportion of residents who received at least one medication review. Semi-structured interviews (n = 14) with managers and OSPs across the intervention RACFs were conducted to identify moderating factors which may have influenced OSP intervention delivery. Results The OSP intervention was generally delivered as intended with overall medium levels of implementation fidelity. This delivery was supported by a range of facilitation strategies with most participants perceiving that the intervention was delivered to a high standard. RACF managers and OSPs were mostly well engaged and responsive. A number of potential barriers (including the part-time OSP role, COVID-19 pandemic, RACFs spread out over a large area with significant distance between resident dwellings) and facilitators (including the pharmacist support meetings, OSPs who took time to establish relationships, RACF managers who actively supported OSPs and worked with them) for OSP intervention delivery were identified which have potential implications for the roll out of OSPs within Australian RACFs. Conclusion In this study, the implementation fidelity of OSP intervention delivery was assessed with overall medium levels of fidelity found across the intervention RACFs. This suggested that the OSP intervention can generally be delivered as intended in real world RACFs. OSP intervention delivery was influenced by a range of moderating factors, some of which posed barriers and others which facilitated the OSP intervention being delivered as intended.

BackgroundParkinson's disease (PD) complexity poses challenges for individuals with Parkinson's, providers, and researchers. A recent multisite randomized trial of a proactive, telephone-based, nurse-led care management intervention - Care Coordination for Health Promotion and Activities in Parkinson's Disease (CHAPS) - demonstrated improved PD care quality. Implementation details and supportive stakeholder feedback were subsequently published. To inform decisions on dissemination, CHAPS Model components require evaluations of their fidelity to the Chronic Care Model and to their implementation. Additionally, assessment is needed on whether CHAPS addresses care challenges cited in recent literature.MethodsThese analyses are based on data from a subset of 140 intervention arm participants and other CHAPS data. To examine CHAPS Model fidelity, we identified CHAPS components corresponding to the Chronic Care Model's six essential elements. To assess implementation fidelity of these components, we examined data corresponding to Hasson's modified implementation fidelity framework. Finally, we identified challenges cited in current Parkinson's care management literature, grouped these into themes using open card sorting techniques, and examined CHAPS data for evidence that CHAPS met these challenges.ResultsAll Chronic Care Model essential elements were addressed by 17 CHAPS components, thus achieving CHAPS Model fidelity. CHAPS implementation fidelity was demonstrated by adherence to content, frequency, and duration with partial fidelity to telephone encounter frequency. We identified potential fidelity moderators for all six of Hasson's moderator types. Through card sorting, four Parkinson's care management challenge themes emerged: unmet needs and suggestions for providers (by patient and/or care partner), patient characteristics needing consideration, and standardizing models for Parkinson's care management. CHAPS activities and stakeholder perceptions addressed all these themes.ConclusionsCHAPS, a supportive nurse-led proactive Parkinson's care management program, improved care quality and is designed to be reproducible and supportive to clinicians. Findings indicated CHAPS Model fidelity occurred to the Chronic Care Model and fidelity to implementation of the CHAPS components was demonstrated. Current Parkinson's care management challenges were met through CHAPS activities. Thus, dissemination of CHAPS merits consideration by those responsible for implementing changes in clinical practice and reaching people in need.Trial registrationClinicalTrials.gov as NCT01532986 , registered on January 13, 2012.

Abstract Background Most implementations fail before the corresponding services are ever delivered. Measuring implementation process fidelity may reveal when and why these attempts fail. This knowledge is necessary to support the achievement of positive implementation milestones, such as delivering services to clients (program start-up) and competency in treatment delivery. The present study evaluates the extent to which implementation process fidelity at different implementation stages predicts achievement of those milestones. Methods Implementation process fidelity data—as measured by the Stages of Implementation Completion (SIC)—from 1287 implementing sites across 27 evidence-informed programs were examined in mixed effects regression models with sites nested within programs. Implementation process fidelity, as measured by the proportion of implementation activities completed during the three stages of the SIC Pre-Implementation phase and overall Pre-Implementation (Phase 1) and Implementation (Phase 2) proportion scores, was assessed as a predictor of sites achieving program start-up (i.e., delivering services) and competency in program delivery. Results The predicted probability of start-up across all sites was low at 35% (95% CI [33%, 38%]). When considering the evidence-informed program being implemented, that probability was nearly twice as high (64%; 95% CI [42%, 82%]), and 57% of the total variance in program start-up was attributable to the program. Implementation process fidelity was positively and significantly associated with achievement of program start-up and competency. The magnitude of this relationship varied significantly across programs for Pre-Implementation Stage 1 (i.e., Engagement) only. Compared to other stages, completing more Pre-Implementation Stage 3 (Readiness Planning) activities resulted in the most rapid gains in probability of achieving program start-up. The predicted probability of achieving competency was very low unless sites had high scores in both Pre-Implementation and Implementation phases. Conclusions Strong implementation process fidelity—as measured by SIC Pre-Implementation and Implementation phase proportion scores—was associated with sites’ achievement of program start-up and competency in program delivery, with early implementation process fidelity being especially potent. These findings highlight the importance of a rigorous Pre-Implementation process.

Abstract Background Toybox is a kindergarten-based intervention program that targets sedentary behavior, snacking and drinking habits, as well as promoting physical activity in an effort to improve healthy energy balance-related behaviors among children attending kindergartens in Malaysia. The pilot of this program was conducted as a randomized controlled trial (RCT) involving 837 children from 22 intervention kindergartens and 26 control kindergartens respectively. This paper outlines the process evaluation of this intervention. Methods We assessed five process indicators: recruitment, retention, dosage, fidelity, and satisfaction for the Toybox program. Data collection was conducted via teachers’ monthly logbooks, post-intervention feedback through questionnaires, and focus group discussions (FGD) with teachers, parents, and children. Data were analyzed using quantitative and qualitative data analysis methods. Results A total of 1072 children were invited. Out of the 1001 children whose parents consented to join, only 837 completed the program (Retention rate: 88.4%). As high as 91% of the 44 teachers and their assistants engaged positively in one or more of the process evaluation data collection methods. In terms of dosage and fidelity, 76% of parents had received newsletters, tip cards, and posters at the appropriate times. All teachers and their assistants felt satisfied with the intervention program. However, they also mentioned some barriers to its implementation, including the lack of suitable indoor environments to conduct activities and the need to make kangaroo stories more interesting to captivate the children’s attention. As for parents, 88% of them were satisfied with the family-based activities and enjoyed them. They also felt that the materials provided were easy to understand and managed to improve their knowledge. Lastly, the children showed positive behaviors in consuming more water, fruits, and vegetables. Conclusions The Toybox program was deemed acceptable and feasible to implement by the parents and teachers. However, several factors need to be improved before it can be expanded and embedded as a routine practice across Malaysia.

Abstract Background Healthcare-Acquired Infections are a major problem in the world and within the healthcare delivery system. An estimated 5–10% and around 25% of hospitalized patients have healthcare-acquired infections in developed and developing countries, respectively. Infection prevention and control programs have proven to be successful in lowering the incidence and spread of infections. Thus, this evaluation aims to evaluate the implementation fidelity of infection prevention practices at Debre Tabor comprehensive specialized hospital in Northwest Ethiopia. Methods A facility-based cross-sectional design with a concurrent mixed method was used to evaluate the implementation fidelity of infection prevention practices. A total of 36 indicators were used to measure adherence, participant responsiveness, and facilitation strategy dimensions. A total of 423 clients were administered for an interview, an inventory checklist, a document review, 35 non-participatory observations, and 11 key informant interviews were conducted. A multivariable logistic regression analysis was used to identify factors significantly associated with the satisfaction of clients. The findings were presented using descriptions, tables, and graphs. Result The overall implementation fidelity of the infection prevention practices was 61.8%. The dimensions of adherence to infection prevention and control guidelines were 71.4%, participant responsiveness was 60.6%, and facilitation strategy was 48%. In multivariable analysis, ward admission and educational level had a p-value of below 0.05 and were significantly associated with the satisfaction of clients with infection prevention practices at the hospital. The major themes that emerged in qualitative data analysis were healthcare worker-related factors, management-related factors, and patient- and visitor-related factors. Conclusion The evaluation result of this study concluded that the overall implementation fidelity of infection prevention practice was judged to be medium and needed improvement. It included dimensions of adherence and participant responsiveness that were rated as medium, as well as a facilitation strategy that was rated as low. Enablers and barriers were thematized into factors related to healthcare providers, management, institutions, and patient and visitor relations.

Abstract Background HIV assisted partner services (aPS) is an intervention to improve HIV status awareness among sex and drug-injecting partners of people newly diagnosed with HIV (index clients). Implementation fidelity—the degree to which an intervention is conducted as intended – is critical to effectiveness, but there are limited data about aPS fidelity when delivered by HIV testing service (HTS) providers. We explored factors affecting implementation fidelity to aPS in two high-HIV prevalence counties in western Kenya. Methods We used convergent mixed methods adapting the conceptual framework for implementation fidelity within the aPS scale-up project. This was an implementation study examining scale-up of APS within HTS programs in Kisumu and Homa Bay counties that recruited male sex partners (MSPs) of female index clients. We defined implementation fidelity as the extent to which HTS providers followed the protocol for phone and in-person participant tracing at six expected tracing attempts. Quantitative data were collected from tracing reports in 31 facilities between November 2018 and December 2020, and in-depth interviews (IDIs) were conducted with HTS providers. Descriptive statistics were used to describe tracing attempts. IDIs were analyzed using thematic content analysis. Results Overall, 3017 MSPs were mentioned of whom 98% (2969/3017) were traced, with most tracing attempts being successful (2831/2969, 95%). Fourteen HTS providers participated in the IDIs—mostly females (10/14, 71%) with a median age of 35 years (range 25–52), who all had post-secondary education (14/14, 100%). The proportion of tracing attempts occurring by phone ranged from 47 to 66%, with the highest proportion occurring on the first attempt and lowest on the sixth attempt. Contextual factors either enhanced or impeded implementation fidelity to aPS. Positive provider attitudes towards aPS and conducive work environment factors promoted implementation fidelity, while negative MSP responses and challenging tracing conditions impeded it. Conclusion Interactions at the individual (provider), interpersonal (client—provider), and health systems (facility) levels affected implementation fidelity to aPS. As policymakers prioritize strategies to reduce new HIV infections, our findings highlight the importance of conducting fidelity assessments to better anticipate and mitigate the impact of contextual factors during the scale-up of interventions.

Background Dengue is the most common and widespread mosquito-borne arboviral disease globally estimated to cause >390 million infections and >20,000 deaths annually. There are no effective preventive drugs and the newly introduced vaccines are not yet available. Control of dengue transmission still relies primarily on mosquito vector control. Although most vector control methods currently used by national dengue control programs may temporarily reduce mosquito populations, there is little evidence that they affect transmission. There is an urgent need for innovative, participatory, effective, and locally adapted approaches for sustainable vector control and monitoring in which students can be particularly relevant contributors and to demonstrate a clear link between vector reduction and dengue transmission reduction, using tools that are inexpensive and easy to use by local communities in a sustainable manner. Methods Here we describe a cluster randomized controlled trial to be conducted in 46 school catchment areas in two townships in Yangon, Myanmar. The outcome measures are dengue cases confirmed by rapid diagnostic test in the townships, dengue incidence in schools, entomological indices, knowledge, attitudes and practice, behavior, and engagement. Conclusions The trial involves middle school students that positions them to become actors in dengue knowledge transfer to their communities and take a leadership role in the delivery of vector control interventions and monitoring methods. Following this rationale, we believe that students can become change agents of decentralized vector surveillance and sustainable disease control in line with recent new paradigms in integrated and participatory vector surveillance and control. This provides an opportunity to operationalize transdisciplinary research towards sustainable health development. Due to the COVID-19 pandemic and political instability in Myanmar the project has been terminated by the donor, but the protocol will be helpful for potential future implementation of the project in Myanmar and/or elsewhere. Registration: This trial was registered in the ISRCTN Registry on 31 May 2022 (https://doi.org/10.1186/ISRCTN78254298).

Context: Health disparities in patients with limited English proficiency are worsened due to scarcity of interpreter-focused communication interventions and trainings. Objectives: To develop a high-fidelity simulation training for interpreters to use a novel pain communication tool, i.e., Pain Assessment Information Visualization (InfoViz) Tool, and evaluate interpreters' implementation fidelity during a pilot study. Methods: This research methodology study involved training interpreters through high-fidelity simulations and assessing the implementation fidelity of 20 patient-provider visits in primary care clinics. Descriptive statistics were calculated for the assessment and fidelity. Debriefing interviews were conducted after the training and at the study completion. These were transcribed and analyzed using thematic analysis. Results: Four interpreters completed training, requesting an average of 2.5 practice simulation studies prior to assessment (M = 54 min, score: M = 95%). Interviews revealed two themes: positive experiences and suggestions for improvement. Interpreters averaged 83% for implementation fidelity for the 20 visits. Post-study interviews revealed positive experiences and the need for refresher training. Conclusion: The communication simulation training for interpreters is feasible, acceptable, and can ensure accurate use of the Pain InfoViz Tool during provider-patient communication. Innovation: We applied a InfoViz Tool in pain simulations and extended high-fidelity training to medical interpreting.

Background: An on-site pharmacist (OSP) intervention was implemented which sought to improve medication management within residential aged care facilities (RACFs) in the Australian Capital Territory, Australia. The objectives of this mixed methods study were to evaluate the implementation fidelity of the OSP intervention and to determine the moderating factors which influenced delivery of this intervention. Methods: This convergent parallel mixed methods study was underpinned by Hasson's conceptual framework for implementation fidelity. Implementation fidelity for seven intervention RACFs was quantitatively assessed using three quantitative data sets: (1) range of OSP intervention activities delivered; (2) random sample of 10% of medication reviews assessed for quality; (3) proportion of residents who received at least one medication review. Semi-structured interviews (n = 14) with managers and OSPs across the intervention RACFs were conducted to identify moderating factors which may have influenced OSP intervention delivery. Results: The OSP intervention was generally delivered as intended with overall medium levels of implementation fidelity. This delivery was supported by a range of facilitation strategies with most participants perceiving that the intervention was delivered to a high standard. RACF managers and OSPs were mostly well engaged and responsive. A number of potential barriers (including the part-time OSP role, COVID-19 pandemic, RACFs spread out over a large area with significant distance between resident dwellings) and facilitators (including the pharmacist support meetings, OSPs who took time to establish relationships, RACF managers who actively supported OSPs and worked with them) for OSP intervention delivery were identified which have potential implications for the roll out of OSPs within Australian RACFs. Conclusion: In this study, the implementation fidelity of OSP intervention delivery was assessed with overall medium levels of fidelity found across the intervention RACFs. This suggested that the OSP intervention can generally be delivered as intended in real world RACFs. OSP intervention delivery was influenced by a range of moderating factors, some of which posed barriers and others which facilitated the OSP intervention being delivered as intended. [ABSTRACT FROM AUTHOR]

District leadership teams perform key roles in building the systems to support schools in the implementation of Positive Behavioral Interventions and Supports (PBIS). However, there is a lack of measures for assessment and progress monitoring specific to district PBIS systems. To address this gap, we evaluated the validity of a measure of implementation of district PBIS systems, the District Systems Fidelity Inventory (DSFI). Using 183 school districts and 760 schools implementing PBIS, we found the DSFI to have good evidence of structural validity for measuring nine aspects of district systems (Leadership Teaming, Stakeholder Engagement, Funding and Alignment, Policy, Workforce Capacity, Training, Coaching, Evaluation, and Local Implementation Demonstrations). We also found DSFI subscales to be moderately related to school-level PBIS implementation fidelity, providing evidence of convergent validity. We describe how leadership teams can use the DSFI to improve PBIS implementation and student outcomes. [ABSTRACT FROM AUTHOR]

Purpose: This paper examines implementation fidelity (IF) and the underpinning conceptual framework drawing on the evaluation of a UK-wide, manualized child abuse and neglect prevention program for elementary schools. We describe and assess our approach to assessing IF and consider how IF can inform program development. Method: We drew on the literature on program fidelity and critical components of the program evaluated to identify three dimensions of IF: Coverage, Quality and Context. Data was collected through external observations using systemized observation schedules which were extracted to be scored using scoring protocols for each intervention type. Scores were calculated by two researchers with a random sample cross-checked by a third member of the research team. Results: Observation analysis demonstrated consistency in the coverage of content when delivering assemblies for both younger and older children with at least 76% coverage of content across the assemblies. However, observation analysis revealed greater levels of variability in the delivery of workshops. Material on sexual abuse was less fully covered and children reported that some facilitators lacked confidence and clarity in delivering this material (Stanley et al., 2023). Conclusion: Our results indicate the usefulness of systemized observations in capturing coverage of content, these findings underscore the importance of developing scoring protocols and training observers prior to evaluating program delivery. We highlight the significance of integrating implementation fidelity training for program facilitators and implementers to both assist with monitoring and to maintain quality, despite variations in the actual delivery and setting of the program. [ABSTRACT FROM AUTHOR]

Abstract Background It is critical to assess implementation fidelity of evidence-based interventions and factors moderating fidelity, to understand the reasons for their success or failure. However, fidelity and fidelity moderators are seldom systematically reported. The study objective was to conduct a concurrent implementation fidelity evaluation and examine fidelity moderators of CHORD (Community Health Outreach to Reduce Diabetes), a pragmatic, cluster-randomized, controlled trial to test the impact of a Community Health Workers (CHW)-led health coaching intervention to prevent incident type 2 Diabetes Mellitus in New York (NY). Methods We applied the Conceptual Framework for Implementation Fidelity to assess implementation fidelity and factors moderating it across the four core intervention components: patient goal setting, education topic coaching, primary care (PC) visits, and referrals to address social determinants of health (SDH), using descriptive statistics and regression models. PC patients with prediabetes receiving care from safety-net patient-centered medical homes (PCMHs) at either, VA NY Harbor or at Bellevue Hospital (BH) were eligible to be randomized into the CHW-led CHORD intervention or usual care. Among 559 patients randomized and enrolled in the intervention group, 79.4% completed the intake survey and were included in the analytic sample for fidelity assessment. Fidelity was measured as coverage, content adherence and frequency of each core component, and the moderators assessed were implementation site and patient activation measure. Results Content adherence was high for three components with nearly 80.0% of patients setting ≥ 1 goal, having ≥ 1 PC visit and receiving ≥ 1 education session. Only 45.0% patients received ≥ 1 SDH referral. After adjusting for patient gender, language, race, ethnicity, and age, the implementation site moderated adherence to goal setting (77.4% BH vs. 87.7% VA), educational coaching (78.9% BH vs. 88.3% VA), number of successful CHW-patient encounters (6 BH vs 4 VA) and percent of patients receiving all four components (41.1% BH vs. 25.7% VA). Conclusions The fidelity to the four CHORD intervention components differed between the two implementation sites, demonstrating the challenges in implementing complex evidence-based interventions in different settings. Our findings underscore the importance of measuring implementation fidelity in contextualizing the outcomes of randomized trials of complex multi-site behavioral interventions. Trial registration The trial was registered with ClinicalTrials.gov on 30/12/2016 and the registration number is NCT03006666 .

Abstract Background Self-management is essential for good outcomes in type 2 diabetes and patients often benefit from self-management education. Shared medical appointments (SMAs) can increase self-efficacy for self management but are difficult for some primary care practices to implement. Understanding how practices adapt processes and delivery of SMAs for patients with type 2 diabetes may provide helpful strategies for other practices interested in implementing SMAs. Methods The Invested in Diabetes study was a pragmatic cluster-randomized, comparative effectiveness trial designed to compare two different models of diabetes SMAs delivered in primary care. We used a multi-method approach guided by the FRAME to assess practices’ experience with implementation, including any planned and unplanned adaptations. Data sources included interviews, practice observations and field notes from practice facilitator check-ins. Results Several findings were identified from the data: 1) Modifications and adaptations are common in implementation of SMAs, 2) while most adaptations were fidelity-consistent supporting the core components of the intervention conditions as designed, some were not, 3) Adaptations were perceived to be necessary to help SMAs meet patient and practice needs and overcome implementation challenges, and 4) Content changes in the sessions were often planned and enacted to better address the contextual circumstances such as patient needs and culture. Discussion Implementing SMAs in primary care can be challenging and adaptations of both implementation processes and content and delivery of SMAS for patients with type 2 diabetes were common in the Invested in Diabetes study. Recognizing the need for adaptations based on practice context prior to implementation may help improve fit and success with SMAs, but care needs to be given to ensure that adaptations do not weaken the impact of the intervention. Practices may be able to assess what might need to adapted for them to be successful prior to implementation but likely will continue to adapt after implementation. Conclusion Adaptations were common in the Invested in Diabetes study. Practices may benefit from understanding common challenges in implementing SMAs and adapting processes and delivery based on their own context. Trial registration This trial is registered on clinicaltrials.gov under Trial number NCT03590041, posted 18/07/2018.

Abstract Background Implementation fidelity assesses the degree to which an intervention is delivered as it should be. Fidelity helps to determine if the outcome(s) of an intervention are attributed to the intervention itself or to a failure of its implementation. Little is known about how fidelity impacts the intended outcome(s) and what elements or moderators can affect the fidelity trajectory over time. We exemplify the meaning of implementation fidelity with INTERCARE, a nurse-led care model that was implemented in eleven Swiss nursing homes (NHs) and showed effectiveness in reducing unplanned hospital transfers. INTERCARE comprises six core elements, including advance care planning and tools to support inter- and interprofessional communication, which were introduced with carefully developed implementation strategies. Methods A mixed-methods convergent/triangulation design was used to investigate the influence of implementation fidelity on unplanned transfers. A fidelity questionnaire measuring the degree of fidelity to INTERCARE’s core components was fielded at four time points in the participating NHs. Two-monthly meetings were conducted with NHs (September 2018-January 2020) and structured notes were used to determine moderators affecting fidelity (e.g., participant responsiveness). We used the fidelity scores and generalized linear mixed models to analyze the quantitative data. The Framework method was used for the qualitative analysis. The quantitative and qualitative findings were integrated using triangulation. Results A higher overall fidelity score showed a decreasing rate of unplanned hospital transfers post-intervention (OR: 0.65 (CI = 0.43–0.99), p = 0.047). A higher fidelity score to advance care planning was associated with lower unplanned transfers (OR = 0.24 (CI 0.13–0.44), p =

Background: Most implementations fail before the corresponding services are ever delivered. Measuring implementation process fidelity may reveal when and why these attempts fail. This knowledge is necessary to support the achievement of positive implementation milestones, such as delivering services to clients (program start-up) and competency in treatment delivery. The present study evaluates the extent to which implementation process fidelity at different implementation stages predicts achievement of those milestones. Methods: Implementation process fidelity data—as measured by the Stages of Implementation Completion (SIC)—from 1287 implementing sites across 27 evidence-informed programs were examined in mixed effects regression models with sites nested within programs. Implementation process fidelity, as measured by the proportion of implementation activities completed during the three stages of the SIC Pre-Implementation phase and overall Pre-Implementation (Phase 1) and Implementation (Phase 2) proportion scores, was assessed as a predictor of sites achieving program start-up (i.e., delivering services) and competency in program delivery. Results: The predicted probability of start-up across all sites was low at 35% (95% CI [33%, 38%]). When considering the evidence-informed program being implemented, that probability was nearly twice as high (64%; 95% CI [42%, 82%]), and 57% of the total variance in program start-up was attributable to the program. Implementation process fidelity was positively and significantly associated with achievement of program start-up and competency. The magnitude of this relationship varied significantly across programs for Pre-Implementation Stage 1 (i.e., Engagement) only. Compared to other stages, completing more Pre-Implementation Stage 3 (Readiness Planning) activities resulted in the most rapid gains in probability of achieving program start-up. The predicted probability of achieving competency was very low unless sites had high scores in both Pre-Implementation and Implementation phases. Conclusions: Strong implementation process fidelity—as measured by SIC Pre-Implementation and Implementation phase proportion scores—was associated with sites' achievement of program start-up and competency in program delivery, with early implementation process fidelity being especially potent. These findings highlight the importance of a rigorous Pre-Implementation process. [ABSTRACT FROM AUTHOR]

Trial-based functional analysis (TBFA) is an accurate and ecologically valid assessment of challenging behavior. Further, there is evidence to suggest that individuals with minimal exposure to behavior analytic assessment methodology (e.g., parents, teachers) can quickly be trained to conduct TBFAs in naturalistic settings (e.g., schools, homes). Notwithstanding, the response effort associated with training development can be prohibitive and may preclude incorporation of TBFA into practice. To address this, we developed a partially automated training package, intended to increase the methodology's accessibility. Using a multiple-probe across skills design, we assessed the degree to which the package increased caregiver accuracy in (a) implementing TBFAs, (b) interpreting TBFA outcomes, and (c) managing TBFA data. Six caregivers completed this study and all demonstrated proficiency following training, first during structured roleplays and again during assessment of their child's actual challenging behavior. [ABSTRACT FROM AUTHOR]

Implementation fidelity is the degree of compliance with which the core elements of program or intervention practices are used as intended. The scientific literature reveals gaps in defining and assessing implementation fidelity in early intervention: lack of common definitions and conceptual framework as well as their lack of application. Through a critical review of the scientific literature, this article aims to identify information that can be used to develop a common language and guidelines for assessing implementation fidelity. An analysis of 46 theoretical and empirical papers about early intervention implementation, published between 1998 and 2018, identified four conceptual frameworks, in addition to that of Dane and Schneider. Following analysis of the conceptual frameworks, a four-component conceptualization of implementation fidelity (adherence, dosage, quality and participant responsiveness) is proposed. [ABSTRACT FROM AUTHOR]

Background: Healthcare-Acquired Infections are a major problem in the world and within the healthcare delivery system. An estimated 5–10% and around 25% of hospitalized patients have healthcare-acquired infections in developed and developing countries, respectively. Infection prevention and control programs have proven to be successful in lowering the incidence and spread of infections. Thus, this evaluation aims to evaluate the implementation fidelity of infection prevention practices at Debre Tabor comprehensive specialized hospital in Northwest Ethiopia. Methods: A facility-based cross-sectional design with a concurrent mixed method was used to evaluate the implementation fidelity of infection prevention practices. A total of 36 indicators were used to measure adherence, participant responsiveness, and facilitation strategy dimensions. A total of 423 clients were administered for an interview, an inventory checklist, a document review, 35 non-participatory observations, and 11 key informant interviews were conducted. A multivariable logistic regression analysis was used to identify factors significantly associated with the satisfaction of clients. The findings were presented using descriptions, tables, and graphs. Result: The overall implementation fidelity of the infection prevention practices was 61.8%. The dimensions of adherence to infection prevention and control guidelines were 71.4%, participant responsiveness was 60.6%, and facilitation strategy was 48%. In multivariable analysis, ward admission and educational level had a p-value of below 0.05 and were significantly associated with the satisfaction of clients with infection prevention practices at the hospital. The major themes that emerged in qualitative data analysis were healthcare worker-related factors, management-related factors, and patient- and visitor-related factors. Conclusion: The evaluation result of this study concluded that the overall implementation fidelity of infection prevention practice was judged to be medium and needed improvement. It included dimensions of adherence and participant responsiveness that were rated as medium, as well as a facilitation strategy that was rated as low. Enablers and barriers were thematized into factors related to healthcare providers, management, institutions, and patient and visitor relations. [ABSTRACT FROM AUTHOR]

Background: HIV assisted partner services (aPS) is an intervention to improve HIV status awareness among sex and drug-injecting partners of people newly diagnosed with HIV (index clients). Implementation fidelity—the degree to which an intervention is conducted as intended – is critical to effectiveness, but there are limited data about aPS fidelity when delivered by HIV testing service (HTS) providers. We explored factors affecting implementation fidelity to aPS in two high-HIV prevalence counties in western Kenya. Methods: We used convergent mixed methods adapting the conceptual framework for implementation fidelity within the aPS scale-up project. This was an implementation study examining scale-up of APS within HTS programs in Kisumu and Homa Bay counties that recruited male sex partners (MSPs) of female index clients. We defined implementation fidelity as the extent to which HTS providers followed the protocol for phone and in-person participant tracing at six expected tracing attempts. Quantitative data were collected from tracing reports in 31 facilities between November 2018 and December 2020, and in-depth interviews (IDIs) were conducted with HTS providers. Descriptive statistics were used to describe tracing attempts. IDIs were analyzed using thematic content analysis. Results: Overall, 3017 MSPs were mentioned of whom 98% (2969/3017) were traced, with most tracing attempts being successful (2831/2969, 95%). Fourteen HTS providers participated in the IDIs—mostly females (10/14, 71%) with a median age of 35 years (range 25–52), who all had post-secondary education (14/14, 100%). The proportion of tracing attempts occurring by phone ranged from 47 to 66%, with the highest proportion occurring on the first attempt and lowest on the sixth attempt. Contextual factors either enhanced or impeded implementation fidelity to aPS. Positive provider attitudes towards aPS and conducive work environment factors promoted implementation fidelity, while negative MSP responses and challenging tracing conditions impeded it. Conclusion: Interactions at the individual (provider), interpersonal (client—provider), and health systems (facility) levels affected implementation fidelity to aPS. As policymakers prioritize strategies to reduce new HIV infections, our findings highlight the importance of conducting fidelity assessments to better anticipate and mitigate the impact of contextual factors during the scale-up of interventions. [ABSTRACT FROM AUTHOR]

Purpose: Support implementation fidelity in intervention research with lesbian, gay, bisexual, transgender, queer, and sexual and gender diverse (LGBTQ+) populations, this study explores the systematic development of a fidelity process for AFFIRM, an evidence-based, affirmative cognitive behavioral therapy group intervention for LGBTQ+ youth and adults. Method: As part of a clinical trial, the AFFIRM fidelity checklist was designed to assess clinician adherence. A total of 151 audio-recorded group sessions were coded by four trained raters. Results: Adherence was high with a mean fidelity score of 84.13 (SD = 12.50). Inter-rater reliability was 81%, suggesting substantial agreement. Qualitative thematic analysis of low-rated sessions identified deviations from the manual and difficulties in group facilitation, while high-rated sessions specified affirmative and effective clinical responses. Discussion: Findings were integrated into clinical training and coaching. The fidelity process provides insights into the challenges of implementing social work interventions effectively with LGBTQ+ populations in community settings. [ABSTRACT FROM AUTHOR]

Copyright of Revue des Sciences de l'Education is the property of Revue des Sciences de l'Education and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Abstract Background In Argentina, HPV self-collection offered by community health workers was demonstrated to be effective to improve cervical cancer screening uptake. Based on these findings, the EMA strategy was scaled up in nine Argentinian provinces. However, there is no evidence about the degree of fidelity—in relation to the core components proposed by the National Program on Cervical Cancer Prevention—with which this strategy was implemented in the new jurisdictions. We carried out a fidelity evaluation of the EMA strategy scaling-up aimed at evaluating the level of adherence to the core components of the EMA strategy, and how different moderating factors affected the implementation fidelity. Methods This descriptive study used a multi-method approach involving quantitative and qualitative evaluations of the implementation fidelity using the Conceptual Framework for Implementation Fidelity. Evaluation of the degree of adherence to the core components of the EMA strategy was carried out through the analysis of a self-administered survey of health promoters, observations, and secondary data from the National Screening Information System. The analysis of moderating factors was carried out through analysis of field notes, and semi-structured interviews with key stakeholders. Results Our results showed that the core components with highest fidelity were training, sample handling, and transportation. Regarding the offer of HPV self-collection, we found some adaptations such as locations in which health promoters offered HPV self-collection, and fewer pieces of information provided to women during the offer. In the follow-up and treatment core component, we found a reduced adherence to triage and colposcopy. Some contextual factors had a negative impact on implementation fidelity, such as urban insecurity and the reduction in the number of health promoters that offered HPV self-collection. Moderating factors that contributed to achieve high level of fidelity included a well-defined strategy with clear steps to follow, permanent feedback and high level of engagement among implementers. Conclusions Our study shows how the analysis of fidelity and adaptations of HPV self-collection in real-world contexts are key to measure and maximize its effectiveness in low-middle-income settings.

Abstract Background BRAC (Bangladesh Rural Advancement Committee), the largest NGO globally, implemented a community-based comprehensive social behavior communication intervention to increase community resilience through prevention, protection, and care for COVID-19. We conducted implementation research to assess fidelity and explore the barriers and facilitators of this intervention implementation. Methods We adopted a concurrent mixed-method triangulation design. We interviewed 666 members of 60 Community Corona Protection Committees (CCPCs) and 80 members of 60 Community Support Teams (CSTs) through multi-stage cluster sampling using a structured questionnaire. The qualitative components relied on 54 key informant interviews with BRAC implementers and government providers. Results The knowledge about wearing mask, keeping social distance, washing hands and COVID-19 symptoms were high (on average more than 70%) among CCPC and CST members. While 422 (63.4%) CCPC members reported they ‘always’ wear a mask while going out, 69 (86.3%) CST members reported the same practice. Only 247 (37.1%) CCPC members distributed masks, and 229 (34.4%) donated soap to the underprivileged population during the last two weeks preceding the survey. The key facilitators included influential community members in the CCPC, greater acceptability of the front-line health workers, free-of-cost materials, and telemedicine services. The important barriers identified were insufficient training, irregular participation of the CCPC members, favouritism of CCPC members in distributing essential COVID-19 preventive materials, disruption in supply and shortage of the COVID-19 preventative materials, improper use of handwashing station, the non-compliant attitude of the community people, challenges to ensure home quarantine, challenges regarding telemedicine with network interruptions, lack of coordination among stakeholders, the short duration of the project. Conclusions Engaging the community in combination with health services through a Government-NGO partnership is a sustainable strategy for implementing the COVID-19 prevention program. Engaging the community should be promoted as an integral component of any public health intervention for sustainability. Engagement structures should incorporate a systems perspective to facilitate the relationships, ensure the quality of the delivery program, and be mindful of the heterogeneity of different community members concerning capacity building. Finally, reaching out to the underprivileged through community engagement is also an effective mechanism to progress through universal health coverage.

Abstract Background Based on the US DARE-kiR, a version of the Keepin’ it REAL program, the Drug and Violence Resistance Educational Program (PROERD) is the most widely implemented Brazilian prevention program. It originates from the translation of the DARE-kiR, a version of the Keepin’ it REAL program. Previous results suggest its inefficiency in preventing drug use among Brazilian adolescents. Since kiR fidelity can impact program outcomes, this mixed-methods study evaluates the PROERD implementation fidelity and its effects on preventing drug use among adolescents. Methods Data from two cluster randomized controlled trials (cRCTs) with 4,030 students from 30 public schools in São Paulo (1,727 fifth graders and 2,303 seventh graders), assessed at two-time points, were analyzed quantitatively. After implementing each lesson during the cRCT, 19 PROERD instructors answered fidelity forms. The effect of PROERD fidelity on alcohol, cigarettes, marijuana, inhalant, and cocaine use (the last two only among seventh graders) in the six months prior to follow-up assessment was analyzed by logistic regressions for fifth grade and mixed effect models for seventh graders. For qualitative analysis, semi-structured interviews were conducted with PROERD instructors and investigated by thematic analysis. Results Quantitative analysis showed that PROERD implementation fidelity had no impact on drug use among fifth and seventh graders. Conversely, the qualitative analysis revealed important aspects that may influence implementation fidelity and consequently program effectiveness, such as adaptations made by instructors, school infrastructure, among others, besides program application. Conclusion PROERD requires cultural adaptation to improve its implementation in Brazilian public schools.

Abstract Background Natural disasters and public health crises can disrupt communities’ capacities to implement important public health programs. A nationwide implementation of an evidence-based HIV prevention program, Focus on Youth in The Caribbean (FOYC) and Caribbean Informed Parents and Children Together (CImPACT), in The Bahamas was disrupted by Hurricane Dorian and the COVID-19 pandemic, especially in its more remote, Family Islands. We explored the teacher- and school-level factors that affected implementation of the program in these islands during those disruptions. Methods Data were collected from 47 Grade 6 teachers and 984 students in 34 government elementary schools during the 2020–2021 school year. Teachers completed a pre-implementation questionnaire to record their characteristics and perceptions that might affect their implementation fidelity and an annual program training workshop. School coordinators and high-performing teachers acting as mentors received additional training to provide teachers with monitoring, feedback, and additional support. Teachers submitted data on their completion of the 9 sessions and 35 core activities of FOYC + CImPACT. The fidelity outcomes were the number of sessions and core activities taught by teachers. Results On average, teachers taught 60% of sessions and 53% of core activities. Teachers with “very good” school coordinators (34% of teachers) taught more activities than those with “satisfactory” (43%) or no (34%) school coordinator (27.5 vs. 16.8 vs. 14.8, F = 12.86, P < 0.001). Teachers who had attended online training or both online and in-person training taught more sessions (6.1 vs. 6.2 vs. 3.6, F = 4.76, P < 0.01) and more core activities (21.1 vs. 20.8 vs. 12.6, F = 3.35, P < 0.05) than those who received no training. Teachers’ implementation was associated with improved student outcomes (preventive reproductive health skills, self-efficacy, and intention). Conclusions The Hurricane Dorian and the COVID-19 pandemic greatly disrupted education in The Bahamas Family Islands and affected implementation of FOYC + CImPACT. However, we identified several strategies that supported teachers’ implementation following these events. Teacher training and implementation monitoring increased implementation fidelity despite external challenges, and students achieved the desired learning outcomes. These strategies can better support teachers’ implementation of school-based interventions during future crises.

Abstract Background Core outcome sets are advocated as a means to standardize outcome reporting across randomized controlled trials (RCTs) and reduce selective outcome reporting. In 2005, the Prevention of Falls Network Europe (ProFaNE) published a core outcome set identifying five domains that should be measured and reported, at a minimum, in RCTs or meta-analysis on falls in older people. As reporting of all five domains of the ProFaNE core outcome set has been minimal, we set out to investigate factors associated with reporting of the ProFaNE core outcome set domains in a purposeful sample of RCTs on falls in older people. Methods We conducted a systematic citation analysis to identify all reports of RCTs focused on falls in older people that cited the ProFaNE core outcome set between October 2005 and July 2021. We abstracted author-level, study-level, and manuscript-level data and whether each domain of the ProFaNE core outcome set was reported. We used penalized LASSO regression to identify factors associated with the mean percentage of ProFaNE core outcome set domains reported. Results We identified 85 eligible reports of RCTs. Articles were published between 2007 and 2021, described 75 unique RCTs, and were authored by 76 unique corresponding authors. The percentage of ProFaNE core outcome set domains reported ranged from 0 to 100%, with a median of 40% and mean (standard deviation, SD) of 52.2% (25.1). RCTs funded by a non-industry source reported a higher mean percentage of domains than RCTs without a non-industry funding source (estimated mean difference = 17.5%; 95% confidence interval (CI) 1.8–33.2). RCTs examining exercise (15.4%; 95% CI 1.9–28.9) or multi-component/factorial (17.4%; 95% CI 4.7–30.1) interventions each reported a higher mean percentage of domains than RCTs examining other intervention types. Conclusions We found that RCTs funded by at least one non-industry source, examining exercise or multi-component/factorial interventions, reported the highest percentages of ProFaNE core outcome set domains. Findings may help inform strategies to increase the impact of the ProFaNE core outcome set. Ultimately, this may lead to enhanced knowledge of the effectiveness and safety of interventions to prevent and/or manage falls in older people.

Copyright of China Journal of Social Work is the property of Routledge and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)