Search

Abstract Aim Customer discovery, an entrepreneurial and iterative process to understand the context and needs of potential adoption agencies, may be an innovative strategy to improve broader dissemination of evidence-based interventions. This paper describes the customer discovery process for the Building Healthy Families (BHF) Online Training Resources and Program Package (BHF Resource Package) to support rural community adoption of an evidence-based, family healthy weight program. Methods The customer discovery process was completed as part of a SPeeding Research-tested INTerventions (SPRINT) training supported by the U.S. Centers for Disease Control and Prevention. Customer discovery interviews (n=47) were conducted with people that could be potential resource users, economic buyers, and BHF adoption influencers to capture multiple contextual and needs-based factors related to adopting new evidence-based interventions. Qualitative analyses were completed in an iterative fashion as each interview was completed. Results The BHF Resource Package was designed to be accessible to a variety of implementation organizations. However, due to different resources being available in different rural communities, customer discovery interviews suggested that focusing on rural health departments may be a consistent setting for intervention adoption. We found that local health departments prioritize childhood obesity but lacked the training and resources necessary to implement effective programming. Several intervention funding approaches were also identified including (1) program grants from local and national foundations, (2) healthcare community benefit initiatives, and (3) regional employer groups. Payment plans recommended in the customer discovery interviews included a mix of licensing and technical support fees for BHF delivery organizations, potential insurance reimbursement, and family fees based on ability to pay. Marketing a range of BHF non-weight related outcomes was also recommended during the customer discovery process to increase the likelihood of BHF scale-up and sustainability. Conclusions Engaging in customer discovery provided practical directions for the potential adoption, implementation, and sustainability of the BHF Resource Package. However, the inconsistent finding that health departments are both the ideal implementation organization, but also see childhood obesity treatment as a clinical service, is concerning.

There are limited reports of community-based nutrition education with culinary instruction that measure biomarkers, particularly in low-income and underrepresented minority populations. Teaching kitchens have been proposed as a strategy to address social determinants of health, combining nutrition education, culinary demonstration, and skill building. The purpose of this paper is to report on the development, implementation, and evaluation of Journey to Health, a program designed for community implementation using the RE-AIM planning and evaluation framework. Reach and effectiveness were the primary outcomes. Regarding reach, 507 individuals registered for the program, 310 participants attended at least one nutrition class, 110 participants completed at least two biometric screens, and 96 participants attended at least two health coaching appointments. Participants who engaged in Journey to Health realized significant improvements in body mass index, blood pressure, and triglycerides. For higher risk participants, we additionally saw significant improvements in total and LDL cholesterol. Regarding dietary intake, we observed a significant increase in cups of fruit and a decrease in sugar sweetened beverages consumed per day. Our findings suggest that Journey to Health may improve selected biometrics and health behaviors in low-income and underrepresented minority participants.

Abstract Background Lactation support resources are less likely to be located in close proximity to where Black families live and there is a systemic racist health care belief that Black women prefer bottle feeding (with infant formula) over breastfeeding. Together, these lead to lower reported breastfeeding rates of Black babies compared to other racial / ethnic groups. It is imperative to have a deeper understanding of the cultural aspects as well as the underlying limitations that prevent Black women / persons from being supported to breastfeed. There is a need to know how effective breastfeeding interventions are in reaching the intended population; how well they work in promoting breastfeeding initiation and continuation; and how successful they are when implemented at the setting and staff level. The purpose of this investigation was to establish the level of internal and external validity that was reported by breastfeeding intervention studies among Black communities. Methods Studies on breastfeeding interventions on Black people that were published between the years 1990 and 2019 were carefully examined through PubMed, EBSCOhost, Web of Science, and OneSearch. A total of 31 studies fulfilled the requirements to be included for this evaluation. In order to extract the information from the articles, the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework extraction tool was utilized. Results On average, the proportion of studies that reported across reach, effectiveness, adoption, implementation, and maintenance indicators was 54, 35, 19, 48, and 9%, respectively. Across core RE-AIM indicators only sample size (100%) and breastfeeding outcomes (90%) were reported consistently. External validity indicators related to representativeness of participants (16%) and sites (3%) were rarely reported. Similarly, adherence to intervention protocol, and indicator of internal validity, was reported in a small proportion of articles (19%). Conclusion This body of literature under-reported on aspects associated to both internal and external validity across all RE-AIM domains. The reporting of the individual level of representativeness; the setting level of representativeness; the intervention’s adherence to the protocol; the expenses; and the factors of sustainability would benefit from improvement in future research.

Abstract Background The Practical, Robust Implementation and Sustainability Model (PRISM) was developed in 2008 as a contextually expanded version of the broadly used Reach, Adoption, Effectiveness, Implementation, and Maintenance (RE-AIM) framework. PRISM provides researchers a pragmatic and intuitive model to improve translation of research interventions into clinical and community practice. Since 2008, the use of PRISM increased across diverse topics, populations, and settings. This citation analysis and scoping systematic review aimed to assess the use of the PRISM framework and to make recommendations for future research. Methods A literature search was conducted using three databases (PubMed, Web of Science, Scopus) for the period of 2008 and September 2020. After exclusion, reverse citation searches and invitations to experts in the field were used to identify and obtain recommendations for additional articles not identified in the original search. Studies that integrated PRISM into their study design were selected for full abstraction. Unique research studies were abstracted for information on study characteristics (e.g., setting/population, design), PRISM contextual domains, and RE-AIM outcomes. Results A total of 180 articles were identified to include PRISM to some degree. Thirty-two articles representing 23 unique studies integrated PRISM within their study design. Study characteristics varied widely and included studies conducted in diverse contexts, but predominately in high-income countries and in clinical out-patient settings. With regards to use, 19 used PRISM for evaluation, 10 for planning/development, 10 for implementation, four for sustainment, and one for dissemination. There was substantial variation across studies in how and to what degree PRISM contextual domains and RE-AIM outcomes were operationalized and connected. Only two studies directly connected individual PRISM context domains with RE-AIM outcomes, and another four included RE-AIM outcomes without direct connection to PRISM domains. Conclusions This is the first systematic review of the use of PRISM in various contexts. While there were low levels of ‘integrated’ use of PRISM and few reports on linkage to RE-AIM outcomes, most studies included important context domains of implementation and sustainability infrastructure and external environment. Recommendations are provided for more consistent and comprehensive use of and reporting on PRISM to inform both research and practice on contextual factors in implementation.

Abstract Background Stand and Move at Work was a 12-month, multicomponent, peer-led (intervention delivery personnel) worksite intervention to reduce sedentary time. Although successful, the magnitude of reduced sedentary time varied by intervention worksite. The purpose of this study was to use a qualitative comparative analysis approach to examine potential explanatory factors that could distinguish higher from lower performing worksites based on reduced sedentary time. Methods We assessed 12-month changes in employee sedentary time objectively using accelerometers at 12 worksites. We ranked worksites based on the magnitude of change in sedentary time and categorized sites as higher vs. lower performing. Guided by the integrated-Promoting Action on Research Implementation in Health Services framework, we created an indicator of intervention fidelity related to adherence to the protocol and competence of intervention delivery personnel (i.e., implementer). We then gathered information from employee interviews and surveys as well as delivery personnel surveys. These data were aggregated, entered into a truth table (i.e., a table containing implementation construct presence or absence), and used to examine differences between higher and lower performing worksites. Results There were substantive differences in the magnitude of change in sedentary time between higher (-75.2 min/8 h workday, CI95: -93.7, -56.7) and lower (-30.3 min/8 h workday, CI95: -38.3, -22.7) performing worksites. Conditions that were present in all higher performing sites included implementation of indoor/outdoor walking route accessibility, completion of delivery personnel surveys, and worksite culture supporting breaks (i.e., adherence to protocol). A similar pattern was found for implementer willingness to continue role and employees using face-to-face interaction/stair strategies (i.e., delivery personnel competence). However, each of these factors were also present in some of the lower performing sites suggesting we were unable to identify sufficient conditions to predict program success. Conclusions Higher intervention adherence and implementer competence is necessary for greater program success. These findings illustrate the need for future research to identify what factors may influence intervention fidelity, and in turn, effectiveness. Trial registration ClinicalTrials.gov Identifier: NCT02566317 . Registered 2 October 2015, first participant enrolled 11 January 2016.

Abstract Background Understanding the cost and/or cost-effectiveness of implementation strategies is crucial for organizations to make informed decisions about the resources needed to implement and sustain evidence-based interventions (EBIs). This economic evaluation protocol describes the methods and processes that will be used to assess costs and cost-effectiveness across implementation strategies used to improve the reach, adoption, implementation, and organizational maintenance of an evidence-based pediatric weight management intervention- Building Health Families (BHF). Methods A within-trial cost and cost-effectiveness analysis (CEA) will be completed as part of a hybrid type III effectiveness-implementation trial (HEI) designed to examine the impact of an action Learning Collaborative (LC) strategy consisting of network weaving, consultee-centered training, goal-setting and feedback, and sustainability action planning to improve the adoption, implementation, organizational maintenance, and program reach of BHF in micropolitan and surrounding rural communities in the USA, over a 12-month period. We discuss key features of implementation strategy components and the associated cost collection and outcome measures and present brief examples on what will be included in the CEA for each discrete implementation strategy and how the results will be interpreted. The cost data will be collected by identifying implementation activities associated with each strategy and using a digital-based time tracking tool to capture the time associated with each activity. Costs will be assessed relative to the BHF program implementation and the multicomponent implementation strategy, included within and external to a LC designed to improve reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) of BHF. The CEA results will be reported by RE-AIM outcomes, using the average cost-effectiveness ratio or incremental cost-effectiveness ratio. All the CEAs will be performed from the community perspective. Discussion The proposed costing approach and economic evaluation framework for dissemination and implementation strategies and EBI implementation will contribute to the evolving but still scant literature on economic evaluation of implementation and strategies used and facilitate the comparative economic analysis. Trial registration ClinicalTrials.gov NCT04719442 . Registered on January 22, 2021.

ObjectiveTo evaluate the effectiveness of two technology-enhanced interventions for diabetes prevention among adults at risk for developing diabetes in a primary care setting.MethodsThe DiaBEAT-it study employed a hybrid 2-group preference (Choice) and 3-group randomized controlled (RCT) design. This paper presents weight related primary outcomes of the RCT arm. Patients from Southwest Virginia were identified through the Carilion Clinic electronic health records. Eligible participants (18 and older, BMI ≥ 25, no Type 2 Diabetes) were randomized to either Choice (n = 264) or RCT (n = 334). RCT individuals were further randomized to one of three groups: (1) a 2-h small group class to help patients develop a personal action plan to prevent diabetes (SC, n = 117); (2) a 2-h small group class plus automated telephone calls using an interactive voice response system (IVR) to help participants initiate weight loss through a healthful diet and regular physical activity (Class/IVR, n = 110); or (3) a DVD with same content as the class plus the same IVR calls over a period of 12 months (DVD/IVR, n = 107).ResultsOf the 334 participants that were randomized, 232 (69%) had study measured weights at 6 months, 221 (66%) at 12 months, and 208 (62%) at 18 months. Class/IVR participants were less likely to complete weight measures than SC or DVD/IVR. Intention to treat analyses, controlling for gender, race, age and baseline BMI, showed that DVD/IVR and Class/IVR led to reductions in BMI at 6 (DVD/IVR −0.94, p < 0.001; Class/IVR −0.70, p < 0.01), 12 (DVD/IVR −0.88, p < 0.001; Class/IVR-0.82, p < 0.001) and 18 (DVD/IVR −0.78, p < 0.001; Class/IVR −0.58, p < 0.01) months. All three groups showed a significant number of participants losing at least 5% of their body weight at 12 months (DVD/IVR 26.87%; Class/IVR 21.62%; SC 16.85%). When comparing groups, DVD/IVR were significantly more likely to decrease BMI at 6 months (p < 0.05) and maintain the reduction at 18 months (p < 0.05) when compared to SC. There were no differences between the other groups.ConclusionsThe DiaBEAT-it interventions show promise in responding to the need for scalable, effective methods to manage obesity and prevent diabetes in primary care settings that do not over burden primary care clinics and providers.Registrationhttps://clinicaltrials.gov/ct2/show/NCT02162901, identifier: NCT02162901.

Improved health-related quality of life (HRQoL) is one benefit of physical activity. Yet, there is limited intervention research exploring (1) whether changes in physical activity influence changes in HRQoL among community-based populations and (2) if baseline obesity status influences the relationships. This exploratory analysis used secondary data from rural Appalachian adults who completed the MoveMore arm of a larger randomized control trial (n = 105, Mage = 41.8, 82 % female, 96 % White, Mincome= $25,911). Specifically, this study examined associations among changes in physical activity and HRQOL and whether baseline obesity status moderated changes. Three HRQoL variables (self-rated health status, total unhealthy days, days poor health impacted activities) and two physical activity variables [weekly moderate-vigorous physical activity (MVPA) minutes, weekly strength training minutes] were collected at baseline and 6-months. Regression models, adjusted for age, gender, race, income, education, assessed associations between physical activity and HRQoL change variables. Moderation analyses explored the influence of baseline obesity status on these relationships. Participants reported significant improvements in self-rated health status (P = 0.001), weekly MVPA minutes (P = 0.008), and weekly strength training minutes (P

Abstract Background Physical activity guidelines recommend young people engage in regular muscle-strengthening activities (e.g., resistance training [RT]). However, few school-based physical activity interventions have been delivered at-scale or promoted RT. The aim of this study was to evaluate the reach, effectiveness, adoption, implementation and maintenance of the Resistance Training for Teens (RT for Teens) program. Methods Data were collected between August 2015 and October 2020. RE-AIM was operationalized as: (i) Reach: number and characteristics of students estimated to be exposed to the program; (ii) Effectiveness: impact of the program on student-level outcomes measured in a subsample of 750 students from 17 schools; (iii) Adoption: number and representativeness of schools with one or more teachers trained to deliver the program; (iv) Implementation: extent to which the program was delivered as intended; and (v) Maintenance: extent to which the program was sustained in schools. Results The estimated program reach was ~ 10,000 students, out of a total student population of ~ 200,000 (~ 5%). Students were from diverse socioeconomic and ethnic backgrounds. Improvements in muscular fitness, RT self-efficacy, perceived cardiorespiratory fitness and flexibility, and participation in muscle-strengthening physical activities were documented. A total of 30 workshops were delivered, involving 468 teachers from 249 schools from diverse geographical regions. Implementation varied considerably, with teachers adapting the program to suit the context of their school and student cohorts. However, RT skill development and the promotion of muscular fitness were the session components delivered most during sessions. Teachers’ adherence to the SAAFE (Supportive, Active, Autonomous, Fair and Enjoyable) teaching principles was high. Approximately 30% of teachers (144/476) registered to use the RT for Teens app. At the school-level, 37% (93/249) of schools had at least one registered user (teacher and/or student). A total of 2,336 workouts and 3,116 fitness tests were completed by registered users. Of the 249 schools represented, 51 (20.5%) sent an additional (previously untrained) teacher to a second workshop. Conclusions The RT for Teens program had broad reach and adoption. However, intervention delivery varied considerably across schools and additional support strategies are required to optimize intervention implementation and maintain program delivery over time. Future studies will benefit from the utilization of accepted frameworks, recommendations and guidelines for implementation research. Trial registration Australian New Zealand Clinical Trials Registry (ACTRN12621000352808), retrospectively registered 1st February 2021.

The need for physical activity promotion is ubiquitous, and offering physical activity interventions in community settings may reach people where they live, work, and play. Reaching people and providing evidence-based programming is exactly what the Cooperative Extension System has accomplished over the last century. In 2014, federal policy brought physical activity promotion into the mission of Extension. Although this policy marks the beginning of concerted efforts for physical activity promotion, several states have had strong success in this area. Borrowing from these efforts, this paper reports strengths, challenges, and opportunities for physical activity promotion in Extension.

The purpose of this investigation was to understand perspectives of physicians, nurses, and staff regarding the feasibility of implementing an evidence-based weight management program to support primary care practice. An exploratory aim was to examine differences in responses based on the clinic location. Ten focus groups were conducted with primary care staff from rural, micropolitan, and metropolitan clinics. The Promoting Action on Research in Health Services (PARIHS) framework was used to inform the interview guide. Transcripts were reviewed to identify common themes among PARIHS constructs (evidence, context, and facilitation). Presence of comorbidities (e.g., diabetes, hypertension) were typical prompts for provider-led discussions about patient weight. Metropolitan clinics reported the availability of health coaching, diabetes education, or dietician consultation, but no clinic reported offering a comprehensive weight management program. Participants agreed it is possible to implement a weight management program through primary care, but cited potential facilitation challenges such as costs, clinic resources, and individual patient barriers. More enthusiasm arose for a referral program with patient tracking. Program characteristics such as proven efficacy, individual tailoring, program accessibility, and patient feedback to the providers were desired. Rural focus group participants reported unique barriers (lack of local resources) and facilitators (more flexibility in practice changes) to weight management when compared to metropolitan and micropolitan focus groups. Primary care staff are interested in weight management solutions for their patients and would prefer an evidence-based program to which they could refer patients, receive feedback on patient progress, and sustainably include as part of their regular services.

Abstract There are complex issues in understanding and categorizing implementation science theories, models, and frameworks. Systematic reviews of these models are important undertakings for synthesizing current knowledge. The issues involved are even more challenging when reviewing a large number of frameworks and when some of the frameworks have evolved significantly over time. This paper addresses how the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework was described in the recent Esmail (2020) review and identifies four mischaracterizations. This is followed by a more general discussion of how advances or extensions of frameworks after an original source publication or influential review tend to be overlooked. We discuss why inadvertent mischaracterization of what a framework is and is not, and what it can and cannot be used for, can have deleterious consequences. Finally, we suggest initial ideas about what could be done to prevent or alleviate some of these problems by reviewers, framework developers, and scholars at large.

Abstract Background SIPsmartER is a 6-month evidenced-based, multi-component behavioral intervention that targets sugar-sweetened beverages among adults. It consists of three in-person group classes, one teach-back call, and 11 automated phone calls. Given SIPsmartER’s previously demonstrated effectiveness, understanding its adoption, implementation, and potential for integration within a system that reaches health disparate communities is important to enhance its public health impact. During this pilot dissemination and implementation trial, SIPsmartER was delivered by trained staff from local health districts (delivery agents) in rural, Appalachian Virginia. SIPsmartER’s execution was supported by consultee-centered implementation strategies. Methods In this mixed-methods process evaluation, adoption and implementation indicators of the program and its implementation strategy (e.g., fidelity, feasibility, appropriateness, acceptability) were measured using tracking logs, delivery agent surveys and interviews, and fidelity checklists. Quantitative data were analyzed with descriptive statistics. Qualitative data were inductively coded. Results Delivery agents implemented SIPsmartER to the expected number of cohorts (n = 12), recruited 89% of cohorts, and taught 86% of expected small group classes with > 90% fidelity. The planned implementation strategies were also executed with high fidelity. Delivery agents completing the two-day training, pre-lesson meetings, fidelity checklists, and post-lesson meetings at rates of 86, 75, 100, and 100%, respectively. Additionally, delivery agents completed 5% (n = 3 of 66) and 10% (n = 6 of 59) of teach-back and missed class calls, respectively. On survey items using 6-point scales, delivery agents reported, on average, higher feasibility, appropriateness, and acceptability related to delivering the group classes (range 4.3 to 5.6) than executing missed class and teach-back calls (range 2.6 to 4.6). They also, on average, found the implementation strategy activities to be helpful (range 4.9 to 6.0). Delivery agents identified strengths and weakness related to recruitment, lesson delivery, call completion, and the implementation strategy. Conclusions In-person classes and the consultee-centered implementation strategies were viewed as acceptable, appropriate, and feasible and were executed with high fidelity. However, implementation outcomes for teach-back and missed class calls and recruitment were not as strong. Findings will inform the future full-scale dissemination and implementation of SIPsmartER, as well as other evidence-based interventions, into rural health districts as a means to improve population health.

Abstract Background To describe the identification, adaptation, and testing of an evidence-based pediatric weight management program for a health disparate community. Methods A community advisory board (CAB) of decision-makers and staff from local health care, public health, and recreation organizations engaged with academic partners to select an evidence-based program (EBP) for local implementation. Three EBPs were identified (Traffic Light, Bright Bodies, Golan and colleagues Home Environmental Model) and each EBP was rated on program characteristics, implementation and adaptation, and adoptability. Following selection of the EBP that was rated highest, the POPS-CAB made adaptations based on the program principles described in peer-reviewed publications. The adapted intervention, iChoose, was then pilot tested in 3 iterative phases delivered initially by research partners, then co-delivered by research and community partners, then delivered by community partners. The RE-AIM framework was used to plan and evaluate the iChoose intervention across all waves with assessments at baseline, post program (3 months), and follow-up (6 months). Results Bright Bodies rated highest on program characteristics and adoptability (p’s

Abstract Background Although reducing sugar-sweetened beverage (SSB) intake is an important behavioral strategy to improve health, no known SSB-focused behavioral trial has examined maintenance of SSB behaviors after an initial reduction. Guided by the RE-AIM framework, this study examines 6–18 month and 0–18 month individual-level maintenance outcomes from an SSB reduction trial conducted in a medically-underserved, rural Appalachia region of Virginia. Reach and implementation indicators are also reported. Methods Following completion of a 6-month, multi-component, behavioral RCT to reduce SSB intake (SIPsmartER condition vs. comparison condition), participants were further randomized to one of three 12-month maintenance conditions. Each condition included monthly telephone calls, but varied in mode and content: 1) interactive voice response (IVR) behavior support, 2) human-delivered behavior support, or 3) IVR control condition. Assessments included the Beverage Intake Questionnaire (BEVQ-15), weight, BMI, and quality of life. Call completion rates and costs were tracked. Analysis included descriptive statistics and multilevel mixed-effects linear regression models using intent-to-treat procedures. Results Of 301 subjects enrolled in the 6-month RCT, 242 (80%) were randomized into the maintenance phase and 235 (78%) included in the analyses. SIPsmartER participants maintained significant 0–18 month decreases in SSB. For SSB, weight, BMI and quality of life, there were no significant 6–18 month changes among SIPsmartER participants, indicating post-program maintenance. The IVR-behavior participants reported greater reductions in SSB kcals/day during the 6–18 month maintenance phase, compared to the IVR control participants (− 98 SSB kcals/day, 95% CI = − 196, − 0.55, p

Background: There is need for the childhood obesity treatment literature to identify effective recruitment and engagement strategies for rural communities that are more likely to lack supportive infrastructure for healthy lifestyles and clinical research relative to their urban counterparts. This community case study examines recruitment and engagement strategies from a comparative effectiveness research (CER) trial of two family-based childhood obesity (FBCO) treatment interventions conducted in a medically underserved, rural region. Guided by a Community Based Participatory Research (CBPR) and systems-based approach, the primary aim was to analyze interviews from academic partners, community partners, and parent study participants for recruitment and engagement assets, challenges, and lessons learned.Methods: Over the 3-year lifespan of the study, researchers conducted 288 interviews with Community Advisory Board members (n = 14), Parent Advisory Team members (n = 7), and study participants (n = 100). Using an inductive-deductive approach, interviews were broadly coded for recruitment and engagement assets, challenges, and recommendations; analyzed for descriptive sub-coding; and organized into stakeholder/organization and participant level themes. Codes were analyzed aggregately across time and examined for differences among stakeholders and parent study participants.Results: Adherence to CBPR principles and development of strong community partnerships facilitated recruitment and engagement; however, variability in recruitment and engagement success impacted partner confidence, threatened outcome validity, and required additional resources. Specifically, assets and challenges emerged around eight key needs. Three were at the stakeholder/organization level: (1) readiness of stakeholders to conduct CBPR research, (2) development of sustainable referral protocols, and (3) development of participant engagement systems. The remaining five were at the participant level: (1) comfort and trust with research, (2) awareness and understanding of the study, (3) intervention accessibility, (4) intervention acceptability, and (5) target population readiness. Future recommendations included conducting readiness assessments and awareness campaigns, piloting and evaluating recruitment and engagement strategies, identifying participant barriers to engagement and finding a priori solutions, and fostering stakeholder leadership to develop sustainable protocols.Conclusion: Collective findings from multiple perspectives demonstrate the need for multi-leveled approaches focusing on infrastructure supports and strategies to improve stakeholder and participant awareness of, and capacity for, recruiting and engaging medically underserved, rural families in a FBCO CER trial.

Abstract Introduction: Understanding, categorizing, and using implementation science theories, models, and frameworks is a complex undertaking. The issues involved are even more challenging given the large number of frameworks and that some of them evolve significantly over time. As a consequence, researchers and practitioners may be unintentionally mischaracterizing frameworks or basing actions and conclusions on outdated versions of a framework. Methods: This paper addresses how the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework has been described, summarizes how the model has evolved over time, and identifies and corrects several misconceptions. Results: We address 13 specific areas where misconceptions have been noted concerning the use of RE-AIM and summarize current guidance on these issues. We also discuss key changes to RE-AIM over the past 20 years, including the evolution to Pragmatic Robust Implementation and Sustainability Model, and provide resources for potential users to guide application of the framework. Conclusions: RE-AIM and many other theories and frameworks have evolved, been misunderstood, and sometimes been misapplied. To some degree, this is inevitable, but we conclude by suggesting some actions that reviewers, framework developers, and those selecting or applying frameworks can do to prevent or alleviate these problems.

The goal of this study was to assess the utility of participatory needs assessment processes for continuous improvement of developing clinical and translational research (CTR) networks. Our approach expanded on evaluation strategies for CTR networks, centers, and institutes, which often survey stakeholders to identify infrastructure or resource needs, using the case example of the Great Plains IDeA-CTR Network. Our 4-stage approach (i.e., pre-assessment, data collection, implementation of needs assessment derived actions, monitoring of action plan) included a member survey (n = 357) and five subsequent small group sessions (n = 75 participants) to better characterize needs identified in the survey and to provide actionable recommendations. This participatory, mixed-methods needs assessment and strategic action planning process yielded 11 inter-related recommendations. These recommendations were presented to the CTR steering committee as inputs to develop detailed, prioritized action plans. Preliminary evaluation shows progress towards improved program capacity and effectiveness of the network to respond to member needs. The participatory, mixed-methods needs assessment and strategic planning process allowed a wide range of stakeholders to contribute to the development of actionable recommendations for network improvement, in line with the principles of team science.

The National Working Group on RE-AIM Planning and Evaluation Framework (herein Workgroup) was established in 2004 to support the application of the framework and advance dissemination and implementation science (D&I). Workgroup members developed and disseminated products and resources (and continue to do so) to advocate for consistent application of RE-AIM and allow for cross study comparisons. The purpose of this paper is to summarize key Workgroup activities, products, and services (e.g., webinars, consultations, planning tools) and enhance bidirectional communication between the Workgroup and RE-AIM users. The ultimate goal of this work is to serve as a forum for dissemination to improve the balance between RE-AIM user demand (needs) and the currently limited RE-AIM Workgroup supply (consultation and resources) to demonstrate and expand the utility of RE-AIM as a D&I planning and evaluation framework. A summary of resources is provided as well as specific examples of how the Workgroup has been responsive to user needs.

Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the “real-world” and identify opportunities for improving use outside of research contexts.Methods: We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants (n = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data.Results: Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach (n = 9), adoption (n = 11), and implementation (n = 12) while effectiveness (n = 7) and maintenance (n = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall M = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall M = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design (M = 4.7 ± 0.6) relative to the other dimensions (3.0–3.9). All dimensions were considered similarly important for decision-making (average M = 4.1 ± 1.4), with the exception of maintenance (M = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert.Discussion: RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement.

The RE-AIM planning and evaluation framework was conceptualized two decades ago. As one of the most frequently applied implementation frameworks, RE-AIM has now been cited in over 2,800 publications. This paper describes the application and evolution of RE-AIM as well as lessons learned from its use. RE-AIM has been applied most often in public health and health behavior change research, but increasingly in more diverse content areas and within clinical, community, and corporate settings. We discuss challenges of using RE-AIM while encouraging a more pragmatic use of key dimensions rather than comprehensive applications of all elements. Current foci of RE-AIM include increasing the emphasis on cost and adaptations to programs and expanding the use of qualitative methods to understand “how” and “why” results came about. The framework will continue to evolve to focus on contextual and explanatory factors related to RE-AIM outcomes, package RE-AIM for use by non-researchers, and integrate RE-AIM with other pragmatic and reporting frameworks.

This community-based participatory research (CBPR) project used a collaborative process to develop a culturally relevant workbook for parents of overweight children. We followed a mixed methods iterative process to assess clear communication using a CBPR approach. Materials were evaluated using readability tests, the Clear Communication Index (CCI), and the Suitability Assessment of Materials (SAM). In addition, we used surveys and focus groups to investigate parents’ perceptions and gather feedback from delivery staff using the workbook. While workbook materials maintained adequate grade reading levels, our iterative process and the use of CCI and SAM led to significant improvements in (a) clearly communicating the objectives of the program, (b) being culturally relevant, and (c) reaching a high satisfaction among users. These findings suggest that evaluative measures for written materials should move beyond readability and need to account for level of clarity and cultural appropriateness of messages. Furthermore, we found that that an iterative process to intervention’s material development using clear communication strategies while involving community members, parents, and research partners can lead to workbook materials that are culturally relevant to the target audience, and better communicate program objectives. Finally, this is a potentially generalizable process for improving clear communication of written health information materials.

The RE-AIM Framework is a planning and evaluation model that has been used in a variety of settings to address various programmatic, environmental, and policy innovations for improving population health. In addition to the broad application and diverse use of the framework, there are lessons learned and recommendations for the future use of the framework across clinical, community, and corporate settings. The purposes of this article are to: (A) provide a brief overview of the RE-AIM Framework and its pragmatic use for planning and evaluation; (B) offer recommendations to facilitate the application of RE-AIM in clinical, community, and corporate settings; and (C) share perspectives and lessons learned about employing RE-AIM dimensions in the planning, implementation, and evaluation phases within these different settings. In this article, we demonstrate how the RE-AIM concepts and elements within each dimension can be applied by researchers and practitioners in diverse settings, among diverse populations and for diverse health topics.

ABSTRACT Objective: the RE-AIM framework has been widely used to evaluate internal and external validity of interventions aimed to promote physical activity, helping to provide comprehensive evaluation of the reach, efficacy, adoption, implementation and maintenance of research and programming. Despite this progress, the RE-AIM framework has not been used widely in Latin America. The purpose of this manuscript is to describe the RE-AIM framework, the process and materials developed for a one-day workshop in Guadalajara, and the acceptability and satisfaction of participants that attended the workshop. Methods: lecture, interactive examples and an agenda were developed for a one-day RE-AIM workshop over a three month period. Results: thirty two health care practitioners (M age = 30.6, SD=9.9 years) attended the workshop. Most (100%) rated the workshop as credible, useful (100%) and intended to apply it in current or future research (95%). Conclusion: results suggest intuitive appeal of the RE-AIM framework, and provide a strategy for introducing the utility and practical application of the framework in practice settings in Mexico and Latin America.

The college transition represents a critical period for maintaining a healthy weight, yet intervention participation and retention represent significant challenges. The objective of this investigation was to evaluate the preliminary efficacy and acceptability of two interventions to prevent freshman weight gain. One intervention provided opportunities to improve outcome expectations and self-efficacy within a social cognitive theory framework (SCT), while the other targeted the same variables but focused on explicit training in self-regulation skills (SCTSR). Methods. Freshmen (n=45) aged >18 years were randomized to a 14-week intervention, SCT or SCTSR; both included online modules and in-class meetings. Of the 45 students randomized, 5 withdrew before the classes began and 39 completed pre- and posttesting. Primary outcomes included body weight/composition, health behaviors, and program acceptability. Analyses included independent sample t-tests, repeated measures ANOVA, and bivariate correlational analyses. Results. Body weight increased over the 14-week period, but there was no group difference. Percent body fat increased in SCTSR but not SCT (mean difference: SCTSR, +1.63 ± 0.52%; SCT, −0.25 ± 0.45%; P=0.01). Class attendance was 100% (SCTSR) and 98% (SCT); SCTSR students (>50%) remarked that the online tracking required “too much time.” Conclusions. The intervention was well received, although there were no improvements in weight outcomes.