Search

Collective impact (CI) is a structured approach that helps drive multi-sector collaborations to address social problems through systems changes. While the CI approach is gaining popularity, practitioners experience challenges in evaluating its implementation and intended outcomes. We conducted a systematic scoping review to understand evaluation methods specific to CI initiatives, identify challenges or limitations with these evaluations, and provide recommendations for the design of CI evaluations. Eighteen studies met the inclusion criteria. Process evaluations were the most frequently used evaluation design. Most studies collected cross-sectional data to evaluate their efforts. The complexity of CI was most frequently cited as the greatest evaluation challenge. Study recommendations primarily focused on improvements during the evaluation planning phase. Taking careful consideration in the planning of CI evaluations, developing context-specific data collection methods, and communicating results intentionally and effectively could prove useful to sufficiently capture and assess this systems-level approach to address social problems.

In 2007 the Oregon Legislature passed a policy requiring students receive a minimum weekly amount of physical activity in school: 150 minutes for elementary and 225 minutes for middle school students. However, no implementation guidance for teachers or school districts were included in the policy. This pilot study examines the differences between teachers using a single paid curriculum versus various free or readily available resources to implement physical activity. Fifteen elementary-level classroom teachers (8 intervention, 7 control) engaged in the study. Intervention teachers received access to Focused Fitness Curriculum; control teachers used already available resources, representing treatment as usual. Researchers administered teacher surveys, classroom activity logs, classroom observations, and teacher interviews to look at activities conducted, time in physical activity, and teacher perceptions. The average duration of physical activity was almost double in the control group compared to the intervention group. Additionally, the control group maintained small increases in activity level throughout the semester, while activity levels of the intervention group fell. However, the treatment group had higher average activity levels and student participation. The treatment group, using the paid curriculum, was not better than the control group. Both groups saw positive outcomes of students engaging in physical activity. Rather than one set curriculum, the more important factors are providing support and flexibility for implementation.

Background: Powdered alcohol, a new form of crystalline alcohol sold under the brand name Palcohol, has yet to be widely distributed in the United States due to political and public concerns surrounding potential for misuse. Purpose: Given the limited research on powdered alcohol, researchers examined YouTube videos on this controversial substance to gain insights into its use. Methods: Researchers thematically evaluated YouTube videos describing knowledge of powdered alcohol use, its effects, as well as the cultural context surrounding its use. Results: Of the videos that met study inclusion criteria (n = 210), 38% were coded as "news report," 20% "opinion," 19% "policy," 11% "user-generated information," 7% "education," 3% "misuse," 2% "development," and 1% "use." One in three videos about powdered alcohol included negative viewpoints about the product (n = 71, 34%). Discussion: The majority of reviewed YouTube videos described negative implications of consuming powdered alcohol (eg, high potential for unintentional over consumption). Translation to Health Education Practice: Findings suggest ways in which health researchers can use popular social media websites, such as YouTube, to address divides between sensationalized public perceptions of chronic health risks and evidence-based research of new alcoholic products.