Search

Background Whole-of-community interventions hold promise in addressing childhood obesity. The COMPACT Stakeholder-driven Community Diffusion theory posits that stakeholders’ knowledge of childhood obesity prevention efforts and engagement with the issue contribute to successful intervention implementation. Building on completed formative research and pilot testing, we describe the validation and refinement of knowledge and engagement measures. Methods We assessed content validity using a modified Delphi process with science (n=18) and practice-based (n=16) experts. Next, we refined the survey based on input from science- and practice-based experts, cognitive response testing, and item analysis of extant survey data. Field testing of the refined survey involved community stakeholders in Greenville County, South Carolina (n=50), East Boston, Massachusetts (n=30), and Tucson, Arizona (n=84) between 2019 and 2020. Construct validity was assessed with confirmatory factor analysis (CFA). Two-week test-retest reliability was assessed among a subsample of 14 paired respondents in South Carolina. Results Experts rated existing knowledge domains (intervention factors, roles, sustainability, problem, resources) and engagement domains (dialogue/mutual learning, flexibility, influence/power, leadership/stewardship, trust) highly for their importance in addressing childhood obesity. Expert input resulted in 11 new knowledge items and 7 new engagement items that mapped onto existing domains. Correspondingly, two domain names were modified: implementation/sustainability and trust/trustworthiness. We also eliminated 8 extant items (4 knowledge and 4 engagement) and adapted item language for comprehension and consistency. Further modifications based on CFA results and item analyses resulted in 23 knowledge items across four domains (roles and resources merged) and 23 engagement items across five domains. Modified knowledge and engagement scales had adequate fit and strong item factor loadings (most >0.7 and all >0.5). Knowledge (α=0.86–0.87) and engagement (α=0.75–0.90) subscales had high internal scale consistency. Knowledge intraclass correlation coefficients (ICCs) for test-retest agreement of subscale scores ranged from 0.50 for intervention factors to 0.86 for roles/resources. For engagement subscale scores, ICCs ranged from 0.70 for trust/trustworthiness to 0.96 for leadership/stewardship. Conclusions Findings from this multi-method survey development process increase our confidence of the knowledge and engagement measures’ content validity, construct validity, and reliability.

Objective To describe our process of using group model building (GMB) with the Shape Up Under 5 Committee; measure the effects on Committee members; and describe the community-wide health messaging campaign that resulted from the process. Design Pilot study. Setting Somerville, Massachusetts. Participants Members of the Shape Up Under 5 Committee, a multisector group of professionals. Intervention Research team convened the Committee and facilitated GMB from October 2015 to June 2017. Main outcome measures Boundary objects produced during GMB activities; committee members' perspectives on early childhood obesity in their community; and Committee members' knowledge, engagement, and trust at the conclusion of each meeting. Results Working together using GMB activities and with support from the research team, the Committee created a community-wide campaign that provided evidence-based messages to reach an entire city that emphasized diversity and reaching immigrants and community members who spoke languages other than English. More than 80% of Committee members reported changes in their perspectives related to early childhood obesity at the conclusion of the pilot test. Six perspective shift themes emerged from interviews and open-ended survey items: exposure to new perspectives about challenges community members face; increased awareness of others working on similar issues; increased knowledge about early childhood obesity; seeing value in creating a space to work across sectors; appreciating complexity and linkages between early childhood obesity prevention and other community issues; and how participation in committee influences members' priorities in their own work. Knowledge of and engagement with early childhood obesity prevention varied at the conclusion of each meeting, as did increases in trust among Committee members. Conclusion Group model building is a promising approach to support multisector groups working to address early childhood obesity in their community. Meeting activities may have had differential impacts on members' knowledge of and engagement with early childhood obesity.