Search

Abstract Background On January 31st, 2023, the province of British Columbia (BC), Canada, was granted a federal exemption allowing adults (aged 18 +) to possess up to 2.5 g of select illicit drugs. The exemption will be in place for three years (2023–2026), marking the first formal decriminalization of illicit drug policy reform in Canada. BC’s decriminalization initiative is premised on several goals. This project seeks to evaluate each of these goals and their individual and combined contributions to determine the overall success of this policy. Methods The following protocol paper provides a detailed outline of a five-year (2022-2027) national evaluation of BC’s decriminalization initiative, as well as the specific objectives, methodologies, and planned analyses for eight interrelated sub-studies that comprise the evaluation. These sub-studies fall under the following five topical areas of research: 1) people who use drugs (PWUD), 2) the police and the criminal justice system, 3) the general public, 4) the health services system, and 5) an economic analysis. Additional research activities may also be explored. Results The overall evaluation and specific sub-study designs were informed by intensive stakeholder engagement. The evaluation was developed in collaboration with an international expert committee who came together to undertake a nominal group technique to decide on the final evaluation design and corresponding logic model. The evaluation will also employ an advisory board and individual sub-study working groups comprised of experts and PWUD who will oversee the development and implementation of the overall evaluation as well as each sub-study. Discussion This evaluation will draw on implementation science research practices to evaluate and understand the full impacts of this novel drug policy experiment. Results will be widely disseminated through manuscripts, reports, presentations, and infographics, which will be adapted and tailored for specific audiences. The protocol identifies several anticipated challenges and limitations. This evaluation’s evidence-based findings will be poised to offer pivotal insights that can shape and refine the discourse on drug policy and will serve as a critical resource for understanding the multifaceted impacts of decriminalization.

Abstract Background In 2016, a voluntary National Healthy Food and Drink Policy (hereafter, “the Policy”) was released to encourage public hospitals in New Zealand to provide food and drink options in line with national dietary guidelines. Five years later, eight (of 20) organisations had adopted it, with several preferring to retain or update their own institutional-level version. This study assessed staff and visitors’ awareness and support for and against the Policy, and collected feedback on perceived food environment changes since implementation of the Policy. Methods Cross-sectional electronic and paper-based survey conducted from June 2021 to August 2022. Descriptive statistics were used to present quantitative findings. Free-text responses were analysed following a general inductive approach. Qualitative and quantitative findings were compared by level of implementation of the Policy, and by ethnicity and financial security of participants. Results Data were collected from 2,526 staff and 261 visitors in 19 healthcare organisations. 80% of staff and 56% of visitors were aware of the Policy. Both staff and visitors generally supported the Policy, irrespective of whether they were aware of it or not, with most agreeing that “Hospitals should be good role models.” Among staff who opposed the Policy, the most common reason for doing so was freedom of choice. The Policy had a greater impact, positive and negative, on Māori and Pacific staff, due to more frequent purchasing onsite. Most staff noticed differences in the food and drinks available since Policy implementation. There was positive feedback about the variety of options available in some hospitals, but overall 40% of free text comments mentioned limited choice. 74% of staff reported that food and drinks were more expensive. Low-income staff/visitors and shift workers were particularly impacted by reduced choice and higher prices for healthy options. Conclusions The Policy led to notable changes in the healthiness of foods and drinks available in NZ hospitals but this was accompanied by a perception of reduced value and choice. While generally well supported, the findings indicate opportunities to improve implementation of food and drink policies (e.g. providing more healthy food choices, better engagement with staff, and keeping prices of healthy options low) and confirm that the Policy could be expanded to other public workplaces.

Abstract Background Qualitative Comparative Analysis (QCA) is a method for identifying the configurations of conditions that lead to specific outcomes. Given its potential for providing evidence of causality in complex systems, QCA is increasingly used in evaluative research to examine the uptake or impacts of public health interventions. We map this emerging field, assessing the strengths and weaknesses of QCA approaches identified in published studies, and identify implications for future research and reporting. Methods PubMed, Scopus and Web of Science were systematically searched for peer-reviewed studies published in English up to December 2019 that had used QCA methods to identify the conditions associated with the uptake and/or effectiveness of interventions for public health. Data relating to the interventions studied (settings/level of intervention/populations), methods (type of QCA, case level, source of data, other methods used) and reported strengths and weaknesses of QCA were extracted and synthesised narratively. Results The search identified 1384 papers, of which 27 (describing 26 studies) met the inclusion criteria. Interventions evaluated ranged across: nutrition/obesity (n = 8); physical activity (n = 4); health inequalities (n = 3); mental health (n = 2); community engagement (n = 3); chronic condition management (n = 3); vaccine adoption or implementation (n = 2); programme implementation (n = 3); breastfeeding (n = 2), and general population health (n = 1). The majority of studies (n = 24) were of interventions solely or predominantly in high income countries. Key strengths reported were that QCA provides a method for addressing causal complexity; and that it provides a systematic approach for understanding the mechanisms at work in implementation across contexts. Weaknesses reported related to data availability limitations, especially on ineffective interventions. The majority of papers demonstrated good knowledge of cases, and justification of case selection, but other criteria of methodological quality were less comprehensively met. Conclusion QCA is a promising approach for addressing the role of context in complex interventions, and for identifying causal configurations of conditions that predict implementation and/or outcomes when there is sufficiently detailed understanding of a series of comparable cases. As the use of QCA in evaluative health research increases, there may be a need to develop advice for public health researchers and journals on minimum criteria for quality and reporting.

Abstract Background Stated principles in government policy documents serve as a set of values outlining how governments intend to work. As such, health planning principles should be reflected in health policy across the cycle of planning, implementation and evaluation. Such principles should be reflected in the process of governments commissioning and funding evaluation, and in the work of those commissioned to do evaluation on behalf of governments. Methods We reviewed health planning policy documents to identify principles Australian State and Territory and National governments stated as being important to the work they do within Aboriginal and Torres Strait Islander health contexts. Evaluation tenders and reports relating to Aboriginal and Torres Strait Islander health policy, programs and service for the period 1-Jan-2007 to 1-Jan-2017 were retrieved and assessed as to whether they embedded principles governments state as important. Results In Aboriginal and Torres Strait Islander health planning policy contexts, Australian governments outline shared responsibility, cultural competence, engagement, partnership, capacity building, equity, a holistic concept of health, accountability, and evidence-based as fundamental principles that will underpin the work they will do. In total, we identified 390 publicly advertised evaluation tenders, but were only able to retrieve 18 tenders and 97 reports. Despite strong rhetoric placing importance on the abovementioned principles, these were not consistently embedded in tenders released by government commissioners, nor in reports largely commissioned by governments. Principles most widely incorporated in documents were those corresponding to Closing the Gap - accountability, evidence-based and equity. Principles of holistic concept of health, capacity building, cultural competence and partnership do not appear well applied in evaluation practice. Conclusion Notwithstanding the tensions and criticism of current practice that sees dominant governments policing Aboriginal and Torres Strait Islander populations and defining what principles should inform health policy and evaluation practice, this paper reveals shortcomings in current evaluation practice. Firstly, this paper reveals a lack of transparency about current practice, with only 2% of tenders and 25% of reports in the public domain. Secondly, this paper reveals that governments do not ‘walk the talk’, particularly when it comes to principles relating to Aboriginal participation in health.

Abstract Background While there has been progress in controlling the HIV epidemic, HIV still remains a disease of global concern. Some of the progress has been attributed to increased public awareness and uptake of public health interventions, as well as increased access to anti- retroviral treatment and the prevention of vertical HIV transmission. These interventions would not have been possible without substantial investments in HIV programs. However, donor fatigue introduces the need for low income countries to maximize the benefits of the available resources. This necessitates identification of priorities that should be funded. Evaluating prioritization processes would enable decision makers to assess the effectiveness of their processes, thereby designing intervention strategies. To date most evaluations have focused on cost-benefit analyses, which overlooks additional critical impacts of priority setting decisions. Kapiriri & Martin (2010) developed and validated a comprehensive framework for evaluating PS in low income countries. The objective of this paper report findings from a comprehensive evaluation of priority setting for HIV in Uganda, using the framework; and to identify lessons of good practice and areas for improvement. Methods This was a qualitative study based on forty interviews with decision makers and policy document review. Data were analysed using INVIVO 10, and based on the parameters in Kapiriri et al’s evaluation framework. Results We found that HIV enjoys political support, which contributes to the availability of resources, strong planning institutions, and participatory prioritization process based on some criteria. Some of the identified limitations included; undue donor and political influence, priorities not being publicized, and lack of mechanisms for appealing the decisions. HIV prioritization had both positive and negative impacts on the health system. Conclusions The framework facilitated a more comprehensive evaluation of HIV priority setting. While there were successful areas, the process could be strengthened by minimizing undue influence of external actors, and support the legitimate institutions to set priorities and implement them. These should also institute mechanisms for publicizing the decisions, appeals and increased accountability. While this paper looked at HIV, the framework is flexible enough to be used in evaluating priority setting for other health programs within similar context.

Abstract Background Peer-research is steered and conducted by people with lived experience of the issues being researched. This paper explores the value of peer-research in two complex public health intervention evaluations in the UK. Methods Reports from 18 peer research projects, completed by residents from 12 communities in the UK taking part in two community empowerment interventions, were analysed using cross-case analysis. Results Undertaking peer research helped to build the evaluation and research skills within individual projects as well as providing data on other outcomes related to the programmes Theory of Change. Some peer researchers, however, felt unprepared for the activity despite support from the academic team and were unsatisfied with project outcomes. While peer research projects provided more opportunities for local residents to engage with the overall evaluations, there was an overreliance on people closely connected to the programmes to be peer researchers. The peer research projects explored topics that were broader than the aims and objectives of the overall programme evaluations. All provided insight into the context in which projects occurred, while some also informed understanding of programme change mechanisms. Conclusions Including peer research as part of complex public health intervention evaluations can help uncover important contextual and ecological details beyond the reach of more traditional evaluation data collection. Peer research can also empower and build research/evaluation capacity within communities, which is particularly pertinent for community empowerment interventions.

Abstract Background One way to facilitate the translation of research into the occupational health service practice is through clinical practice guidelines. To increase the implementability of guidelines it is important to include the end-users in the development, for example by a community of practice approach. This paper describes the development of an occupational health practice guideline aimed at the management of non-specific low back pain (LBP) by using a community of practice approach. The paper also includes a process evaluation of the development providing insight into the feasibility of the process. Methods A multidisciplinary community of practice group (n = 16) consisting of occupational nurses, occupational physicians, ergonomists/physical therapists, health and safety engineers, health educators, psychologists and researchers from different types of occupational health services and geographical regions within Sweden met eleven times (June 2012–December 2013) to develop the practice guideline following recommendations of guideline development handbooks. Process-outcomes recruitment, reach, context, satisfaction, feasibility and fidelity were assessed by questionnaire, observations and administrative data. Results Group members attended on average 7.5 out of 11 meetings. Half experienced support from their workplace for their involvement. Feasibility was rated as good, except for time-scheduling. Most group members were satisfied with the structure of the process (e.g. presentations, multidisciplinary group). Fidelity was rated as fairly high. Conclusions The described development process is a feasible process for guideline development. For future guideline development expectations of the work involved should be more clearly communicated, as well as the purpose and tasks of the CoP-group. Moreover, possibilities to improve support from managers and colleagues should be explored. This paper has important implications for future guideline development; it provides valuable information on how practitioners can be included in the development process, with the aim of increasing the implementability of the developed guidelines.

Abstract Background Increasingly, strength-based approaches to health and wellbeing interventions with Aboriginal and Torres Strait Islander Australians are being explored. This is a welcome counter to deficit-based initiatives which can represent a non-Indigenous view of outcomes of interest. However, the evidence base is not well developed. This paper presents the protocol for evaluating a strengths-based initiative which provides life coaching services to Aboriginal and Torres Strait Islander community housing tenants. The study aims to evaluate the effect of life coaching on social and emotional wellbeing (SEWB) of tenants in three Victorian regions. Methods The More Than a Landlord (MTAL) study is a prospective cohort study of Aboriginal Housing Victoria tenants aged 16 years and over that embeds the evaluation of a life coaching program. All tenant holders in one metropolitan and two regional areas of Victoria are invited to participate in a survey of SEWB, containing items consistent with key categories of SEWB as understood and defined by Aboriginal and Torres Strait Islander peoples, and key demographics, administered by Aboriginal and Torres Strait Islander peer researchers at baseline, 6 and 18 months. Survey participants are then invited to participate in strengths based life coaching, using the GROW model, for a duration of up to 18 months. Indigenous life coaches provide tenants with structured support in identifying and making progress towards their goals and aspirations, rather than needs. The study aims to recruit a minimum of 200 survey participants of which it is anticipated that approximately 73% will agree to life coaching. Discussion The MTAL study is a response to Aboriginal and Torres Strait Islander community and organisational requests to build the evidence base for an initiative originally developed and piloted within an Aboriginal controlled organisation. The study design aligns with key principles for research in Indigenous communities in promoting control, decision making and capacity building. The MTAL study will provide essential evidence to evaluate the effectiveness of strengths-based initiatives in promoting SEWB in these communities and provide new evidence about the relationship between strengths, resilience, self-determination and wellbeing outcomes. Trial registration This trial was retrospectively registered with the ISRCTN Register on the 12/7/21 with the study ID: ISRCTN33665735 .

Abstract Background Men’s Sheds (“Sheds”) offer a unique opportunity to reach a captive audience of “hard-to-reach” men. However, attempts to engage Sheds in structured health promotion programmes must respect the ethos of Sheds as highly variable, autonomous, non-structured spaces. This paper captures the key methodologies used in “Sheds for Life’ (SFL), a men’s health initiative tailored to the Shed setting. Methods A hybrid effectiveness-implementation study design is used to test effectiveness and implementation outcomes across multiple levels (participant, provider, organisational and systems levels). A dynamic, iterative and collaborative process seeks to address barriers and translation into the real world context. Using a community-based participatory research approach and guided by established implementation frameworks, Shed members (‘Shedders’) assume the role of key decision makers throughout the evaluation process to promote the systematic uptake of SFL across Shed settings. The protocols pertaining to the development, design and implementation of SFL and the evaluation of impact on participants’ health and wellbeing outcomes up to 12 months are outlined. Conclusions There is a dynamic interplay between the intervention characteristics of SFL and the need to assess and understand the diverse contexts of Sheds and the wider implementation environment. A pragmatic and context-specific design is therefore favoured over a tightly controlled efficacy trial. Documenting the protocols used to evaluate and implement a complex multi-level co-developed intervention such as SFL helps to inform gender-specific, community-based men’s health promotion and translational research more broadly. Trial registration This study has been retrospectively registered with the ‘International Standard Randomised Controlled Trial Number’ registry ( ISRCTN79921361 ) as of the 5th of March 2021.

Abstract Background Complex global initiatives, like the Global Polio Eradication Initiative (GPEI), have prevented millions of paralyses and improved the health status of diverse populations. Despite the logistical challenges these initiatives must overcome at several levels, scant methods exist for systematically identifying and reaching a range of actors involved in their implementation. As a result, efforts to document the lessons learned from such initiatives are often incomplete. This paper describes the development and application of the Synthesis and Translation of Research and Innovations from Polio Eradication (STRIPE) systematic approach for identifying a comprehensive sample of actors involved in the GPEI. Results The survey for collecting lessons learned from the GPEI was conducted at the global level and within seven countries that represented GPEI operational contexts. Standard organizational and operational levels, as well as goals of program activities, were defined across contexts. Each survey iteration followed similar methodologies to theorize a target population or “universe” of all polio-related actors in the study area, enumerate a source population of specific individuals within the target population, and administer the survey to individuals within the source population. Based on the systematic approach used to obtain a comprehensive sample for lessons learned in GPEI, steps for obtaining a comprehensive sample for studying complex initiatives can be summarized as follows: (i) State research goal(s); (ii) Describe the program of interest; (iii) Define a sampling universe to meet these criteria; (iv) Estimate the size of the sampling universe; (v) Enumerate a source population within the universe that can be feasibly reached for sampling; (vi) Sample from the source population; and (vii) Reflect on the process to determine strength of inferences drawn. Conclusions The application of these methods can inform future evaluations of complex public health initiatives, resulting in better adoption of lessons learned, ultimately improving efficacy and efficiency, and resulting in significant health gains. Their use to administer the STRIPE lessons learned survey reflects experiences related to implementation challenges and strategies used to overcome barriers from actors across an extensive range of organizational, programming, and contextual settings.

Abstract Background Greenland struggles with a high prevalence of smoking, alcohol and drug abuse. In response to the increasing need for preventive initiatives, the first public health program Inuuneritta was introduced in 2007. Internationally, frameworks focus primarily on the implementation of a single, well-described intervention or program. However, with the increasing need and emergence of more holistic, integrated approaches, a need for research investigating the process of policy implementation from launch to action arises. This paper aims to augment the empirical evidence on the implementation of integrated health promotion programs within a governmental setting using the case of Inuuneritta II. In this study, the constraining and enabling determinants of the implementation processes within and across levels and sectors were examined. Methods Qualitative methods with a transdisciplinary approach were applied. Data collection consisted of six phases with different qualitative methods applied to gain a comprehensive overview and understanding of Inuuneritta II’s implementation process. These methods included: observations and focus group discussions at the community health worker (CHW) conference, telephone interviews, document analysis, and a workshop on results dissemination. Results Enabling determinants influencing the implementation process of Inuuneritta II positively were high motivation among adopters, local prevention committees supporting community health workers, and the initiation of the central prevention committee. In contrast, constraining determinants were ambiguous program aims, high turnovers, siloed budgets and work environments, and an inconsistent and neglected central prevention committee. Conclusion Inuuneritta II provided a substantial framework for an integrated health policy approach. However, having a holistic and comprehensive program enabling an integrated approach is not sufficient. Inuuneritta II’s integrated approach does not harmonise with the government’s inflexible organisational structure resulting in insufficient implementation.

Abstract Background January 2016 saw the publication of proposed revisions to the UK’s lower risk drinking guidelines but no sustained promotional activity. This paper aims to explore the impact of publishing guidelines without sustained promotional activity on reported guideline exposure and determinants of behaviour (capability, opportunity and motivation) proposed by the COM-B model. Methods Data were collected by a monthly repeat cross-sectional survey of adults (18+) resident in England over 15 months between November 2015 and January 2017 from a total of 16,779 drinkers, as part of the Alcohol Toolkit Study. Trends and associated 95% confidence intervals were described in the proportion of reported exposure to guidelines in the past month and measures of the capability, opportunity and motivation to consume alcohol within drinking guidelines. Results There was a rise in reported exposure to drinking guidelines in January 2016 (57.6–80.6%) which did not reoccur in January 2017. Following the increase in January 2016, reported exposure reduced slowly but remained significantly higher than in December 2015. In February 2016, there was an increase in measures of capability (31.1% reported tracking units of alcohol consumption and 87.8% considered it easier to drink safely) and opportunity (84.0% perceived their lifestyle as conducive to drinking within guidelines). This change was not maintained in subsequent months. Other measures showed marginal changes between January and February 2016 with no evidence of change in subsequent months. Conclusions Following the publication of revised drinking guideline in January 2016, there was a transient increase in exposure to guidelines, and capability and opportunity to drink within the guidelines that diminished over time. The transience and size of the changes indicate that behaviour change is unlikely. Well-designed, theory-based promotional campaigns may be required for drinking guidelines to be an effective public health intervention.

Abstract Background Translation encompasses the continuum from clinical efficacy to widespread adoption within the healthcare service and ultimately routine clinical practice. The Parenting, Eating and Activity for Child Health (PEACH™) program has previously demonstrated clinical effectiveness in the management of child obesity, and has been recently implemented as a large-scale community intervention in Queensland, Australia. This paper aims to describe the translation of the evaluation framework from a randomised controlled trial (RCT) to large-scale community intervention (PEACH™ QLD). Tensions between RCT paradigm and implementation research will be discussed along with lived evaluation challenges, responses to overcome these, and key learnings for future evaluation conducted at scale. Methods The translation of evaluation from PEACH™ RCT to the large-scale community intervention PEACH™ QLD is described. While the CONSORT Statement was used to report findings from two previous RCTs, the REAIM framework was more suitable for the evaluation of upscaled delivery of the PEACH™ program. Evaluation of PEACH™ QLD was undertaken during the project delivery period from 2013 to 2016. Results Experiential learnings from conducting the evaluation of PEACH™ QLD to the described evaluation framework are presented for the purposes of informing the future evaluation of upscaled programs. Evaluation changes in response to real-time changes in the delivery of the PEACH™ QLD Project were necessary at stages during the project term. Key evaluation challenges encountered included the collection of complete evaluation data from a diverse and geographically dispersed workforce and the systematic collection of process evaluation data in real time to support program changes during the project. Conclusions Evaluation of large-scale community interventions in the real world is challenging and divergent from RCTs which are rigourously evaluated within a more tightly-controlled clinical research setting. Constructs explored in an RCT are inadequate in describing the enablers and barriers of upscaled community program implementation. Methods for data collection, analysis and reporting also require consideration. We present a number of experiential reflections and suggestions for the successful evaluation of future upscaled community programs which are scarcely reported in the literature. Trials registration PEACH™ QLD was retrospectively registered with the Australian New Zealand Clinical Trials Registry on 28 February 2017 (ACTRN12617000315314).

Abstract Background Alcohol-related harm is a substantial burden on the community in Australia and internationally, particularly harm related to risky drinking practices of young people in the night-time economy. This protocol paper describes a study that will report on the changes in a wide range of health and justice outcome measures associated with major policy changes in the state of Queensland, Australia. A key element includes trading hours restrictions for licensed premises to 2 am for the state and 3 am in Safe Night Precincts (SNPs). Other measures introduced include drinks restrictions after midnight, increased patron banning measures for repeat offenders, mandatory ID scanning of patrons in late-night venues, and education campaigns. Methods The primary aim of the study is to evaluate change in the levels of harm due to these policy changes using administrative data (e.g., police, hospital, ambulance, and court data). Other study elements will investigate the impact of the Policy by measuring foot traffic volume in SNPs, using ID scanner data to quantify the volume of people entering venues and measure the effectiveness of banning notices, using patron interviews to quantify the levels of pre-drinking, intoxication and illicit drug use within night-time economy districts, and to explore the impacts of the Policy on business and live music, and costs to the community. Discussion The information gathered through this project aims to evaluate the effectiveness of the Policy and to draw on these findings to inform future prevention and enforcement approaches by policy makers, police, and venue staff.

Abstract Background Determining what constitutes “good practice” in the measurement of the costs and effects of health promotion and disease prevention measures is of particular importance. The aim of this paper was to gather expert knowledge on (economic) evaluations of health promotion and prevention measures for children and adolescents, especially on the practical importance, the determinants of project success, meaningful parameters for evaluations, and supporting factors, but also on problems in their implementation. This information is targeted at people responsible for the development of primary prevention or health promotion programs. Methods Partially structured open interviews were conducted by two interviewers and transcribed, paraphrased, and summarized for further use. Eight experts took part in the interviews. Results The interviewed experts saw evaluation as a useful tool to establish the effects of prevention programs, to inform program improvement and further development, and to provide arguments to decision making. The respondents’ thought that determinants of a program’s success were effectiveness with evidence of causality, cost benefit relation, target-group reach and sustainability. It was considered important that hard and soft factors were included in an evaluation; costs were mentioned only by one expert. According to the experts, obstacles to evaluation were lacking resources, additional labor requirements, and the evaluators’ unfamiliarity with a program’s contents. It was recommended to consider evaluation design before a program is launched, to co-operate with people involved in a program and to make use of existing structures. Conclusion While in in this study only a partial view of expert knowledge is represented, it could show important points to consider when developing evaluations of prevention programs. By considering these points, researchers could further advance towards a more comprehensive approach of evaluation targeting measures in children and adolescents.

Abstract Background School-based structured opportunities for physical activity can provide health-related benefits to children and youth, and contribute to international guidelines recommending 60 min of moderate-to-vigorous physical activity (MVPA) per day. In 2005, the Ministry of Education in Ontario, Canada, released the Daily Physical Activity (DPA) policy requiring school boards to “ensure that all elementary students, including students with special needs, have a minimum of twenty minutes of sustained MVPA each school day during instructional time”. This paper reports on the first provincial study evaluating implementation fidelity to the DPA policy in Ontario elementary schools and classrooms. Using an adapted conceptual framework, the study also examined associations between implementation of DPA and a number of predictors in each of these respective settings. Methods Separate cross-sectional online surveys were conducted in 2014 with Ontario elementary school administrators and classroom teachers, based on a representative random sample of schools and classrooms. An implementation fidelity score was developed based on six required components of the DPA policy. Other survey items measured potential predictors of implementation at the school and classroom levels. Descriptive analyses included frequency distributions of implementation fidelity and predictor variables. Bivariate analyses examining associations between implementation and predictors included binary logistic regression for school level data and generalized linear mixed models for classroom level data, in order to adjust for school-level clustering effects. Results Among administrators, 61.4 % reported implementation fidelity to the policy at the school level, while 50.0 % of teachers reported fidelity at the classroom level. Several factors were found to be significantly associated with implementation fidelity in both school and classroom settings including: awareness of policy requirements; scheduling; monitoring; use of resources and supports; perception that the policy is realistic and achievable; and specific barriers to implementation. Conclusions Findings from the surveys indicate incomplete policy implementation and a number of factors significantly associated with implementation fidelity. The results indicate a number of important implications for policy, practice and further research, including the need for additional research to monitor implementation and its predictors, and assess the impacts of study recommendations and subsequent outcomes of a reinvigorated DPA moving forward.

Abstract Background Reducing the Strength is an increasingly popular intervention in which local authorities ask retailers to stop selling ‘super-strength’ beers and ciders. The intervention cannot affect alcohol availability, nor consumption, unless retailers participate. In this paper, we ask whether and why retailers choose or refuse to self-impose restrictions on alcohol sales in this way. Methods Mixed method assessment of retailers’ participation in Reducing the Strength in two London (UK) local authorities. Compliance rates and the cheapest available unit of alcohol at each store were assessed. Qualitative interviews with retailer managers and staff (n = 39) explored attitudes towards the intervention and perceptions of its impacts. Results Shops selling super-strength across both areas fell from 78 to 25 (18 % of all off-licences). The median price of the cheapest unit of alcohol available across all retailers increased from £0.29 to £0.33 and in shops that participated in Reducing the Strength it rose from £0.33 to £0.43. The project received a mixed response from retailers. Retailers said they participated to deter disruptive customers, reduce neighbourhood disruptions and to maintain a good relationship with the local authority. Reducing the Strength participants and non-participants expressed concern about its perceived financial impact due to customers shopping elsewhere for super-strength. Some felt that customers’ ability to circumvent the intervention would limit its effectiveness and that a larger scale compulsory approach would be more effective. Conclusions Reducing the Strength can achieve high rates of voluntary compliance, reduce availability of super-strength and raise the price of the cheapest available unit of alcohol in participating shops. Questions remain over the extent to which voluntary interventions of this type can achieve wider social or health goals if non-participating shops attract customers from those who participate.