Search

Abstract System dynamics approaches are increasingly addressing the complexity of public health problems such as childhood overweight and obesity. These approaches often use system mapping methods, such as the construction of causal loop diagrams, to gain an understanding of the system of interest. However, there is limited practical guidance on how such a system understanding can inform the development of an action programme that can facilitate systems changes. The Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme combines system dynamics and participatory action research to improve obesity-related behaviours, including diet, physical activity, sleep and sedentary behaviour, in 10–14-year-old adolescents in Amsterdam, the Netherlands. This paper illustrates how we used a previously obtained understanding of the system of obesity-related behaviours in adolescents to develop an action programme to facilitate systems changes. A team of evaluation researchers guided interdisciplinary action-groups throughout the process of identifying mechanisms, applying the Intervention Level Framework to identify leverage points and arriving at action ideas with aligning theories of change. The LIKE action programme consisted of 8 mechanisms, 9 leverage points and 14 action ideas which targeted the system’s structure and function within multiple subsystems. This illustrates the feasibility of developing actions targeting higher system levels within the confines of a research project timeframe when sufficient and dedicated effort in this process is invested. Furthermore, the system dynamics action programme presented in this study contributes towards the development and implementation of public health programmes that aim to facilitate systems changes in practice.

Abstract Background Systems thinking embraces the complexity of public health problems, including childhood overweight and obesity. It aids in understanding how factors are interrelated, and it can be targeted to produce favourable changes in a system. There is a growing call for systems approaches in public health research, yet limited practical guidance is available on how to evaluate public health programmes within complex adaptive systems. The aim of this paper is to present an evaluation framework that supports researchers in designing systems evaluations in a comprehensive and practical way. Methods We searched the literature for existing public health systems evaluation studies. Key characteristics on how to conduct a systems evaluation were extracted and compared across studies. Next, we overlaid the identified characteristics to the context of the Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme evaluation and analyzed which characteristics were essential to carry out the LIKE evaluation. This resulted in the Evaluation of Programmes in Complex Adaptive Systems (ENCOMPASS) framework. Results The ENCOMPASS framework includes five iterative stages: (1) adopting a system dynamics perspective on the overall evaluation design; (2) defining the system boundaries; (3) understanding the pre-existing system to inform system changes; (4) monitoring dynamic programme output at different system levels; and (5) measuring programme outcome and impact in terms of system changes. Conclusions The value of ENCOMPASS lies in the integration of key characteristics from existing systems evaluation studies, as well as in its practical, applied focus. It can be employed in evaluating public health programmes in complex adaptive systems. Furthermore, ENCOMPASS provides guidance for the entire evaluation process, all the way from understanding the system to developing actions to change it and to measuring system changes. By the nature of systems thinking, the ENCOMPASS framework will likely evolve further over time, as the field expands with more completed studies.

Background: Systems thinking embraces the complexity of public health problems, including childhood overweight and obesity. It aids in understanding how factors are interrelated, and it can be targeted to produce favourable changes in a system. There is a growing call for systems approaches in public health research, yet limited practical guidance is available on how to evaluate public health programmes within complex adaptive systems. The aim of this paper is to present an evaluation framework that supports researchers in designing systems evaluations in a comprehensive and practical way. Methods: We searched the literature for existing public health systems evaluation studies. Key characteristics on how to conduct a systems evaluation were extracted and compared across studies. Next, we overlaid the identified characteristics to the context of the Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme evaluation and analyzed which characteristics were essential to carry out the LIKE evaluation. This resulted in the Evaluation of Programmes in Complex Adaptive Systems (ENCOMPASS) framework. Results: The ENCOMPASS framework includes five iterative stages: (1) adopting a system dynamics perspective on the overall evaluation design; (2) defining the system boundaries; (3) understanding the pre-existing system to inform system changes; (4) monitoring dynamic programme output at different system levels; and (5) measuring programme outcome and impact in terms of system changes. Conclusions: The value of ENCOMPASS lies in the integration of key characteristics from existing systems evaluation studies, as well as in its practical, applied focus. It can be employed in evaluating public health programmes in complex adaptive systems. Furthermore, ENCOMPASS provides guidance for the entire evaluation process, all the way from understanding the system to developing actions to change it and to measuring system changes. By the nature of systems thinking, the ENCOMPASS framework will likely evolve further over time, as the field expands with more completed studies. [ABSTRACT FROM AUTHOR]