Search

Introduction: Health policy and systems research (HPSR) is a multi-disciplinary approach of generating health system and policy-level evidence. Setting HPSR agendas is considered as an efficient strategy to map and identify policy and cost-effective research topics, but its practice in developing countries is limited. This paper aimed to conduct a collaborative health policy and system research priority-setting exercise in Ethiopia., Method: The WHO's plan, implement, publish, and evaluate (PIPE) framework and the Delphi technique were used to conduct the priority-setting exercise. The PIPE model was used to lead the priority-setting process from planning to evaluation, while the Delphi technique was used to run the rating and ranking exercise with the aim of reaching a consensus. Two rounds of expert panel workshops supplemented with an online survey were used for the HPSR agenda setting, rating and ranking purposes. Groups were formed using the WHO health system building blocks as a base framework to identify and prioritize the HPSR topics., Result: Under 8 themes, 32 sub-themes and 182 HPSR topics were identified. The identified research themes include leadership management and governance, health policy, health information system, healthcare financing, human resource for health, medical products and supply, service delivery and cross-cutting issues., Conclusions: Priority HPSR topics focussing on national health priority issues were identified. The identified topics were shared with policymakers and academic and research institutions. Evidence generation on the identified priority topics will guide future research endeavours and improve evidence-informed decision-making practice, health system performance and national health goals and targets., (© 2024. The Author(s).)

Sex and gender are inadequately considered in health and medical research, policy and practice, leading to preventable disparities in health and wellbeing. Several global institutions, journals, and funding bodies have developed policies and guidelines to improve the inclusion of diverse participants and consideration of sex and gender in research design and reporting and the delivery of clinical care. However, according to recent evaluations, these policies have had limited impact on the inclusion of diverse research participants, adequate reporting of sex and gender data and reducing preventable inequities in access to, and quality provision of, healthcare. In Australia, the Sex and Gender Policies in Medical Research (SGPMR) project aims to address sex and gender bias in health and medical research by (i) examining how sex and gender are currently considered in Australian research policy and practice; (ii) working with stakeholders to develop policy interventions; and (iii) understanding the wider impacts, including economic, of improved sex and gender consideration in Australian health and medical research. In this paper we describe the development of a theory of change (ToC) for the SGPMR project. The ToC evolved from a two-stage process consisting of key stakeholder interviews and a consultation event. The ToC aims to identify the pathways to impact from improved consideration of sex and gender in health and medical research, policy and practice, and highlight how key activities and policy levers can lead to improvements in clinical practice and health outcomes. In describing the development of the ToC, we present an entirely novel framework for outlining how sex and gender can be appropriately considered within the confines of health and medical research, policy and practice., (© 2024. The Author(s).)

Background: Nigeria commenced rollout of vaccination for coronavirus disease 2019 (COVID-19) in March 2021 as part of the national public health response to the pandemic. Findings from appropriately contextualized cost-effectiveness analyses (CEA) as part of a wider process involving health technology assessment (HTA) approaches have been important in informing decision-making in this area. In this paper we outline the processes that were followed to identify COVID-19 vaccine stakeholders involved in the selection, approval, funding, procurement and rollout of vaccines in Nigeria, and describe the process routes we identified to support uptake of HTA-related information for evidence-informed policy in Nigeria., Methods: Our approach to engaging with policy-makers and other stakeholders as part of an HTA of COVID vaccination in Nigeria consisted of three steps, namely: (i) informal discussions with key stakeholders; (ii) stakeholder mapping, analysis and engagement; and (iii) communication and dissemination strategies for the HTA-relevant evidence produced. The analysis of the stakeholder mapping uses the power/interest grid framework., Results: The informal discussion with key stakeholders generated six initial policy questions. Further discussions with policy-makers yielded three suitable policy questions for analysis: which COVID-19 vaccines should be bought; what is the optimal mode of delivery of these vaccines; and what are the cost and cost-effectiveness of vaccinating people highlighted in Nigeria's phase 2 vaccine rollout prioritized by the government, especially the inclusion of those aged between 18 and 49 years. The stakeholder mapping exercise highlighted the range of organizations and groups within Nigeria that could use the information from this HTA to guide decision-making. These stakeholders included both public/government, private and international organizations The dissemination plan developed included disseminating the full HTA results to key stakeholders; production of policy briefs; and presentation at different national and international conferences and peer-reviewed publications., Conclusions: HTA processes that involve stakeholder engagement will help ensure important policy questions are taken into account when designing any HTA including any underpinning evidence generation. Further guidance about stakeholder engagement throughout HTA is required, especially for those with low interest in vaccine procurement and use., (© 2024. The Author(s).)

Background: Health policy and systems research (HPSR) can strengthen health systems and improve population health outcomes. In the Eastern Mediterranean Region (EMR), there is limited recognition of the importance of HPSR and funding remains the main challenge. This study seeks to: (1) assess the reporting of funding in HPSR papers published between 2010 and 2022 in the EMR, (2) examine the source of funding in the published HPSR papers in the EMR and (3) explore variables influencing funding sources, including any difference in funding sources for coronavirus disease 2019 (COVID-19)-related articles., Methods: We conducted a rapid scoping review of HPSR papers published between 2010 and 2022 (inclusively) in the EMR, addressing the following areas: reporting of funding in HPSR papers, source of funding in the published HPSR papers, authors' affiliations and country of focus. We followed the Joanna Briggs Institute (JBI) guidelines for conducting scoping reviews. We also conducted univariate and bivariate analyses for all variables at 0.05 significance level., Results: Of 10,797 articles screened, 3408 were included (of which 9.3% were COVID-19-related). More than half of the included articles originated from three EMR countries: Iran (n = 1018, 29.9%), the Kingdom of Saudi Arabia (n = 595, 17.5%) and Pakistan (n = 360, 10.6%). Approximately 30% of the included articles did not report any details on study funding. Among articles that reported funding (n = 1346, 39.5%), analysis of funding sources across all country income groups revealed that the most prominent source was national (55.4%), followed by international (41.7%) and lastly regional sources (3%). Among the national funding sources, universities accounted for 76.8%, while governments accounted for 14.9%. Further analysis of funding sources by country income group showed that, in low-income and lower-middle-income countries, all or the majority of funding came from international sources, while in high-income and upper-middle-income countries, national funding sources, mainly universities, were the primary sources of funding. The majority of funded articles' first authors were affiliated with academia/university, while a minority were affiliated with government, healthcare organizations or intergovernmental organizations. We identified the following characteristics to be significantly associated with the funding source: country income level, the focus of HPSR articles (within the EMR only, or extending beyond the EMR as part of international research consortia), and the first author's affiliation. Similar funding patterns were observed for COVID-19-related HPSR articles, with national funding sources (78.95%), mainly universities, comprising the main source of funding. In contrast, international funding sources decreased to 15.8%., Conclusion: This is the first study to address the reporting of funding and funding sources in published HPSR articles in the EMR. Approximately 30% of HPSR articles did not report on the funding source. Study findings revealed heavy reliance on universities and international funding sources with minimal role of national governments and regional entities in funding HPSR articles in the EMR. We provide implications for policy and practice to enhance the profile of HPSR in the region., (© 2024. The Author(s).)

Introduction: Collaboration is gaining prominence in the priority setting of Health Policy And System Research (HPSR). However, its practice and challenges are not well explored in Ethiopia. Understanding the practice and barriers of collaborative Health Policy and System Research will help design approaches and platforms for setting inclusive and participatory policy and system-level health research topics. This paper explores the practice and barriers of collaborative HPSR-priority setting exercise in Ethiopia., Methods: This study investigates the practice and barriers of collaborative health policy and system research priority-setting exercises in Ethiopia. Utilizing a mixed-methods approach, we conducted Key Informant Interviews (KIIs) and an online self-administered survey with open-ended questionnaires to capture diverse perspectives from stakeholders involved in the research priority-setting process. Through conventional content analysis, we identified key contents related to current practices, challenges, and opportunities for enhancing collaboration in health policy and system research prioritization., Results: Our findings reveal a complex landscape characterized by varying levels of stakeholder engagement, institutional capacity constraints, and competing priorities within the health research ecosystem. Despite notable efforts to foster collaboration, stakeholders identified persistent challenges such as limited resources, institutional fragmentation, and inadequate coordination mechanisms as barriers to effective priority-setting processes. The implications of our research extend beyond academic discourse, with direct relevance to health policy and system research practice in Ethiopia. By shedding light on the dynamics of collaborative priority-setting exercises, our findings offer valuable insights for policymakers, researchers, and practitioners seeking to enhance the effectiveness and inclusivity of health research prioritization processes. Addressing the identified barriers and leveraging existing strengths in the research ecosystem can contribute to more evidence-informed health policies and programs, ultimately improving health outcomes for Ethiopian populations., Conclusions: Most institutions do not apply health policy and system research-priority setting to conduct informed decision-making. The barriers explored were weak integration, lack of knowledge, system, and platforms for the priority setting of Health Policy and System Resreach. So, it is recommended to build skills of different actors in the Health Policy and System Research-priority setting exercise and design a system and platform to integrate different stakeholders for collaborative research topics priority setting., (© 2024. The Author(s).)

Background: Decentralization of a health system is a complex and multidimensional phenomenon that demands thorough investigation of its process logistics, predisposing factors and implementation mechanisms, within the broader socio-political environment of each nation. Despite its wide adoption across both high-income countries (HICs) and low-and-middle-income countries (LMICs), empirical evidence of whether decentralization actually translates into improved health system performance remains inconclusive and controversial. This paper aims to provide a comprehensive description of the decentralization processes in three countries at different stages of their decentralization strategies - Pakistan, Brazil and Portugal., Main Body: This study employed a systematic analysis of peer-reviewed academic journals, official government reports, policy documents and publications from international organizations related to health system decentralization. A comprehensive search was conducted using reputable databases such as PubMed, Google Scholar, the WHO repository and other relevant databases, covering the period up to the knowledge cutoff date in June 2023. Information was systematically extracted and organized into the determinants, process mechanics and challenges encountered during the planning, implementation and post-decentralization phases. Although decentralization reforms have achieved some success, challenges persist in their implementation. Comparing all three countries, it was evident that all three have prioritized health in their decentralization reforms and aimed to enhance local decision-making power. Brazil has made significant progress in implementing decentralization reforms, while Portugal and Pakistan are still in the process. Pakistan has faced significant implementation challenges, including capacity-building, resource allocation, resistance to change and inequity in access to care. Brazil and Portugal have also faced challenges, but to a lesser extent. The extent, progress and challenges in the decentralization processes vary among the three countries, each requiring ongoing evaluation and improvement to achieve the desired outcomes., Conclusion: Notable differences exist in the extent of decentralization, the challenges faced during implementation and inequality in access to care between the three countries. It is important for Portugal, Brazil and Pakistan to address these through reinforcing implementation strategies, tackling inequalities in access to care and enhancing monitoring and evaluation mechanism. Additionally, fostering knowledge sharing among these different countries will be instrumental in facilitating mutual learning., (© 2024. The Author(s).)

Knowledge synthesis methods help summarize evidence and utilize content expertise to draw out key messages to aid knowledge mobilization and translation. Systems thinking and coproduction can support this by facilitating a multiperspective view and ensuring that knowledge is mobilized and translated in a useful and meaningful way for policy-makers and practitioners. In this paper, we describe the development of a knowledge synthesis approach that utilizes coproduction with policy-makers to combine the findings of a programme of research with policy knowledge to support decision-makers working in chronic disease prevention. The process developed by The Australian Prevention Partnership Centre combined the expertise of research, policy and science communications experts. We reflect on how we used coproduction processes to embed policy-makers as partners in the evidence synthesis process via research-policy dialogues, and embedded science communication into the development and presentation of the findings. This differs from a more common approach of researchers generating evidence for policy with limited input from policy-makers themselves. By collaborating with policy-makers and using coproduction, we can better inform policy-relevant research and generate policy-relevant knowledge. We describe the development of our knowledge synthesis approach using two case studies: the first drawing on a body of work in public health law, and the second on a body of work focused on the first 2000 days of life. We consider how these case studies demonstrate the value of working with policy partners as part of a knowledge synthesis process, and discuss how this process could be adapted and used in future., (© 2023. The Author(s).)

Background: Tunisia has been engaged in the Societal Dialogue (SD) for Health process since 2012, a participatory health governance process aimed at bringing in people's voice into health policy-making. Its first success was the recently released National Health Policy 2030. This paper aims to document the SD process and to bring out the lessons learned to inspire other countries., Methods: This study was based essentially on a qualitative analysis of semi-structured interviews with citizen jury members and health experts that took place from May to September 2018. The qualitative analysis adopted an inductive-deductive approach according to a cross-matrix between the themes of the interview of the two groups of interviewees., Results: The qualitative analysis of the data highlighted that the Societal Dialogue created a health democracy dynamic with inclusive dialogue spaces for the population, communities, and civil society to participate in health system design. It constituted a multi-actor and multidisciplinary coordination platform to increase consensus building among actors. Initial government support and high levels of volunteer commitment allowed the process to achieve a certain level of sustainability. However, this process faced and still faces many challenges such as overreliance on volunteers; a crisis of trust; political instability and the lack of an effective communication strategy. These challenges negatively influence the policy uptake of recommendations made by the Societal Dialogue for Health., Conclusion: The Tunisian societal dialogue experience highlights both the successes and challenges of a structured participatory platform, as well as the effort and perseverance it takes to keep such a process functional and relevant. A key lesson from this study is that this model of participatory health governance eventually reaches a stage where population, community, and civil society participation needs to be more institutionalized within the government routine so that it can credibly feed into health policy review processes and inform decision-makers on a regular basis., (© 2023. BioMed Central Ltd., part of Springer Nature.)

Background: The roles and functionality of technical working groups (TWGs) in the health sectors vary across countries, still they aim to support government and ministries in formulating evidence-informed recommendations for policies and facilitate dialogue and alignment of activities among stakeholders within the health sector. Thus, TWGs have a role in enhancing the functionality and effectiveness of the health system structure. However, in Malawi, the functionality of TWGs and how they utilize research evidence to contribute to decision-making is not monitored. This study sought to understand the TWGs' performance and functionality in enabling evidence-informed decision-making (EIDM) in Malawi's health sector., Methods: A cross-sectional descriptive qualitative study. Data were collected through interviews, documents review and observation of three TWG meetings. Qualitative data were analysed using a thematic approach. The WHO-UNICEF Joint Reporting Form (JRF) was used to guide the assessment of TWG functionality., Results: TWG functionality varied in the Ministry of Health (MoH) in Malawi. The reasons for those perceived to be functioning well included meeting frequently, diverse representation of members, and that their recommendations to MoH were usually considered when decisions were made. For the TWGs that were perceived as not functioning well, the main reasons included lack of funding, periodic meetings and discussions that needed to provide clear decisions on the actions to be taken. In addition, evidence was recognized as important in decision-making, and research was valued by decision-makers within the MoH. However, some of the TWGs lacked reliable mechanisms for generating, accessing and synthesizing research. They also needed more capacity to review and use the research to inform their decisions., Conclusions: TWGs are highly valued and play a critical role in strengthening EIDM within the MoH. Our paper highlights the complexity and barriers of TWG functionality in supporting pathways for health policy-making in Malawi. These results have implications for EIDM in the health sector. This suggests that the MoH should actively develop reliable interventions and evidence tools, strengthen capacity-building and increase funding for EIDM., (© 2023. The Author(s).)

Background: Recent estimates report that 2.4 billion people with health conditions globally could benefit from rehabilitation. While the benefits of rehabilitation for individuals and society have been described in the literature, many individuals, especially in low- and middle-income countries do not have access to quality rehabilitation. As the need for rehabilitation continues to increase, it is crucial that health systems are adequately prepared to meet this need. Practice- and policy-relevant evidence plays an important role in health systems strengthening efforts. The aim of this paper is to report on the outcome of a global consultative process to advance the development of a research framework to stimulate health policy and systems research (HPSR) for rehabilitation, in order to generate evidence needed by key stakeholders., Methods: A multi-stakeholder participatory technical consultation was convened by WHO to develop a research framework. This meeting included participants from selected Member States, rehabilitation experts, HPSR experts, public health researchers, civil society and other stakeholders from around the world. The meeting focused on introducing systems approaches to stakeholders and deliberating on priority rehabilitation issues in health systems. Participants were allocated to one of four multi-stakeholder groups with a facilitator to guide the structured technical consultations. Qualitative data in the form of written responses to guiding questions were collected during the structured technical consultations. A technical working group was then established to analyse the data and extract its emerging themes. This informed the development of the HPSR framework for rehabilitation and a selection of preliminary research questions that exemplify how the framework might be used., Results: A total of 123 individuals participated in the multi-stakeholder technical consultations. The elaborated framework is informed by an ecological model and puts forth elements of the six WHO traditional building blocks of the health system, while emphasizing additional components pertinent to rehabilitation, such as political priority, engagement and participatory approaches, and considerations regarding demand and access. Importantly, the framework highlights the multilevel interactions needed across health systems in order to strengthen rehabilitation. Additionally, an initial set of research questions was proposed as a primer for how the framework might be used., Conclusions: Strengthening health systems to meet the increasing need for rehabilitation will require undertaking more HPSR to inform the integration of rehabilitation into health systems globally. We anticipate that the proposed framework and the emerging research questions will support countries in their quest to increase access to rehabilitation for their populations., (© 2022. The Author(s).)

Background: Globally, policy-makers face challenges to using evidence in health decision-making, particularly lack of interaction between research and policy. Knowledge-brokering mechanisms can fill research-policy gaps and facilitate evidence-informed policy-making. In Myanmar, the need to promote evidence-informed policy is significant, and thus a mechanism was set up for this purpose. This paper discusses lessons learned from the development of the Knowledge Broker Group-Myanmar (KBG-M), supported by the Johns Hopkins Bloomberg School of Public Health's Applied Mental Health Research Group (JHU) and Community Partners International (CPI)., Methods: Sixteen stakeholders were interviewed to explore challenges in formulating evidence-informed policy. Two workshops were held: the first to further understand the needs of policy-makers and discuss knowledge-brokering approaches, and the second to co-create the KBG-M structure and process. The KBG-M was then envisioned as an independent body, with former officials of the Ministry of Health and Sports (MoHS) and representatives from the nongovernmental sector actively engaging in the health sector, with an official collaboration with the MoHS., Results: A development task force that served as an advisory committee was established. Then, steps were taken to establish the KBG-M and obtain official recognition from the MoHS. Finally, when the technical agreement with the MoHS was nearly complete, the process stopped because of the military coup on 1 February 2021, and is now on hold indefinitely., Conclusions: Learning from this process may be helpful for future or current knowledge-brokering efforts, particularly in fragile, conflict-affected settings. Experienced and committed advisory committee members enhanced stakeholder relationships. Responsive coordination mechanisms allowed for adjustments to a changing bureaucratic landscape. Coordination with similar initiatives avoided overlap and identified areas needing technical support. Recommendations to continue the work of the KBG-M itself or similar platforms include the following: increase resilience to contextual changes by ensuring diverse partnerships, maintain advisory committee members experienced and influential in the policy-making process, ensure strong organizational and funding support for effective functioning and sustainability, have budget and timeline flexibility to allow sufficient time and resources for establishment, organize ongoing needs assessments to identify areas needing technical support and to develop responsive corrective approaches, and conduct information sharing and collaboration between stakeholders to ensure alignment., (© 2021. The Author(s).)

Background: Australian governments are increasingly mandating the use of cost-benefit analysis (CBA) to inform the efficient allocation of government resources. CBA is likely to be useful when evaluating preventive health interventions that are often cross-sectoral in nature and require Cabinet approval prior to implementation. This study outlines a CBA framework for the evaluation of preventive health interventions that balances the need for consistency with other agency guidelines whilst adhering to guidelines and conventions for health economic evaluations., Methods: We analysed CBA and other evaluation guidance documents published by Australian federal and New South Wales (NSW) government departments. Data extraction compared the recommendations made by different agencies and the impact on the analysis of preventive health interventions. The framework specifies a reference case and sensitivity analyses based on the following considerations: (1) applied economic evaluation theory; (2) consistency between CBA across different government departments; (3) the ease of moving from a CBA to a more conventional cost-effectiveness/cost-utility analysis framework often used for health interventions; (4) the practicalities of application; and (5) the needs of end users being both Cabinet decision-makers and health policy-makers., Results: Nine documents provided CBA or relevant economic evaluation guidance. There were differences in terminology and areas of agreement and disagreement between the guidelines. Disagreement between guidelines involved (1) the community included in the societal perspective; (2) the number of options that should be appraised in ex ante analyses; (3) the appropriate time horizon for interventions with longer economic lives; (4) the theoretical basis and value of the discount rate; (5) parameter values for variables such as the value of a statistical life; and (6) the summary measure for decision-making., Conclusions: This paper addresses some of the methodological challenges that have hindered the use of CBA in prevention by outlining a framework that is consistent with treasury department guidelines whilst considering the unique features of prevention policies. The effective use and implementation of a preventive health CBA framework is likely to require considerable investment of time and resources from state and federal government departments of health and treasury but has the potential to improve decision-making related to preventive health policies and programmes., (© 2021. The Author(s).)

Background: Health research governance is an essential function of national health research systems. Yet many African countries have not developed strong health research governance structures and processes. This paper presents a comparative analysis of national health research governance in Botswana, Kenya, Uganda and Zambia, where health sciences research production is well established relative to some others in the region and continues to grow. The paper aims to examine progress made and challenges faced in strengthening health research governance in these countries., Methods: We collected data through document review and key informant interviews with a total of 80 participants including decision-makers, researchers and funders across stakeholder institutions in the four countries. Data on health research governance were thematically coded for policies, legislation, regulation and institutions and analysed comparatively across the four national health research systems., Results: All countries were found to be moving from using a research governance framework set by national science, technology and innovation policies to one that is more anchored in health research structures and policies within the health sectors. Kenya and Zambia have adopted health research legislation and policies, while Botswana and Uganda are in the process of developing the same. National-level health research coordination and regulation is hampered by inadequate financial and human resource capacities, which present challenges for building strong health research governance institutions., Conclusion: Building health research governance as a key pillar of national health research systems involves developing stronger governance institutions, strengthening health research legislation, increasing financing for governance processes and improving human resource capacity in health research governance and management., (© 2021. The Author(s).)

Background: While the evidence supporting the effectiveness of community health worker (CHW) programmes is substantial, there is also considerable evidence that many of these programmes have notable weaknesses that need to be addressed in order for them to reach their full potential. Thus, considerations about CHW programme performance and its assessment must be taken into account as the importance of these programmes is becoming more widely appreciated. In this paper, the tenth in our 11-paper series, "Community health workers at the dawn of a new era", we address CHW programme performance and how it is assessed from a systems perspective., Methods: The paper builds on the 2014 CHW Reference Guide, a compendium of case studies of 29 national CHW programmes, the 2018 WHO guideline on health policy and system support to optimize CHW programmes, and scientific studies on CHW programme performance published in the past 5 years., Results: The paper provides an overview of existing frameworks that are useful for assessing the performance of CHW programmes, with a specific focus on how individual CHW performance and community-level outcomes can be measured. The paper also reviews approaches that have been taken to assess CHW programme performance, from programme monitoring using the routine health information system to national assessments using quantitative and/or qualitative study designs and assessment checklists. The paper also discusses contextual factors that influence CHW programme performance, and reflects upon gaps and needs for the future with regard to assessment of CHW programme performance., Conclusion: Assessments of CHW programme performance can have various approaches and foci according to the programme and its context. Given the fact that CHW programmes are complex entities and part of health systems, their assessment ideally needs to be based on data derived from a mix of reliable sources. Assessments should be focused not only on effectiveness (what works) but also on contextual factors and enablers (how, for whom, under what circumstances). Investment in performance assessment is instrumental for continually innovating, upgrading, and improving CHW programmes at scale. Now is the time for new efforts in implementation research for strengthening CHW programming., (© 2021. The Author(s).)

Background: Almost 20 million children under one year of age did not receive basic vaccines in 2019, and most of these children lived in low- and middle-income countries. Implementation research has been recognized as an emerging area that is critical to strengthen the implementation of interventions proven to be effective. As a component of strengthening implementation, WHO has called for greater embedding of research within decision-making processes. One strategy to facilitate the embedding of research is to engage decision-makers as Principal Investigators of the research. Since 2015, the Alliance for Health Policy and Systems Research within the WHO and the United Nations Children's Fund have supported decision-maker led research by partnering with Gavi, the Vaccine Alliance, in an initiative called "Decision-Maker Led Implementation Research". This synthesis paper describes the cross-cutting lessons from the initiative to further understand and develop future use of the decision-maker led strategy., Methods: This study used qualitative methods of data collection, including a document review and in-depth interviews with decision-makers and researchers engaged in the initiative. Document extraction and thematic content analysis were applied. The individual project was the unit of analysis and the results were summarized across projects., Results: Research teams from 11 of the 14 projects participated in this study, for an overall response rate of 78.6%. Most projects were carried out in countries in Africa and conducted at the sub-state or sub-district level. Seven enablers and five barriers to the process of conducting the studies or bringing about changes were identified. Key enablers were the relevance, acceptability, and integration of the research, while key barriers included unclear results, limited planning and support, and the limited role of a single study in informing changes to strengthen implementation., Conclusions: Decision-maker led research is a promising strategy to facilitate the embedding of research into decision-making processes and contribute to greater use of research to strengthen implementation of proven-effective interventions, such as immunization. We identified several lessons for consideration in the future design and use of the decision-maker led strategy., (© 2021. The Author(s).)

Background: The concept of "intersectionality" is increasingly employed within public health arenas, particularly in North America, and is often heralded as offering great potential to advance health inequalities research and action. Given persistently poor progress towards tackling health inequalities, and recent calls to reframe this agenda in the United Kingdom and Europe, the possible contribution of intersectionality deserves attention. Yet, no existing research has examined professional stakeholder understandings and perspectives on applying intersectionality to this field., Methods: In this paper we seek to address that gap, drawing upon a consultation survey and face-to-face workshop (n = 23) undertaken in the United Kingdom. The survey included both researchers (n = 53) and policy and practice professionals (n = 20) with varied roles and levels of engagement in research and evaluation. Topics included familiarity with the term and concept "intersectionality", relevance to health inequalities work, and issues shaping its uptake. Respondents were also asked to comment on two specific policy suggestions: intersectionally targeting and tailoring interventions, and evaluating the intersectional effects of policies. The workshop aims were to share examples of applying intersectionality within health inequalities research and practice; understand the views of research and practice colleagues on potential contributions and challenges; and identify potential ways to promote intersectional approaches., Results: Findings indicated a generally positive response to the concept and a cautiously optimistic assessment that intersectional approaches could be valuable. However, opinions were mixed and various challenges were raised, especially around whether intersectionality research is necessarily critical and transformative and, accordingly, how it should be operationalized methodologically. Nonetheless, there was general agreement that intersectionality is concerned with diverse inequalities and the systems of power that shape them., Conclusions: We position intersectionality within the wider context of health inequalities policy and practice, suggesting potential ways forward for the approach in the context of the United Kingdom. The views of policy and practice professionals suggest that intersectionality has far to travel to help counter individualistic narratives and to encourage an approach that is sensitive to subgroup inequalities and the processes that generate them. Examples of promising practice, albeit mostly in North America, suggest that it is possible for intersectionality to gain traction.

Background: Various interventions have been undertaken in Iran to promote evidence-informed health policy-making (EIHP). Identifying the challenges in EIHP is the first step toward strengthening EIHP in each country through the design of tailored interventions. Therefore, the current study was conducted to synthesize the results of earlier studies and to finalize the list of barriers to EIHP in Iran., Methods: To identify the barriers to EIHP in Iran, two steps were taken: a systematic review and policy dialogue. To conduct the systematic review, three Iranian databases and PubMed, Health Systems Evidence (HSE), Embase, and Scopus were searched. The reference lists of included papers and documentation from some local organizations were hand-searched. Upon conducting the systematic review, given the significance of stakeholders in clarifying the problem of EIHP, policy dialogue was used to complete the list previously extracted and to do advocacy. Selection criteria for the stakeholders included influential and informed individuals from knowledge-producing, knowledge-utilizing, and knowledge-brokering organizations. Semi-structured interviews were held with three important absent stakeholders., Results: Challenges specific to Iran that were identified included the lack of integration of the health ministry and the medical universities, lack of ties between health knowledge utilization organizations, failure to establish long-term research plans, neglect of national research needs at the time of recruiting human resources in knowledge-producing organizations, and duplication and lack of coordination in routine data obtained from surveillance systems, disease registration systems, and censuses. It seems that some challenges are common across countries, including neglecting the importance of inter- and intra-disciplinary studies, the capacity of policy-makers and managers to utilize evidence, the criteria for evaluating the performance of policy-makers, managers, and academic members, the absence of long-term programmes in knowledge-utilizing organizations, the rapid replacement of policy-makers and managers, and lack of use of evaluation studies., Conclusions: In this study, we tried to identify the challenges regarding EIHP in Iran using a systematic review and policy dialogue approach. This is the first step toward determining the best interventions to improve evidence-informed policy-making in each country, because these challenges are contextual and need to be investigated contextually.

Background: This paper critically discusses the use and merits of global indices, in particular, the Global Health Security Index (GHSI; Cameron et al. https://www.ghsindex.org/#l-section--map ) in times of an imminent crisis, such as the current pandemic. This index ranked 195 countries according to their expected preparedness in the case of a pandemic or other biological threat. The coronavirus disease 2019 (Covid-19) pandemic provides the background to compare each country's predicted performance from the GHSI with the actual performance. In general, there is an inverted relation between predicted versus actual performance, i.e. the predicted top performers are among those that are the worst hit. Obviously, this reflects poorly on the potential policy uses of this index in imminent crisis management., Methods: The paper analyses the GHSI and identifies why it may have struggled to predict actual pandemic preparedness as evidenced by the Covid-19 pandemic. The paper also uses two different data sets, one from the Worldmeter on the spread of the Covid-19 pandemics, and the other from the International Network for Government Science Advice (INGSA) Evidence-to-Policy Tracker, to draw comparisons between the actual introduction of pandemic response policies and the corresponding death rate in 29 selected countries., Results: This paper analyses the reasons for the poor match between prediction and reality in the index, and mentions six general observations applying to global indices in this respect. These observations are based on methodological and conceptual analyses. The level of abstraction in these global indices builds uncertainties upon uncertainties and hides implicit value assumptions, which potentially removes them from the policy needs on the ground., Conclusions: From the analysis, the question is raised if the policy community might have better tools for decision-making in a pandemic. On the basis of data from the INGSA Evidence-to-Policy Tracker, and with backing in studies from social psychology and philosophy of science, some simple heuristics are suggested, which may be more useful than a global index.

Background: Public policy is increasingly recognized as an important component of physical activity promotion. This paper reports on the current status of physical activity policy development and implementation in four European countries based on the Health-Enhancing Physical Activity Policy Audit Tool (HEPA PAT) developed by WHO. It compares the findings to previous studies and discusses the general utility of this tool and its unique features in relation to other instruments., Methods: The study was conducted as part of the Policy Evaluation Network ( www.jpi-pen.eu ) in Germany, Ireland, the Netherlands and Poland. Data collection built upon information obtained via the EU Physical Activity Monitoring Framework survey, additional desk research and expert opinion. Data analysis employed Howlett's policy cycle framework to map and compare national physical activity policies in the four countries., Results: In all countries under study, policy agenda-setting is influenced by prevalence data from national health monitoring systems, and the sport and/or health sector takes the lead in policy formulation. Key policy documents were located mainly in the health sector but also in sport, urban design and transport. Physical activity programmes implemented to meet policy objectives usually cover a broad range of target groups, but currently only a small selection of major policies are evaluated for effectiveness. National experts made several suggestions to other countries wishing to establish physical activity policies, e.g. regarding cross-sectoral support and coordination, comprehensive national action plans, and monitoring/surveillance., Conclusions: This study provides a detailed overview of physical activity policies in the four countries. Results show that national governments are already very active in the field but that there is room for improvement in a number of areas, e.g. regarding the contribution of sectors beyond sport and health. Using the HEPA PAT simultaneously in four countries also showed that procedures and timelines have to be adapted to national contexts. Overall, the instrument can make an important contribution to understanding and informing physical activity policy, especially when used as an add-on to regular monitoring tools like the EU HEPA Monitoring Framework.

Background: The expectation that climate change will further exacerbate extreme weather events such as heatwaves is of primary concern to policymakers and scientists. Effective governance is fundamental to preparedness for and response to such threats. This paper explores the governance structures of European heat health action plans and provides insights into key stakeholders, roles, responsibilities and collaboration., Methods: This was a two-phase qualitative study, in which we complemented a desk review of 15 European national heat health action plans (NHHAPs) with, after obtaining informed consent, 68 interviews in nine countries with key informants involved in the development, implementation and/or evaluation of these NHHAPs. A thematic analysis was used to analyze the NHHAPs inductively. This analysis focused on three themes: identifying key stakeholders, defining and assigning roles and collaboration among stakeholders. The iteratively created codebook was then applied to the analysis of the key informant interviews. All analyses were done using NVivo 10 qualitative analysis software., Results: The majority of the NHHAPs have governance as one of their main objectives, to support the coordination of actions and collaboration among involved stakeholders. There are, however, significant differences between plan and practice. On the basis of the available data, we have little insight into the process of stakeholder identification, but we do find that most countries involve the same types of stakeholders. Roles are mainly defined and assigned in relation to the alert levels of the warning system, causing other role aspects and other roles to be vague and ambiguous. Collaboration is key to many NHHAP elements and is mainly experienced positively, though improvements and new collaborations are considered., Conclusions: Our findings show a need for a more deliberate and structured approach to governance in the context of NHHAPs. A cross-sectoral approach to the identification of key stakeholders can facilitate a broader preparedness and response to heatwaves. Roles and responsibilities of stakeholders should be defined and assigned more clearly to avoid confusion and to improve effective implementation. To this extent, we identify and describe seven key roles and potential stakeholders to which these roles are usually assigned. Finally, also collaboration among stakeholders can benefit from a cross-sectoral approach, but also formal structures can be beneficial.

Background: Although values underpin the goals pursued in health systems, including how health systems benefit the population, it is often not clear how values are incorporated into policy decision-making about health systems. The challenge is to encompass social/citizen values, health system goals, and financial realities and to incorporate them into the policy-making process. This is a challenge for all health systems and of particular importance for Latin American (LA) countries. Our objective was to understand how and under what conditions societal values inform decisions about health system financing in LA countries., Methods: A critical interpretive synthesis approach was utilised for this work. We searched 17 databases in December 2016 to identify articles written in English, Spanish or Portuguese that focus on values that inform the policy process for health system financing in LA countries at the macro and meso levels. Two reviewers independently screened records and assessed them for inclusion. One researcher conceptually mapped the included articles, created structured summaries of key findings from each, and selected a purposive sample of articles to thematically synthesise the results across the domains of agenda-setting/prioritisation, policy development and implementation., Results: We identified 5925 references, included 199 papers, and synthesised 68 papers. We identified 116 values and developed a framework to explain how values have been used to inform policy decisions about financing in LA countries. This framework has four categories - (1) goal-related values (i.e. guiding principles of the health system); (2) technical values (those incorporated into the instruments adopted by policy-makers to ensure a sustainable and efficient health system); (3) governance values (those applied in the policy process to ensure a transparent and accountable process of decision-making); and (4) situational values (a broad category of values that represent competing strategies to make decisions in the health systems, their influence varying according to the four factors)., Conclusions: It is an effort to consolidate and explain how different social values are considered and how they support policy decision-making about health system financing. This can help policy-makers to explicitly incorporate values into the policy process and understand how values are supporting the achievement of policy goals in health system financing., Trial Registration: The protocol was registered with PROSPERO, ID=CRD42017057049 .

Background: Health policy and systems research (HPSR) is an inherently cross-disciplinary field of investigation. However, conflicting conceptualisations about inter-, multi- and transdisciplinary research have contributed to confusion about the characteristics of cross-disciplinary approaches in HPSR. This review was conducted to (1) define the characteristic features of context-mechanism-outcome (CMO) configurations in cross-disciplinary HPSR, (2) develop criteria for evaluating cross-disciplinarity and (3) synthesise emerging challenges of the approach., Method: The paper is a critical realist synthesis conducted in three phases, as follows: (1) scoping the literature, (2) searching for and screening the evidence, and (3) extracting and synthesising the evidence. Five databases, namely the International Bibliography of the Social Sciences and Web of Science, PubMed central, Embase and CINHAL, and reference lists of studies that qualified for inclusion in the review were searched. The search covered peer-reviewed original research, reviews, commentary papers, and institutional or government reports published in English between January 1998 and January 2020., Results: A total of 7792 titles were identified in the online search and 137 publications, comprising pilot studies as well as anecdotal and empirical literature were selected for the final review. The review draws attention to the fact that cross-disciplinary HPSR is not defined by individual characteristics but by the combination of a particular type of research question and setting (context), a specific way of researchers working together (mechanism), and research output (outcome) that is superior to what could be achieved under a monodisciplinary approach. This CMO framework also informs the criteria for assessing whether a given HPSR is truly cross-disciplinary. The challenges of cross-disciplinary HPSR and their accompanying coping mechanisms were also found to be context driven, originating mainly from conceptual disagreements, institutional restrictions, communication and information management challenges, coordination problems, and resource limitations., Conclusion: These findings have important implications. First, the CMO framework of cross-disciplinary HPSR can provide guidance for researchers engaging in new projects and for policy-makers using their findings. Second, the proposed criteria for evaluating theory and practice of cross-disciplinary HPSR may inform the systematic development of new research projects and the structured assessment of existing ones. Third, a better understanding of the challenges of cross-disciplinary HPSR and potential response mechanisms may help researchers to avoid these problems in the future.

Background: Embedded approaches to implementation research (IR), whereby health system decision-makers participate actively in the research process, are gaining traction as effective approaches to optimise the delivery of health programmes and policies. However, the evidence base on the processes and effectiveness of such collaborative research remains inchoate. Standardised approaches to evaluate these initiatives are needed to identify core elements of 'embeddedness', unveil the underlying pathways of change, and assess contribution to evidence uptake in decision-making and overall outcomes of effect. The framework presented in this paper responds to this need, designed to guide the systematic evaluation of embedded IR., Methods: This evaluation framework for embedded IR approaches is based on the experience of a joint initiative by the Pan American Health Organization/Alliance for Health Policy and Systems Research, which has supported 19 IR grants in 10 Latin American and Caribbean countries from 2014 to 2017. The conceptualisation of this framework drew on various sources of information, including empirical evidence and conceptual insights from the literature, interviews with content experts, and a prospective evaluation of the 2016 cohort that included semi-structured key informant interviews, document analysis, and a research team survey to examine key aspects of embedded research., Results: We developed a widely applicable conceptual framework to guide the evaluation of embedded IR in various contexts. Focused on uncovering how this collaborative research approach influences programme improvement, it outlines expected processes and intermediate outcomes. It also highlights constructs with which to assess 'embeddedness' as well as critical contextual factors. The framework is intended to provide a structure by which to systematically examine such embedded research initiatives, proposing three key stages of evidence-informed decision-making - co-production of evidence, engagement with research, and enactment of programme changes., Conclusion: Rigorous evaluation of embedded IR is needed to build the evidence on its processes and effectiveness in influencing decision-making. The evaluation framework presented here addresses this gap with consideration of the complexity of such efforts. Its applicability to similar initiatives is bolstered by virtue of being founded on real-world experience; its potential to contribute to a nuanced understanding of embedded IR is significant.

Background: Scientific journals play a critical role in research validation and dissemination and are increasingly vocal about the identification of research priorities and the targeting of research results to key audiences. No new journals specialising in health policy and systems research (HPSR) and focusing in the developing world or in a specific developing world region have been established since the early 1980s. This paper compares the growth of publications on HPSR across Latin America and the world and explores the potential, feasibility and challenges of innovative publication strategies., Methods: A bibliometric analysis was undertaken using HPSR MeSH terms with journals indexed in Medline. A survey was undertaken among 2500 authors publishing on HPSR in Latin America (LA) through an online survey, with a 13.1% response rate. Aggregate indicators were constructed and validated, and two-way ANOVA tests were performed on key variables., Results: HPSR publications on LA observed an average annual growth of 27.5% from the years 2000 to 2018, as against 11.4% worldwide and yet a lag on papers published per capita. A total of 48 journals with an Impact Factor publish HPSR on LA, of which 5 non-specialised journals are published in the region and are ranked in the bottom quintile of Impact Factor. While the majority of HPSR papers worldwide is published in specialised HPSR journals, in LA this is the minority. Very few researchers from LA sit in the Editorial Board of international journals. Researchers highly support strengthening quality HPSR publications through publishing in open access, on-line journals with a focus on the LA region and with peer reviewers specialized on the region. Researchers would support a new open access journal specializing in the LA region and in HPSR, publishing in English. Open access up-front costs and disincentives while waiting for an Impact Factor can be overcome., Conclusion: Researchers publishing on HPSR in LA widely support the launching of a new specialised journal for the region with a vigorous editorial policy focusing on regional and country priorities. Strategies should be in place to support English-language publishing and to develop a community of practice around the publication process. In the first years, special issues should be promoted through a priority-setting process to attract prominent authors, develop the audience and attain an Impact Factor.

Background: While intersectoral collaboration is considered valuable and important for achieving health outcomes, there are few examples of successes. The literature on intersectoral collaboration suggests that success relies on a shared understanding of what can be achieved collectively and whether stakeholders can agree on mutual goals or acceptable trade-offs. When health systems are faced with negotiating intersectoral responses to complex issues, achieving consensus across sectors can be a challenging and uncertain process. Stakeholders may present divergent framings of the problem based on their disciplinary background, interests and institutional mandates. This raises an important question about how different frames of problems and solutions affect the potential to work across sectors during the initiating phases of the policy process., Methods: In this paper, this question was addressed through an analysis of the case of the First 1000 Days (FTD) Initiative, an intersectoral approach targeting early childhood in the Western Cape Province of South Africa. We conducted a documentary analysis of 34 policy and other documents on FTD (spanning global, national and subnational spheres) using Schmidt's conceptualisation of policy ideas in order to elicit framings of the policy problem and solutions., Results: We identified three main frames, associated with different sectoral positionings - a biomedical frame, a nurturing care frame and a socioeconomic frame. Anchored in these different frames, ideas of the problem (definition) and appropriate policy solutions engaged with FTD and the task of intersectoral collaboration at different levels, with a variety of (sometimes cross) purposes., Conclusions: The paper concludes on the importance of principled engagement processes at the beginning of collaborative processes to ensure that different framings are revealed, reflected upon and negotiated in order to arrive at a joint determination of common goals.

Background: The need for research-based knowledge to inform health policy formulation and implementation is a chronic global concern impacting health systems functioning and impeding the provision of quality healthcare for all. This paper provides a systematic overview of the literature on knowledge translation (KT) strategies employed by health system researchers and policy-makers in African countries., Methods: Evidence mapping methodology was adapted from the social and health sciences literature and used to generate a schema of KT strategies, outcomes, facilitators and barriers. Four reference databases were searched using defined criteria. Studies were screened and a searchable database containing 62 eligible studies was compiled using Microsoft Access. Frequency and thematic analysis were used to report study characteristics and to establish the final evidence map. Focus was placed on KT in policy formulation processes in order to better manage the diversity of available literature., Results: The KT literature in African countries is widely distributed, problematically diverse and growing. Significant disparities exist between reports on KT in different countries, and there are many settings without published evidence of local KT characteristics. Commonly reported KT strategies include policy briefs, capacity-building workshops and policy dialogues. Barriers affecting researchers and policy-makers include insufficient skills and capacity to conduct KT activities, time constraints and a lack of resources. Availability of quality locally relevant research was the most reported facilitator. Limited KT outcomes reflect persisting difficulties in outcome identification and reporting., Conclusion: This study has identified substantial geographical gaps in knowledge and evidenced the need to boost local research capacities on KT practices in low- and middle-income countries. Evidence mapping is also shown to be a useful approach that can assist local decision-making to enhance KT in policy and practice.

Background: This paper describes the trial of a novel intervention, Supporting Policy In health with evidence from Research: an Intervention Trial (SPIRIT). It examines (1) the feasibility of delivering this kind of programme in practice; (2) its acceptability to participants; (3) the impact of the programme on the capacity of policy agencies to engage with research; and (4) the engagement with and use of research by policy agencies., Methods: SPIRIT was a multifaceted, highly tailored, stepped-wedge, cluster-randomised, trial involving six health policy agencies in Sydney, Australia. Agencies were randomly allocated to one of three start dates to receive the 1-year intervention programme. SPIRIT included audit, feedback and goal setting; a leadership programme; staff training; the opportunity to test systems to facilitate research use in policies; and exchange with researchers. Outcome measures were collected at each agency every 6 months for 30 months., Results: Participation in SPIRIT was associated with significant increases in research use capacity at staff and agency levels. Staff reported increased confidence in research use skills, and agency leaders reported more extensive systems and structures in place to support research use. Self-report data suggested there was also an increase in tactical research use among agency staff. Given the relatively small numbers of participating agencies and the complexity of their contexts, findings suggest it is possible to effect change in the way policy agencies approach the use of research. This is supported by the responses on the other trial measures; while these were not statistically significant, on 18 of the 20 different measures used, the changes observed were consistent with the hypothesised intervention effect (that is, positive impacts)., Conclusions: As an early test of an innovative approach, SPIRIT has demonstrated that it is possible to increase research engagement and use in policy agencies. While more work is needed to establish the replicability and generalisability of these findings, this trial suggests that building staff skills and organisational structures may be effective in increasing evidence use.

Background: Despite calls for the application of complex systems science in empirical studies of health promotion, there are very few examples. The aim of this paper was to use a complex systems approach to examine the key factors that influenced health promotion (HP) policy and practice in a multisectoral health system in Australia., Methods: Within a qualitative case study, a schema was developed that incorporated HP goals, actions and strategies with WHO building blocks (leadership and governance, financing, workforce, services and information). The case was a multisectoral health system bounded in terms of geographical and governance structures and a history of support for HP. A detailed analysis of 20 state government strategic documents and interviews with 53 stakeholders from multiple sectors were completed. Based upon key findings and dominants themes, causal pathways and feedback loops were established. Finally, a causal loop diagram was created to visualise the complex array of feedback loops in the multisectoral health system that influenced HP policy and practice., Results: The complexity of the multisectoral health system was clearly illustrated by the numerous feedback mechanisms that influenced HP policy and practice. The majority of feedback mechanisms in the causal loop diagram were vicious cycles that inhibited HP policy and practice, which need to be disrupted or changed for HP to thrive. There were some virtuous cycles that facilitated HP, which could be amplified to strengthen HP policy and practice. Leadership and governance at federal-state-local government levels figured prominently and this building block was interdependently linked to all others., Conclusion: Creating a causal loop diagram enabled visualisation of the emergent properties of the case health system. It also highlighted specific leverage points at which HP policy and practice can be improved. This paper demonstrates the critical importance of leveraging leadership and governance for HP and adds urgency to the need for increased and strong advocacy efforts targeting all levels of government in multisectoral health systems.

Background: The uptake of findings from sexual and reproductive health and rights research into policy-making remains a complex and non-linear process. Different models of research utilisation and guidelines to maximise this in policy-making exist, however, challenges still remain for researchers to improve uptake of their research findings and for policy-makers to use research evidence in their work., Methods: A participatory workshop with researchers was organised in November 2017 by the Academic Network for Sexual and Reproductive Health and Rights Policy (ANSER) to address this gap. ANSER is a consortium of experienced researchers, some of whom have policy-making experience, working on sexual and reproductive health and rights issues across 16 countries and 5 continents. The experiential learning cycle was used to guide the workshop discussions based on case studies and to encourage participants to focus on key lessons learned. Workshop findings were thematically analysed using specific stages from Hanney et al.'s (Health Res Policy Syst 1:2, 2003) framework on the place of policy-making in the stages of assessment of research utilisation and outcomes., Results: The workshop identified key strategies for translating research into policy, including joint agenda-setting between researchers and policy-makers, as well as building trust and partnerships with different stakeholders. These were linked to stages within Hanney et al.'s framework as opportunities for engaging with policy-makers to ensure uptake of research findings., Conclusion: The engagement of stakeholders during the research development and implementation phases, especially at strategic moments, has a positive impact on uptake of research findings. The strategies and stages described in this paper can be applied to improve utilisation of research findings into policy development and implementation globally.

The potential use, influence and impact of health research is seldom fully realised. This stubborn problem has caused burgeoning global interest in research aiming to address the implementation 'gap' and factors inhibiting the uptake of scientific evidence. Scholars and practitioners have questioned the nature of evidence used and required for healthcare, highlighting the complex ways in which knowledge is formed, shared and modified in practice and policy. This has led to rapid expansion, expertise and innovation in the field of knowledge mobilisation and funding for experimentation into the effectiveness of different knowledge mobilisation models. One approach gaining prominence involves stakeholders (e.g. researchers, practitioners, service users, policy-makers, managers and carers) in the co-production, and application, of knowledge for practice, policy and research (frequently termed integrated knowledge translation in Canada). Its popularity stems largely from its potential to address dilemmas inherent in the implementation of knowledge generated using more reductionist methods. However, despite increasing recognition, demands for co-produced research to illustrate its worth are becoming pressing while the means to do so remain challenging. This is due not only to the diversity of approaches to co-production and their application, but also to the ways through which different stakeholders conceptualise, measure, reward and use research. While research co-production can lead to demonstrable benefits such as policy or practice change, it may also have more diffuse and subtle impact on relationships, knowledge sharing, and in engendering culture shifts and research capacity-building. These relatively intangible outcomes are harder to measure and require new emphases and tools. This opinion paper uses six Canadian and United Kingdom case studies to explore the principles and practice of co-production and illustrate how it can influence interactions between research, policy and practice, and benefit diverse stakeholders. In doing so, we identify a continuum of co-production processes. We propose and illustrate the use of a new 'social model of impact' and framework to capture multi-layered and potentially transformative impacts of co-produced research. We make recommendations for future directions in research co-production and impact measurement.

Background: India recently launched the largest universal health coverage scheme in the world to address the gaps in providing healthcare to its population. Health technology assessment (HTA) has been recognised as a tool for setting priorities as the government seeks to increase public health expenditure. This study aims to understand the current situation for healthcare decision-making in India and deliberate on the opportunities for introducing HTA in the country., Methods: A paper-based questionnaire, adapted from a survey developed by the International Decision Support Initiative (iDSI), was administered on the second day of the Topic Selection Workshop that was conducted as part of the HTA Awareness Raising Workshop held in New Delhi on 25-27 July, 2016. Participants were invited to respond to questions covering the need, demand and supply for HTA in their context as well as the role of their organisation vis-à-vis HTA. The response rate for the survey was about 68% with 41 participants having completed the survey., Results: Three quarters of the respondents (71%) stated that the government allocated healthcare resources on the basis of expert opinion. Most respondents indicated reimbursement of individual health technologies and designing a basic health benefit package (93% each) were important health policy areas while medical devices and screening programmes were cited as important technologies (98% and 92%, respectively). More than half of the respondents noted that relevant local data was either not available or was limited. Finally, technical capacity was seen as a strength and a constraint facing organisations., Conclusion: The findings from this study shed light on the current situation, the opportunities, including potential topics, and challenges in conducting HTA in India. There are limitations to the study and further studies may need to be conducted to inform the role that HTA will play in the design or implementation of universal health coverage in India.

Background: Cross-sectoral, multidisciplinary partnership research is considered one of the most effective means of facilitating research-informed policy and practice, particularly for addressing complex problems such as chronic disease. Successful research partnerships tend to be underpinned by a range of features that enable knowledge mobilisation (KMb), seeking to connect academic researchers with decision-makers and practitioners to improve the nature, quality and use of research. This paper contributes to the growing discourse on partnership approaches by illustrating how knowledge mobilisation strategies are operationalised within the Australian Prevention Partnership Centre (the Centre), a national collaboration of academics, policy-makers and practitioners established to develop systems approaches for the prevention of lifestyle-related chronic diseases., Methods: We undertook interviews with key academics, policy, and practice partners and funding representatives at the mid-point of the Centre's initial 5-year funding cycle. We aimed to explore how the Centre is functioning in practice, to develop a conceptual model of KMb within the Centre for use in further evaluation, and to identify ways of strengthening our approach to partnership research. Inductive and deductive thematic analysis was used to identify the key mechanisms underpinning the Centre's KMb approach., Results: Six key mechanisms appeared to facilitate KMb within our Centre, namely Engagement, Partnerships, Co-production, Capacity and Skills, Knowledge Integration, and Adaptive Learning and Improvement. We developed a conceptual model that articulated these mechanisms in relation to the structures and processes that support them, as well as the Centre's goals. Findings also informed adaptations designed to strengthen the Centre., Conclusions: Findings provide insights into the practical realities of operationalising KMb strategies within a research partnership. Overall, the centre is perceived to be progressing towards its KMb goals, but challenges include stakeholders from different settings understanding each other's contexts and working together effectively, and ensuring knowledge generated across different projects within the Centre is integrated into a more comprehensive understanding of chronic disease prevention policy and practice. Our conceptual model is now informing ongoing developmental evaluation activities within the Centre, where it is being tested and refined.

Background: Integrated knowledge translation (IKT) flows from the premise that knowledge co-produced with decision-makers is more likely to inform subsequent decisions. However, evaluations of manager/policy-maker-focused IKT often concentrate on intermediate outcomes, stopping short of assessing whether research findings have contributed to identifiable organisational action. Such hesitancy may reflect the difficulty of tracing the causes of this distal, multifactorial outcome. This paper elucidates how an approach based on realistic evaluation could advance the field., Main Text: Realistic evaluation views outcomes as a joint product of intervention mechanisms and context. Through identification of context-mechanism-outcome configurations, it enables the systematic testing and refinement of 'mid-range theory' applicable to diverse interventions that share a similar underlying logic of action. The 'context-sensitive causal chain' diagram, a tool adapted from the broader theory-based evaluation literature, offers a useful means of visualising the posited chain from activities to outcomes via mechanisms, and the context factors that facilitate or disrupt each linkage (e.g. activity-mechanism, mechanism-outcome). Drawing on relevant literature, this paper proposes a context-sensitive causal chain by which IKT may generate instrumental use of research findings (i.e. direct use to make a concrete decision) and identifies an existing tool to assess this outcome, then adapts the chain to describe a more subtle, indirect pathway of influence. Key mechanisms include capacity- and relationship-building among researchers and decision-makers, changes in the (perceived) credibility and usability of findings, changes in decision-makers' beliefs and attitudes, and incorporation of new knowledge in an actual decision. Project-specific context factors may impinge upon each linkage; equally important is the organisation's absorptive capacity, namely its overall ability to acquire, assimilate and apply knowledge. Given a sufficiently poor decision-making environment, even well-implemented IKT that triggers important mechanisms may fall short of its desired outcomes. Further research may identify additional mechanisms and context factors., Conclusion: By investigating 'what it is about an intervention that works, for whom, under what conditions', realistic evaluation addresses questions of causality head-on without sacrificing complexity. A realist approach could contribute greatly to our ability to assess - and, ultimately, to increase - the value of IKT.

Background: The interrelationships between research evidence and policy-making are complex. Different theoretical frameworks exist to explain general evidence-policy interactions. One largely unexplored element of these interrelationships is how evidence interrelates with, and influences, policy/political agenda-setting. This review aims to identify the elements and processes of theories, frameworks and models on interrelationships of research evidence and health policy-making, with a focus on actionability and agenda-setting in the context of mental health in low- and middle-income countries (LMICs)., Methods: A systematic review of theories was conducted based on the BeHeMOTh search method, using a tested and refined search strategy. Nine electronic databases and other relevant sources were searched for peer-reviewed and grey literature. Two reviewers screened the abstracts, reviewed full-text articles, extracted data and performed quality assessments. Analysis was based on a thematic analysis. The included papers had to present an actionable theoretical framework/model on evidence and policy interrelationships, such as knowledge translation or evidence-based policy, specifically target the agenda-setting process, focus on mental health, be from LMICs and published in English., Results: From 236 publications included in the full text analysis, no studies fully complied with our inclusion criteria. Widening the focus by leaving out 'agenda-setting', we included ten studies, four of which had unique conceptual frameworks focusing on mental health and LMICs but not agenda-setting. The four analysed frameworks confirmed research gaps from LMICs and mental health, and a lack of focus on agenda-setting. Frameworks and models from other health and policy areas provide interesting conceptual approaches and lessons with regards to agenda-setting., Conclusion: Our systematic review identified frameworks on evidence and policy interrelations that differ in their elements and processes. No framework fulfilled all inclusion criteria. Four actionable frameworks are applicable to mental health and LMICs, but none specifically target agenda-setting. We have identified agenda-setting as a research theory gap in the context of mental health knowledge translation in LMICs. Frameworks from other health/policy areas could offer lessons on agenda-setting and new approaches for creating policy impact for mental health and to tackle the translational gap in LMICs.

Background: Non-communicable diseases (NCDs) are the leading causes of disease burden and mortality at the European level and in Cyprus. This research was conducted to map the research activities of Cypriot institutions in five NCDs, namely oncology, cardiovascular diseases, diabetes, mental health and respiratory conditions., Methods: For the period 2002-2013, research in Cyprus was assessed on its biomedical outputs and compared to the rest of Europe relative to their GDP. The research output in the five NCDs was obtained and contrasted to their respective disease burdens. The results from each of the five NCDs showed the amount of cross-country collaboration with other researchers from other European countries and from the rest of the world, and the research level of the papers on a clinical to basic scale. For each NCD field the research application was assessed, whereas for oncology the research type was also assessed. Information was collected on the development of clinical guidelines, on Cypriot newspapers reporting on medical and policy documents and advisory committees' output as well as research and funding organisations available in Cyprus, for potential evaluation of impact in health policy on the five NCDs., Results: Cypriot biomedical research output appeared appropriate in volume compared with its wealth and the expected value from a regression line for other European countries. However, it was focused particularly on the molecular mechanisms of transmittable or hereditary diseases, rather than on the five NCDs. Cyprus performs well in palliative care, which receives funding from several local charities and other non-profit organisations. Cyprus has the highest relative burden from diabetes in Europe, but the subject is largely neglected by researchers. Similarly, it suffers more from mental disorders than most of the rest of Europe, but the amount of research is relatively small. Respiratory conditions research is under-funded and under-researched too., Conclusions: The biomedical research portfolio in Cyprus is adequate in volume, but not well fitted to its pattern of disease. The means whereby research can be used to improve healthcare in the country are also unsatisfactory, although the Ministry of Health is now developing a comprehensive plan which will include the development of clinical guidelines and proposals for the evaluation of how healthcare is delivered on the island.

Background: If there is one universal recommendation to countries wanting to make progress towards Universal Health Coverage (UHC), it is to develop the learning capacities that will enable them to 'find their own way' - this is especially true for countries struggling with fragmented health financing systems. This paper explores results from a multi-country study whose main aim was to assess the extent to which UHC systems and processes at country level operate as 'learning systems'., Method: This study is part of a multi-year action-research project implemented by two communities of practice active in Africa. For this specific investigation, we adapted the concept of the learning organisation to so-called 'UHC systems'. Our framework organises the assessment around 92 questions divided into blocks, sub-blocks and levels of learning, with a seven scale score in a standardised questionnaire developed during a protocol and methodology workshop attended by all the research teams. The study was implemented in six francophone African countries by national research teams involving researchers and cadres of the ministries involved in the UHC policy. Across the six countries, the questionnaire was administrated to 239 UHC actors. Data were analysed per country, per blocks and sub-blocks, by levels of learning and per question., Results: The study confirms the feasibility and relevance of adapting the learning organisation framework to UHC systems. All countries scored between 4 and 5 for all the sub-blocks of the learning system. The study and the validation workshops organised in the six countries indicate that the tool is particularly powerful to assess weaknesses within a specific country. However, some remarkable patterns also emerge from the cross-country analysis. Our respondents recognise the leadership developed at governmental level for UHC, but they also report some major weaknesses in the UHC system, especially the absence of a learning agenda and the limited use of data., Conclusion: Countries will not progress towards UHC without strong learning systems. Our tool has allowed us to document the situation in six countries, create some awareness at country level and initiate a participatory action-oriented process.

Background: Growing interest in public involvement in health research has led to organisational and policy change. Additionally, an emerging body of policy-oriented scholarship has begun to identify the organisational and network arrangements that shape public involvement activity. Such developments suggest the need to clearly conceptualise and characterise public involvement in health research in terms of governance., Methods: We drew on an established health research system framework to analyse governance functions related to public involvement, adapting scoping review methods to identify evidence from a corpus of journal papers and policy reports. We drew on the logics of aggregation and top down configuration, using a qualitative interpretive approach to combine and link findings from different studies into framework categories., Results: We identified a total of 32 scholarly papers and 13 policy reports (n = 45 included papers) with relevance to governance for public involvement. Included papers were broadly consonant in identifying the need for activity to specify and support public involvement across all four governance functions of stewardship, financing, creating and sustaining resources, and research production and use. However, different visions for public involvement, and the activity required to implement it and achieve impact, were particularly evident with respect to the stewardship function, which seeks to set overall directions for research while addressing the potentially competing demands of a system's many constituents., Conclusions: A governance perspective has considerable value for public involvement in health research systems, supporting efforts to coordinate and institutionalise the burgeoning public involvement enterprise. Furthermore, it highlights challenges for what is, ultimately, a highly political intervention, suggesting that diverse publics must be both involved within health research systems and enrolled as governors of them.

Background: World over, stakeholders are increasingly concerned about making research useful in public policy-making. However, there are hardly any reports linking production of research by students at institutions of higher learning to its application in society. We assessed whether and how post-graduate students' research was used in evidence-informed health policies., Methods: This is a multiple case study of master's students' dissertations at Makerere University College of Health Sciences (MakCHS) produced between 1996 and 2010. In a structured review, we applied a theoretical framework of 'research use' and used content analysis to map how research was used in public policy documents. We categorised content of these documents according to the health-related Millennium Development Goals (MDG). We defined a case of 'use' as citation of research products from a master's student's dissertation in a public policy-related document., Results: We found 22 cases of research use in policy-related documents (0.5%) out of a total 4230 citations from 16 of 1172 total dissertations (1.4%). Additionally, research was mostly cited in primary studies (95.4%), systematic reviews (3%), narrative reviews (0.8%) and cost-effectiveness analyses (0.2%). Research was predominantly used instrumentally, to either frame the problem (burden of disease or health condition) or select an intervention (treatment or diagnostic option) and rarely symbolically to justify strategies already selected. The bulk of the cases of research use addressed child health (MDG 4), focusing on infectious diseases (MDG 6), mainly in international clinical or public health guidelines, working papers, a consensus statement and a global report. We distilled 'synergistic relationships' among organisations or interest groups, 'globalisation of local evidence', 'trade-offs' in the use of research and use of 'negative results' from the documents and text content., Conclusions: Research from dissertations of post-graduate students at MakCHS is used in evidence-informed health policies, particularly for infectious diseases in child health. Further, we have delineated pathways of research use in the global arena and highlighted the importance of 'negative results' from dissertations of post-graduate students at MakCHS.

Background: The paper carries out a situational analysis to examine the production, dissemination and utilisation of reproductive and child health-related evidence to inform policy formulation in Ghana's health sector., Methods: The study used Wald's model of knowledge production, transfer and utilisation as a conceptual model to collect relevant data via interviews and administration of questionnaire to a network of persons who either previously or currently hold policy-relevant positions in Ghana's health sector. Additional data was also gathered through a scoping review of the knowledge transfer and research utilisation literature, existing reproductive and child health policies, protocols and guidelines and information available on the websites of relevant institutions in Ghana's health sector., Results: The findings of the study suggest that the health sector in Ghana has major strengths (strong knowledge production capacity, a positive environment for the promotion of evidence-informed policy) and opportunities (access to major donors who have the resources to fund good quality research and access to both local and international networks for collaborative research). What remains a challenge, however, is the absence of a robust institutional-wide mechanism for collating research needs and communicating these to researchers, communicating research findings in forms that are friendlier to policy-makers and the inability to incorporate funding for research into the budget of the health sector., Conclusion: The study concludes, admonishing the Ministry of Health and its agencies to leverage on the existing strengths and opportunities to address the identified challenges.

Background: Understanding decision-making processes that influence the fate of items on the health policy agenda at national level in low- and middle-income countries is important because of the implications for programmes and outcomes. This paper seeks to advance our understanding of these processes by asking how and why maternal health policy agenda items have fared in Ghana between 1963 and 2014., Methods: The study design was a single case study of maternal health agenda evolution once on a decision pathway in Ghana, with three different agenda items as sub-units of analysis (fee exemptions for maternal health, free family planning and primary maternal health as part of a per capita provider payment system). Data analysis involved chronologically reconstructing how maternal health policy items evolved over time., Results: The fate of national level maternal health policy items was heavily influenced by how stakeholders (bureaucrats, professional bodies, general public and developmental partners) exercised power to put forward and advocate for specific ideas through processes of issues framing within a changing political and socioeconomic context. The evolution and fate of an agenda item once on a decision pathway involved an iterative process of interacting drivers shaping decisions through cycles of 'active' and 'static' pathways. Items could move from 'active' to 'static' pathways, depending on changing context and actor positions. Items that pursued the 'static' pathway in a particular cycle fell into obscurity by a process that could be described as a form of 'no decision made' in that an explicit decision was not taken to drop the item, but neither was any policy content agreed. Low political interest was exhibited and attempts to bring the item back into active decision-making were made by actors mainly in the bureaucratic arena seeking and struggling (unsuccessfully) to obtain financial and institutional support. Policy items that pursued 'active' pathways showed opposite characteristics and generally moved beyond agenda into formulation and implementation., Conclusion: Policy change requires sustaining policy agenda items into formulation and implementation. To do this, change agents need to understand and work within the relevant context, stakeholder interests, power, ideas and framing of issues.

Background: There is increased international focus on improving the rigour of clinical practice guideline (CPG) development practices. However, few empirical studies on CPG development have been conducted in low- and middle-income countries. This paper explores national stakeholders' perceptions of processes informing CPG development for primary healthcare in South Africa, focusing on both their aspirations and views of what is actually occurring., Methods: A qualitative study design was employed including individual interviews with 37 South African primary care CPG development role-players. Participants represented various disciplines, sectors and provinces. The data were analysed through thematic analysis and an interpretivist conceptual framework., Results: Strongly reflecting current international standards, participants identified six 'aspirational' processes that they thought should inform South African CPG development, as follows: (1) evidence; (2) stakeholder consultation; (3) transparency; (4) management of interests; (5) communication/co-ordination between CPG development groups; and (6) fit-for-context. While perceptions of a transition towards more robust processes was common, CPG development was seen to face ongoing challenges with regards to all six aspirational processes. Many challenges were attributed to inadequate financial and human resources, which were perceived to hinder capacity to undertake the necessary methodological work, respond to stakeholders' feedback, and document and share decision-making processes. Challenges were also linked to a complex web of politics, power and interests. The CPG development arena was described as saturated with personal and financial interests, groups competing for authority over specific territories and unequal power dynamics which favour those with the time, resources and authority to make contributions. These were all perceived to affect efforts for transparency, collaboration and inclusivity in CPG development., Conclusion: While there is strong commitment amongst national stakeholders to advance CPG development processes, a mix of values, politics, power and capacity constraints pose significant challenges. Contrasting perspectives regarding managing interests and how best to adapt to within-country contexts requires further exploration. Dedicated resources for CPG development, standardised systems for managing conflicting interests, and the development of a political environment that fosters collaboration and more equitable inclusion within and between CPG development groups are needed. These initiatives may enhance CPG quality and acceptability, with associated positive impact on patient care.

Background: Gender is often neglected in health systems, yet health systems are not gender neutral. Within health systems research, gender analysis seeks to understand how gender power relations create inequities in access to resources, the distribution of labour and roles, social norms and values, and decision-making. This paper synthesises findings from nine studies focusing on four health systems domains, namely human resources, service delivery, governance and financing. It provides examples of how a gendered and/or intersectional gender approach can be applied by researchers in a range of low- and middle-income settings (Cambodia, Zimbabwe, Uganda, India, China, Nigeria and Tanzania) to issues across the health system and demonstrates that these types of analysis can uncover new and novel ways of viewing seemingly intractable problems., Methods: The research used a combination of mixed, quantitative, qualitative and participatory methods, demonstrating the applicability of diverse research methods for gender and intersectional analysis. Within each study, the researchers adapted and applied a variety of gender and intersectional tools to assist with data collection and analysis, including different gender frameworks. Some researchers used participatory tools, such as photovoice and life histories, to prompt deeper and more personal reflections on gender norms from respondents, whereas others used conventional qualitative methods (in-depth interviews, focus group discussion). Findings from across the studies were reviewed and key themes were extracted and summarised., Results: Five core themes that cut across the different projects were identified and are reported in this paper as follows: the intersection of gender with other social stratifiers; the importance of male involvement; the influence of gendered social norms on health system structures and processes; reliance on (often female) unpaid carers within the health system; and the role of gender within policy and practice. These themes indicate the relevance of and need for gender analysis within health systems research., Conclusion: The implications of the diverse examples of gender and health systems research highlighted indicate that policy-makers, health practitioners and others interested in enhancing health system research and delivery have solid grounds to advance their enquiry and that one-size-fits-all heath interventions that ignore gender and intersectionality dimensions require caution. It is essential that we build upon these insights in our efforts and commitment to move towards greater equity both locally and globally.

Background: Measuring the policy and practice impacts of research is becoming increasingly important. Policy impacts can be measured from two directions - tracing forward from research and tracing backwards from a policy outcome. In this review, we compare these approaches and document the characteristics of studies assessing research impacts on policy and the policy utilisation of research., Methods: Keyword searches of electronic databases were conducted in December 2016. Included studies were published between 1995 and 2016 in English and reported methods and findings of studies measuring policy impacts of specified health research, or research use in relation to a specified health policy outcome, and reviews reporting methods of research impact assessment. Using an iterative data extraction process, we developed a framework to define the key elements of empirical studies (assessment reason, assessment direction, assessment starting point, unit of analysis, assessment methods, assessment endpoint and outcomes assessed) and then documented the characteristics of included empirical studies according to this framework., Results: We identified 144 empirical studies and 19 literature reviews. Empirical studies were derived from two parallel streams of research of equal size, which we termed 'research impact assessments' and 'research use assessments'. Both streams provided insights about the influence of research on policy and utilised similar assessment methods, but approached measurement from opposite directions. Research impact assessments predominantly utilised forward tracing approaches while the converse was true for research use assessments. Within each stream, assessments focussed on narrow or broader research/policy units of analysis as the starting point for assessment, each with associated strengths and limitations. The two streams differed in terms of their relative focus on the contributions made by specific research (research impact assessments) versus research more generally (research use assessments) and the emphasis placed on research and the activities of researchers in comparison to other factors and actors as influencers of change., Conclusions: The Framework presented in this paper provides a mechanism for comparing studies within this broad field of research enquiry. Forward and backward tracing approaches, and their different ways of 'looking', tell a different story of research-based policy change. Combining approaches may provide the best way forward in terms of linking outcomes to specific research, as well as providing a realistic picture of research influence.