Search

BACKGROUND: Audit and Feedback (A&F) interventions based on quality indicators have been shown to lead to significant improvements in compliance with evidence-based care including de-adoption of low-value practices (LVPs). Our primary aim was to evaluate the cost-effectiveness of adding a hypothetical A&F module targeting LVPs for trauma admissions to an existing quality assurance intervention targeting high-value care and risk-adjusted outcomes. A secondary aim was to assess how certain A&F characteristics might influence its cost-effectiveness. METHODS: We conducted a cost-effectiveness analysis using a probabilistic static decision analytic model in the Québec trauma care continuum. We considered the Québec Ministry of Health perspective. Our economic evaluation compared a hypothetical scenario in which the A&F module targeting LVPs is implemented in a Canadian provincial trauma quality assurance program to a status quo scenario in which the A&F module is not implemented. In scenarios analyses we assessed the impact of A&F characteristics on its cost-effectiveness. Results are presented in terms of incremental costs per LVP avoided. RESULTS: Results suggest that the implementation of A&F module (Cost = $1,480,850; Number of LVPs = 6,005) is associated with higher costs and higher effectiveness compared to status quo (Cost = $1,124,661; Number of LVPs = 8,228). The A&F module would cost $160 per LVP avoided compared to status quo. The A&F module becomes more cost-effective with the addition of facilitation visits; more frequent evaluation; and when only high-volume trauma centers are considered. CONCLUSION: A&F module targeting LVPs is associated with higher costs and higher effectiveness than status quo and has the potential to be cost-effective if the decision-makers willingness-to-pay is at least $160 per LVP avoided. This likely represents an underestimate of true ICER due to underestimated costs or missed opportunity costs. Results suggest that virtual facilitation visits, frequent evaluation, and implementing the module in high-volume centers can improve cost-effectiveness.

Proven effective interventions exist that would enable all countries to meet the Millennium Development Goals. However, uptake and use of these interventions in the poorest populations is at least 50% less than in the richest populations within each country. Also, we have recently shown that community effectiveness of interventions is lower for the poorest populations due to a "staircase" effect of lower coverage/access, worse diagnostic accuracy, less provider compliance and less consumer adherence. We propose an evidence-based framework for equity-oriented knowledge translation to enhance community effectiveness and health equity. This framework is represented as a cascade of steps to assess and prioritize barriers and thus choose effective knowledge translation interventions that are tailored for relevant audiences (public, patient, practitioner, policy-maker, press and private sector), as well as the evaluation, monitoring and sharing of these strategies. We have used two examples of effective interventions (insecticide-treated bednets to prevent malaria and childhood immunization) to illustrate how this framework can provide a systematic method for decision-makers to ensure the application of evidence-based knowledge in disadvantaged populations. Future work to empirically validate and evaluate the usefulness of this framework is needed. We invite researchers and implementers to use the cascade for equity-oriented knowledge translation as a guide when planning implementation strategies for proven effective interventions. We also encourage policy-makers and health-care managers to use this framework when deciding how effective interventions can be implemented in their own settings.

Abstract This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. Policymakers and those supporting them may find themselves in one or more of the following three situations that will require them to characterise the costs and consequences of options to address a problem. These are: 1. A decision has already been taken and their role is to maximise the benefits of an option, minimise its harms, optimise the impacts achieved for the money spent, and (if there is substantial uncertainty about the likely costs and consequences of the option) to design a monitoring and evaluation plan, 2. A policymaking process is already underway and their role is to assess the options presented to them, or 3. A policymaking process has not yet begun and their role is therefore to identify options, characterise the costs and consequences of these options, and look for windows of opportunity in which to act. In situations like these, research evidence, particularly about benefits, harms, and costs, can help to inform whether an option can be considered viable. In this article, we suggest six questions that can be used to guide those involved in identifying policy and programme options to address a high-priority problem, and to characterise the costs and consequences of these options. These are: 1. Has an appropriate set of options been identified to address a problem? 2. What benefits are important to those who will be affected and which benefits are likely to be achieved with each option? 3. What harms are important to those who will be affected and which harms are likely to arise with each option? 4. What are the local costs of each option and is there local evidence about their cost-effectiveness? 5. What adaptations might be made to any given option and could they alter its benefits, harms and costs? 6. Which stakeholder views and experiences might influence an option's acceptability and its benefits, harms, and costs?

Abstract This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. Systematic reviews are increasingly seen as a key source of information in policymaking, particularly in terms of assisting with descriptions of the impacts of options. Relative to single studies they offer a number of advantages related to understanding impacts and are also seen as a key source of information for clarifying problems and providing complementary perspectives on options. Systematic reviews can be undertaken to place problems in comparative perspective and to describe the likely harms of an option. They also assist with understanding the meanings that individuals or groups attach to a problem, how and why options work, and stakeholder views and experiences related to particular options. A number of constraints have hindered the wider use of systematic reviews in policymaking. These include a lack of awareness of their value and a mismatch between the terms employed by policymakers, when attempting to retrieve systematic reviews, and the terms used by the original authors of those reviews. Mismatches between the types of information that policymakers are seeking, and the way in which authors fail to highlight (or make obvious) such information within systematic reviews have also proved problematic. In this article, we suggest three questions that can be used to guide those searching for systematic reviews, particularly reviews about the impacts of options being considered. These are: 1. Is a systematic review really what is needed? 2. What databases and search strategies can be used to find relevant systematic reviews? 3. What alternatives are available when no relevant review can be found?

Abstract Background The Canadian CT Head Rule was prospectively derived and validated to assist clinicians with diagnostic decision-making regarding the use of computed tomography (CT) in adult patients with minor head injury. A recent intervention trial failed to demonstrate a decrease in the rate of head CTs following implementation of the rule in Canadian emergency departments. Yet, the same intervention, which included a one-hour educational session and reminders at the point of requisition, was successful in reducing cervical spine imaging rates in the same emergency departments. The reason for the varied effect of the intervention across these two behaviours is unclear. There is an increasing appreciation for the use of theory to conduct process evaluations to better understand how strategies are linked with outcomes in implementation trials. The Theoretical Domains Framework (TDF) has been used to explore health professional behaviour and to design behaviour change interventions but, to date, has not been used to guide a theory-based process evaluation. In this proof of concept study, we explored whether the TDF could be used to guide a retrospective process evaluation to better understand emergency physicians’ responses to the interventions employed in the Canadian CT Head Rule trial. Methods A semi-structured interview guide, based on the 12 domains from the TDF, was used to conduct telephone interviews with project leads and physician participants from the intervention sites in the Canadian CT Head Rule trial. Two reviewers independently coded the anonymised interview transcripts using the TDF as a coding framework. Relevant domains were identified by: the presence of conflicting beliefs within a domain; the frequency of beliefs; and the likely strength of the impact of a belief on the behaviour. Results Eight physicians from four of the intervention sites in the Canadian CT Head Rule trial participated in the interviews. Barriers likely to assist with understanding physicians’ responses to the intervention in the trial were identified in six of the theoretical domains: beliefs about consequences; beliefs about capabilities; behavioural regulation; memory, attention and decision processes; environmental context and resources; and social influences. Despite knowledge that the Canadian CT Head Rule was highly sensitive and reliable for identifying clinically important brain injuries and strong beliefs about the benefits for using the rule, a number of barriers were identified that may have prevented physicians from consistently applying the rule. Conclusion This proof of concept study demonstrates the use of the TDF as a guiding framework to design a retrospective theory-based process evaluation. There is a need for further development and testing of methods for using the TDF to guide theory-based process evaluations running alongside behaviour change intervention trials.

Abstract Background Healthcare-associated infections affect 10% of patients in Canadian acute-care hospitals and are significant and preventable causes of morbidity and mortality among hospitalized patients. Hand hygiene is among the simplest and most effective preventive measures to reduce these infections. However, compliance with hand hygiene among healthcare workers, specifically among physicians, is consistently suboptimal. We aim to first identify the barriers and enablers to physician hand hygiene compliance, and then to develop and pilot a theory-based knowledge translation intervention to increase physicians’ compliance with best hand hygiene practice. Design The study consists of three phases. In Phase 1, we will identify barriers and enablers to hand hygiene compliance by physicians. This will include: key informant interviews with physicians and residents using a structured interview guide, informed by the Theoretical Domains Framework; nonparticipant observation of physician/resident hand hygiene audit sessions; and focus groups with hand hygiene experts. In Phase 2, we will conduct intervention mapping to develop a theory-based knowledge translation intervention to improve physician hand hygiene compliance. Finally, in Phase 3, we will pilot the knowledge translation intervention in four patient care units. Discussion In this study, we will use a behavioural theory approach to obtain a better understanding of the barriers and enablers to physician hand hygiene compliance. This will provide a comprehensive framework on which to develop knowledge translation interventions that may be more successful in improving hand hygiene practice. Upon completion of this study, we will refine the piloted knowledge translation intervention so it can be tested in a multi-site cluster randomized controlled trial.

Abstract Background Cluster randomized trials (CRTs) pose ethical challenges for investigators and ethics committees. This study describes the views and experiences of CRT researchers with respect to: (1) ethical challenges in CRTs; (2) the ethics review process for CRTs; and (3) the need for comprehensive ethics guidelines for CRTs. Methods Descriptive qualitative analysis of interviews conducted with a purposive sample of 20 experienced CRT researchers. Results Informants expressed concern over the potential for bias that may result from requirements to obtain informed consent from research participants in CRTs. Informants suggested that the need for informed consent ought to be related to the type of intervention under study in a CRT. Informants rarely expressed concern regarding risks to research participants in CRTs, other than risks to privacy. Important issues identified in the research ethics literature, including fair subject selection and other justice issues, were not mentioned by informants. The ethics review process has had positive and negative impacts on CRT conduct. Informants stated that variability in ethics review between jurisdictions, and increasingly stringent ethics review in recent years, have hampered their ability to conduct CRTs. Many informants said that comprehensive ethics guidelines for CRTs would be helpful to researchers and research ethics committees. Conclusions Informants identified key ethical challenges in the conduct of CRTs, specifically relating to identifying subjects, seeking informed consent, and the use of gatekeepers. These data have since been used to identify topics for in-depth ethical analysis and to guide the development of comprehensive ethics guidelines for CRTs.

Abstract Background In the field of implementation research, there is an increased interest in use of theory when designing implementation research studies involving behavior change. In 2003, we initiated a series of five studies to establish a scientific rationale for interventions to translate research findings into clinical practice by exploring the performance of a number of different, commonly used, overlapping behavioral theories and models. We reflect on the strengths and weaknesses of the methods, the performance of the theories, and consider where these methods sit alongside the range of methods for studying healthcare professional behavior change. Methods These were five studies of the theory-based cognitions and clinical behaviors (taking dental radiographs, performing dental restorations, placing fissure sealants, managing upper respiratory tract infections without prescribing antibiotics, managing low back pain without ordering lumbar spine x-rays) of random samples of primary care dentists and physicians. Measures were derived for the explanatory theoretical constructs in the Theory of Planned Behavior (TPB), Social Cognitive Theory (SCT), and Illness Representations specified by the Common Sense Self Regulation Model (CSSRM). We constructed self-report measures of two constructs from Learning Theory (LT), a measure of Implementation Intentions (II), and the Precaution Adoption Process. We collected data on theory-based cognitions (explanatory measures) and two interim outcome measures (stated behavioral intention and simulated behavior) by postal questionnaire survey during the 12-month period to which objective measures of behavior (collected from routine administrative sources) were related. Planned analyses explored the predictive value of theories in explaining variance in intention, behavioral simulation and behavior. Results Response rates across the five surveys ranged from 21% to 48%; we achieved the target sample size for three of the five surveys. For the predictor variables, the mean construct scores were above the mid-point on the scale with median values across the five behaviors generally being above four out of seven and the range being from 1.53 to 6.01. Across all of the theories, the highest proportion of the variance explained was always for intention and the lowest was for behavior. The Knowledge-Attitudes-Behavior Model performed poorly across all behaviors and dependent variables; CSSRM also performed poorly. For TPB, SCT, II, and LT across the five behaviors, we predicted median R2 of 25% to 42.6% for intention, 6.2% to 16% for behavioral simulation, and 2.4% to 6.3% for behavior. Conclusions We operationalized multiple theories measuring across five behaviors. Continuing challenges that emerge from our work are: better specification of behaviors, better operationalization of theories; how best to appropriately extend the range of theories; further assessment of the value of theories in different settings and groups; exploring the implications of these methods for the management of chronic diseases; and moving to experimental designs to allow an understanding of behavior change.

Abstract Background Evidence of variations in red blood cell transfusion practices have been reported in a wide range of clinical settings. Parallel studies in Canada and the United Kingdom were designed to explore transfusion behaviour in intensive care physicians. The aim of this paper is three-fold: first, to explore beliefs that influence Canadian intensive care physicians’ transfusion behaviour; second, to systematically select relevant theories and models using the Theoretical Domains Framework (TDF) to inform a future predictive study; and third, to compare its results with the UK study. Methods Ten intensive care unit (ICU) physicians throughout Canada were interviewed. Physicians’ responses were coded into theoretical domains, and specific beliefs were generated for each response. Theoretical domains relevant to behaviour change were identified, and specific constructs from the relevant domains were used to select psychological theories. The results from Canada and the United Kingdom were compared. Results Seven theoretical domains populated by 31 specific beliefs were identified as relevant to the target behaviour. The domains Beliefs about capabilities (confident to not transfuse if patients’ clinical condition is stable), Beliefs about consequences (positive beliefs of reducing infection and saving resources and negative beliefs about risking patients’ clinical outcome and potentially more work), Social influences (transfusion decision is influenced by team members and patients’ relatives), and Behavioural regulation (wide range of approaches to encourage restrictive transfusion) that were identified in the UK study were also relevant in the Canadian context. Three additional domains, Knowledge (it requires more evidence to support restrictive transfusion), Social/professional role and identity (conflicting beliefs about not adhering to guidelines, referring to evidence, believing restrictive transfusion as professional standard, and believing that guideline is important for other professionals), and Motivation and goals (opposing beliefs about the importance of restrictive transfusion and compatibility with other goals), were also identified in this study. Similar to the UK study, the Theory of Planned Behaviour, Social Cognitive Theory, Operant Learning Theory, Action Planning, and Knowledge-Attitude-Behaviour model were identified as potentially relevant theories and models for further study. Personal project analysis was added to the Canadian study to explore the Motivation and goals domain in further detail. Conclusions A wide range of beliefs was identified by the Canadian ICU physicians as likely to influence their transfusion behaviour. We were able to demonstrate similar though not identical results in a cross-country comparison. Designing targeted behaviour-change interventions based on unique beliefs identified by physicians from two countries are more likely to encourage restrictive transfusion in ICU physicians in respective countries. This needs to be tested in future prospective clinical trials.

Abstract Background The Theoretical Domains Framework (TDF) was developed to investigate determinants of specific clinical behaviors and inform the design of interventions to change professional behavior. This framework was used to explore the beliefs of chiropractors in an American Provider Network and two Canadian provinces about their adherence to evidence-based recommendations for spine radiography for uncomplicated back pain. The primary objective of the study was to identify chiropractors’ beliefs about managing uncomplicated back pain without x-rays and to explore barriers and facilitators to implementing evidence-based recommendations on lumbar spine x-rays. A secondary objective was to compare chiropractors in the United States and Canada on their beliefs regarding the use of spine x-rays. Methods Six focus groups exploring beliefs about managing back pain without x-rays were conducted with a purposive sample. The interview guide was based upon the TDF. Focus groups were digitally recorded, transcribed verbatim, and analyzed by two independent assessors using thematic content analysis based on the TDF. Results Five domains were identified as likely relevant. Key beliefs within these domains included the following: conflicting comments about the potential consequences of not ordering x-rays (risk of missing a pathology, avoiding adverse treatment effects, risks of litigation, determining the treatment plan, and using x-ray-driven techniques contrasted with perceived benefits of minimizing patient radiation exposure and reducing costs; beliefs about consequences); beliefs regarding professional autonomy, professional credibility, lack of standardization, and agreement with guidelines widely varied ( social/professional role & identity); the influence of formal training, colleagues, and patients also appeared to be important factors ( social influences); conflicting comments regarding levels of confidence and comfort in managing patients without x-rays ( belief about capabilities); and guideline awareness and agreements ( knowledge). Conclusions Chiropractors’ use of diagnostic imaging appears to be influenced by a number of factors. Five key domains may be important considering the presence of conflicting beliefs, evidence of strong beliefs likely to impact the behavior of interest, and high frequency of beliefs. The results will inform the development of a theory-based survey to help identify potential targets for behavioral-change strategies.

Abstract Background Healthcare professional response rates to postal questionnaires are declining and this may threaten the validity and generalisability of their findings. Methods to improve response rates do incur costs (resources) and increase the cost of research projects. The aim of these randomised controlled trials (RCTs) was to assess whether 1) incentives, 2) type of reminder and/or 3) reduced response burden improve response rates; and to assess the cost implications of such additional effective interventions. Methods Two RCTs were conducted. In RCT A general dental practitioners (dentists) in Scotland were randomised to receive either an incentive; an abridged questionnaire or a full length questionnaire. In RCT B non-responders to a postal questionnaire sent to general medical practitioners (GPs) in the UK were firstly randomised to receive a second full length questionnaire as a reminder or a postcard reminder. Continued non-responders from RCT B were then randomised within their first randomisation to receive a third full length or an abridged questionnaire reminder. The cost-effectiveness of interventions that effectively increased response rates was assessed as a secondary outcome. Results There was no evidence that an incentive (52% versus 43%, Risk Difference (RD) -8.8 (95%CI −22.5, 4.8); or abridged questionnaire (46% versus 43%, RD −2.9 (95%CI −16.5, 10.7); statistically significantly improved dentist response rates compared to a full length questionnaire in RCT A. In RCT B there was no evidence that a full questionnaire reminder statistically significantly improved response rates compared to a postcard reminder (10.4% versus 7.3%, RD 3 (95%CI −0.1, 6.8). At a second reminder stage, GPs sent the abridged questionnaire responded more often (14.8% versus 7.2%, RD −7.7 (95%CI −12.8, -2.6). GPs who received a postcard reminder followed by an abridged questionnaire were most likely to respond (19.8% versus 6.3%, RD 8.1%, and 9.1% for full/postcard/full, three full or full/full/abridged questionnaire respectively). An abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy for increasing the response rate (£15.99 per response). Conclusions When expecting or facing a low response rate to postal questionnaires, researchers should carefully identify the most efficient way to boost their response rate. In these studies, an abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy. An increase in response rates may be explained by a combination of the number and type of contacts. Increasing the sampling frame may be more cost-effective than interventions to prompt non-responders. However, this may not strengthen the validity and generalisability of the survey findings and affect the representativeness of the sample.

Abstract Reviews have repeatedly noted important methodological issues in the conduct and reporting of cluster randomized controlled trials (C-RCTs). These reviews usually focus on whether the intracluster correlation was explicitly considered in the design and analysis of the C-RCT. However, another important aspect requiring special attention in C-RCTs is the risk for imbalance of covariates at baseline. Imbalance of important covariates at baseline decreases statistical power and precision of the results. Imbalance also reduces face validity and credibility of the trial results. The risk of imbalance is elevated in C-RCTs compared to trials randomizing individuals because of the difficulties in recruiting clusters and the nested nature of correlated patient-level data. A variety of restricted randomization methods have been proposed as way to minimize risk of imbalance. However, there is little guidance regarding how to best restrict randomization for any given C-RCT. The advantages and limitations of different allocation techniques, including stratification, matching, minimization, and covariate-constrained randomization are reviewed as they pertain to C-RCTs to provide investigators with guidance for choosing the best allocation technique for their trial.

Abstract Objective The purpose of this project was to conduct an overview of existing systematic reviews to evaluate the effectiveness of reminders in changing professional behavior in clinical settings. Materials and methods Relevant systematic reviews of reminder interventions were identified through searches in MEDLINE, EMBASE, DARE and the Cochrane Library in conjunction with a larger project examining professional behavioral change interventions. Reviews were appraised using AMSTAR, a validated tool for assessing the quality of systematic reviews. As most reviews only reported vote counting, conclusions about effectiveness for each review were based on a count of positive studies. If available, we also report effect sizes. Conclusions were based on the findings from higher quality and current systematic reviews. Results Thirty-five reviews were eligible for inclusion in this overview. Ten reviews examined the effectiveness of reminders generally, 5 reviews focused on specific health care settings, 14 reviews concentrated on specific behaviors and 6 reviews addressed specific patient populations. The quality of the reviews was variable (median = 3, range = 1 to 8). Seven reviews had AMSTAR scores >5 and were considered in detail. Five of these seven reviews demonstrated positive effects of reminders in changing provider behavior. Few reviews used quantitative pooling methods; in one high quality and current review, the overall observed effects were moderate with an absolute median improvement in performance of 4.2% (IQR: 0.5% to 6.6%). Discussion The results support that modest improvements can occur with the use of reminders. The effect size is consistent with other interventions that have been used to improve professional behavior. Conclusion Reminders appear effective in improving different clinical behaviors across a range of settings.

Abstract Clinical practice guidelines are one of the foundations of efforts to improve health care. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearing houses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this first paper we discuss: the target audience(s) for guidelines and their use of guidelines; identifying topics for guidelines; guideline group composition (including consumer involvement) and the processes by which guideline groups function and the important procedural issue of managing conflicts of interest in guideline development.

Abstract Clinical practice guidelines are one of the foundations of efforts to improve health care. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearing houses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this third paper we discuss the issues of: reviewing, reporting, and publishing guidelines; updating guidelines; and the two emerging issues of enhancing guideline implementability and how guideline developers should approach dealing with the issue of patients who will be the subject of guidelines having co-morbid conditions.

Abstract Clinical practice guidelines are one of the foundations of efforts to improve healthcare. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearinghouses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this second paper, we discuss issues of identifying and synthesizing evidence: deciding what type of evidence and outcomes to include in guidelines; integrating values into a guideline; incorporating economic considerations; synthesis, grading, and presentation of evidence; and moving from evidence to recommendations.

Abstract This article is part of a series of papers examining ethical issues in cluster randomized trials (CRTs) in health research. In the introductory paper in this series, we set out six areas of inquiry that must be addressed if the CRT is to be set on a firm ethical foundation. This paper addresses the sixth of the questions posed, namely, what is the role and authority of gatekeepers in CRTs in health research? ‘Gatekeepers’ are individuals or bodies that represent the interests of cluster members, clusters, or organizations. The need for gatekeepers arose in response to the difficulties in obtaining informed consent because of cluster randomization, cluster-level interventions, and cluster size. In this paper, we call for a more restrictive understanding of the role and authority of gatekeepers. Previous papers in this series have provided solutions to the challenges posed by informed consent in CRTs without the need to invoke gatekeepers. We considered that consent to randomization is not required when cluster members are approached for consent at the earliest opportunity and before any study interventions or data-collection procedures have started. Further, when cluster-level interventions or cluster size means that obtaining informed consent is not possible, a waiver of consent may be appropriate. In this paper, we suggest that the role of gatekeepers in protecting individual interests in CRTs should be limited. Generally, gatekeepers do not have the authority to provide proxy consent for cluster members. When a municipality or other community has a legitimate political authority that is empowered to make such decisions, cluster permission may be appropriate; however, gatekeepers may usefully protect cluster interests in other ways. Cluster consultation may ensure that the CRT addresses local health needs, and is conducted in accord with local values and customs. Gatekeepers may also play an important role in protecting the interests of organizations, such as hospitals, nursing homes, general practices, and schools. In these settings, permission to access the organization relies on resource implications and adherence to institutional policies.

Abstract Background Despite evidence-based recommendations supporting long-term use of cardiac medications in patients post ST-elevation myocardial infarction, adherence is known to decline over time. Discontinuation of cardiac medications in such patients is associated with increased mortality. Methods/design This is a pragmatic, cluster-randomized controlled trial with blinded outcome assessment and embedded qualitative process evaluation. Patients from one health region in Ontario, Canada who undergo a coronary angiogram during their admission for ST-elevation myocardial infarction and who survive their initial hospitalization will be included. Allocation of eligible patients to intervention or usual care will take place within one week after the angiogram using a computer-generated random sequence. To avoid treatment contamination, patients treated by the same family physician will be allocated to the same study arm. The intervention consists of recurrent, personalized, paper-based educational messages and reminders sent via post on behalf of the interventional cardiologist to the patient, family physician, and pharmacist urging long-term adherence to secondary prevention medications. The primary outcome is the proportion of patients who report in a phone interview taking all relevant classes of cardiac medications at twelve months. Secondary outcomes to be measured at three and twelve months include proportions of patients who report: actively taking each cardiac medication class of interest (item-by-item); stopping medications due to side effects; taking one or two or three medication classes concurrently; a perfect Morisky Medication Adherence Score for cardiac medication compliance; and having a discussion with their family physician about long-term adherence to cardiac medications. Self-reported measures of adherence will be validated using administrative data for prescriptions filled. Discussion This intervention is designed to be easily generalizable. If effective, it could be implemented broadly. If it does not change medication utilization, the process evaluation will offer insights regarding how such an intervention could be optimized in future. Trial registration Clinicaltrials.gov NCT01325116

Abstract Background Routine pre-operative tests for anesthesia management are often ordered by both anesthesiologists and surgeons for healthy patients undergoing low-risk surgery. The Theoretical Domains Framework (TDF) was developed to investigate determinants of behaviour and identify potential behaviour change interventions. In this study, the TDF is used to explore anaesthesiologists’ and surgeons’ perceptions of ordering routine tests for healthy patients undergoing low-risk surgery. Methods Sixteen clinicians (eleven anesthesiologists and five surgeons) throughout Ontario were recruited. An interview guide based on the TDF was developed to identify beliefs about pre-operative testing practices. Content analysis of physicians’ statements into the relevant theoretical domains was performed. Specific beliefs were identified by grouping similar utterances of the interview participants. Relevant domains were identified by noting the frequencies of the beliefs reported, presence of conflicting beliefs, and perceived influence on the performance of the behaviour under investigation. Results Seven of the twelve domains were identified as likely relevant to changing clinicians’ behaviour about pre-operative test ordering for anesthesia management. Key beliefs were identified within these domains including: conflicting comments about who was responsible for the test-ordering (Social/professional role and identity); inability to cancel tests ordered by fellow physicians (Beliefs about capabilities and social influences); and the problem with tests being completed before the anesthesiologists see the patient (Beliefs about capabilities and Environmental context and resources). Often, tests were ordered by an anesthesiologist based on who may be the attending anesthesiologist on the day of surgery while surgeons ordered tests they thought anesthesiologists may need (Social influences). There were also conflicting comments about the potential consequences associated with reducing testing, from negative (delay or cancel patients’ surgeries), to indifference (little or no change in patient outcomes), to positive (save money, avoid unnecessary investigations) (Beliefs about consequences). Further, while most agreed that they are motivated to reduce ordering unnecessary tests (Motivation and goals), there was still a report of a gap between their motivation and practice (Behavioural regulation). Conclusion We identified key factors that anesthesiologists and surgeons believe influence whether they order pre-operative tests routinely for anesthesia management for a healthy adults undergoing low-risk surgery. These beliefs identify potential individual, team, and organisation targets for behaviour change interventions to reduce unnecessary routine test ordering.

Abstract Background One of the most consistent findings from clinical and health services research is the failure to translate research into practice and policy. As a result of these evidence-practice and policy gaps, patients fail to benefit optimally from advances in healthcare and are exposed to unnecessary risks of iatrogenic harms, and healthcare systems are exposed to unnecessary expenditure resulting in significant opportunity costs. Over the last decade, there has been increasing international policy and research attention on how to reduce the evidence-practice and policy gap. In this paper, we summarise the current concepts and evidence to guide knowledge translation activities, defined as T2 research (the translation of new clinical knowledge into improved health). We structure the article around five key questions: what should be transferred; to whom should research knowledge be transferred; by whom should research knowledge be transferred; how should research knowledge be transferred; and, with what effect should research knowledge be transferred? Discussion We suggest that the basic unit of knowledge translation should usually be up-to-date systematic reviews or other syntheses of research findings. Knowledge translators need to identify the key messages for different target audiences and to fashion these in language and knowledge translation products that are easily assimilated by different audiences. The relative importance of knowledge translation to different target audiences will vary by the type of research and appropriate endpoints of knowledge translation may vary across different stakeholder groups. There are a large number of planned knowledge translation models, derived from different disciplinary, contextual (i.e., setting), and target audience viewpoints. Most of these suggest that planned knowledge translation for healthcare professionals and consumers is more likely to be successful if the choice of knowledge translation strategy is informed by an assessment of the likely barriers and facilitators. Although our evidence on the likely effectiveness of different strategies to overcome specific barriers remains incomplete, there is a range of informative systematic reviews of interventions aimed at healthcare professionals and consumers (i.e., patients, family members, and informal carers) and of factors important to research use by policy makers. Summary There is a substantial (if incomplete) evidence base to guide choice of knowledge translation activities targeting healthcare professionals and consumers. The evidence base on the effects of different knowledge translation approaches targeting healthcare policy makers and senior managers is much weaker but there are a profusion of innovative approaches that warrant further evaluation.

Abstract Background There is a significant public health burden associated with substance use in Canada. The early detection and/or treatment of risky substance use has the potential to dramatically improve outcomes for those who experience harms from the non-medical use of psychoactive substances, particularly adolescents whose brains are still undergoing development. The Screening, Brief Intervention, and Referral to Treatment model is a comprehensive, integrated approach for the delivery of early intervention and treatment services for individuals experiencing substance use-related harms, as well as those who are at risk of experiencing such harm. Methods This article describes the protocol for a systematic review of the effectiveness of brief interventions as part of the Screening, Brief Intervention, and Referral to Treatment model for reducing the non-medical use of psychoactive substances. Studies will be selected in which brief interventions target non-medical psychoactive substance use (excluding alcohol, nicotine, or caffeine) among those 12 years and older who are opportunistically screened and deemed at risk of harms related to psychoactive substance use. We will include one-on-one verbal interventions and exclude non-verbal brief interventions (for example, the provision of information such as a pamphlet or online interventions) and group interventions. Primary, secondary and adverse outcomes of interest are prespecified. Randomized controlled trials will be included; non-randomized controlled trials, controlled before-after studies and interrupted time series designs will be considered in the absence of randomized controlled trials. We will search several bibliographic databases (for example, MEDLINE, EMBASE, CINAHL, PsycINFO, CORK) and search sources for grey literature. We will meta-analyze studies where possible. We will conduct subgroup analyses, if possible, according to drug class and intervention setting. Discussion This review will provide evidence on the effectiveness of brief interventions as part of the Screening, Brief Intervention, and Referral to Treatment protocol aimed at the non-medical use of psychoactive substances and may provide guidance as to where future research might be most beneficial.

Abstract Background There is little systematic operational guidance about how best to develop complex interventions to reduce the gap between practice and evidence. This article is one in a Series of articles documenting the development and use of the Theoretical Domains Framework (TDF) to advance the science of implementation research. Methods The intervention was developed considering three main components: theory, evidence, and practical issues. We used a four-step approach, consisting of guiding questions, to direct the choice of the most appropriate components of an implementation intervention: Who needs to do what, differently? Using a theoretical framework, which barriers and enablers need to be addressed? Which intervention components (behaviour change techniques and mode(s) of delivery) could overcome the modifiable barriers and enhance the enablers? And how can behaviour change be measured and understood? Results A complex implementation intervention was designed that aimed to improve acute low back pain management in primary care. We used the TDF to identify the barriers and enablers to the uptake of evidence into practice and to guide the choice of intervention components. These components were then combined into a cohesive intervention. The intervention was delivered via two facilitated interactive small group workshops. We also produced a DVD to distribute to all participants in the intervention group. We chose outcome measures in order to assess the mediating mechanisms of behaviour change. Conclusions We have illustrated a four-step systematic method for developing an intervention designed to change clinical practice based on a theoretical framework. The method of development provides a systematic framework that could be used by others developing complex implementation interventions. While this framework should be iteratively adjusted and refined to suit other contexts and settings, we believe that the four-step process should be maintained as the primary framework to guide researchers through a comprehensive intervention development process.

Abstract Background Rapid reviews have emerged as a streamlined approach to synthesizing evidence - typically for informing emergent decisions faced by decision makers in health care settings. Although there is growing use of rapid review 'methods', and proliferation of rapid review products, there is a dearth of published literature on rapid review methodology. This paper outlines our experience with rapidly producing, publishing and disseminating evidence summaries in the context of our Knowledge to Action (KTA) research program. Methods The KTA research program is a two-year project designed to develop and assess the impact of a regional knowledge infrastructure that supports evidence-informed decision making by regional managers and stakeholders. As part of this program, we have developed evidence summaries - our form of rapid review - which have come to be a flagship component of this project. Our eight-step approach for producing evidence summaries has been developed iteratively, based on evidence (where available), experience and knowledge user feedback. The aim of our evidence summary approach is to deliver quality evidence that is both timely and user-friendly. Results From November 2009 to March 2011 we have produced 11 evidence summaries on a diverse range of questions identified by our knowledge users. Topic areas have included questions of clinical effectiveness to questions on health systems and/or health services. Knowledge users have reported evidence summaries to be of high value in informing their decisions and initiatives. We continue to experiment with incorporating more of the established methods of systematic reviews, while maintaining our capacity to deliver a final product in a timely manner. Conclusions The evolution of the KTA rapid review evidence summaries has been a positive one. We have developed an approach that appears to be addressing a need by knowledge users for timely, user-friendly, and trustworthy evidence and have transparently reported these methods here for the wider rapid review and scientific community.

Abstract In this editorial, we reflect on the arguments for starting a scientific society focused on research on how to improve healthcare. This society would take an inclusive approach to what constitutes healthcare. For instance, it should include mental health healthcare, treatment for substance abuse, the work of allied health professions, and preventive healthcare. The society would be open to researchers from all traditions. Thus, we take an inclusive approach to what constitutes scientific research, as long as it uses rigorous methods, is focused on improving healthcare, and aims at knowledge that can be transferred across settings. The society would primarily target scientific researchers but would invite others with an interest in this area of research, regardless of their discipline, position, field of application, or group affiliation (e.g., improvement science, behavioral medicine, knowledge translation). A society would need fruitful collaboration with related societies and organizations, which may include having combined meetings. Special links may be developed with one or more journals. A website to provide information on relevant resources, events, and training opportunities is another key activity. It would also provide a voice for the field at funding agencies, political arenas, and similar institutions. An organizational structure and financial resources are required to develop and run these activities. Our aim is to start an international debate, to discover if we can establish a shared vision across academics and stakeholders engaged with creating scientific knowledge on how to improve healthcare. We invite readers to express their views in the online questionnaire accessed by following the URL link provided at the end of the editorial.

Abstract Background Regular laboratory test monitoring of patient parameters offers a route for improving the quality of chronic disease care. We evaluated the effects of brief educational messages attached to laboratory test reports on diabetes care. Methods A programme of cluster randomised controlled trials was set in primary care practices in one primary care trust in England. Participants were the primary care practices' constituent healthcare professionals and patients with diabetes. Interventions comprised brief educational messages added to paper and electronic primary care practice laboratory test reports and introduced over two phases. Phase one messages, attached to Haemoglobin A1c (HbA1c) reports, targeted glycaemic and cholesterol control. Phase two messages, attached to albumin:creatinine ratio (ACR) reports, targeted blood pressure (BP) control, and foot inspection. Main outcome measures comprised practice mean HbA1c and cholesterol levels, diastolic and systolic BP, and proportions of patients having undergone foot inspections. Results Initially, 35 out of 37 eligible practices participated. Outcome data were available for a total of 8,690 patients with diabetes from 32 practices. The BP message produced a statistically significant reduction in diastolic BP (-0.62 mmHg; 95% confidence interval -0.82 to -0.42 mmHg) but not systolic BP (-0.06 mmHg, -0.42 to 0.30 mmHg) and increased the odds of achieving target BP control (odds ratio 1.05; 1.00, 1.10). The foot inspection message increased the likelihood of a recorded foot inspection (incidence rate ratio 1.26; 1.18 to 1.36). The glycaemic control message had no effect on mean HbA1c (increase 0.01%; -0.03 to 0.04) despite increasing the odds of a change in likelihood of HbA1c tests being ordered (OR 1.06; 1.01, 1.11). The cholesterol message had no effect (decrease 0.01 mmol/l, -0.04 to 0.05). Conclusions Three out of four interventions improved intermediate outcomes or process of diabetes care. The diastolic BP reduction approximates to relative reductions in mortality of 3% to 5% in stroke and 3% to 4% in ischaemic heart disease over 10 years. The lack of effect for other outcomes may, in part, be explained by difficulties in bringing about further improvements beyond certain thresholds of clinical performance. Trial Registration Current Controlled Trials, ISRCTN2186314.

Abstract Background Canada is among the most prosperous nations in the world, yet the health and wellness outcomes of Canadian children are surprisingly poor. There is some evidence to suggest that these poor health outcomes are partly due to clinical practice variation, which can stem from failure to apply the best available research evidence in clinical practice, otherwise known as knowledge translation (KT). Surprisingly, clinical practice variation, even for common acute paediatric conditions, is pervasive. Clinical practice variation results in unnecessary medical treatments, increased suffering, and increased healthcare costs. This study focuses on improving health outcomes for common paediatric acute health concerns by evaluating strategies that improve KT and reduce clinical practice variation. Design/Methods Using a multiple case study design, qualitative and quantitative data will be collected from four emergency departments in western Canada. Data sources will include: pre- and post-implementation focus group data from multidisciplinary healthcare professionals; individual interviews with the local champions, KT intervention providers, and unit/site leaders/managers; Alberta Context Tool (ACT) survey data; and aggregated patient outcome data. Qualitative and quantitative data will be systematically triangulated, and matrices will be built to do cross-case comparison. Explanations will be built about the success or lack of success of the clinical practice guidelines (CPG) and clinical pathways (CPs) uptake based upon the cross-case comparisons. Significance This study will generate new knowledge about the potential causal mechanisms and factors which shape implementation. Future studies will track the impact of the CPG/CPs implementation on children's health outcome, and healthcare costs.

Abstract Background Globally, healthcare systems are attempting to optimize quality of care. This challenge has resulted in the development of implementation science or knowledge translation (KT) and the resulting need to build capacity in both the science and practice of KT. Findings We are attempting to meet these challenges through the creation of a national training initiative in KT. We have identified core competencies in this field and have developed a series of educational courses and materials for three training streams. We report the outline for this approach and the progress to date. Conclusions We have prepared a strategy to develop, implement, and evaluate a national training initiative to build capacity in the science and practice of KT. Ultimately through this initiative, we hope to meet the capacity demand for KT researchers and practitioners in Canada that will lead to improved care and a strengthened healthcare system.

Abstract This editorial marks the launch of a special collection of articles highlighting 'Five years of Trials' (http://www.trialsjournal.com/series/5years). The journal's achievements on its objectives since 2006 are described and some of the challenges still ahead are outlined - in particular further innovating in the reporting of trials and the publication of negative results. The other articles in this series are examples of where Trials has demonstrated progress on its objectives. These include the publication of raw data, extended versions of previously published trial-related articles, descriptions of 'lessons learned', negative results, and educational articles regarding ethics and reporting bias.

Abstract Background Opinion leaders represent one way to disseminate new knowledge and influence the practice behaviors of physicians. This study explored the stability of opinion leaders over time, whether opinion leaders were polymorphic (i.e., influencing multiple practice areas) or monomorphic (i.e., influencing one practice area), and reach of opinion leaders in their local network. Methods We surveyed surgeons and pathologists in Ontario to identify opinion leaders for colorectal cancer in 2003 and 2005 and to identify opinion leaders for breast cancer in 2005. We explored whether opinion leaders for colorectal cancer identified in 2003 were re-identified in 2005. We examined whether opinion leaders were considered polymorphic (nominated in 2005 as opinion leaders for both colorectal and breast cancer) or monomorphic (nominated in 2005 for only one condition). Social-network mapping was used to identify the number of local colleagues identifying opinion leaders. Results Response rates for surgeons were 41% (2003) and 40% (2005); response rates for pathologists were 42% (2003) and 37% (2005). Four (25%) of the surgical opinion leaders identified in 2003 for colorectal cancer were re-identified in 2005. No pathology opinion leaders for colorectal cancer were identified in both 2003 and 2005. Only 29% of surgical opinion leaders and 17% of pathology opinion leaders identified in the 2005 survey were considered influential for both colorectal cancer and breast cancer. Social-network mapping revealed that only a limited number of general surgeons (12%) or pathologists (7%) were connected to the social networks of identified opinion leaders. Conclusions Opinion leaders identified in this study were not stable over a two-year time period and generally appear to be monomorphic, with clearly demarcated areas of expertise and limited spheres of influence. These findings may limit the practicability of routinely using opinion leaders to influence practice.