Search

Background: With massive investment in health-related research, above and beyond investments in the management and delivery of healthcare and public health services, there has been increasing focus on the impact of health research to explore and explain the consequences of these investments and inform strategic planning. Relevance is reflected by increased attention to the usability and impact of health research, with research funders increasingly engaging in relevance assessment as an input to decision processes. Yet, it is unclear whether relevance is a synonym for or predictor of impact, a necessary condition or stage in achieving it, or a distinct aim of the research enterprise. The main aim of this paper is to improve our understanding of research relevance, with specific objectives to (1) unpack research relevance from both theoretical and practical perspectives, and (2) outline key considerations for its assessment.Approach: Our approach involved the scholarly strategy of review and reflection. We prepared a draft paper based on an exploratory review of literature from various fields, and gained from detailed and insightful analysis and critique at a roundtable discussion with a group of key health research stakeholders. We also solicited review and feedback from a small sample of expert reviewers.Conclusions: Research relevance seems increasingly important in justifying research investments and guiding strategic research planning. However, consideration of relevance has been largely tacit in the health research community, often depending on unexplained interpretations of value, fit and potential for impact. While research relevance seems a necessary condition for impact - a process or component of efforts to make rigorous research usable - ultimately, relevance stands apart from research impact. Careful and explicit consideration of research relevance is vital to gauge the overall value and impact of a wide range of individual and collective research efforts and investments. To improve understanding, this paper outlines four key considerations, including how research relevance assessments (1) orientate to, capture and compare research versus non-research sources, (2) consider both instrumental versus non-instrumental uses of research, (3) accommodate dynamic temporal-shifting perspectives on research, and (4) align with an intersubjective understanding of relevance. [ABSTRACT FROM AUTHOR]

Background: Collaboration among researchers and research users, or integrated knowledge translation (IKT), enhances the relevance and uptake of evidence into policy and practice. However, it is not widely practiced and, even when well-resourced, desired impacts may not be achieved. Given that large-scale investment is not the norm, further research is needed to identify how IKT can be optimized.Methods: Interviews were conducted with researchers and research users (clinicians, managers) in a health care delivery (HCDO) and health care monitoring (HCMO) organization that differed in size and infrastructure, and were IKT-naïve. Basic qualitative description was used. Participants were asked about IKT activities and challenges, and recommendations for optimizing IKT. Data were analysed inductively using constant comparative technique.Results: Forty-three interviews were conducted (28 HCDO, 15 HCMO) with 13 researchers, 8 clinicians, and 22 managers. Little to no IKT took place. Participants articulated similar challenges and recommendations revealing that a considerable number of changes were needed at the organizational, professional and individual levels. Given the IKT-absent state of participating organizations, this research identified a core set of conditions which must be addressed to prepare an environment conducive to IKT. These conditions were compiled into a framework by which organizations can plan for, or evaluate their capacity for IKT.Conclusions: The IKT capacity framework is relevant for organizations in which there is no current IKT activity. Use of the IKT framework may result in more organizations that are ready to initiate and establish IKT, perhaps ultimately leading to more, and higher-quality collaboration for health system innovation. Further research is needed to confirm these findings in other organizations not yet resourced for, or undertaking IKT, and to explore the resource implications and mechanisms for establishing the conditions identified here as essential to preparing for IKT. [ABSTRACT FROM AUTHOR]

Background Inter-professional collaborative care (ICC) for cancer leads to multiple system, organizational, professional, and patient benefits, but is limited by numerous challenges. Empirical research on interventions that promote or enable ICC is sparse so guidance on how to achieve ICC is lacking. Research shows that ICC for diagnosis could be improved. Diagnostic assessment programs (DAPs) appear to be a promising model for enabling ICC. The purpose of this study was to explore how DAP structure and function enable ICC, and whether that may be associated with organizational and clinical outcomes. Methods A case study approach will be used to explore ICC among eight DAPs that vary by type of cancer (lung, breast), academic status, and geographic region. To describe DAP function and outcomes, and gather information that will enable costing, recommendations expressed in DAP standards and clinical guidelines will be assessed through retrospective observational study. Data will be acquired from databases maintained by participating DAPs and the provincial cancer agency, and confirmed by and supplemented with review of medical records. We will conduct a pilot study to explore the feasibility of estimating the incremental cost-effectiveness ratio using person-level data from medical records and other sources. Interviews will be conducted with health professionals, staff, and referring physicians from each DAP to learn about barriers and facilitators of ICC. Qualitative methods based on a grounded approach will be used to guide sampling, data collection and analysis. Discussion Findings may reveal opportunities for unique structures, interventions or tools that enable ICC that could be developed, implemented, and evaluated through future research. This information will serve as a formative needs assessment to identify the nature of ongoing or required improvements, which can be directly used by our decision maker collaborators, and as a framework by policy makers, cancer system managers, and DAP managers elsewhere to strategically plan for and implement diagnostic cancer services. [ABSTRACT FROM AUTHOR]

Background: Health-policy decision making is a complex and dynamic process, for which strong evidentiary support is required. This includes scientifically produced research, as well as information that relates to the context in which the decision takes place. Unlike scientific evidence, this "contextual evidence" is highly variable and often includes information that is not scientifically produced, drawn from sources such as political judgement, program management experience and knowledge, or public values. As the policy decision-making process is variable and difficult to evaluate, it is often unclear how this heterogeneous evidence is identified and incorporated into "evidence-based policy" decisions. Population-based colorectal cancer screening poses an ideal context in which to examine these issues. In Canada, colorectal cancer screening programs have been established in several provinces over the past five years, based on the fecal occult blood test (FOBT) or the fecal immunochemical test. However, as these programs develop, new scientific evidence for screening continues to emerge. Recently published randomized controlled trials suggest that the use of flexible sigmoidoscopy for population-based screening may pose a greater reduction in mortality than the FOBT. This raises the important question of how policy makers will address this evidence, given that screening programs are being established or are already in place. This study will examine these issues prospectively and will focus on how policy makers monitor emerging scientific evidence and how both scientific and contextual evidence are identified and applied for decisions about health system improvement. Methods: This study will employ a prospective multiple case study design, involving participants from Ontario, Alberta, Manitoba, Nova Scotia, and Quebec. In each province, data will be collected via document analysis and key informant interviews. Documents will include policy briefs, reports, meeting minutes, media releases, and correspondence. Interviews will be conducted in person with senior administrative leaders, government officials, screening experts, and high-level cancer system stakeholders. Discussion: The proposed study comprises the third and final phase of an Emerging Team grant to address the challenges of health-policy decision making and colorectal cancer screening decisions in Canada. This study will contribute a unique prospective look at how policy makers address new, emerging scientific evidence in several different policy environments and at different stages of program planning and implementation. Findings will provide important insight into the various approaches that are or should be used to monitor emerging evidence, the relative importance of scientific versus contextual evidence for decision making, and the tools and processes that may be important to support challenging health-policy decisions. [ABSTRACT FROM AUTHOR]

Background: In research, diagrams are most commonly used in the analysis of data and visual presentation of results. However there has been a substantial growth in the use of diagrams in earlier stages of the research process to collect data. Despite this growth, guidance on this technique is often isolated within disciplines. Methods: A multidisciplinary systematic review was performed, which included 13 traditional healthcare and non-health-focused indexes, non-indexed searches and contacting experts in the field. English-language articles that used diagrams as a data collection tool and reflected on the process were included in the review, with no restriction on publication date. Results: The search identified 2690 documents, of which 80 were included in the final analysis. The choice to use diagrams for data collection is often determined by requirements of the research topic, such as the need to understand research subjects' knowledge or cognitive structure, to overcome cultural and linguistic differences, or to understand highly complex subject matter. How diagrams were used for data collection varied by the degrees of instruction for, and freedom in, diagram creation, the number of diagrams created or edited and the use of diagrams in conjunction with other data collection methods. Depending on how data collection is structured, a variety of options for qualitative and quantitative analysis are available to the researcher. The review identified a number of benefits to using diagrams in data collection, including the ease with which the method can be adapted to complement other data collection methods and its ability to focus discussion. However it is clear that the benefits and challenges of diagramming depend on the nature of its application and the type of diagrams used. Discussion/Conclusion: The results of this multidisciplinary systematic review examine the application of diagrams in data collection and the methods for analyzing the unique datasets elicited. Three recommendations are presented. Firstly, the diagrammatic approach should be chosen based on the type of data needed. Secondly, appropriate instructions will depend on the approach chosen. And thirdly, the final results should present examples of original or recreated diagrams. This review also highlighted the need for a standardized terminology of the method and a supporting theoretical framework. [ABSTRACT FROM AUTHOR]

Background: Decision aids have been developed in a number of health disciplines to support evidence-informed decision making, including patient decision aids and clinical practice guidelines. However, policy contexts differ from clinical contexts in terms of complexity and uncertainty, requiring different approaches for identifying, interpreting, and applying many different types of evidence to support decisions. With few studies in the literature offering decision guidance specifically to health policymakers, the present study aims to facilitate the structured and systematic incorporation of research evidence and, where there is currently very little guidance, values and other non-research-based evidence, into the policy making process. The resulting decision aid is intended to help public sector health policy decision makers who are tasked with making evidence-informed decisions on behalf of populations. The intent is not to develop a decision aid that will yield uniform recommendations across jurisdictions, but rather to facilitate more transparent policy decisions that reflect a balanced consideration of all relevant factors. Methods/design: The study comprises three phases: a modified meta-narrative review, the use of focus groups, and the application of a Delphi method. The modified meta-narrative review will inform the initial development of the decision aid by identifying as many policy decision factors as possible and other features of methodological guidance deemed to be desirable in the literatures of all relevant disciplines. The first of two focus groups will then seek to marry these findings with focus group members' own experience and expertise in public sector population-based health policy making and screening decisions. The second focus group will examine issues surrounding the application of the decision aid and act as a sounding board for initial feedback and refinement of the draft decision aid. Finally, the Delphi method will be used to further inform and refine the decision aid with a larger audience of potential end-users. Discussion: The product of this research will be a working version of a decision aid to support policy makers in population-based health policy decisions. The decision aid will address the need for more structured and systematic ways of incorporating various evidentiary sources where applicable. [ABSTRACT FROM AUTHOR]

Background: This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answers, and 'graphic elicitation', where a researcher-prepared diagram is used to stimulate data collection. Methods: These two diagramming methods were applied in key informant interviews and their value in efficiently and effectively gathering data was assessed based on quantitative measures and qualitative observations. Results: Assessment of the two diagramming methods suggests that participatory diagramming is an efficient method for collecting data in graphic form, but may not generate the depth of verbal response that many qualitative researchers seek. In contrast, graphic elicitation was more intuitive, better understood and preferred by most respondents, and often provided more contemplative verbal responses, however this was achieved at the expense of more interview time. Conclusion: Diagramming methods are important for eliciting interview data that are often difficult to obtain through traditional verbal exchanges. Subject to the methodological limitations of the study, our findings suggest that while participatory diagramming and graphic elicitation have specific strengths and weaknesses, their combined use can provide complementary information that would not likely occur with the application of only one diagramming method. The methodological insights gained by examining the efficiency and effectiveness of these diagramming methods in our study should be helpful to other researchers considering their incorporation into qualitative research designs. [ABSTRACT FROM AUTHOR]

Background: Qualitative research has the potential to inform and improve health care decisions but a study based on one year of publications suggests that it is not published in prominent health care journals. A more detailed, longitudinal analysis of its availability is needed. The purpose of this study was to identify, count and compare the number of qualitative and non-qualitative research studies published in high impact health care journals, and explore trends in these data over the last decade.Methods: A bibliometric approach was used to identify and quantify qualitative articles published in 20 top general medical and health services and policy research journals from 1999 to 2008. Eligible journals were selected based on performance in four different ranking systems reported in the 2008 ISI Journal Citation Reports. Qualitative and non-qualitative research published in these journals were identified by searching MEDLINE, and validated by hand-searching tables of contents for four journals.Results: The total number of qualitative research articles published during 1999 to 2008 in ten general medical journals ranged from 0 to 41, and in ten health services and policy research journals from 0 to 39. Over this period the percentage of empirical research articles that were qualitative ranged from 0% to 0.6% for the general medical journals, and 0% to 6.4% for the health services and policy research journals.Conclusions: This analysis suggests that qualitative research it is rarely published in high impact general medical and health services and policy research journals. The factors that contribute to this persistent marginalization need to be better understood. [ABSTRACT FROM AUTHOR]

Background: Research regarding the decision to adopt and implement technological innovations in radiation oncology is lacking. This is particularly problematic since these technologies are often complex and rapidly evolving, requiring ongoing revisiting of decisions regarding which technologies are the most appropriate to support. Variations in adoption and implementation decisions for new radiation technologies across cancer centres can impact patients' access to appropriate and innovative forms of radiation therapy. This study examines the key steps in the process of adopting and implementing intensity modulated radiation therapy (IMRT) in publicly funded cancer centres and identifies facilitating or impeding factors., Methods: A multiple case study design, utilizing document analysis and key informant interviews was employed. Four cancer centres in Ontario, Canada were selected and interviews were conducted with radiation oncologists, medical physicists, radiation therapists, and senior administrative leaders., Results: Eighteen key informants were interviewed. Overall, three centres made fair to excellent progress in the implementation of IMRT, while one centre achieved only limited implementation as of 2009. Key factors that influenced the extent of IMRT implementation were categorized as: 1) leadership, 2) training, expertise and standardization, 3) collaboration, 4) resources, and 5) resistance to change., Conclusion: A framework for the adoption and implementation of complex and evolving technologies is presented. It identifies the key factors that should be addressed by decision-makers at specific stages of the adoption/implementation process.

Background: The use of electronic health records (EHRs) to support the organization and delivery of healthcare is evolving rapidly. However, little is known regarding potential variation in access to EHRs by provider type or care setting. This paper reports on observed variation in the perceptions of access to EHRs by a wide range of cancer care providers covering diverse cancer care settings in Ontario, Canada., Methods: Perspectives were sought regarding EHR access and health record completeness for cancer patients as part of an internet survey of 5663 cancer care providers and administrators in Ontario. Data were analyzed using a multilevel logistic regression model. Provider type, location of work, and access to computer or internet were included as covariates in the model., Results: A total of 1997 of 5663 (35%) valid responses were collected. Focusing on data from cancer care providers (N = 1247), significant variation in EHR access and health record completeness was observed between provider types, location of work, and level of computer access. Providers who worked in community hospitals were half as likely as those who worked in teaching hospitals to have access to their patients' EHRs (OR 0.45 95% CI: 0.24-0.85, p < 0.05) and were six times less likely to have access to other organizations' EHRs (OR 0.15 95% CI: 0.02-1.00, p < 0.05). Compared to surgeons, nurses (OR 3.47 95% CI: 1.80-6.68, p < 0.05), radiation therapists/physicists (OR 7.86 95% CI: 2.54-25.34, p < 0.05), and other clinicians (OR 4.92 95% CI: 2.15-11.27, p < 0.05) were more likely to report good access to their organization's EHRs., Conclusion: Variability in access across different provider groups, organization types, and geographic locations illustrates the fragmented nature of EHR adoption in the cancer system. Along with focusing on technological aspects of EHR adoption within organizations, it is essential that there is cross-organizational and cross-provider access to EHRs to ensure patient continuity of care, system efficiency, and high quality care.

Background: This paper assesses interviewee transcript review (ITR) as a technique for improving the rigour of interview-based, qualitative research. ITR is a process whereby interviewees are provided with verbatim transcripts of their interviews for the purposes of verifying accuracy, correcting errors or inaccuracies and providing clarifications. ITR, in various forms, is widely used among qualitative researchers, however there is limited methodological guidance on how it should be employed and little is known about its actual impact on the transcript, the data, the interviewee or the researcher., Methods: ITR was incorporated into a qualitative research study in which 51 key informant interviews were conducted with a range of senior stakeholders within the Canadian health care system. The changes made by interviewees to their transcripts were systematically tracked and categorized using a set of mutually exclusive categories., Results: The study found that ITR added little to the accuracy of the transcript and may create complications if the goal of the researcher is to produce a transcript which reflects precisely what was said at the time of the interview. The advantages of ITR are that it allows interviewees the opportunity to edit or clarify information provided in the original interview, with many interviewees providing corrections, clarifications, and in some cases, adding new material to their transcripts. There are also potential disadvantages, such as a bias created by inconsistent data sources or the loss of data when an interviewee chooses to remove valuable material. The impact of ITR on the interviewee may be both positive and negative, depending on the specific circumstances and the nature of the study. The impact of ITR on the researcher was minimal in this study, but is again subject to specific circumstances of the research context., Conclusion: While ITR is employed by many researchers across numerous fields, the advantages of its use may be relatively small in terms of verifying the accuracy of qualitative interview transcripts. Researchers are advised to carefully consider both the potential advantages and disadvantages of ITR outlined in this paper before deciding to incorporate the practice within their qualitative study designs.