Search

Abstract Background Patients receiving complementary and alternative medicine (CAM) therapies often report shifts in well-being that go beyond resolution of the original presenting symptoms. We undertook a research program to develop and evaluate a patient-centered outcome measure to assess the multidimensional impacts of CAM therapies, utilizing a novel mixed methods approach that relied upon techniques from the fields of anthropology and psychometrics. This tool would have broad applicability, both for CAM practitioners to measure shifts in patients' states following treatments, and conventional clinical trial researchers needing validated outcome measures. The US Food and Drug Administration has highlighted the importance of valid and reliable measurement of patient-reported outcomes in the evaluation of conventional medical products. Here we describe Phase I of our research program, the iterative process of content identification, item development and refinement, and response format selection. Cognitive interviews and psychometric evaluation are reported separately. Methods From a database of patient interviews (n = 177) from six diverse CAM studies, 150 interviews were identified for secondary analysis in which individuals spontaneously discussed unexpected changes associated with CAM. Using ATLAS.ti, we identified common themes and language to inform questionnaire item content and wording. Respondents' language was often richly textured, but item development required a stripping down of language to extract essential meaning and minimize potential comprehension barriers across populations. Through an evocative card sort interview process, we identified those items most widely applicable and covering standard psychometric domains. We developed, pilot-tested, and refined the format, yielding a questionnaire for cognitive interviews and psychometric evaluation. Results The resulting questionnaire contained 18 items, in visual analog scale format, in which each line was anchored by the positive and negative extremes relevant to the experiential domain. Because of frequent informant allusions to response set shifts from before to after CAM therapies, we chose a retrospective pretest format. Items cover physical, emotional, cognitive, social, spiritual, and whole person domains. Conclusions This paper reports the success of a novel approach to the development of outcome instruments, in which items are extracted from patients' words instead of being distilled from pre-existing theory. The resulting instrument, focused on measuring shifts in patients' perceptions of health and well-being along pre-specified axes, is undergoing continued testing, and is available for use by cooperating investigators.

Abstract Background Therapeutic massage and bodywork (TMB) practitioners are predominantly trained in programs that are not uniformly standardized, and in variable combinations of therapies. To date no studies have explored this variability in training and how this affects clinical practice. Methods Combined methods, consisting of a quantitative, population-based survey and qualitative interviews with practitioners trained in multiple therapies, were used to explore the training and practice of TMB practitioners in Alberta, Canada. Results Of the 5242 distributed surveys, 791 were returned (15.1%). Practitioners were predominantly female (91.7%), worked in a range of environments, primarily private (44.4%) and home clinics (35.4%), and were not significantly different from other surveyed massage therapist populations. Seventy-seven distinct TMB therapies were identified. Most practitioners were trained in two or more therapies (94.4%), with a median of 8 and range of 40 therapies. Training programs varied widely in number and type of TMB components, training length, or both. Nineteen interviews were conducted. Participants described highly variable training backgrounds, resulting in practitioners learning unique combinations of therapy techniques. All practitioners reported providing individualized patient treatment based on a responsive feedback process throughout practice that they described as being critical to appropriately address the needs of patients. They also felt that research treatment protocols were different from clinical practice because researchers do not usually sufficiently acknowledge the individualized nature of TMB care provision. Conclusions The training received, the number of therapies trained in, and the practice descriptors of TMB practitioners are all highly variable. In addition, clinical experience and continuing education may further alter or enhance treatment techniques. Practitioners individualize each patient's treatment through a highly adaptive process. Therefore, treatment provision is likely unique to each practitioner. These results may be of interest to researchers considering similar practice issues in other professions. The use of a combined-methods design effectively captured this complexity of TMB practice. TMB research needs to consider research approaches that can capture or adapt to the individualized nature of practice.

Abstract Background The extent to which a health care intervention causes or facilitates health-related change is a key question in research. The need to quantify such change has led to the development of an increasing number of change indicators, to measure what have come to be known as 'outcomes'. In the context of medical research into the efficacy or effectiveness of an intervention the term 'outcomes' has often been interpreted to mean single endpoints with a linear cause and effect link to an external intervention. Discussion In this paper we present a critical analysis of the nature and interpretation of the 'outcomes' concept and of the assumptions that underpin it. Drawing on our own work and that of others, we analyse the problems that arise when the concept is applied to complex interventions and discuss the use of other models, such as programme theory, as a basis for alternative conceptualisations for indicators of change. Our analysis demonstrates that the interpretation of 'outcomes' that may be appropriate for clinical trials of pharmaceutical products, is problematic when used in evaluations of complex interventions in areas such as complementary medicine, palliative care, rehabilitation, and health promotion. The 'outcomes' concept may impose inappropriate patterns of thought and meaning. We present alternative models, such as those based on programme theory, which conceptualise health-related change as resulting from the interaction between intervention, process and context over time. In this framework both the intervention and the patient are defined as causal factors, because the result of the treatment is dependent on the resources of the patient – such as the body's ability to heal itself – and the impact of the patient's situation. Summary Evaluations based on a model such as programme theory will encompass a wide range of health-related changes that include aspects of process, such as new meanings and understanding, as well as longer term changes in health, wellbeing and health-related competences and behaviours.

Abstract Background Central to the development of a sound evidence base for Complementary and Alternative Medicine (CAM) interventions is the need for valid, reliable and relevant outcome measures to assess whether the interventions work. We assessed the specific needs for a database that would cover a wide range of outcomes measures for CAM research and considered a framework for such a database. Methods The study was a survey of CAM researchers, practitioners and students. An online questionnaire was emailed to the members of the Canadian Interdisciplinary Network for CAM Research (IN-CAM) and the CAM Education and Research Network of Alberta (CAMera). The majority of survey questions were open-ended and asked about outcome measures currently used, outcome measures' assessment criteria, sources of information, perceived barriers to finding outcome measures and outcome domains of importance. Descriptive quantitative analysis and qualitative content analysis were used. Results One hundred and sixty-four completed surveys were received. Of these, 62 respondents reported using outcome measures in their CAM research and identified 92 different specific outcomes. The most important barriers were the fact that, for many health concepts, outcome measures do not yet exist, as well as issues related to accessibility of instruments. Important outcome domains identified included physical, psychological, social, spiritual, quality of life and holistic measures. Participants also mentioned the importance of individualized measures that assess unique patient-centered outcomes for each research participant, and measures to assess the context of healing and the process of healing. Conclusion We have developed a preliminary framework that includes all components of health-related outcomes. The framework provides a foundation for a larger, comprehensive collection of CAM outcomes. It fits very well in a whole systems perspective, which requires an expanded set of outcome measures, such as individualized and holistic measures, with attention to issues of process and context.