Search

BackgroundThe Mindfulness-Based Interventions: Teaching Assessment Criteria (MBI:TAC) is an important tool for assessing teacher skill and aspects of the fidelity of mindfulness-based interventions, but prior research on and implementation of the MBI:TAC has used video recordings, which can be difficult to obtain, share for assessments, and which increase privacy concerns for participants. Audio-only recordings might be a useful alternative, but their reliability is unknown.ObjectiveTo assess evaluator perception of the rating process and inter-rater reliability of MBI:TAC ratings using audio-only recordings.MethodsWe prepared audio-only files from video recordings of 21 previously rated Mindfulness-Based Stress Reduction teachers. Each audio recording was rated by 3 trained MBI:TAC assessors drawn from a pool of 12 who had previously participated in rating the video recordings. Teachers were rated by evaluators who had not viewed the video recording and did not know the teacher. We then conducted semi-structured interviews with evaluators.ResultsOn the 6 MBI:TAC domains, the intraclass correlation coefficients (ICCs) for audio recordings ranged from .53 to .69 using an average across 3 evaluators. Using a single rating resulted in lower ICCs (.27-.38). Bland-Altman plots showed audio ratings had little consistent bias compared to video recordings and agreed more closely for teachers with higher ratings. Qualitative analysis identified 3 themes: video recordings were particularly helpful when rating less skillful teachers, video recordings tended to provide a more complete picture for rating, and audio rating had some positive features.ConclusionsInter-rater reliability of the MBI:TAC using audio-only recordings was adequate for many research and clinical purposes, and reliability is improved when using an average across several evaluators. Ratings using audio-only recordings may be more challenging when rating less experienced teachers.

Background: Prior data suggests the Mindfulness-Based Interventions: (MBI) Teaching Assessment Criteria (MBI:TAC) has good inter-rater reliability, but many raters knew teacher experience level. Objective: We sought to further evaluate the MBI-TAC's inter-rater reliability and obtain preliminary data on predictive validity. Methods: We videorecorded 21 MBSR teachers from academic and community settings. We trained 19 experienced MBI teachers in using the MBI:TAC. MBSR teachers were rated by three assessors; teachers and their assessors did not know one another. To assess predictive validity, MBSR students in courses taught by 18 of the MBSR teachers were invited to complete PROMIS-29 measures before the MBSR course, at the end of the course (month 2), and month 4. Results: Intraclass correlation coefficients (ICCs) representing a single rater ranged from 0.33 to 0.56 on the 6 MBI:TAC domains. Using an average of two raters, ICC estimates ranged from 0.48 to 0.71 and ICCs generalizing to an average of three raters ranged from 0.6 to 0.8. Among n = 152 participating MBSR students, we found improvements from baseline to 2 months and 4 months in PROMIS measures of Anxiety, Depression, Fatigue, Sleep, and Social Role function (range in improvement 2.3 to 6.3, P < 0.0001 for all comparisons except Social Role at 2 months, P = 0.007). Higher MBI:TAC ratings were associated with greater improvements in anxiety among MBSR students from baseline to 2 months, with a −0.31 lower participant anxiety score per 1 unit increase in MBI:TAC composite teaching rating (95% CI −0.58, −0.05, P = 0.019), but we did not find statistically significant relationships with improvements in other PROMIS-29 domains. Conclusions: ICCs indicated good reliability using an average of three ratings, but inter-rater reliability was only fair using a single rater. We found initial validation that higher MBI:TAC ratings predicted greater improvements in anxiety symptoms in MBSR participants. [ABSTRACT FROM AUTHOR]

Assessing program or intervention fidelity/integrity is an important methodological consideration in clinical and educational research. These critical variables influence the degree to which outcomes can be attributed to the program and the success of the transition from research to practice and back again. Research in the Mindfulness-Based Program (MBP) field has been expanding rapidly over the last 20 years, but little attention has been given to how to assess intervention integrity within research and practice settings. The proliferation of different program forms, inconsistency in adhering to published curriculum guides, and variability of training levels and competency of trial teachers all pose grave risks to the sustainable development of the science of MBPs going forward. Three tools for assessing intervention integrity in the MBP field have been developed and researched to assess adherence and/or teaching competence: the Mindfulness-Based Cognitive Therapy-Adherence Scale (MBCT-AS), the Mindfulness-Based Relapse Prevention-Adherence and Competence Scale (MBRP-AC), and the Mindfulness-Based Interventions: Teaching Assessment Criteria (MBI:TAC). Further research is needed on these tools to better define their inter-rater reliability and their ability to measure elements of teaching competence that are important for participant outcomes. Research going forward needs to include systematic and consistent methods for demonstrating and verifying that the MBP was delivered as intended, both to ensure the rigor of individual studies and to enable different studies of the same MBP to be fairly and validly compared with each other. The critical variable of the teaching also needs direct investigation in future research. We recommend the use of the "Template for Intervention Description and Replication" (TIDieR) guidelines for addressing and reporting on intervention integrity during the various phases of the conduct of research and provide specific suggestions about how to implement these guidelines when reporting studies of mindfulness-based programs.

Background: The assessment of intervention integrity is essential in psychotherapeutic intervention outcome research and psychotherapist training. There has been little attention given to it in mindfulness-based interventions research, training programs, and practice. Aims: To address this, the Mindfulness-Based Interventions: Teaching Assessment Criteria (MBI:TAC) was developed. This article describes the MBI:TAC and its development and presents initial data on reliability and validity. Method: Sixteen assessors from three centers evaluated teaching integrity of 43 teachers using the MBI:TAC. Results: Internal consistency (a = 0.94) and interrater reliability (overall intraclass correlation coefficient = 0.81; range = 0.60-0.81) were high. Face and content validity were established through the MBI:TAC development process. Data on construct validity were acceptable. Conclusions: Initial data indicate that the MBI:TAC is a reliable and valid tool. It can be used in Mindfulness-Based Stress Reduction/Mindfulness-Based Cognitive Therapy outcome evaluation research, training and pragmatic practice settings, and in research to assess the impact of teaching integrity on participant outcome.

Growing interest in mindfulness-based programs (MBPs) has resulted in increased demand for MBP teachers, raising questions around safeguarding teaching standards. Training literature emphasises the need for appropriate training and meditation experience, yet studies into impact of such variables on participant outcomes are scarce, requiring further investigation. This feasibility pilot study hypothesised that participant outcomes would relate to teachers' mindfulness-based teacher training levels and mindfulness-based teaching and meditation experience. Teachers ( n  = 9) with different MBP training levels delivering mindfulness-based stress reduction (MBSR) courses to the general public were recruited together with their course participants ( n  = 31). A teacher survey collected data on their mindfulness-based teacher training, other professional training and relevant experience. Longitudinal evaluations using online questionnaires measured participant mindfulness and well-being before and after MBSR and participant course satisfaction. Course attendees' gains after the MBSR courses were correlated with teacher training and experience. Gains in well-being and reductions in perceived stress were significantly larger for the participant cohort taught by teachers who had completed an additional year of mindfulness-based teacher training and assessment. No correlation was found between course participants' outcomes and their teacher's mindfulness-based teaching and meditation experience. Our results support the hypothesis that higher mindfulness-based teacher training levels are possibly linked to more positive participant outcomes, with implications for training in MBPs. These initial findings highlight the need for further research on mindfulness-based teacher training and course participant outcomes with larger participant samples., Competing Interests: Compliance with Ethical StandardsThe research study was approved by the ethics committee of the university where the participating postgraduate program is located, prior to participant recruitment. Rebecca Crane is a non-salaried director of a not-for-profit business providing mindfulness services and directs the centre within which the postgraduate program under investigation in this study is located.All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments.Informed consent was obtained from all individual participants included in the study.