Search

Coordinated Specialty Care (CSC) is an evidence-based model for early intervention of first episode psychosis (FEP). Monitoring fidelity to CSC models is essential for proper evaluation of program outcomes and quality improvement. To address variability across CSC programs and fidelity assessment-associated burden, an adapted fidelity scale was developed and implemented statewide in Pennsylvania. This report describes the design and preliminary performance of the adapted scale. The Pennsylvania FEP Fidelity Scale (PA-FEP-FS) assesses adherence to the CSC model by focusing on essential model components of other established fidelity scales, in tandem with program evaluation data. Initial data from fourteen PA-FEP sites from 2018 to 2021 were examined as preliminary validation. Assessment-associated burdens and costs were also estimated. PA-FEP-FS captured essential components of CSC models and proved feasible for implementation across varying program structures, while minimizing burden and cost. Programs utilized annual feedback as CSC benchmarks, evidenced by increased scores over time. PA-FEP-FS provides a model for adapting CSC fidelity scales to meet state- or local-level requirements while reducing assessment burdens and costs that may be associated with existing scales. [ABSTRACT FROM AUTHOR]

Family involvement is part of the evidence-based treatment for persons with psychotic disorders, yet is under-implemented despite guideline recommendations. This study assessed whether an implementation support programme increased the adherence to guidelines on family involvement, compared to guideline/manual only. In a cluster randomised design, community mental health centre units in South-East Norway went through stratified allocation to the experimental (n = 7) or control (n = 7) arm. Experimental clusters received an implementation support programme including clinical training and supervision, appointing a family coordinator and an implementation team, a toolkit, and fidelity measurements at baseline, 12, 18, and 24 months with on-site feedback and supervision. Control clusters received no such support and had fidelity measurements at baseline and 24 months without feedback. During fidelity measurements, adherence to the guidelines was measured with the basic family involvement and support scale, the general organizational index, and the family psychoeducation fidelity scale, the latter being the primary outcome. The scales consist of 12–14 items rated from 1 to 5. Data was analysed with an independent samples t-test, linear mixed models, and a tobit regression model. At 24 months, the mean scores were 4.00 or higher on all scales in the experimental arm, and the increase in adherence to the guidelines was significantly greater than in the control arm with p-values < 0.001. Large-scale implementation of guidelines on family involvement for persons with psychotic disorders in community mental health centres may be accomplished, with substantial implementation support. Trial Registration: ClinicalTrials.gov Identifier NCT03869177. Registered 11.03.19. [ABSTRACT FROM AUTHOR]

Abstract Background Family involvement for persons with psychotic disorders is supported by scientific evidence, as well as legal and ethical considerations, and recommended in clinical practice guidelines. This article reports a cross-sectional measurement of the level of implementation of such guidelines in fifteen community mental health centre units in Norway, and presents a novel fidelity scale to measure basic family involvement and support. The aim was to investigate current family involvement practices comprehensively, as a basis for targeted quality improvement. Methods We employed three fidelity scales, with 12–14 items, to measure family involvement practices. Items were scored from 1 to 5, where 1 equals no implementation and 5 equals full implementation. Data was analysed using descriptive statistics, a non-parametric test, and calculation of interrater reliability for the scales. Results The mean score was 2.33 on the fidelity scale measuring basic family involvement and support. Among patients with psychotic disorders, only 4% had received family psychoeducation. On the family psychoeducation fidelity assessment scale, measuring practice and content, the mean score was 2.78. Among the eight units who offered family psychoeducation, it was 4.34. On the general organizational index scale, measuring the organisation and implementation of family psychoeducation, the mean score was 1.78. Among the units who offered family psychoeducation, it was 2.46. As a measure of interrater reliability, the intra-class correlation coefficient was 0.99 for the basic family involvement and support scale, 0.93 for the family psychoeducation fidelity assessment scale and 0.96 for the general organizational index scale. Conclusions The implementation level of the national guidelines on family involvement for persons with psychotic disorders was generally poor. The quality of family psychoeducation was high, but few patients had received this evidence-based treatment. Our novel fidelity scale shows promising psychometric properties and may prove a useful tool to improve the quality of health services. There is a need to increase the implementation of family involvement practices in Norway, to reach a larger percentage of patients and relatives. Trial registration ClinicalTrials.gov Identifier NCT03869177 . Registered 11.03.19.

Abstract Background Crisis resolution teams (CRTs) are specialized multidisciplinary teams intended to provide assessment and short-term outpatient or home treatment as an alternative to hospital admission for people experiencing a mental health crisis. In Norway, CRTs have been established within mental health services throughout the country, but their fidelity to an evidence-based model for CRTs has been unknown. Methods We assessed fidelity to the evidence-based CRT model for 28 CRTs, using the CORE Crisis Resolution Team Fidelity Scale Version 2, a tool developed and first applied in the UK to measure adherence to a model of optimal CRT practice. The assessments were completed by evaluation teams based on written information, interviews, and review of patient records during a one-day visit with each CRT. Results The fidelity scale was applicable for assessing fidelity of Norwegian CRTs to the CRT model. On a scale 1 to 5, the mean fidelity score was low (2.75) and with a moderate variation of fidelity across the teams. The CRTs had highest scores on the content and delivery of care subscale, and lowest on the location and timing of care subscale. Scores were high on items measuring comprehensive assessment, psychological interventions, visit length, service users’ choice of location, and of type of support. However, scores were low on opening hours, gatekeeping acute psychiatric beds, facilitating early hospital discharge, intensity of contact, providing medication, and providing practical support. Conclusions The CORE CRT Fidelity Scale was applicable and relevant to assessment of Norwegian CRTs and may be used to guide further development in clinical practice and research. Lower fidelity and differences in fidelity patterns compared to the UK teams may indicate that Norwegian teams are more focused on early interventions to a broader patient group and less on avoiding acute inpatient admissions for patients with severe mental illness.

Purpose: Service providers need effective strategies to implement evidence-based practices (EBPs) with high fidelity. This study aimed to evaluate an intensive implementation support strategy to increase fidelity to EBP standards in treatment of patients with psychosis. Methods: The study used a cluster randomized design with pairwise assignment of practices within each of 39 Norwegian mental health clinics. Each site chose two of four practices for implementation: physical health care, antipsychotic medication management, family psychoeducation, illness management and recovery. One practice was assigned to the experimental condition (toolkits, clinical training, implementation facilitation, data-based feedback) and the other to the control condition (manual only). The outcome measure was fidelity to the EBP, measured at baseline and after 6, 12, and 18 months, analyzed using linear mixed models and effect sizes. Results: The increase in fidelity scores (within a range 1–5) from baseline to 18 months was significantly greater for experimental sites than for control sites for the combined four practices, with mean difference in change of 0.86 with 95% CI (0.21; 1.50), p = 0.009). Effect sizes for increase in group difference of mean fidelity scores were 2.24 for illness management and recovery, 0.68 for physical health care, 0.71 for antipsychotic medication management, and 0.27 for family psychoeducation. Most improvements occurred during the first 12 months. Conclusions: Intensive implementation strategies (toolkits, clinical training, implementation facilitation, data-based feedback) over 12 months can facilitate the implementation of EBPs for psychosis treatment. The approach may be more effective for some practices than for others. [ABSTRACT FROM AUTHOR]

Customized employment (CE) shows promise as a strategy that can assist job seekers with significant disabilities obtain employment in community settings. However, the extant research has not sufficiently established, with research control, what CE practices are correlated to improved outcomes. Recent calls for more rigorous standards to determine the efficacy of rehabilitation practices should compel researchers to systematically outline what customized job development practices are effective. Developing an objective fidelity measure is one way to understand what structures and processes lead to high quality, customized jobs. This study was designed to be the first step to validate a fidelity scale for customized job development. A three-round, modified Delphi was used to determine and build consensus among CE experts regarding 52 customized job development fidelity descriptors developed by Hall and Keeton (2019). Each fidelity descriptor represented either an unacceptable, acceptable, good, or exemplary practice that was anchored to one of five systems and one of eight services customized job development tenets. The Delphi process helped confirm the value of each JDFS fidelity descriptor and results are discussed in regards to the importance of continued validation of the fidelity scale.. [ABSTRACT FROM AUTHOR]

Background: Family involvement for persons with psychotic disorders is supported by scientific evidence, as well as legal and ethical considerations, and recommended in clinical practice guidelines. This article reports a cross-sectional measurement of the level of implementation of such guidelines in fifteen community mental health centre units in Norway, and presents a novel fidelity scale to measure basic family involvement and support. The aim was to investigate current family involvement practices comprehensively, as a basis for targeted quality improvement. Methods: We employed three fidelity scales, with 12–14 items, to measure family involvement practices. Items were scored from 1 to 5, where 1 equals no implementation and 5 equals full implementation. Data was analysed using descriptive statistics, a non-parametric test, and calculation of interrater reliability for the scales. Results: The mean score was 2.33 on the fidelity scale measuring basic family involvement and support. Among patients with psychotic disorders, only 4% had received family psychoeducation. On the family psychoeducation fidelity assessment scale, measuring practice and content, the mean score was 2.78. Among the eight units who offered family psychoeducation, it was 4.34. On the general organizational index scale, measuring the organisation and implementation of family psychoeducation, the mean score was 1.78. Among the units who offered family psychoeducation, it was 2.46. As a measure of interrater reliability, the intra-class correlation coefficient was 0.99 for the basic family involvement and support scale, 0.93 for the family psychoeducation fidelity assessment scale and 0.96 for the general organizational index scale. Conclusions: The implementation level of the national guidelines on family involvement for persons with psychotic disorders was generally poor. The quality of family psychoeducation was high, but few patients had received this evidence-based treatment. Our novel fidelity scale shows promising psychometric properties and may prove a useful tool to improve the quality of health services. There is a need to increase the implementation of family involvement practices in Norway, to reach a larger percentage of patients and relatives. Trial registration: ClinicalTrials.gov Identifier NCT03869177. Registered 11.03.19. [ABSTRACT FROM AUTHOR]

Background: Crisis resolution teams (CRTs) are specialized multidisciplinary teams intended to provide assessment and short-term outpatient or home treatment as an alternative to hospital admission for people experiencing a mental health crisis. In Norway, CRTs have been established within mental health services throughout the country, but their fidelity to an evidence-based model for CRTs has been unknown. Methods: We assessed fidelity to the evidence-based CRT model for 28 CRTs, using the CORE Crisis Resolution Team Fidelity Scale Version 2, a tool developed and first applied in the UK to measure adherence to a model of optimal CRT practice. The assessments were completed by evaluation teams based on written information, interviews, and review of patient records during a one-day visit with each CRT. Results: The fidelity scale was applicable for assessing fidelity of Norwegian CRTs to the CRT model. On a scale 1 to 5, the mean fidelity score was low (2.75) and with a moderate variation of fidelity across the teams. The CRTs had highest scores on the content and delivery of care subscale, and lowest on the location and timing of care subscale. Scores were high on items measuring comprehensive assessment, psychological interventions, visit length, service users' choice of location, and of type of support. However, scores were low on opening hours, gatekeeping acute psychiatric beds, facilitating early hospital discharge, intensity of contact, providing medication, and providing practical support. Conclusions: The CORE CRT Fidelity Scale was applicable and relevant to assessment of Norwegian CRTs and may be used to guide further development in clinical practice and research. Lower fidelity and differences in fidelity patterns compared to the UK teams may indicate that Norwegian teams are more focused on early interventions to a broader patient group and less on avoiding acute inpatient admissions for patients with severe mental illness. [ABSTRACT FROM AUTHOR]

Mental health programs need an instrument to monitor adherence to evidence-based physical health care for people with serious mental illness. The paper describes the Physical Health Care Fidelity Scale and study interrater reliability, frequency distribution, sensitivity to change and feasibility. Four fidelity assessments were conducted over 18 months at 13 sites randomized to implementation support for evidence-based physical health care. We found good to excellent interrater reliability, adequate sensitivity for change, good feasibility and wide variability in fidelity across sites after 18 months of implementation. Programs were more successful in establishing Policies stating physical health care standards than in implementing these Policies. The Physical Health Care Fidelity Scale measures and guides implementation of evidence-based physical health care reliably. Trial registration: ClinicalTrials.gov Identifier: NCT03271242 [ABSTRACT FROM AUTHOR]

The paper describes the Antipsychotic Medication Management Fidelity Scale and its psychometric properties, including interrater reliability, frequency distribution, sensitivity to change and feasibility. Fidelity assessors conducted fidelity reviews four times over 18 months at eight sites receiving implementation support for evidence-based antipsychotic medication management. Data analyses shows good to fair interrater reliability, adequate sensitivity to change over time and good feasibility. At 18 months, item ratings varied from poor to full fidelity on most items. Use of the scale can assess fidelity to evidence-based guidelines for antipsychotic medication management and guide efforts to improve practice. Further research should improve and better calibrate some items, and improve the procedures for access to information. Trial registration: ClinicalTrials.gov Identifier: NCT03271242. [ABSTRACT FROM AUTHOR]

Individual Placement and Support (IPS) is a highly effective model of employment support for individuals with severe mental health conditions. Its potential modification for new settings and larger cohorts is of keen interest across advanced economies given shared health-related (un)employment challenges. Despite mushrooming policy interest and activity around modified IPS a significant barrier and risk at present is the absence of a well-considered analytical framework to enable structured critical reflection about the effective translation of IPS principles and fidelity into modified IPS services. This article fills this void through the presentation for the first time in the literature of such an analytical framework, unpacking as it does so a set of key original analytical distinctions that are unhelpfully homogenised in current literature and policy thinking and highlighting the wider potential of IPS principles and models to the nature of good employment support for other individuals with health conditions and disabilities. [ABSTRACT FROM AUTHOR]

Background: The efficacy of the Specialized Early Intervention (SEI) treatment in Denmark, the OPUS treatment, has in a randomized clinical trial proved to be very effective compared to treatment as usual, and the dissemination of SEI services is increasing in Denmark. A prerequisite for upholding positive effects along with creating new teams and preserving critical components is to ensure fidelity to the model. Currently there is no Danish fidelity scale for SEI services. Aim: To establish a fidelity scale for SEI teams, in a brief and easily manageable form, for the use of evaluating and assessing the critical components in Danish SEI services. Method: We identified essential evidence‐based components of SEI services internationally and interviewed experts from five Danish SEI teams, using an adapted version of the Delphi Consensus method. Results: An 18‐point fidelity scale was constructed. The scale was divided into two dimensions: one relating to the structure of the SEI team and one relating to the character and content of the SEI treatment. Each component can be rated either 1 or 0 (1 point = fulfilling the requirements for the components; and 0 point = the requirements were not met). The maximum score was a total of 18 points with 5 of the components being mandatory. Conclusion: The development of the fidelity scale is an important tool for securing the quality of SEI treatment in Denmark. [ABSTRACT FROM AUTHOR]

This study aims to validate the HIC monitor as a model-fidelity scale to the High and Intensive Care (HIC) model, a recently developed model for acute psychiatric wards. To assess the psychometric properties of the HIC monitor, 37 audits were held on closed inpatient wards at 20 psychiatric hospitals in the Netherlands. Interrater reliability, construct validity and content validity were examined. Our results suggest that the HIC monitor has good psychometric properties. It can be used as a tool for assessing the implementation of the HIC model on acute psychiatric wards in the Netherlands, and for quality assessment and improvement. [ABSTRACT FROM AUTHOR]

The Individual Placement and Support (IPS) model of supported employment is an evidence based practice. Although several agencies have been trying to implement the IPS-model since 2005 in Japan, there was no tool to assess the quality. This study developed a Japanese version of the 25-item Individualized Supported Employment Fidelity Scale (J-ISEF), a new Japanese fidelity tool for supported employment based on the IPS model. A working group consisting of researchers and practitioners was formed to develop J-ISEF based on IPS-25. Some experts of the group visited the community agencies in Vermont before the development process. Twenty-six eligible agencies were identified using snowball sampling, and 14 agencies of them agreed and participated at T1. We conducted three cross-sectional surveys (T1, T2 and T3), using the new scale. The first evaluation period (T1) was between September 2013 and February 2014, the second (T2) between September 2014 and February 2015, and the third (T3) between October 2015 and February 2016. High inter-rater reliability (ICC = 0.98 for the entire scale) was confirmed from T1 data. The total score and the service subscale total were positively correlated with employment rate (P < 0.05). A new fidelity scale, J-ISEF, is developed as a quality assessment tool for evidence-based supported employment programs in Japan. The evidence for its inter-rater reliability and criterion-related validity is promising. [ABSTRACT FROM AUTHOR]

Shared decision making has become a central tenet of recovery-oriented, person-centered mental health care, yet the practice is not always transferred to the routine psychiatric visit. Supporting the practice at the system level, beyond the interactions of consumers and medication prescribers, is needed for successful adoption of shared decision making. CommonGround is a systemic approach, intended to be part of a larger integration of shared decision-making tools and practices at the system level. The authors discuss the organizational components that CommonGround uses to facilitate shared decision making, and we present a fidelity scale to assess how well the system is being implemented. [ABSTRACT FROM AUTHOR]

Psychometric properties of the Dual-Disorder Treatment Fidelity Scale (Mueser et al. Integrated treatment for dual disorders: A guide to effective practice, 2003) were evaluated. Reliability was assessed through measures of inter-rater agreement, and validity was assessed through a concurrent known groups validation procedure. Two raters assessed three community mental health center (CMHC) and three specialized dual diagnosis (DDE) programs for fidelity; inter-rater agreement was good. Total fidelity scores did not distinguish between CMHC and DDE program types; however, a cluster analysis revealed concurrent validity based on the item level ratings. Conclusions drawn from item level ratings appear valid; the validity of conclusions based on total scores remains unsupported. [ABSTRACT FROM AUTHOR]

The Recovery Promotion Fidelity Scale (RPFS) was developed to evaluate the extent to which public mental health agencies in Hawai’i incorporate recovery principles into their services and operations. The project progressed through two phases using concept mapping and expert review methods to generate scale items and identify dimensions of recovery that were used as scale domains. The resultant measure consists of 12 items organized around five recovery domains. This paper describes the development of the RPFS, illustrating how public mental health stakeholders, particularly persons in recovery, can be involved in efforts toward making a system of care more recovery oriented. [ABSTRACT FROM AUTHOR]

Objective: This study examined the adoption of the principles of assertive community treatment (ACT) by case management teams for severely mentally ill adults in the Netherlands. Methods: Using an email-survey, we obtained information from 39 program leaders who completed a 25-item checklist assessing adoption of the ACT principles. Respondents also indicated their intention to become a high-fidelity ACT program user. Results: Sixteen (41%) program leaders indicated their intention to implement ACT with at least moderate fidelity. Intention to implement ACT was associated with location in an urban area and caseloads with high rates of homelessness. Conclusions: Dissemination of ACT seems to be in an early stage in the Netherlands. Ongoing training, consultation, and research are necessary to stimulate the implementation of ACT in the Netherlands. Declaration of interest: This survey was carried out for the benefit of the second National Assertive Community Treatment conference in Rotterdam, The Netherlands. There were no grants involved. [ABSTRACT FROM AUTHOR]

Objective: To compare fidelity of implementation of supported employment in different types of provider organizations. Methods: Using opportunity sampling, a multi-state survey yielded a sample of 106 supported employment programs, including 33 located in community mental health centers (CMHCs), 18 located in psychosocial rehabilitation centers, 31 located in comprehensive rehabilitation centers, and 24 housed in other social service agencies. Program directors completed a telephone interview on the Quality of Supported Employment Implementation Scale (QSEIS), a 33-item supported employment fidelity scale. Results: CMHC-based programs rated significantly higher on fidelity than programs housed in psychosocial rehabilitation or comprehensive rehabilitation centers. Integration with mental health treatment was the key factor differentiating the types of provider organizations. Conclusions: Type of provider organization is an important factor in facilitating implementation of evidence-based principles of supported employment. [ABSTRACT FROM AUTHOR]