Search

BACKGROUND: The Diabetes Prevention Program (DPP) has been translated into digital formats. We report an economic evaluation of a digital DPP implemented in a large, integrated health care system. METHODS: Patients (n = 4148) were invited to participate in digital DPP based on clinical characteristics (HbA1c 5.7%-6.4% and body mass index = 30 kg/m2) assessed using electronic medical record data. Using a propensity score we matched (1:1) enrolled and not enrolled patients for a total of 784. We identified high-risk patients (ie, above the 50th percentile of risk; n = 202) by calculating each patient's 2-year of developing diabetes. We report the cost of the intervention and the costs of medical care over 12- and 24-month follow-up, and the incremental cost-effectiveness ratio as the cost per additional kilogram weight loss at 24 months. RESULTS: At 12 months, enrolled patients had lower total costs ($6,926, 95% CI $5,681-$8,171) than not enrolled patients ($7,538, 95% CI $6,293-$8,783). This pattern attenuated slightly at 24 months (enrolled = $16,255, 95% CI $14,097-$18,412; not enrolled = $16,688, 95% CI $14,531-$18,846). We found an incremental cost-effectiveness ratio of $81.92 per additional kilogram weight loss. For high-risk patients, the digital DPP group had, on average, lower costs and greater weight loss. We found a 55% chance of the digital DPP program being cost-effective at a willingness-to-pay of $150 per additional kilogram of weight loss; at the same willingness-to-pay, there is a 60% chance in the high-risk subgroup. Limitations include the nonrandomized design and potential volunteer bias. CONCLUSION: Digital DPP had a favorable cost-effectiveness profile compared to other lifestyle interventions. [ABSTRACT FROM AUTHOR]

The purpose of this natural experiment study was to assess the effectiveness of a 12-month digital Diabetes Prevention Program (DPP) for adults aged 65–75 years with prediabetes and obesity within a large, integrated health care system. Adjusting for propensity scores and covariates, patients who enrolled and participated in the digital DPP had a mean weight loss of 8.6 lb over 12 months and 5.7 lb by 24 months, compared with a steady, minimal weight loss of 1.3 lb over 12 months and 2.8 lb by 24 months among patients not enrolled. There was a significant difference in mean change in A1C between enrolled and nonenrolled patients over 12 months (−0.10%), but not by 24 months (−0.06%). Digital DPP appears to be an effective weight loss option and potential diabetes prevention intervention for older adults at high risk for type 2 diabetes. [ABSTRACT FROM AUTHOR]

Background: Chronic pain is common, disabling, and costly. Few clinical trials have examined cognitive behavioral therapy (CBT) interventions embedded in primary care settings to improve chronic pain among those receiving long-term opioid therapy.Objective: To determine the effectiveness of a group-based CBT intervention for chronic pain.Design: Pragmatic, cluster randomized controlled trial. (ClinicalTrials.gov: NCT02113592).Setting: Kaiser Permanente health care systems in Georgia, Hawaii, and the Northwest.Participants: Adults (aged ≥18 years) with mixed chronic pain conditions receiving long-term opioid therapy.Intervention: A CBT intervention teaching pain self-management skills in 12 weekly, 90-minute groups delivered by an interdisciplinary team (behaviorist, nurse, physical therapist, and pharmacist) versus usual care.Measurements: Self-reported pain impact (primary outcome, as measured by the PEGS scale [pain intensity and interference with enjoyment of life, general activity, and sleep]) was assessed quarterly over 12 months. Pain-related disability, satisfaction with care, and opioid and benzodiazepine use based on electronic health care data were secondary outcomes.Results: A total of 850 patients participated, representing 106 clusters of primary care providers (mean age, 60.3 years; 67.4% women); 816 (96.0%) completed follow-up assessments. Intervention patients sustained larger reductions on all self-reported outcomes from baseline to 12-month follow-up; the change in PEGS score was -0.434 point (95% CI, -0.690 to -0.178 point) for pain impact, and the change in pain-related disability was -0.060 point (CI, -0.084 to -0.035 point). At 6 months, intervention patients reported higher satisfaction with primary care (difference, 0.230 point [CI, 0.053 to 0.406 point]) and pain services (difference, 0.336 point [CI, 0.129 to 0.543 point]). Benzodiazepine use decreased more in the intervention group (absolute risk difference, -0.055 [CI, -0.099 to -0.011]), but opioid use did not differ significantly between groups.Limitation: The inclusion of only patients with insurance in large integrated health care systems limited generalizability, and the clinical effect of change in scores is unclear.Conclusion: Primary care-based CBT, using frontline clinicians, produced modest but sustained reductions in measures of pain and pain-related disability compared with usual care but did not reduce use of opioid medication.Primary Funding Source: National Institutes of Health. [ABSTRACT FROM AUTHOR]

Background: Health insurance plans are increasingly offering mailed fecal immunochemical test (FIT) programs for colorectal cancer (CRC) screening, but few studies have compared the outcomes of different program models (eg, invitation strategies). Methods: This study compares the outcomes of 2 health plan–based mailed FIT program models. In the first program (2016), FIT kits were mailed to all eligible enrollees; in the second program (2018), FIT kits were mailed only to enrollees who opted in after an outreach phone call. Participants in this observational study included dual‐eligible Medicaid/Medicare enrollees who were aged 50 to 75 years and were due for CRC screening (1799 in 2016 and 1906 in 2018). Six‐month FIT completion rates, implementation outcomes (eg, mailed FITs sent and reminders attempted), and program‐related health plan costs for each program are described. Results: All 1799 individuals in 2016 were sent an introductory letter and a FIT kit. In 2018, all 1906 were sent an introductory letter, and 1905 received at least 1 opt‐in call attempt, with 410 (21.5%) sent a FIT. The FIT completion rate was 16.2% (292 of 1799 [95% CI, 14.5%‐17.9%]) in 2016 and 14.6% (278 of 1906 [95% CI, 13.0%‐16.2%]) in 2018 (P =.36). The overall implementation costs were higher in 2016 ($40,156) than 2018 ($34,899), with the cost per completed FIT slightly higher in 2016 ($138) than 2018 ($126). Conclusions: An opt‐in mailed FIT program achieved FIT completion rates similar to those of a program mailing to all dual‐eligible Medicaid/Medicare enrollees. Lay Summary: Health insurance plans can use different program models to successfully mail fecal test kits for colorectal cancer screening to dual‐eligible Medicaid/Medicare enrollees, with nearly 1 in 6 enrollees completing fecal testing. In this study, a health insurance plan demonstrates its ability to deliver 2 different mailed fecal immunochemical test (FIT) program models, with vendors used to manage some program elements. These mailed FIT programs began to close gaps in colorectal cancer screening rates in the health plan's dual‐eligible Medicaid/Medicare population. [ABSTRACT FROM AUTHOR]

INTRODUCTION: Implementation of a Diabetes Prevention Program (DPP) in both in-person and digital health-care settings has been increasing. The purpose of this article is to describe the protocol of a mixed-methods, natural experiment study designed to evaluate the implementation of DPP in a large, integrated health system. METHODS: Kaiser Permanente Northwest patients who were 19 to 75 years with prediabetes (hemoglobin A1c or glycated hemoglobin, 5.7-6.4) and obesity (body mass index = 30 kg/m2) were invited, via the Kaiser Permanente Northwest patient portal, to participate in the digital (n = 4124) and in-person (n = 2669) DPP during 2016 through 2018. Primary (weight) and secondary (hemoglobin A1c or glycated hemoglobin level) outcome data will be obtained from electronic health records. A cost-effectiveness analysis as well as qualitative interviews with patients (enrolled and not enrolled in the DPP) and stakeholders will be conducted to examine further implementation, acceptability, and sustainability. CONCLUSION: The mixed-methods, natural experiment design we will use to evaluate Kaiser Permanente Northwest's implementation of the digital and in-person DPP builds on existing evidence related to the effectiveness of these two DPP delivery modes and will contribute new knowledge related to best practices for implementing and sustaining the DPP within large health systems over the long term. [ABSTRACT FROM AUTHOR]

Background: Colorectal cancer screening uptake is low, particularly among individuals enrolled in Medicaid. To the authors' knowledge, little is known regarding the effectiveness of direct-to-member outreach by Medicaid health insurance plans to raise colorectal cancer screening use, nor how best to deliver such outreach.Methods: BeneFIT is a hybrid implementation-effectiveness study of 2 program models that health plans developed for a mailed fecal immunochemical test (FIT) intervention. The programs differed with regard to whether they used a centralized approach (Health Plan Washington) or collaborated with health centers (Health Plan Oregon). The primary implementation outcome of the current study was the percentage of eligible enrollees to whom the plans delivered each intervention component. The primary effectiveness outcome was the rate of FIT completion within 6 months of mailing of the introductory letter.Results: The health plans identified 12,000 eligible enrollees (8551 in Health Plan Washington and 3449 in Health Plan Oregon). Health Plan Washington mailed an introductory letter and FIT kit to 8551 enrollees (100%) and delivered a reminder call to 839 (10.3% of the 8132 attempted). Health Plan Oregon mailed an introductory letter, and a letter and FIT kit plus a reminder postcard to 2812 enrollees (81.5%) and 2650 enrollees (76.8%), respectively. FIT completion rates were 18.2% (1557 of 8551 enrollees) in Health Plan Washington. In Health Plan Oregon, completion rates were 17.4% (488 of 2812 enrollees) among enrollees who were mailed an introductory letter and 18.3% (484 of 2650 enrollees) among enrollees who also were mailed a FIT kit plus reminder postcard.Conclusions: The implementation of mailed FIT outreach by health plans may be effective and could reach many individuals at risk of developing colorectal cancer. [ABSTRACT FROM AUTHOR]

Background: Colorectal cancer (CRC) screening rates remain suboptimal, particularly in low-income and underserved populations. Mailed fecal immunochemical testing (FIT) may overcome common barriers to screening; however, the effect of mailed FIT kits may differ across important subpopulations. The goal of the current study was to examine sociodemographic and health-related factors that moderate the effect of an intervention of automated direct mail of FIT kits at health clinics serving low-income populations.Methods: This study is a secondary analysis of the Strategies and Opportunities to Stop Colon Cancer in Priority Populations (STOP CRC) study, a cluster-randomized pragmatic trial to increase uptake of CRC screening in patients seen at federally qualified health centers. The intervention involved tools embedded in the electronic medical records to enable participating clinics to mail FIT kits and related materials to eligible participants. We examined the rate of FIT completion by potential moderating characteristics using electronic health record data supplemented by the American Community Survey and the Centers for Medicare & Medicaid Services Geographic Variation datasets, linked via geocoding to patients' addresses. All patients aged 50-75 seen in participating health clinics who were eligible for CRC screening were included.Results: Although not always statistically significant, we saw a consistent pattern of increased FIT return rates among intervention participants compared to control participants across all subgroups studied, with incidence rate ratios (IRRs) generally ranging from 1.25 to 1.50. FIT completion in the intervention group ranged from 15 and 20% across subpopulations, typically three to six percentage points higher than the control group participants. The only moderator with a statistically significant interaction was race: persons of Asian descent showed a twofold response to the intervention (adjusted incidence rate ratio [aIRR] = 2.06, 95% confidence interval 1.41 to 3.00).Conclusions: Response to a mailed FIT intervention was generally consistent across a wide range of individual and neighborhood-level patient characteristics, including typically underserved patients and those in low-resource communities.Trial Registration: ClinicalTrials.gov, NCT01742065. Registered on 5 December 2012. [ABSTRACT FROM AUTHOR]

Chronic obstructive pulmonary disease (COPD) is characterized by airflow obstruction and often co-exists with cardiovascular disease (CVD), hypertension and diabetes. This international study assessed the association between airflow obstruction and these comorbidities. 23,623 participants (47.5% males, 19.0% current smokers, age: 55.1 ± 10.8 years) in 33 centers in the Burden of Obstructive Lung Disease (BOLD) initiative were included. 10.4% of subjects had airflow obstruction. Self-reports of physician-diagnosed CVD (heart disease or stroke), hypertension and diabetes were regressed against airflow obstruction (post-bronchodilator FEV1/FVC < 5th percentile of reference values), adjusting for age, sex, smoking (including pack-years), body mass index and education. Analyses were undertaken within center and meta-analyzed across centers checking heterogeneity using the I2-statistic. Crude odds ratios for the association with airflow obstruction were 1.42 (95% CI: 1.20–1.69) for CVD, 1.24 (1.02–1.51) for hypertension, and 0.93 (0.76–1.15) for diabetes. After adjustment these were 1.00 (0.86–1.16) (I2:6%) for CVD, 1.14 (0.99–1.31) (I2:53%) for hypertension, and 0.76 (0.64–0.89) (I2:1%) for diabetes with similar results for men and women, smokers and nonsmokers, in richer and poorer centers. Alternatively defining airflow obstruction by FEV1/FVC < 2.5th percentile or 0.70, did not yield significant other results. In conclusion, the associations of CVD and hypertension with airflow obstruction in the general population are largely explained by age and smoking habits. The adjusted risk for diabetes is lower in subjects with airflow obstruction. These findings emphasize the role of common risk factors in explaining the coexistence of cardio-metabolic comorbidities and COPD. [ABSTRACT FROM AUTHOR]

Abstract: Annual fecal immunochemical testing (FIT) is cost‐effective for colorectal cancer (CRC) screening. However, FIT positivity rates and positive predictive value (PPV) can vary substantially, with false‐positive (FP) results adding to colonoscopy burden without improving cancer detection. Our objective was to describe FIT PPV and the factors associated with FP results among patients undergoing CRC screening. In an ongoing pragmatic clinical trial of mailed‐FIT outreach, clinics delivered one of three FIT brands (InSure, OC‐Micro, and Hemosure). Patients who had a positive FIT result and a follow‐up colonoscopy were included in this analysis (N = 1130). Patients’ demographic and medical histories were abstracted from electronic health records (EHR). Associations with a FP result (ie, a positive FIT result with no evidence of advanced neoplasia during follow‐up colonoscopy) were evaluated for FIT brand and patient factors using mixed‐effects multivariable logistic regression. The mean proportion of FIT‐positive results ranged from 8% in centers using the OC‐Micro test to 21% for Hemosure. PPVs for advanced neoplasia were 0.30 to 0.17, respectively (P for χ2 = 0.08). In multivariable‐adjusted models, use of Hemosure was associated with greater odds of a FP result than OC‐Micro (OR = 2.00, 95% CI: 0.47‐8.56) or InSure (OR = 1.72, 95% CI: 0.44‐6.68). However, only female sex (OR = 1.58, 95% CI: 1.19‐2.10) and history of a colorectal condition (OR = 2.17, 95% CI: 1.13‐4.15) were significantly associated with FP. In conclusion, FIT positivity varied by brand, and FP results differed by patient factors available through the EHR. These results can be used to minimize the frequency of FP results, reducing patient distress and colonoscopy burden. [ABSTRACT FROM AUTHOR]

Objective: To examine changes in children's albuterol use and out-of-pocket (OOP) costs in response to increased copayments after the Food and Drug Administration banned inhalers with chlorofluorocarbon (CFC) propellants.Setting: Four health maintenance organizations (HMOs), two that increased copayments for albuterol inhalers that went from generic CFC-containing to branded CFC-free versions, and two that retained generic copayments for CFC-free inhalers (controls). We included children with asthma aged 4-17 years with commercial coverage from 2007 to 2010.Design: Interrupted time series with comparison series.Data: We obtained enrollee and plan characteristics from enrollment files, and utilization data from pharmacy and medical claims; OOP expenditures were extracted from pharmacy claims for two HMOs with cost data available.Findings: There were no significant differences in albuterol use between the group with increased cost-sharing and controls with respect to changes after the policy change. There was a postpolicy increase of $6.11 OOP per month per child using albuterol among those with increased cost-sharing versus $0.36 in controls; the difference between groups was significant (p < .01).Conclusions: Increased copayments for brand-name CFC-free albuterol after the CFC ban did not lead to a decrease in children's albuterol use, but it led to a modest increase in OOP costs. [ABSTRACT FROM AUTHOR]

Context: Given the dramatic rise in the incidence of type 2 diabetes mellitus (T2DM) in recent decades, identifying individuals at increased risk of T2DM and validating methods to reduce their risk of disease progression is important. With more than one-third of US adults having prediabetes, a more precise stratification of absolute risk of T2DM incidence would help in prioritizing prevention efforts. Objective: To develop a simple and clinically useful schema to stratify short-term (2-year) absolute risk of T2DM. Design: Observational study of more than 77,000 adult members (age 18-75 years) from 3 Regions of the Kaiser Foundation Health Plan with prediabetes (hemoglobin A1C [HbA1C] = 5.7%-6.4%). Main Outcome Measures: The 2-year probability for development of diabetes as a function of baseline HbA1C and body mass index (BMI). Results: The 2-year risk of diabetes diagnosis varied widely by HbA1C and BMI. A small subset (5.2%) had a very high risk of T2DM developing within 2 years. Another 13.3% had a moderate 2-year risk of T2DM, whereas most (81.5%) of the population was at much lower risk. Thus, most Kaiser Foundation Health Plan members with prediabetes have only modest risk of progression to T2DM within 2 years. Conclusion: Using HbA1C and BMI, we created a simple stratification scheme to more precisely estimate risk of T2DM incidence. This will enable more efficient assignment of prevention interventions and clinical and laboratory follow-up to the small subset at highest risk, while minimizing the potentially negative effects of overdiagnosis among the majority with prediabetes who are not at high short-term risk of T2DM. [ABSTRACT FROM AUTHOR]

Background: The Community Preventive Services Task Force recommends multi-component interventions, including patient reminders, to improve uptake of colorectal cancer screening.Objective: We sought to compare the effectiveness of different forms of reminders for a direct-mail fecal immunochemical test (FIT) program.Design: Patient-randomized controlled trial.Participants: 2772 adults aged 50-75, not up to date with colorectal cancer screening recommendations, with a clinic visit in the previous year at any of four participating health center clinics.Intervention: Participants were mailed an introductory letter and FIT. Those who did not complete their FIT within 3 weeks were randomized to receive (1) a reminder letter, (2) two automated phone calls, (3) two text messages, (4) a live phone call, (5) a reminder letter and a live phone call, (6) two automated phone calls and a live phone call, or (7) two text messages and a live phone call. Patients with a patient portal account were sent two email reminders, but were not randomized.Main Measures: FIT return rates for each group, 6 months following randomization.Key Results: A total of 255 (10%) participants returned their FIT within 3 weeks of the mailing. Among randomized participants (n = 2010), an additional 25.5% returned their FITs after reminders were delivered (estimated overall return rate = 32.7%). In intention-to-treat analysis, compared to the group allocated to receive a reminder letter, return rates were higher for the group assigned to receive the live phone call (OR = 1.51 [1.03-2.21]) and lower for the group assigned to receive text messages (OR = 0.66 [0.43-0.99]). Reminder effectiveness differed by language preference.Conclusions: Our data suggest that FIT reminders that included a live call were more effective than reminders that relied solely on written communication (a text message or letter).Trial Registration: ClinicalTrials.gov/ctc2/show/NCT01742065 . [ABSTRACT FROM AUTHOR]

Group-randomized trials are randomized studies that allocate intact groups of individuals to different comparison arms. A frequent practical limitation to adopting such research designs is that only a limited number of groups may be available, and therefore, simple randomization is unable to adequately balance multiple group-level covariates between arms. Therefore, covariate-based constrained randomization was proposed as an allocation technique to achieve balance. Constrained randomization involves generating a large number of possible allocation schemes, calculating a balance score that assesses covariate imbalance, limiting the randomization space to a prespecified percentage of candidate allocations, and randomly selecting one scheme to implement. When the outcome is binary, a number of statistical issues arise regarding the potential advantages of such designs in making inference. In particular, properties found for continuous outcomes may not directly apply, and additional variations on statistical tests are available. Motivated by two recent trials, we conduct a series of Monte Carlo simulations to evaluate the statistical properties of model-based and randomization-based tests under both simple and constrained randomization designs, with varying degrees of analysis-based covariate adjustment. Our results indicate that constrained randomization improves the power of the linearization F-test, the KC-corrected GEE t-test (Kauermann and Carroll, 2001, Journal of the American Statistical Association 96, 1387-1396), and two permutation tests when the prognostic group-level variables are controlled for in the analysis and the size of randomization space is reasonably small. We also demonstrate that constrained randomization reduces power loss from redundant analysis-based adjustment for non-prognostic covariates. Design considerations such as the choice of the balance metric and the size of randomization space are discussed. [ABSTRACT FROM AUTHOR]

Current classifications of Chronic Obstructive Pulmonary Disease (COPD) severity are complex and do not grade levels of obstruction. Obstruction is a simpler construct and independent of ethnicity. We constructed an index of obstruction severity based on the FEV1/FVC ratio, with cut-points dividing the Burden of Obstructive Lung Disease (BOLD) study population into four similarly sized strata to those created by the GOLD criteria that uses FEV1. We measured the agreement between classifications and the validity of the FEV1-based classification in identifying the level of obstruction as defined by the new groupings. We compared the strengths of association of each classification with quality of life (QoL), MRC dyspnoea score and the self-reported exacerbation rate. Agreement between classifications was only fair. FEV1-based criteria for moderate COPD identified only 79% of those with moderate obstruction and misclassified half of the participants with mild obstruction as having more severe COPD. Both scales were equally strongly associated with QoL, exertional dyspnoea and respiratory exacerbations. Severity assessed using the FEV1/FVC ratio is only in moderate agreement with the severity assessed using FEV1but is equally strongly associated with other outcomes. Severity assessed using the FEV1/FVC ratio is likely to be independent of ethnicity. [ABSTRACT FROM PUBLISHER]

Background: Propensity scores are typically applied in retrospective cohort studies. We describe the feasibility of matching on a propensity score derived from a retrospective cohort and subsequently applied in a prospective cohort study of patients with chronic musculoskeletal pain before the start of acupuncture or usual care treatment and enrollment in a comparative effectiveness study that required patient reported pain outcomes.Methods: We assembled a retrospective cohort study using data from 2010 to develop a propensity score for acupuncture versus usual care based on electronic healthcare record and administrative data (e.g., pharmacy) from an integrated health plan, Kaiser Permanente Northwest. The propensity score's probabilities allowed us to match acupuncture-referred and non-referred patients prospectively in 2013-14 after a routine outpatient visit for pain. Among the matched patients, we collected patient-reported pain before treatment and during follow-up to assess the comparative effectiveness of acupuncture. We assessed balance in patient characteristics with the post-matching c-statistic and standardized differences.Results: Based on the propensity score and other characteristics (e.g., patient-reported pain), we were able to match all 173 acupuncture-referred patients to 350 non-referred (usual care) patients. We observed a residual imbalance (based on the standardized differences) for some characteristics that contributed to the score; for example, age, -0.283, and the Charlson comorbidity score, -0.264, had the largest standardized differences. The overall balance of the propensity score appeared more favorable according to the post-matching c-statistic, 0.503.Conclusion: The propensity score matching was feasible statistically and logistically and allowed approximate balance on patient characteristics, some of which will require adjustment in the comparative effectiveness regression model. By transporting propensity scores to new patients, healthcare systems with electronic health records can conduct comparative effectiveness cohort studies that require prospective data collection, such as patient-reported outcomes, while approximately balancing numerous patient characteristics that might confound the benefit of an intervention. The approach offers a new study design option. [ABSTRACT FROM AUTHOR]

Background: While electronic health records (EHRs) play a key role in increasing colorectal cancer (CRC) screening by identifying individuals who are overdue, important shortfalls remain.Objectives: As part of the Strategies and Opportunities to STOP Colon Cancer (STOP CRC) study, we assessed the accuracy of EHR codes in identifying patients eligible for CRC screening.Methods: We selected a stratified random sample of 800 study participants from 26 participating clinics, in the Pacific Northwest region of the USA. We compared data obtained through codes in the EHR to conduct a manual chart audit. A trained chart abstractor completed the abstraction of eligible and ineligible patients.Results: Of 520 individuals in need of CRC screening, identified via the EHR, 459 were confirmed through chart review (positive predictive value = 88%). Of 280 individuals flagged as up-to-date in their screening per EHR data, 269 were confirmed through chart review (negative predictive value = 96%). Among the 61 patients incorrectly classified as eligible, 83.6% of disagreements were due to evidence of a prior colonoscopy or referral that was not captured in recognizable fields in the EHR.Conclusions: Our findings highlight importance of better capture of past screening events in the EHR. While the need for better population-based data is not unique to CRC screening, it provides an important example of the use of population-based data not only for tracking care, but also for delivering interventions. [ABSTRACT FROM AUTHOR]

Background/aims: Pragmatic clinical trials embedded within health care systems provide an important opportunity to evaluate new interventions and treatments. Networks have recently been developed to support practical and efficient studies. Pragmatic trials will lead to improvements in how we deliver health care and promise to more rapidly translate research findings into practice. Methods: The National Institutes of Health (NIH) Health Care Systems Collaboratory was formed to conduct pragmatic clinical trials and to cultivate collaboration across research areas and disciplines to develop best practices for future studies. Through a two-stage grant process including a pilot phase (UH2) and a main trial phase (UH3), investigators across the Collaboratory had the opportunity to work together to improve all aspects of these trials before they were launched and to address new issues that arose during implementation. Seven Cores were created to address the various considerations, including Electronic Health Records; Phenotypes, Data Standards, and Data Quality; Biostatistics and Design Core; Patient-Reported Outcomes; Health Care Systems Interactions; Regulatory/Ethics; and Stakeholder Engagement. The goal of this article is to summarize the Biostatistics and Design Core’s lessons learned during the initial pilot phase with seven pragmatic clinical trials conducted between 2012 and 2014. Results: Methodological issues arose from the five cluster-randomized trials, also called group-randomized trials, including consideration of crossover and stepped wedge designs. We outlined general themes and challenges and proposed solutions from the pilot phase including topics such as study design, unit of randomization, sample size, and statistical analysis. Our findings are applicable to other pragmatic clinical trials conducted within health care systems. Conclusion: Pragmatic clinical trials using the UH2/UH3 funding mechanism provide an opportunity to ensure that all relevant design issues have been fully considered in order to reliably and efficiently evaluate new interventions and treatments. The integrity and generalizability of trial results can only be ensured if rigorous designs and appropriate analysis choices are an essential part of their research protocols. [ABSTRACT FROM AUTHOR]

Context: There is little research investigating whether health information technologies, such as interactive voice recognition, are effective ways to deliver information to individuals with lower health literacy.Objective: Determine the extent to which the impact of an interactive voice recognition-based intervention to improve medication adherence appeared to vary by participants’ health literacy level.Design: Promoting Adherence to Improve Effectiveness of Cardiovascular Disease Therapies (PATIENT) was a randomized clinical trial designed to test the impact, compared with usual care, of 2 technology-based interventions that leveraged interactive voice recognition to promote medication adherence. A 14% subset of participants was sent a survey that included questions on health literacy. This exploratory analysis was limited to the 833 individuals who responded to the survey and provided data on health literacy.Main Outcome Measures: Adherence to statins and/or angiotensin-converting enzyme inhibitors and/or angiotensin II receptor blockers.Results: Although intervention effects did not differ significantly by level of health literacy, the data were suggestive of differential intervention effects by health literacy level.Conclusions: The differences in intervention effects for high vs low health literacy in this exploratory analysis are consistent with the hypothesis that individuals with lower health literacy may derive greater benefit from this type of intervention compared with individuals with higher health literacy. Additional studies are needed to further explore this finding. [ABSTRACT FROM AUTHOR]

This study aimed to find the set of risk indicators best able to predict root caries (RC) incidence in caries-active adults utilizing data from the Xylitol for Adult Caries Trial (X-ACT). Five logistic regression models were compared with respect to their predictive performance for incident RC using data from placebo-control participants with exposed root surfaces at baseline and from two study centers with ancillary data collection (n = 155). Prediction performance was assessed from baseline variables and after including ancillary variables [smoking, diet, use of removable partial dentures (RPD), toothbrush use, income, education, and dental insurance]. A sensitivity analysis added treatment to the models for both the control and treatment participants (n = 301) to predict RC for the control participants. Forty-nine percent of the control participants had incident RC. The model including the number of follow-up years at risk, the number of root surfaces at risk, RC index, gender, race, age, and smoking resulted in the best prediction performance, having the highest AUC and lowest Brier score. The sensitivity analysis supported the primary analysis and gave slightly better performance summary measures. The set of risk indicators best able to predict RC incidence included an increased number of root surfaces at risk and increased RC index at baseline, followed by white race and nonsmoking, which were strong nonsignificant predictors. Gender, age, and increased number of follow-up years at risk, while included in the model, were also not statistically significant. The inclusion of health, diet, RPD use, toothbrush use, income, education, and dental insurance variables did not improve the prediction performance. [ABSTRACT FROM AUTHOR]

Objective: In the Weight Loss Maintenance (WLM) Trial, a personal contact (PC) intervention sustained greater weight loss relative to a self-directed (SD) group over 30 months. This study investigated the effects of continued intervention over an additional 30 months and overall weight change across the entire WLM Trial.Methods: WLM had 3 phases. Phase 1 was a 6-month weight loss program. In Phase 2, those who lost ≥4 kg were randomized to a 30-month maintenance trial. In Phase 3, PC participants (n = 196, three sites) were re-randomized to no further intervention (PC-Control) or continued intervention (PC-Active) for 30 more months; 218 SD participants were also followed.Results: During Phase 3, weight increased 1.0 kg in PC-Active and 0.5 kg in PC-Control (mean difference 0.6 kg; 95% CI:-1.4 to 2.7; P = 0.54). Mean weight change over the entire study was -3.2 kg in those originally assigned to PC (PC-Combined) and -1.6 kg in SD (mean difference -1.6 kg; 95% CI:-3.0 to -0.1; P = 0.04).Conclusions: After 30 months of the PC maintenance intervention, continuation for another 30 months provided no additional benefit. However, across the entire study, weight loss was slightly greater in those originally assigned to PC. [ABSTRACT FROM AUTHOR]

Context: Pragmatic trials lack the relatively tight quality control of traditional efficacy studies and hence may pose added analytic challenges owing to the practical realities faced in carrying them out. Case Description: STOP CRC is a cluster randomized trial testing the effectiveness of automated, electronic medical record (EMR)-driven strategies to raise colorectal cancer (CRC) screening rates in safety net clinics. Screen-eligible participants were accrued during year 1 and followed for 12 months (measurement window) to assess completion of a fecal screening test. Control clinics implemented the intervention in year 2. Implementation Challenges/Analytic Issues: Due to limitations on how we could build the intervention tools, the overlap of the year 1 measurement windows with year 2 intervention rollout posed a potential for contamination of the primary outcome for control participants. In addition, a variety of factors led to a lack of synchronization of the measurement windows with actual intervention delivery. In both cases, the net impact of these factors would be to diminish the estimated impact of the intervention. Proposed Solutions: We dealt with the overlap issue by delaying the start of intervention rollout to control clinics in year 2 by 6 months and by truncating the measurement windows for intervention and control participants at this point. In addition we formulated three sensitivity analyses to help address the issue of asynchronization. Conclusion: This case study might help other investigators facing similar challenges think about such issues and the pros and cons of various strategies for dealing with them. [ABSTRACT FROM AUTHOR]