Search

BACKGROUND: The problem of loneliness has garnered increased attention from policymakers, payors, and providers due to higher rates during the pandemic, particularly among seniors. Prior systematic reviews have in general not been able to reach conclusions about effectiveness of interventions. METHODS: Computerized databases were searched using broad terms such as loneliness or lonely or social isolation or social support from Jan 1, 2011 to June 23, 2021. We reference mined existing systematic reviews for additional and older studies. The Social Interventions Research & Evaluation Network database and Google were searched for gray literature on Feb 4, 2022. Eligible studies were RCTs and observational studies of interventions to reduce loneliness in community-living adults that used a validated loneliness scale; studies from low- or middle-income countries were excluded, and studies were excluded if restricted to populations where all persons had the same disease (such as loneliness in persons with dementia). RESULTS: A total of 5971 titles were reviewed and 60 studies were included in the analysis, 36 RCTs and 24 observational studies. Eleven RCTs and 5 observational studies provided moderate certainty evidence that group-based treatment was associated with reduced loneliness (standardized mean difference for RCTs = - 0.27, 95% CI - 0.48, - 0.08). Five RCTs and 5 observational studies provided moderate certainty evidence that internet training was associated with reduced loneliness (standardized mean difference for RCTs = - 0.22, 95% CI - 0.30, - 0.14). Low certainty evidence suggested that group exercises may be associated with very small reductions in loneliness. Evidence was insufficient to reach conclusions about group-based activities, individual in-person interactions, internet-delivered interventions, and telephone-delivered interventions. DISCUSSION: Low-to-moderate certainty evidence exists that group-based treatments, internet training, and possibl

In response to concerns about healthcare access and long wait times within the Veterans Health Administration (VA), Congress passed the Choice Act of 2014 and the Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act of 2018 to create a program for patients to receive care in non-VA sites of care, paid by VA. Questions remain about the quality of surgical care between these sites in specific and between VA and non-VA care in general. This review synthesizes recent evidence comparing surgical care between VA and non-VA delivered care across the domains of quality and safety, access, patient experience, and comparative cost/efficiency (2015 to 2021). Eighteen studies met the inclusion criteria. Of 13 studies reporting quality and safety outcomes, 11 reported that quality and safety of VA surgical care were as good as or better than non-VA sites of care. Six studies of access did not have a preponderance of evidence favoring care in either setting. One study of patient experience reported VA care as about equal to non-VA care. All 4 studies of cost/efficiency outcomes favored non-VA care. Based on limited data, these findings suggest that expanding eligibility for veterans to get care in the community may not provide benefits in terms of increasing access to surgical procedures, will not result in better quality, and may result in worse quality of care, but may reduce inpatient length of stay and perhaps cost less.

BACKGROUND: Antiplatelet agents are central in the management of vascular disease. The use of dual antiplatelet therapy (DAPT) for the management of thromboembolic complications must be weighed against bleeding risk in the perioperative setting. This balance is critical in patients undergoing cardiac or non-cardiac surgery. The management of patients on DAPT for any indication (including stents) is not clear and there is limited evidence to guide decision-making. This review summarizes current evidence since 2015 regarding the occurrence of major adverse events associated with continuing, suspending, or varying DAPT in the perioperative period. METHODS: A research librarian searched PubMed and Cochrane from November 30, 2015 to May 17, 2022, for relevant terms regarding adult patients on DAPT for any reason undergoing surgery, with a perioperative variation in DAPT strategy. Outcomes of interest included the occurrence of major adverse cardiac events, major adverse limb events, all-cause death, major bleeding, and reoperation. We considered withdrawal or discontinuation of DAPT as stopping either aspirin or a P2Y12 inhibitor or both agents; continuation of DAPT indicates that both drugs were given in the specified timeframe. RESULTS: Eighteen observational studies met the inclusion criteria. No RCTs were identified, and no studies were judged to be at low risk of bias. Twelve studies reported on CABG. Withholding DAPT therapy for more than 2 days was associated with less blood loss and a slight trend favoring less transfusion and surgical re-exploration. Among five observational CABG studies, there were no statistically significant differences in patient death across DAPT management strategies. Few studies reported cardiac outcomes. The remaining studies, which were about procedures other than exclusively CABG, demonstrated mixed findings with respect to DAPT strategy, bleeding, and ischemic outcomes. CONCLUSION: The evidence base on the benefits and risks of d

BACKGROUND: Obesity is a major threat to public health and traditional bariatric surgery continues to have low utilization. Endoscopic treatments for obesity have emerged that offer less risk, but questions remain regarding efficacy, durability, and safety. We compared the efficacy of endoscopic bariatric procedures as compared to other existing treatments. METHODS: A literature search of Embase, Cochrane Central, and Pubmed was conducted from January 1, 2014 to December 7, 2021, including endoscopic bariatric therapies that were FDA or CE approved at the time of search to non-endoscopic treatments. Thirty-seven studies involving 15,639 patients were included. Primary outcomes included % total body weight loss (%TBWL), % excess body weight loss (%EBWL), and adverse events. Secondary outcomes included quality of life data and differences in hemoglobin A1C levels. Strength of clinical trial and observational data were graded according to the Cochrane methods. RESULTS: Intragastric balloons achieved greater %TBWL with a range of 7.6-14.1% compared to 3.3-6.7% with lifestyle modification at 6 months, and 7.5-14.0% compared to 3.1-7.9%, respectively, at 12 months. When endoscopic sleeve gastroplasty (ESG) was compared to laparoscopic sleeve gastrectomy (LSG), ESG had less %TBWL at 4.7-14.4% compared to 18.8-26.5% after LSG at 6 months, and 4.5-18.6% as compared to 28.4-29.3%, respectively, at 12 months. For the AspireAssist, there was greater %TBWL with aspiration therapy compared to lifestyle modification at 12 months, 12.1-18.3% TBWL versus 3.5-5.9% TBWL, respectively. All endoscopic interventions had higher adverse events rates compared to lifestyle modification. CONCLUSION: This review is the first to evaluate various endoscopic bariatric therapies using only RCTs and observational studies for evaluation of weight loss compared with conservative management, lifestyle modification, and bariatric surgery. Endoscopi

BackgroundWhether the presence of dementia in patients makes it difficult for physicians to assess the risk such patients might have for serious conditions such as pulmonary embolism (PE) is unknown. Our objective was to examine the differential association of four clinical factors (deep venous thrombosis (DVT)/PE, malignancy, recent surgery, and tachycardia) with PE testing for patients with dementia compared to patients without dementia.MethodsWe performed a cross-sectional study of emergency department (ED) visits to 104 Veterans Affairs (VA) hospitals from 2011 to 2018 by patients aged 60 years and over presenting with shortness of breath (SOB). Our outcomes were PE testing (CT scan and/or D-dimer) and subsequently diagnosed acute PE.ResultsThe sample included 593,001 patient visits for SOB across 7124 ED physicians; 5.6% of the sample had dementia, and 10.6% received PE testing. Three of the four clinical factors examined had a lower association with PE testing for patients with dementia. For example, after taking into account that at baseline, physicians were 0.9 percentage points less likely to test patients with dementia than patients without dementia for PE, physicians were an additional 2.6 percentage points less likely to test patients with dementia who had tachycardia than patients without dementia who had tachycardia. We failed to find evidence that any clinical factor examined had a differentially lower association with a subsequently diagnosed acute PE for patients with dementia.ConclusionsClinical factors known to be predictive of PE risk had a lower association with PE testing for patients with dementia compared to patients without dementia. These results may be consistent with physicians missing these clinical factors more often when evaluating patients with dementia, but also with physicians recognizing such factors but not using them in the decision-making process. Further understanding how physicians evaluate patients with dementia presenting wi

BACKGROUND: Hospitals have implemented diverse quality improvement (QI) interventions to reduce rates of catheter-associated urinary tract infections (CAUTIs). The economic value of these QI interventions is uncertain. OBJECTIVE: To systematically review economic evaluations of QI interventions designed to prevent CAUTI in acute care hospitals. METHODS: A search of Ovid MEDLINE, Econlit, Centre for Reviews & Dissemination, New York Academy of Medicines Grey Literature Report, WorldCat, IDWeek conference abstracts and prior systematic reviews was conducted from January 2000 to October 2020.We included English-language studies of any design that evaluated organisational or structural changes to prevent CAUTI in acute care hospitals, and reported programme and infection-related costs.Dual reviewers assessed study design, effectiveness, costs and study quality. For each eligible study, we performed a cost-consequences analysis from the hospital perspective, estimating the incidence rate ratio (IRR) and incremental net cost/savings per hospital over 3 years. Unadjusted weighted regression analyses tested predictors of these measures, weighted by catheter days per study. RESULTS: Fifteen unique economic evaluations were eligible, encompassing 74 hospitals. Across 12 studies amenable to standardisation, QI interventions were associated with a 43% decline in infections (mean IRR 0.57, 95% CI 0.44 to 0.70) and wide ranges of net costs (mean US$52 000, 95% CI -$288 000 to $392 000), relative to usual care. CONCLUSIONS: QI interventions were associated with large declines in infection rates and net costs to hospitals that varied greatly but that, on average, were not significantly different from zero over 3 years. Future research should examine specific practices associated with cost-savings and clinical effectiveness, and examine whether or not more comprehensive interventions offer hospitals and patients the best value.

Robotic ventral hernia repair (VHR) has seen rapid adoption, but with limited data assessing clinical outcome or cost. This systematic review compared robotic VHR with laparoscopic and open approaches. This systematic review was undertaken in accordance with PRISMA guidelines. PubMed, MEDLINE, Embase, and Cochrane databases were searched for articles with terms relating to 'robot-assisted', 'cost effectiveness', and 'ventral hernia' or 'incisional hernia' from 1 January 2010 to 10 November 2020. Intraoperative and postoperative outcomes, pain, recurrence, and cost data were extracted for narrative analysis. Of 25 studies that met the inclusion criteria, three were RCTs and 22 observational studies. Robotic VHR was associated with a longer duration of operation than open and laparoscopic repairs, but with fewer transfusions, shorter hospital stay, and lower complication rates than open repair. Robotic VHR was more expensive than laparoscopic repair, but not significantly different from open surgery in terms of cost. There were no significant differences in rates of intraoperative complication, conversion to open surgery, surgical-site infection, readmission, mortality, pain, or recurrence between the three approaches. Robotic VHR was associated with a longer duration of operation, fewer transfusions, a shorter hospital stay, and fewer complications compared with open surgery. Robotic VHR had higher costs and a longer operating time than laparoscopic repair. Randomized or matched data with standardized reporting, long-term outcomes, and cost-effectiveness analyses are still required to weigh the clinical benefits against the cost of robotic VHR.

BackgroundRapid adoption of robotic-assisted general surgery procedures, particularly for cholecystectomy, continues while questions remain about its benefits and utility. The objective of this study was to compare the clinical effectiveness of robot-assisted cholecystectomy for benign gallbladder disease as compared with the laparoscopic approach.MethodsA literature search was performed from January 2010 to March 2020, and a narrative analysis was performed as studies were heterogeneous.ResultsOf 887 articles screened, 44 met the inclusion criteria (range 20-735,537 patients). Four were randomized controlled trials, and four used propensity-matching. There were variable comparisons between operative techniques with only 19 out of 44 studies comparing techniques using the same number of ports. Operating room time was longer for the robot-assisted technique in the majority of studies (range 11-55 min for 22 studies, p < 0.05; 15 studies showed no difference; two studies showed shorter laparoscopic times), while conversion rates and intraoperative complications were not different. No differences were detected for the length of stay, surgical site infection, or readmissions. Across studies comparing single-port robot-assisted to multi-port laparoscopic cholecystectomy, there was a higher rate of incisional hernia; however, no differences were noted when comparing single-port robot-assisted to single-port laparoscopic cholecystectomy.ConclusionsClinical outcomes were similar for benign, elective gallbladder disease for robot-assisted compared with laparoscopic cholecystectomy. Overall, the rates of complications were low. More high-quality studies are needed as the robot-assisted technique expands to more complex gallbladder disease, where its utility may prove increasingly beneficial.Systematic review registrationPROSPERO CRD42020156945.

IntroductionMost older Americans use drug therapies for chronic conditions. Several are associated with risk of Alzheimer's disease and related dementias (ADRD).MethodsA scoping review was used to identify drug classes associated with increasing or decreasing ADRD risk. We analyzed size, type, and findings of the evidence.ResultsWe identified 29 drug classes across 11 therapeutic areas, and 404 human studies. Most common were studies on drugs for hypertension (93) or hyperlipidemia (81). Fewer than five studies were identified for several anti-diabetic and anti-inflammatory drugs. Evidence was observational only for beta blockers, proton pump inhibitors, benzodiazepines, and disease-modifying anti-rheumatic drugs. For 13 drug classes, 50% or more of the studies reported consistent direction of effect on risk of ADRD.DiscussionFuture research targeting drug classes with limited/non-robust evidence, examining sex, racial heterogeneity, and separating classes by molecule, will facilitate understanding of associated risk, and inform clinical and policy efforts to alleviate the growing impact of ADRD.

Objectives: Massage therapy has been proposed for painful conditions, but it can be difficult to understand the breadth and depth of evidence, as various painful conditions may respond differently to massage. The authors conducted an evidence mapping process and generated an "evidence map" to visually depict the distribution of evidence available for massage and various pain indications to identify gaps in evidence and to inform future research priorities. Design: The authors searched PubMed, Embase, and Cochrane for systematic reviews reporting pain outcomes for massage therapy. The authors assessed the quality of each review using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) criteria. The authors used a bubble plot to depict the number of included articles, pain indication, effect of massage for pain, and strength of findings for each included systematic review. Results: The authors identified 49 systematic reviews, of which 32 were considered high quality. Types of pain frequently included in systematic reviews were cancer pain, low back pain, and neck pain. High quality reviews concluded that there was low strength of evidence of potential benefits of massage for labor, shoulder, neck, low back, cancer, arthritis, postoperative, delayed onset muscle soreness, and musculoskeletal pain. Reported attributes of massage interventions include style of massage, provider, co-interventions, duration, and comparators, with 14 high-quality reviews reporting all these attributes in their review. Conclusion: Prior reviews have conclusions of low strength of evidence because few primary studies of large samples with rigorous methods had been conducted, leaving evidence gaps about specific massage type for specific pain. Primary studies often do not provide adequate details of massage therapy provided, limiting the extent to which reviews are able to draw conclusions about characteristics such as provider type.

Objectives: Massage therapy has been proposed for painful conditions, but it can be difficult to understand the breadth and depth of evidence, as various painful conditions may respond differently to massage. The authors conducted an evidence mapping process and generated an "evidence map" to visually depict the distribution of evidence available for massage and various pain indications to identify gaps in evidence and to inform future research priorities. Design: The authors searched PubMed, Embase, and Cochrane for systematic reviews reporting pain outcomes for massage therapy. The authors assessed the quality of each review using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) criteria. The authors used a bubble plot to depict the number of included articles, pain indication, effect of massage for pain, and strength of findings for each included systematic review. Results: The authors identified 49 systematic reviews, of which 32 were considered high quality. Types of pain frequently included in systematic reviews were cancer pain, low back pain, and neck pain. High quality reviews concluded that there was low strength of evidence of potential benefits of massage for labor, shoulder, neck, low back, cancer, arthritis, postoperative, delayed onset muscle soreness, and musculoskeletal pain. Reported attributes of massage interventions include style of massage, provider, co-interventions, duration, and comparators, with 14 high-quality reviews reporting all these attributes in their review. Conclusion: Prior reviews have conclusions of low strength of evidence because few primary studies of large samples with rigorous methods had been conducted, leaving evidence gaps about specific massage type for specific pain. Primary studies often do not provide adequate details of massage therapy provided, limiting the extent to which reviews are able to draw conclusions about characteristics such as provider type.

BackgroundPayers and policy makers across the international healthcare market are increasingly using publicly available summary measures to designate providers as "high-performing", but no consistently-applied approach exists to identifying high performers. This paper uses publicly available data to examine how different classification approaches influence which providers are designated as "high-performers".MethodsWe conducted a quantitative analysis of cross-sectional publicly-available performance data in the U.S. We used 2014 Minnesota Community Measurement data from 58 medical groups to classify performance across 4 domains: quality (two process measures of cancer screening and 2 composite measures of chronic disease management), total cost of care, access (a composite CAHPS measure), and patient experience (3 CAHPS measures). We classified medical groups based on performance using either relative thresholds or absolute values of performance on all included measures.ResultsUsing relative thresholds, none of the 58 medical groups achieved performance in the top 25% or 35% in all 4 performance domains. A relative threshold of 40% was needed before one group was classified as high-performing in all 4 domains. Using absolute threshold values, two medical groups were classified as high-performing across all 4 domains. In both approaches, designating "high performance" using fewer domains led to more groups designated as high-performers, though there was little to moderate concordance across identified "high-performing" groups.ConclusionsClassification of medical groups as high performing is sensitive to the domains of performance included, the classification approach, and choice of threshold. With increasing focus on achieving high performance in healthcare delivery, the absence of a consistently-applied approach to identify high performers impedes efforts to reliably compare, select and reward high-performing providers.

BACKGROUND:Rural areas have historically struggled with shortages of healthcare providers; however, advanced communication technologies have transformed rural healthcare, and practice in underserved areas has been recognized as a policy priority. This systematic review aims to assess reasons for current providers' geographic choices and the success of training programs aimed at increasing rural provider recruitment. METHODS:This systematic review (PROSPERO: CRD42015025403) searched seven databases for published and gray literature on the current cohort of US rural healthcare practitioners (2005 to March 2017). Two reviewers independently screened citations for inclusion; one reviewer extracted data and assessed risk of bias, with a senior systematic reviewer checking the data; quality of evidence was assessed using the GRADE approach. RESULTS:Of 7276 screened citations, we identified 31 studies exploring reasons for geographic choices and 24 studies documenting the impact of training programs. Growing up in a rural community is a key determinant and is consistently associated with choosing rural practice. Most existing studies assess physicians, and only a few are based on multivariate analyses that take competing and potentially correlated predictors into account. The success rate of placing providers-in-training in rural practice after graduation, on average, is 44% (range 20-84%; N = 31 programs). We did not identify program characteristics that are consistently associated with program success. Data are primarily based on rural tracks for medical residents. DISCUSSION:The review provides insight into the relative importance of demographic characteristics and motivational factors in determining which providers should be targeted to maximize return on recruitment efforts. Existing programs exposing students to rural practice during their training are promising but require further refining. Public policy must include a specific focus on the trajectory of t

BACKGROUND:The correct perioperative management of antiplatelet therapy (APT) in patients undergoing non-cardiac surgery (NCS) is often debated by clinicians. American College of Cardiology (ACC) and American Heart Association (AHA) guidelines recommend postponing elective NCS at least 3 months after stent implantation. Regardless of the timing of surgery, ACC/AHA guidelines recommend continuing at least ASA throughout the perioperative period and ideally continuing dual APT (DAPT) therapy "unless surgery demands discontinuation." The objective of this review was to ascertain the risks and benefits of APT in the perioperative period, to assess how these risks and benefits vary by APT management, and the significance of length of time since stent implantation before operative intervention. METHODS:PubMed, Web of Science, and Scopus were searched from inception through October 2017. Articles were included if patients were post PCI with stent placement (bare metal [BMS] or drug eluting [DES]), underwent elective NCS, and had rates of major adverse cardiac events (MACE) or bleeding events associated with pre and perioperative APT therapy. RESULTS:Of 4882 screened articles, we included 16 studies in the review (1 randomized controlled trial and 15 observational studies). Studies were small (< 50: n = 5, 51-150: n = 5, >150: n = 6). All studies included DES with 7 of 16 also including BMS. Average time from stent to NCS was variable (< 6 months: n = 3, 6-12 months: n = 1, > 12 months: n = 6). At least six different APT strategies were described. Six studies further utilized bridging protocols using three different pharmacologic agents. Studies typically included multiple surgical fields with varying degrees of invasiveness. Across all APT strategies, rates of MACE/bleeding ranged from 0 to 21% and 0 to 22%. There was no visible trend in MACE/bleeding rates within a given APT strategy. Stratifying the articles by type of surgery, timing

ObjectiveQuality improvement (QI) interventions can improve glycemic control, but little is known about their value. We systematically reviewed economic evaluations of QI interventions for glycemic control among adults with type 1 or type 2 diabetes.Research design and methodsWe used English-language studies from high-income countries that evaluated organizational changes and reported program and utilization-related costs, chosen from PubMed, EconLit, Centre for Reviews and Dissemination, New York Academy of Medicine's Grey Literature Report, and WorldCat (January 2004 to August 2016). We extracted data regarding intervention, study design, change in HbA1c, time horizon, perspective, incremental net cost (studies lasting ≤3 years), incremental cost-effectiveness ratio (ICER) (studies lasting ≥20 years), and study quality. Weighted least-squares regression analysis was used to estimate mean changes in HbA1c and incremental net cost.ResultsOf 3,646 records, 46 unique studies were eligible. Across 19 randomized controlled trials (RCTs), HbA1c declined by 0.26% (95% CI 0.17-0.35) or 3 mmol/mol (2 to 4) relative to usual care. In 8 RCTs lasting ≤3 years, incremental net costs were $116 (95% CI -$612 to $843) per patient annually. Long-term ICERs were $100,000-$115,000/quality-adjusted life year (QALY) in 3 RCTs, $50,000-$99,999/QALY in 1 RCT, $0-$49,999/QALY in 4 RCTs, and dominant in 1 RCT. Results were more favorable in non-RCTs. Our limitations include the fact that the studies had diverse designs and involved moderate risk of bias.ConclusionsDiverse multifaceted QI interventions that lower HbA1c appear to be a fair-to-good value relative to usual care, depending on society's willingness to pay for improvements in health.

CONTEXT: Influenza vaccination rates remain below Healthy People 2020 goals. This project sought to systematically review economic evaluations of healthcare-based quality improvement interventions for improving influenza vaccination uptake among general populations and healthcare workers. EVIDENCE ACQUISITION: The databases MEDLINE, Econlit, Centre for Reviews & Dissemination, Greylit, and Worldcat were searched in July 2016 for papers published from January 2004 to July 2016. Eligible studies evaluated efforts by bodies within the healthcare system to encourage influenza vaccination by means of an organizational or structural change. For each study, program costs per enrollee and per additional enrollee vaccinated were derived (excluding vaccine costs, standardized to 2017 U.S. dollars). Complete economic evaluations were examined when available. EVIDENCE SYNTHESIS: Of 2,350 records, 18 articles were eligible and described 29 unique interventions. Most interventions improved vaccine uptake. Among 23 interventions in general populations, the median program cost was $3.27 (interquartile range, $0.82-$11.53) per enrollee and $50.78 (interquartile range, $27.85-$124.84) per additional enrollee vaccinated. Among ten complete economic evaluations in general populations, three studies reported net cost savings, four reported costs <$50,000 per quality-adjusted life year, and three reported costs <$60,000 per life saved. Among six interventions in healthcare workers, the median program cost was $8.09 (interquartile range, $5.03-$10.31) per worker enrolled and $125.24 (interquartile range, $96.06-$171.38) per additional worker vaccinated (there were no complete economic analyses). CONCLUSIONS: Quality improvement interventions for influenza vaccination involve per-enrollee costs that are similar to the cost of the vaccine itself ($11.78-$36.08/dose). Based on limited available evidence in general populations, quality improvement interventions may be cost saving to

BackgroundSystematic reviews are a cornerstone of evidence-based medicine but are useful only if up-to-date. Methods for detecting signals of when a systematic review needs updating have face validity, but no proposed method has had an assessment of predictive validity performed.MethodsThe AHRQ Comparative Effectiveness Review program had produced 13 comparative effectiveness reviews (CERs), a subcategory of systematic reviews, by 2009, 11 of which were assessed in 2009 using a surveillance system to determine the degree to which individual conclusions were out of date and to assign a priority for updating each report. Four CERs were judged to be a high priority for updating, four CERs were judged to be medium priority for updating, and three CERs were judged to be low priority for updating. AHRQ then commissioned full update reviews for 9 of these 11 CERs. Where possible, we matched the original conclusions with their corresponding conclusions in the update reports, and compared the congruence between these pairs with our original predictions about which conclusions in each CER remained valid. We then classified the concordance of each pair as good, fair, or poor. We also made a summary determination of the priority for updating each CER based on the actual changes in conclusions in the updated report, and compared these determinations with the earlier assessments of priority.ResultsThe 9 CERs included 149 individual conclusions, 84% with matches in the update reports. Across reports, 83% of matched conclusions had good concordance, and 99% had good or fair concordance. The one instance of poor concordance was partially attributable to the publication of new evidence after the surveillance signal searches had been done. Both CERs originally judged as being low priority for updating had no substantive changes to their conclusions in the actual updated report. The agreement on overall priority for updating between prediction and actual changes to conclusions was Kapp

BackgroundSystematic reviews are a cornerstone of evidence-based medicine but are useful only if up-to-date. Methods for detecting signals of when a systematic review needs updating have face validity, but no proposed method has had an assessment of predictive validity performed.MethodsThe AHRQ Comparative Effectiveness Review program had produced 13 comparative effectiveness reviews (CERs), a subcategory of systematic reviews, by 2009, 11 of which were assessed in 2009 using a surveillance system to determine the degree to which individual conclusions were out of date and to assign a priority for updating each report. Four CERs were judged to be a high priority for updating, four CERs were judged to be medium priority for updating, and three CERs were judged to be low priority for updating. AHRQ then commissioned full update reviews for 9 of these 11 CERs. Where possible, we matched the original conclusions with their corresponding conclusions in the update reports, and compared the congruence between these pairs with our original predictions about which conclusions in each CER remained valid. We then classified the concordance of each pair as good, fair, or poor. We also made a summary determination of the priority for updating each CER based on the actual changes in conclusions in the updated report, and compared these determinations with the earlier assessments of priority.ResultsThe 9 CERs included 149 individual conclusions, 84% with matches in the update reports. Across reports, 83% of matched conclusions had good concordance, and 99% had good or fair concordance. The one instance of poor concordance was partially attributable to the publication of new evidence after the surveillance signal searches had been done. Both CERs originally judged as being low priority for updating had no substantive changes to their conclusions in the actual updated report. The agreement on overall priority for updating between prediction and actual changes to conclusions was Kapp

IMPORTANCE Quality improvement (QI) interventions can reduce hospital readmission, but little is known about their economic value. OBJECTIVE To systematically review economic evaluations of QI interventions designed to reduce readmissions. DATA SOURCES Databases searched included PubMed, Econlit, the Centre for Reviews & Dissemination Economic Evaluations, New York Academy of Medicine's Grey Literature Report, andWorldcat (January 2004 to July 2016). STUDY SELECTION Dual reviewers selected English-language studies from high-income countries that evaluated organizational or structural changes to reduce hospital readmission, and that reported program and readmission-related costs. DATA EXTRACTION AND SYNTHESIS Dual reviewers extracted intervention characteristics, study design, clinical effectiveness, study quality, economic perspective, and costs.We calculated the risk difference and net costs to the health system in 2015 US dollars.Weighted least-squares regression analyses tested predictors of the risk difference and net costs. MAIN OUTCOMES AND MEASURES Main outcomes measures included the risk difference in readmission rates and incremental net cost. This systematic review and data analysis is reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. RESULTS Of 5205 articles, 50 unique studies were eligible, including 25 studies in populations limited to heart failure (HF) that included 5768 patients, 21 in general populations that included 10 445 patients, and 4 in unique populations. Fifteen studies lasted up to 30 days while most others lasted 6 to 24 months. Based on regression analyses, readmissions declined by an average of 12.1% among patients with HF (95%CI, 8.3%-15.9%; P < .001; based on 22 studies with complete data) and by 6.3%among general populations (95%CI, 4.0%-8.7%; P < .001; 18 studies). The mean net savings to the health system per patient was $972 among patients with HF (95%CI, −$642 to $

IMPORTANCE Quality improvement (QI) interventions can reduce hospital readmission, but little is known about their economic value. OBJECTIVE To systematically review economic evaluations of QI interventions designed to reduce readmissions. DATA SOURCES Databases searched included PubMed, Econlit, the Centre for Reviews & Dissemination Economic Evaluations, New York Academy of Medicine's Grey Literature Report, andWorldcat (January 2004 to July 2016). STUDY SELECTION Dual reviewers selected English-language studies from high-income countries that evaluated organizational or structural changes to reduce hospital readmission, and that reported program and readmission-related costs. DATA EXTRACTION AND SYNTHESIS Dual reviewers extracted intervention characteristics, study design, clinical effectiveness, study quality, economic perspective, and costs.We calculated the risk difference and net costs to the health system in 2015 US dollars.Weighted least-squares regression analyses tested predictors of the risk difference and net costs. MAIN OUTCOMES AND MEASURES Main outcomes measures included the risk difference in readmission rates and incremental net cost. This systematic review and data analysis is reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. RESULTS Of 5205 articles, 50 unique studies were eligible, including 25 studies in populations limited to heart failure (HF) that included 5768 patients, 21 in general populations that included 10 445 patients, and 4 in unique populations. Fifteen studies lasted up to 30 days while most others lasted 6 to 24 months. Based on regression analyses, readmissions declined by an average of 12.1% among patients with HF (95%CI, 8.3%-15.9%; P < .001; based on 22 studies with complete data) and by 6.3%among general populations (95%CI, 4.0%-8.7%; P < .001; 18 studies). The mean net savings to the health system per patient was $972 among patients with HF (95%CI, −$642 to $

BackgroundThis evidence map describes the volume and focus of Tai Chi research reporting health outcomes. Originally developed as a martial art, Tai Chi is typically taught as a series of slow, low-impact movements that integrate the breath, mind, and physical activity to achieve greater awareness and a sense of well-being.MethodsThe evidence map is based on a systematic review of systematic reviews. We searched 11 electronic databases from inception to February 2014, screened reviews of reviews, and consulted with topic experts. We used a bubble plot to graphically display clinical topics, literature size, number of reviews, and a broad estimate of effectiveness.ResultsThe map is based on 107 systematic reviews. Two thirds of the reviews were published in the last five years. The topics with the largest number of published randomized controlled trials (RCTs) were general health benefits (51 RCTs), psychological well-being (37 RCTs), interventions for older adults (31 RCTs), balance (27 RCTs), hypertension (18 RCTs), fall prevention (15 RCTs), and cognitive performance (11 RCTs). The map identified a number of areas with evidence of a potentially positive treatment effect on patient outcomes, including Tai Chi for hypertension, fall prevention outside of institutions, cognitive performance, osteoarthritis, depression, chronic obstructive pulmonary disease, pain, balance confidence, and muscle strength. However, identified reviews cautioned that firm conclusions cannot be drawn due to methodological limitations in the original studies and/or an insufficient number of existing research studies.ConclusionsTai Chi has been applied in diverse clinical areas, and for a number of these, systematic reviews have indicated promising results. The evidence map provides a visual overview of Tai Chi research volume and content.Systematic review registrationPROSPERO CRD42014009907.

BackgroundThis evidence map describes the volume and focus of Tai Chi research reporting health outcomes. Originally developed as a martial art, Tai Chi is typically taught as a series of slow, low-impact movements that integrate the breath, mind, and physical activity to achieve greater awareness and a sense of well-being.MethodsThe evidence map is based on a systematic review of systematic reviews. We searched 11 electronic databases from inception to February 2014, screened reviews of reviews, and consulted with topic experts. We used a bubble plot to graphically display clinical topics, literature size, number of reviews, and a broad estimate of effectiveness.ResultsThe map is based on 107 systematic reviews. Two thirds of the reviews were published in the last five years. The topics with the largest number of published randomized controlled trials (RCTs) were general health benefits (51 RCTs), psychological well-being (37 RCTs), interventions for older adults (31 RCTs), balance (27 RCTs), hypertension (18 RCTs), fall prevention (15 RCTs), and cognitive performance (11 RCTs). The map identified a number of areas with evidence of a potentially positive treatment effect on patient outcomes, including Tai Chi for hypertension, fall prevention outside of institutions, cognitive performance, osteoarthritis, depression, chronic obstructive pulmonary disease, pain, balance confidence, and muscle strength. However, identified reviews cautioned that firm conclusions cannot be drawn due to methodological limitations in the original studies and/or an insufficient number of existing research studies.ConclusionsTai Chi has been applied in diverse clinical areas, and for a number of these, systematic reviews have indicated promising results. The evidence map provides a visual overview of Tai Chi research volume and content.Systematic review registrationPROSPERO CRD42014009907.

BackgroundThe prevalence of knee osteoarthritis (OA)/degenerative joint disease (DJD) is increasing in the USA. Systematic reviews of treatment efficacy and adverse events (AEs) of hyaluronic acid (HA) injections report conflicting evidence about the balance of benefits and harms. We review evidence on efficacy and AEs of intraarticular viscosupplementation with HA in older individuals with knee osteoarthritis and account for differences in these conclusions from another systematic review.MethodsWe searched PubMed and eight other databases and gray literature sources from 1990 to December 12, 2014. Double-blind placebo-controlled randomized controlled trials (RCTs) reporting functional outcomes or quality-of-life; RCTs and observational studies on delay/avoidance of arthroplasty; RCTs, case reports, and large cohort studies and case series assessing safety; and systematic reviews reporting on knee pain were considered for inclusion. A standardized, pre-defined protocol was applied by two independent reviewers to screen titles and abstracts, review full text, and extract details on study design, interventions, outcomes, and quality. We compared our results with those of a prior systematic review and found them to be discrepant; our analysis of why this discrepancy occurred is the focus of this manuscript.ResultsEighteen RCTs reported functional outcomes: pooled analysis of ten placebo-controlled, blinded trials showed a standardized mean difference of -0.23 (95 % confidence interval (CI) -0.45 to -0.01) favoring HA at 6 months. Studies reported few serious adverse events (SAEs) and no significant differences in non-serious adverse events (NSAEs) (relative risk (RR) [95 % CI] 1.03 [0.93-1.15] or SAEs (RR [95 % CI] 1.39 [0.78-2.47]). A recent prior systematic review reported similar functional outcomes, but significant SAE risk. Differences in SAE inclusion and synthesis accounted for the disparate conclusions.ConclusionsTrials show a small but significant effect

PurposeOur aim was to test the feasibility of a set of quality of care indicators for urinary incontinence and at the same time measure the care provided to women with urinary incontinence in 2 clinical settings.Materials and methodsThis was a pilot test of a set of quality of care indicators. A total of 20 quality of care indicators were previously developed using the RAND Appropriateness Method. These quality of care indicators were used to measure care received for 137 women with a urinary incontinence diagnosis in a 120-physician hospital based multispecialty medical group. We also performed an abstraction of 146 patient records from primary care offices in Southern California. These charts were previously used as part of ACOVE (Assessing Care of Vulnerable Elders Project). As a post-hoc secondary analysis, the 2 populations were compared with respect to quality, as measured by compliance with the quality of care indicators.ResultsIn the ACOVE population, 37.7% of patients with urinary incontinence underwent a pelvic examination vs 97.8% in the multispecialty medical group. Only 15.6% of cases in the multispecialty medical group and 14.2% in ACOVE (p = 0.86) had documentation that pelvic floor exercises were offered. Relatively few women with a body mass index of greater than 25 kg/m(2) were counseled about weight loss in either population (20.9% multispecialty medical group vs 26.1% ACOVE, p = 0.76). For women undergoing sling surgery, documentation of counseling about risks was lacking and only 9.3% of eligible cases (multispecialty medical group only) had documentation of the risks of mesh.ConclusionsQuality of care indicators are a feasible means to measure the care provided to women with urinary incontinence. Care varied by population studied and yet deficiencies in care were prevalent in both patient populations studied.

Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described protocols can facilitate the understanding and appraisal of the review methods, as well as the detection of modifications to methods and selective reporting in completed reviews. We describe the development of a reporting guideline, the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Protocols 2015 (PRISMA-P 2015). PRISMA-P consists of a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. Funders and those commissioning reviews might consider mandating the use of the checklist to facilitate the submission of relevant protocol information in funding applications. Similarly, peer reviewers and editors can use the guidance to gauge the completeness and transparency of a systematic review protocol submitted for publication in a journal or other medium., Las revisiones sistemáticas deben establecerse sobre la base de un protocolo que describa la justificación, la hipótesis y los métodos planificados de la revisión, antes de su realización o publicación; sin embargo pocas revisiones publicadas informan sobre la existencia previa de un protocolo. Disponer de un protocolo detallado y bien escrito puede facilitar la comprensión y valoración de la metodología de la revisión, así como la detección de modificaciones en la metodología o la publicación selectiva en revisiones completadas. El presente trabajo describe el desarrollo de unas directrices de presentación de la información, Preferred Reporting Items for Systematic reviews and Meta-analyses for Protocols 2015 (PRISMA-P 2015). Las directrices PRISMA-P se componen de una lista de verificación de 17 elementos que pretenden facilitar la preparación y presentación de un protocolo sólido para la revisión sistemática. Las instituciones financiadoras y quienes encargan las revisiones podrían considerar la posibilidad de exigir la lista de verificación, a fin de facilitar la presentación de la información relevante del protocolo, para solicitar financiación. De forma similar, los revisores por pares y editores pueden utilizar las directrices para determinar la integridad y transparencia de un protocolo de revisión sistemática presentado a una revista u otro medio para su publicación.

Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described protocols can facilitate the understanding and appraisal of the review methods, as well as the detection of modifications to methods and selective reporting in completed reviews. We describe the development of a reporting guideline, the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Protocols 2015 (PRISMA-P 2015). PRISMA-P consists of a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. Funders and those commissioning reviews might consider mandating the use of the checklist to facilitate the submission of relevant protocol information in funding applications. Similarly, peer reviewers and editors can use the guidance to gauge the completeness and transparency of a systematic review protocol submitted for publication in a journal or other medium.

BackgroundThe purpose of this review is to study the effect of school-based interventions on smoking prevention for girls.MethodsWe performed a systematic review of articles published since 1992 on school-based tobacco-control interventions in controlled trials for smoking prevention among children. We searched the databases of PubMed, Embase, Web of Science, The Cochrane Databases, CINAHL, Social Science Abstracts, and PsycInfo. Two reviewers independently assessed trials for inclusion and quality and extracted data. A pooled random-effects estimate was estimated of the overall relative risk.ResultsThirty-seven trials were included, of which 16 trials with 24,210 girls were included in the pooled analysis. The overall pooled effect was a relative risk (RR) of 0.96 (95 % confidence interval (CI) 0.86-1.08; I (2)=75 %). One study in which a school-based intervention was combined with a mass media intervention showed more promising results compared to only school-based prevention, and four studies with girl-specific interventions, that could not be included in the pooled analysis, reported statistically significant benefits for attitudes and intentions about smoking and quit rates.ConclusionsThere was no evidence that school-based smoking prevention programs have a significant effect on preventing adolescent girls from smoking. Combining school-based programs with mass media interventions, and developing girl-specific interventions, deserve additional study as potentially more effective interventions compared to school-based-only intervention programs.Systematic review registrationPROSPERO CRD42012002322.

Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described protocols can facilitate the understanding and appraisal of the review methods, as well as the detection of modifications to methods and selective reporting in completed reviews. We describe the development of a reporting guideline, the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Protocols 2015 (PRISMA-P 2015). PRISMA-P consists of a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. Funders and those commissioning reviews might consider mandating the use of the checklist to facilitate the submission of relevant protocol information in funding applications. Similarly, peer reviewers and editors can use the guidance to gauge the completeness and transparency of a systematic review protocol submitted for publication in a journal or other medium.

BackgroundThe purpose of this review is to study the effect of school-based interventions on smoking prevention for girls.MethodsWe performed a systematic review of articles published since 1992 on school-based tobacco-control interventions in controlled trials for smoking prevention among children. We searched the databases of PubMed, Embase, Web of Science, The Cochrane Databases, CINAHL, Social Science Abstracts, and PsycInfo. Two reviewers independently assessed trials for inclusion and quality and extracted data. A pooled random-effects estimate was estimated of the overall relative risk.ResultsThirty-seven trials were included, of which 16 trials with 24,210 girls were included in the pooled analysis. The overall pooled effect was a relative risk (RR) of 0.96 (95 % confidence interval (CI) 0.86-1.08; I (2)=75 %). One study in which a school-based intervention was combined with a mass media intervention showed more promising results compared to only school-based prevention, and four studies with girl-specific interventions, that could not be included in the pooled analysis, reported statistically significant benefits for attitudes and intentions about smoking and quit rates.ConclusionsThere was no evidence that school-based smoking prevention programs have a significant effect on preventing adolescent girls from smoking. Combining school-based programs with mass media interventions, and developing girl-specific interventions, deserve additional study as potentially more effective interventions compared to school-based-only intervention programs.Systematic review registrationPROSPERO CRD42012002322.

The expanded use of clinical process-of-care measures to assess the quality of health care in the context of public reporting and pay-for-performance applications has led to a desire to demonstrate the value of such efforts in terms of improved patient outcomes. The inability to observe associations between improved delivery of clinical processes and improved clinical outcomes in practice has raised concerns about the value of holding providers accountable for delivery of clinical processes of care. Analyses that attempt to investigate this relationship are fraught with many challenges, including selection of an appropriate outcome, the proximity of the outcome to the receipt of the clinical process, limited power to detect an effect, small expected effect sizes in practice, potential bias due to unmeasured confounding factors, and difficulties due to changes in measure specification over time. To avoid potentially misleading conclusions about an observed or lack of observed association between a clinical process of care and an outcome in the context of observational studies, individuals conducting and interpreting such studies should carefully consider, evaluate, and acknowledge these types of challenges.

ObjectiveHealth care providers are increasingly being evaluated by the quality of care they provide. Our aim was to assess the feasibility of recently developed quality indicators (QIs) for pelvic organ prolapse (POP) and identify possible deficits in care.Study designA panel ranked 14 QIs based on the RAND appropriateness method assessing screening and diagnosis, pessary management, and surgery for POP. Retrospective chart abstraction was performed after identifying patients with a diagnosis of POP evaluated within a hospital-based multispecialty group using International Classification of Diseases, ninth edition, diagnosis codes.ResultsOf 283 patients identified, 98% of those with a new complaint of vaginal bulge had a pelvic examination. The POP was described but not staged in 6% and not documented at all in 25.1%. Among those managed with pessaries, 98% had vaginal examinations at least every 6 months. Forty-nine percent of the patients who had surgery had complete preoperative POP staging. Only 20% of women undergoing apical surgery had documentation of counseling regarding different surgical options, and of the women who underwent a hysterectomy for POP, only 48% had a concomitant vault suspension. Although 71% had documentation about the risk of postoperative stress incontinence, only 14.5% had documented counseling regarding risks of mesh. Only 37% of patients implanted with mesh for POP had documented follow-up at 1 year. An intraoperative cystoscopy was performed in 86% undergoing cystocele repair or apical surgery.ConclusionThe quality of care for women with POP can be feasibly measured with QIs. Processes of care were deficient in many areas, and our findings can serve as a basis for quality improvement interventions.

BackgroundThere is an increasing push for 'evidence-based' decision making in global health policy circles. However, at present there are no agreed upon standards or guidelines for how to evaluate evidence in global health. Recent evaluations of existing evidence frameworks that could serve such a purpose have identified details of program context and project implementation as missing components needed to inform policy. We performed a pilot study to assess the current state of reporting of context and implementation in studies of global health interventions.MethodsWe identified three existing criteria sets for implementation reporting and selected from them 10 criteria potentially relevant to the needs of policy makers in global health contexts. We applied these 10 criteria to 15 articles included in the evidence base for three global health interventions chosen to represent a diverse set of advocated global health programs or interventions: household water chlorination, prevention of mother-to-child transmission of HIV, and lay community health workers to reduce child mortality. We used a good-fair-poor/none scale for the ratings.ResultsThe proportion of criteria for which reporting was poor/none ranged from 11% to 54% with an average of 30%. Eight articles had 'good' or 'fair' documentation for greater than 75% of criteria, while five articles had 'poor or none' documentation for 50% of criteria or more. Examples of good reporting were identified.ConclusionsReporting of context and implementation information in studies of global health interventions is mostly fair or poor, and highly variable. The idiosyncratic variability in reporting indicates that global health investigators need more guidance about what aspects of context and implementation to measure and how to report them. This lack of context and implementation information is a major gap in the evidence needed by global health policy makers to reach decisions.

BackgroundThe Health Information Technology for Economic and Clinical Health (HITECH) Act subsidizes implementation by hospitals of electronic health records with computerized provider order entry (CPOE), which may reduce patient injuries caused by medication errors (preventable adverse drug events, pADEs). Effects on pADEs have not been rigorously quantified, and effects on medication errors have been variable. The objectives of this analysis were to assess the effectiveness of CPOE at reducing pADEs in hospital-related settings, and examine reasons for heterogeneous effects on medication errors.MethodsArticles were identified using MEDLINE, Cochrane Library, Econlit, web-based databases, and bibliographies of previous systematic reviews (September 2013). Eligible studies compared CPOE with paper-order entry in acute care hospitals, and examined diverse pADEs or medication errors. Studies on children or with limited event-detection methods were excluded. Two investigators extracted data on events and factors potentially associated with effectiveness. We used random effects models to pool data.ResultsSixteen studies addressing medication errors met pooling criteria; six also addressed pADEs. Thirteen studies used pre-post designs. Compared with paper-order entry, CPOE was associated with half as many pADEs (pooled risk ratio (RR) = 0.47, 95% CI 0.31 to 0.71) and medication errors (RR = 0.46, 95% CI 0.35 to 0.60). Regarding reasons for heterogeneous effects on medication errors, five intervention factors and two contextual factors were sufficiently reported to support subgroup analyses or meta-regression. Differences between commercial versus homegrown systems, presence and sophistication of clinical decision support, hospital-wide versus limited implementation, and US versus non-US studies were not significant, nor was timing of publication. Higher baseline rates of medication errors predicted greater reductions (P < 0.001). Other context and implementation varia

ObjectiveContinuous quality improvement (CQI) methods are foundational approaches to improving healthcare delivery. Publications using the term CQI, however, are methodologically heterogeneous, and labels other than CQI are used to signify relevant approaches. Standards for identifying the use of CQI based on its key methodological features could enable more effective learning across quality improvement (QI) efforts. The objective was to identify essential methodological features for recognizing CQI.DesignPrevious work with a 12-member international expert panel identified reliably abstracted CQI methodological features. We tested which features met rigorous a priori standards as essential features of CQI using a three-phase online modified-Delphi process.SettingPrimarily United States and Canada.Participants119 QI experts randomly assigned into four on-line panels.InterventionParticipants rated CQI features and discussed their answers using online, anonymous and asynchronous discussion boards. We analyzed ratings quantitatively and discussion threads qualitatively. Main outcome measure(s) Panel consensus on definitional CQI features.Results/st> Seventy-nine (66%) panelists completed the process. Thirty-three completers self-identified as QI researchers, 18 as QI practitioners and 28 as both equally. The features 'systematic data guided activities,' 'designing with local conditions in mind' and 'iterative development and testing' met a priori standards as essential CQI features. Qualitative analyses showed cross-cutting themes focused on differences between QI and CQI.ConclusionsWe found consensus among a broad group of CQI researchers and practitioners on three features as essential for identifying QI work more specifically as 'CQI.' All three features are needed as a minimum standard for recognizing CQI methods.

Background: The Health Information Technology for Economic and Clinical Health (HITECH) Act subsidizes implementation by hospitals of electronic health records with computerized provider order entry (CPOE), which may reduce patient injuries caused by medication errors (preventable adverse drug events, pADEs). Effects on pADEs have not been rigorously quantified, and effects on medication errors have been variable. The objectives of this analysis were to assess the effectiveness of CPOE at reducing pADEs in hospital-related settings, and examine reasons for heterogeneous effects on medication errors. Methods: Articles were identified using MEDLINE, Cochrane Library, Econlit, web-based databases, and bibliographies of previous systematic reviews (September 2013). Eligible studies compared CPOE with paper-order entry in acute care hospitals, and examined diverse pADEs or medication errors. Studies on children or with limited event-detection methods were excluded. Two investigators extracted data on events and factors potentially associated with effectiveness. We used random effects models to pool data. Results: Sixteen studies addressing medication errors met pooling criteria; six also addressed pADEs. Thirteen studies used pre-post designs. Compared with paper-order entry, CPOE was associated with half as many pADEs (pooled risk ratio (RR) = 0.47, 95% CI 0.31 to 0.71) and medication errors (RR = 0.46, 95% CI 0.35 to 0.60). Regarding reasons for heterogeneous effects on medication errors, five intervention factors and two contextual factors were sufficiently reported to support subgroup analyses or meta-regression. Differences between commercial versus homegrown systems, presence and sophistication of clinical decision support, hospital-wide versus limited implementation, and US versus non-US studies were not significant, nor was timing of publication. Higher baseline rates of medication errors predicted greater reductions (P < 0.001). Other context and implementation

BackgroundThere is an increasing push for 'evidence-based' decision making in global health policy circles. However, at present there are no agreed upon standards or guidelines for how to evaluate evidence in global health. Recent evaluations of existing evidence frameworks that could serve such a purpose have identified details of program context and project implementation as missing components needed to inform policy. We performed a pilot study to assess the current state of reporting of context and implementation in studies of global health interventions.MethodsWe identified three existing criteria sets for implementation reporting and selected from them 10 criteria potentially relevant to the needs of policy makers in global health contexts. We applied these 10 criteria to 15 articles included in the evidence base for three global health interventions chosen to represent a diverse set of advocated global health programs or interventions: household water chlorination, prevention of mother-to-child transmission of HIV, and lay community health workers to reduce child mortality. We used a good-fair-poor/none scale for the ratings.ResultsThe proportion of criteria for which reporting was poor/none ranged from 11% to 54% with an average of 30%. Eight articles had 'good' or 'fair' documentation for greater than 75% of criteria, while five articles had 'poor or none' documentation for 50% of criteria or more. Examples of good reporting were identified.ConclusionsReporting of context and implementation information in studies of global health interventions is mostly fair or poor, and highly variable. The idiosyncratic variability in reporting indicates that global health investigators need more guidance about what aspects of context and implementation to measure and how to report them. This lack of context and implementation information is a major gap in the evidence needed by global health policy makers to reach decisions.

BackgroundThe Health Information Technology for Economic and Clinical Health (HITECH) Act subsidizes implementation by hospitals of electronic health records with computerized provider order entry (CPOE), which may reduce patient injuries caused by medication errors (preventable adverse drug events, pADEs). Effects on pADEs have not been rigorously quantified, and effects on medication errors have been variable. The objectives of this analysis were to assess the effectiveness of CPOE at reducing pADEs in hospital-related settings, and examine reasons for heterogeneous effects on medication errors.MethodsArticles were identified using MEDLINE, Cochrane Library, Econlit, web-based databases, and bibliographies of previous systematic reviews (September 2013). Eligible studies compared CPOE with paper-order entry in acute care hospitals, and examined diverse pADEs or medication errors. Studies on children or with limited event-detection methods were excluded. Two investigators extracted data on events and factors potentially associated with effectiveness. We used random effects models to pool data.ResultsSixteen studies addressing medication errors met pooling criteria; six also addressed pADEs. Thirteen studies used pre-post designs. Compared with paper-order entry, CPOE was associated with half as many pADEs (pooled risk ratio (RR) = 0.47, 95% CI 0.31 to 0.71) and medication errors (RR = 0.46, 95% CI 0.35 to 0.60). Regarding reasons for heterogeneous effects on medication errors, five intervention factors and two contextual factors were sufficiently reported to support subgroup analyses or meta-regression. Differences between commercial versus homegrown systems, presence and sophistication of clinical decision support, hospital-wide versus limited implementation, and US versus non-US studies were not significant, nor was timing of publication. Higher baseline rates of medication errors predicted greater reductions (P < 0.001). Other context and implementation varia

ObjectiveContinuous quality improvement (CQI) methods are foundational approaches to improving healthcare delivery. Publications using the term CQI, however, are methodologically heterogeneous, and labels other than CQI are used to signify relevant approaches. Standards for identifying the use of CQI based on its key methodological features could enable more effective learning across quality improvement (QI) efforts. The objective was to identify essential methodological features for recognizing CQI.DesignPrevious work with a 12-member international expert panel identified reliably abstracted CQI methodological features. We tested which features met rigorous a priori standards as essential features of CQI using a three-phase online modified-Delphi process.SettingPrimarily United States and Canada.Participants119 QI experts randomly assigned into four on-line panels.InterventionParticipants rated CQI features and discussed their answers using online, anonymous and asynchronous discussion boards. We analyzed ratings quantitatively and discussion threads qualitatively. Main outcome measure(s) Panel consensus on definitional CQI features.Results/st> Seventy-nine (66%) panelists completed the process. Thirty-three completers self-identified as QI researchers, 18 as QI practitioners and 28 as both equally. The features 'systematic data guided activities,' 'designing with local conditions in mind' and 'iterative development and testing' met a priori standards as essential CQI features. Qualitative analyses showed cross-cutting themes focused on differences between QI and CQI.ConclusionsWe found consensus among a broad group of CQI researchers and practitioners on three features as essential for identifying QI work more specifically as 'CQI.' All three features are needed as a minimum standard for recognizing CQI methods.

Our objective was to conduct a rigorous, structured process to create a new model of well-child care (WCC) in collaboration with a multisite community health center and 2 small, independent practices serving predominantly Medicaid-insured children. Working groups of clinicians, staff, and parents (called "Community Advisory Boards" [CABs]) used (1) perspectives of WCC stakeholders and (2) a literature review of WCC practice redesign to create 4 comprehensive WCC models for children ages 0 to 3 years. An expert panel, following a modified version of the Rand/UCLA Appropriateness Method, rated each model for potential effectiveness on 4 domains: (1) receipt of recommended services, (2) family-centeredness, (3) timely and appropriate follow-up, and (4) feasibility and efficiency. Results were provided to the CABs for selection of a final model to implement. The newly developed models rely heavily on a health educator for anticipatory guidance and developmental, behavioral, and psychosocial surveillance and screening. Each model allots a small amount of time with the pediatrician to perform a brief physical examination and to address parents' physical health concerns. A secure Web-based tool customizes the visit to parents' needs and facilitates previsit screening. Scheduled, non-face-to-face methods (text, phone) for parent communication with the health care team are also critical to these new models of care. A structured process that engages small community practices and community health centers in clinical practice redesign can produce comprehensive, site-specific, and innovative models for delivery of WCC. This process, as well as the models developed, may be applicable to other small practices and clinics interested in practice redesign.

Background: The Health Information Technology for Economic and Clinical Health (HITECH) Act subsidizes implementation by hospitals of electronic health records with computerized provider order entry (CPOE), which may reduce patient injuries caused by medication errors (preventable adverse drug events, pADEs). Effects on pADEs have not been rigorously quantified, and effects on medication errors have been variable. The objectives of this analysis were to assess the effectiveness of CPOE at reducing pADEs in hospital-related settings, and examine reasons for heterogeneous effects on medication errors. Methods: Articles were identified using MEDLINE, Cochrane Library, Econlit, web-based databases, and bibliographies of previous systematic reviews (September 2013). Eligible studies compared CPOE with paper-order entry in acute care hospitals, and examined diverse pADEs or medication errors. Studies on children or with limited event-detection methods were excluded. Two investigators extracted data on events and factors potentially associated with effectiveness. We used random effects models to pool data. Results: Sixteen studies addressing medication errors met pooling criteria; six also addressed pADEs. Thirteen studies used pre-post designs. Compared with paper-order entry, CPOE was associated with half as many pADEs (pooled risk ratio (RR) = 0.47, 95% CI 0.31 to 0.71) and medication errors (RR = 0.46, 95% CI 0.35 to 0.60). Regarding reasons for heterogeneous effects on medication errors, five intervention factors and two contextual factors were sufficiently reported to support subgroup analyses or meta-regression. Differences between commercial versus homegrown systems, presence and sophistication of clinical decision support, hospital-wide versus limited implementation, and US versus non-US studies were not significant, nor was timing of publication. Higher baseline rates of medication errors predicted greater reductions (P < 0.001). Other context and implementation

BackgroundSystematic reviews (SRs) can become outdated as new evidence emerges over time. Organizations that produce SRs need a surveillance method to determine when reviews are likely to require updating. This report describes the development and initial results of a surveillance system to assess SRs produced by the Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) Program.MethodsTwenty-four SRs were assessed using existing methods that incorporate limited literature searches, expert opinion, and quantitative methods for the presence of signals triggering the need for updating. The system was designed to begin surveillance six months after the release of the original review, and then ceforth every six months for any review not classified as being a high priority for updating. The outcome of each round of surveillance was a classification of the SR as being low, medium or high priority for updating.ResultsTwenty-four SRs underwent surveillance at least once, and ten underwent surveillance a second time during the 18 months of the program. Two SRs were classified as high, five as medium, and 17 as low priority for updating. The time lapse between the searches conducted for the original reports and the updated searches (search time lapse - STL) ranged from 11 months to 62 months: The STL for the high priority reports were 29 months and 54 months; those for medium priority reports ranged from 19 to 62 months; and those for low priority reports ranged from 11 to 33 months. Neither the STL nor the number of new relevant articles was perfectly associated with a signal for updating. Challenges of implementing the surveillance system included determining what constituted the actual conclusions of an SR that required assessing; and sometimes poor response rates of experts.ConclusionIn this system of regular surveillance of 24 systematic reviews on a variety of clinical interventions produced by a leading organization, about 70% of reviews

BackgroundSystematic reviews (SRs) can become outdated as new evidence emerges over time. Organizations that produce SRs need a surveillance method to determine when reviews are likely to require updating. This report describes the development and initial results of a surveillance system to assess SRs produced by the Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) Program.MethodsTwenty-four SRs were assessed using existing methods that incorporate limited literature searches, expert opinion, and quantitative methods for the presence of signals triggering the need for updating. The system was designed to begin surveillance six months after the release of the original review, and then ceforth every six months for any review not classified as being a high priority for updating. The outcome of each round of surveillance was a classification of the SR as being low, medium or high priority for updating.ResultsTwenty-four SRs underwent surveillance at least once, and ten underwent surveillance a second time during the 18 months of the program. Two SRs were classified as high, five as medium, and 17 as low priority for updating. The time lapse between the searches conducted for the original reports and the updated searches (search time lapse - STL) ranged from 11 months to 62 months: The STL for the high priority reports were 29 months and 54 months; those for medium priority reports ranged from 19 to 62 months; and those for low priority reports ranged from 11 to 33 months. Neither the STL nor the number of new relevant articles was perfectly associated with a signal for updating. Challenges of implementing the surveillance system included determining what constituted the actual conclusions of an SR that required assessing; and sometimes poor response rates of experts.ConclusionIn this system of regular surveillance of 24 systematic reviews on a variety of clinical interventions produced by a leading organization, about 70% of reviews

AimsTo develop a means to measure the quality of care provided to women treated for urinary incontinence (UI) through the development of quality-of-care indicators (QIs).MethodsWe performed an extensive literature review to develop a set of potential quality indicators for the management of UI. QIs were modeled after those previously described in the Assessing the Care of Vulnerable Elders (ACOVE) project. Nine experts ranked the indicators on a nine-point scale for both validity and feasibility. We analyzed preliminary rankings of each indicator using the RAND Appropriateness Method. A forum was then held in which each indicator was thoroughly discussed by the panelists as a group, after which the indicators were rated a second time individually using the same nine-point scale.ResultsQIs were developed that addressed screening, diagnosis, work-up, and both non-surgical and surgical management. Areas of controversy included whether routine screening for incontinence should be performed, whether urodynamics should be performed before non-surgical management is initiated, and whether cystoscopy should be part of the pre-operative work-up of uncomplicated stress incontinence. Following the expert panel discussion, 27 of 40 potential indicators were determined to be valid for UI with a median score of at least seven on a nine-point scale.ConclusionsWe identified 27 quality indicators for the care of women with UI. Once these QIs are pilot-tested for feasibility, they will be applied on a larger scale to measure the quality of care provided to women with UI in the United States.

BackgroundFall prevention interventions for community-dwelling older adults have been found to reduce falls in some research studies. However, wider implementation of fall prevention activities in routine care has yielded mixed results. We implemented a theory-driven program to improve care for falls at our Veterans Affairs healthcare facility. The first project arising from this program used a nurse advice telephone line to identify patients' risk factors for falls and to triage patients to appropriate services. Here we report the formative evaluation of this project.MethodsTo evaluate the intervention we: 1) interviewed patient and employee stakeholders, 2) reviewed participating patients' electronic health record data and 3) abstracted information from meeting minutes. We describe the implementation process, including whether the project was implemented according to plan; identify barriers and facilitators to implementation; and assess the incremental benefit to the quality of health care for fall prevention received by patients in the project. We also estimate the cost of developing the pilot project.ResultsThe project underwent multiple changes over its life span, including the addition of an option to mail patients educational materials about falls. During the project's lifespan, 113 patients were considered for inclusion and 35 participated. Patient and employee interviews suggested support for the project, but revealed that transportation to medical care was a major barrier in following up on fall risks identified by nurse telephone triage. Medical record review showed that the project enhanced usual medical care with respect to home safety counseling. We discontinued the program after 18 months due to staffing limitations and competing priorities. We estimated a cost of $9194 for meeting time to develop the project.ConclusionsThe project appeared feasible at its outset but could not be sustained past the first cycle of evaluation due to insufficient resourc

Background Fall prevention interventions for community-dwelling older adults have been found to reduce falls in some research studies. However, wider implementation of fall prevention activities in routine care has yielded mixed results. We implemented a theory-driven program to improve care for falls at our Veterans Affairs healthcare facility. The first project arising from this program used a nurse advice telephone line to identify patients' risk factors for falls and to triage patients to appropriate services. Here we report the formative evaluation of this project. Methods To evaluate the intervention we: 1) interviewed patient and employee stakeholders, 2) reviewed participating patients' electronic health record data and 3) abstracted information from meeting minutes. We describe the implementation process, including whether the project was implemented according to plan; identify barriers and facilitators to implementation; and assess the incremental benefit to the quality of health care for fall prevention received by patients in the project. We also estimate the cost of developing the pilot project. Results The project underwent multiple changes over its life span, including the addition of an option to mail patients educational materials about falls. During the project's lifespan, 113 patients were considered for inclusion and 35 participated. Patient and employee interviews suggested support for the project, but revealed that transportation to medical care was a major barrier in following up on fall risks identified by nurse telephone triage. Medical record review showed that the project enhanced usual medical care with respect to home safety counseling. We discontinued the program after 18 months due to staffing limitations and competing priorities. We estimated a cost of $9194 for meeting time to develop the project. Conclusions The project appeared feasible at its outset but could not be sustained past the first cycle of evaluation due to insu

Background The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and QI practitioners to access the literature systematically and to identify relevant publications. Methods We evaluated search strategies developed for MEDLINE (Ovid) and PubMed based on free text words, Medical subject headings (MeSH), QI intervention components, continuous quality improvement (CQI) methods, and combinations of the strategies. Three sets of pertinent QI intervention publications were used for validation. Two independent expert reviewers screened publications for relevance. We compared the yield, recall rate, and precision of the search strategies for the identification of QI publications and for a subset of empirical studies on effects of QI interventions. Results The search yields ranged from 2,221 to 216,167 publications. Mean recall rates for reference publications ranged from 5% to 53% for strategies with yields of 50,000 publications or fewer. The 'best case' strategy, a simple text word search with high face validity ('quality' AND 'improv*' AND 'intervention*') identified 44%, 24%, and 62% of influential intervention articles selected by Agency for Healthcare Research and Quality (AHRQ) experts, a set of exemplar articles provided by members of the Standards for Quality Improvement Reporting Excellence (SQUIRE) group, and a sample from the Cochrane Effective Practice and Organization of Care Group (EPOC) register of studies, respectively. We applied the search strategy to a PubMed search for articles published in 10 pertinent journals in a three-year period which retrieved 183 publications. Among these, 67% were deemed relevant to QI by at least one of two independent raters. Forty percent were classified as empirical studies reporting on a QI intervention. Conclusions The presented search terms a

Background Fall prevention interventions for community-dwelling older adults have been found to reduce falls in some research studies. However, wider implementation of fall prevention activities in routine care has yielded mixed results. We implemented a theory-driven program to improve care for falls at our Veterans Affairs healthcare facility. The first project arising from this program used a nurse advice telephone line to identify patients' risk factors for falls and to triage patients to appropriate services. Here we report the formative evaluation of this project. Methods To evaluate the intervention we: 1) interviewed patient and employee stakeholders, 2) reviewed participating patients' electronic health record data and 3) abstracted information from meeting minutes. We describe the implementation process, including whether the project was implemented according to plan; identify barriers and facilitators to implementation; and assess the incremental benefit to the quality of health care for fall prevention received by patients in the project. We also estimate the cost of developing the pilot project. Results The project underwent multiple changes over its life span, including the addition of an option to mail patients educational materials about falls. During the project's lifespan, 113 patients were considered for inclusion and 35 participated. Patient and employee interviews suggested support for the project, but revealed that transportation to medical care was a major barrier in following up on fall risks identified by nurse telephone triage. Medical record review showed that the project enhanced usual medical care with respect to home safety counseling. We discontinued the program after 18 months due to staffing limitations and competing priorities. We estimated a cost of $9194 for meeting time to develop the project. Conclusions The project appeared feasible at its outset but could not be sustained past the first cycle of evaluation due to insu

Background The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and QI practitioners to access the literature systematically and to identify relevant publications. Methods We evaluated search strategies developed for MEDLINE (Ovid) and PubMed based on free text words, Medical subject headings (MeSH), QI intervention components, continuous quality improvement (CQI) methods, and combinations of the strategies. Three sets of pertinent QI intervention publications were used for validation. Two independent expert reviewers screened publications for relevance. We compared the yield, recall rate, and precision of the search strategies for the identification of QI publications and for a subset of empirical studies on effects of QI interventions. Results The search yields ranged from 2,221 to 216,167 publications. Mean recall rates for reference publications ranged from 5% to 53% for strategies with yields of 50,000 publications or fewer. The 'best case' strategy, a simple text word search with high face validity ('quality' AND 'improv*' AND 'intervention*') identified 44%, 24%, and 62% of influential intervention articles selected by Agency for Healthcare Research and Quality (AHRQ) experts, a set of exemplar articles provided by members of the Standards for Quality Improvement Reporting Excellence (SQUIRE) group, and a sample from the Cochrane Effective Practice and Organization of Care Group (EPOC) register of studies, respectively. We applied the search strategy to a PubMed search for articles published in 10 pertinent journals in a three-year period which retrieved 183 publications. Among these, 67% were deemed relevant to QI by at least one of two independent raters. Forty percent were classified as empirical studies reporting on a QI intervention. Conclusions The presented search terms a

BackgroundFall prevention interventions for community-dwelling older adults have been found to reduce falls in some research studies. However, wider implementation of fall prevention activities in routine care has yielded mixed results. We implemented a theory-driven program to improve care for falls at our Veterans Affairs healthcare facility. The first project arising from this program used a nurse advice telephone line to identify patients' risk factors for falls and to triage patients to appropriate services. Here we report the formative evaluation of this project.MethodsTo evaluate the intervention we: 1) interviewed patient and employee stakeholders, 2) reviewed participating patients' electronic health record data and 3) abstracted information from meeting minutes. We describe the implementation process, including whether the project was implemented according to plan; identify barriers and facilitators to implementation; and assess the incremental benefit to the quality of health care for fall prevention received by patients in the project. We also estimate the cost of developing the pilot project.ResultsThe project underwent multiple changes over its life span, including the addition of an option to mail patients educational materials about falls. During the project's lifespan, 113 patients were considered for inclusion and 35 participated. Patient and employee interviews suggested support for the project, but revealed that transportation to medical care was a major barrier in following up on fall risks identified by nurse telephone triage. Medical record review showed that the project enhanced usual medical care with respect to home safety counseling. We discontinued the program after 18 months due to staffing limitations and competing priorities. We estimated a cost of $9194 for meeting time to develop the project.ConclusionsThe project appeared feasible at its outset but could not be sustained past the first cycle of evaluation due to insufficient resourc

Determining whether persons with multiple sclerosis (MS) receive appropriate, comprehensive healthcare requires tools for measuring quality. The objective of this study was to develop quality indicators for the care of persons with MS. We used a modified version of the RAND/UCLA Appropriateness Method in a two-stage process to identify relevant MS care domains and to assess the validity of indicators within high-ranking care domains. Based on a literature review, interviews with persons with MS, and discussions with MS providers, 25 MS symptom domains and 14 general health domains of MS care were identified. A multidisciplinary panel of 15 stakeholders of MS care, including 4 persons with MS, rated these 39 domains in a two-round modified Delphi process. The research team performed an expanded literature review for 26 highly ranked domains to draft 86 MS care indicators. Through another two-round modified Delphi process, a second panel of 18 stakeholders rated these indicators using a nine-point response scale. Indicators with a median rating in the highest tertile were considered valid. Among the most highly rated MS care domains were appropriateness and timeliness of the diagnostic work-up, bladder dysfunction, cognition dysfunction, depression, disease-modifying agent usage, fatigue, integration of care, and spasticity. Of the 86 preliminary indicators, 76 were rated highly enough to meet predetermined thresholds for validity. Following a widely accepted methodology, we developed a comprehensive set of quality indicators for MS care that can be used to assess quality of care and guide the design of interventions to improve care among persons with MS.