Search

Importance Patient care should be informed by clinical practice guidelines, which in turn should be informed by evidence from reliable systematic reviews. The American Academy of Ophthalmology is updating its Preferred Practice Patterns (PPPs) for the management of the following 6 corneal diseases: bacterial keratitis, blepharitis, conjunctivitis, corneal ectasia, corneal edema and opacification, and dry eye syndrome. Objective To summarize the reliability of the existing systematic reviews addressing interventions for corneal diseases. Data Source The Cochrane Eyes and Vision US Satellite database. Study Selection In this study of published systematic reviews from 1997 to 2017 (median, 2014), the Cochrane Eyes and Vision US Satellite database was searched for systematic reviews evaluating interventions for the management of any corneal disease, combiningeyesandvisionkeywords and controlled vocabulary terms with a validated search filter. Data Extraction and Synthesis The study classified systematic reviews as reliable when each of the following 5 criteria were met: the systematic review specified eligibility criteria for inclusion of studies, conducted a comprehensive literature search for studies, assessed risk of bias of the individual included studies, used appropriate methods for quantitative syntheses (meta-analysis) (only assessed if meta-analysis was performed), and had conclusions that were supported by the results of the systematic review. They were classified as unreliable if at least 1 criterion was not met. Main Outcomes and Measures The proportion of systematic reviews that were reliable and the reasons for unreliability. Results This study identified 98 systematic reviews that addressed interventions for 15 corneal diseases. Thirty-three of 98 systematic reviews (34%) were classified as unreliable. The most frequent reasons for unreliability were that the systematic review did not conduct a comprehensive literature search for studies (22 of 33 [67%]), did not assess risk of bias of the individual included studies (13 of 33 [39%]), and did not use appropriate methods for quantitative syntheses (meta-analysis) (12 of 17 systematic reviews that conducted a quantitative synthesis [71%]). Sixty-five of 98 systematic reviews (66%) were classified as reliable. Forty-two of the 65 reliable systematic reviews (65%) addressed corneal diseases relevant to the 2018 American Academy of Ophthalmology PPPs; 33 of these 42 systematic reviews (79%) are cited in the 2018 PPPs. Conclusions and Relevance One in 3 systematic reviews addressing interventions for corneal diseases are unreliable and thus were not used to inform PPP recommendations. Careful adherence by systematic reviewers and journal editors to well-established best practices regarding systematic review conduct and reporting might help make future systematic reviews in eyes and vision more reliable.

Importance Trustworthy clinical practice guidelines require reliable systematic reviews of the evidence to support recommendations. Since 2016, the American Academy of Ophthalmology (AAO) has partnered with Cochrane Eyes and Vision US Satellite to update their guidelines, the Preferred Practice Patterns (PPP). Objective To describe experiences and findings related to identifying reliable systematic reviews that support topics likely to be addressed in the 2016 update of the 2011 AAO PPP guidelines on cataract in the adult eye. Design, Setting, and Participants Cross-sectional study. Systematic reviews on the management of cataract were searched for in an established database. Each relevant systematic review was mapped to 1 or more of the 24 management categories listed under the Management section of the table of contents of the 2011 AAO PPP guidelines. Data were extracted to determine the reliability of each systematic review using prespecified criteria, and the reliable systematic reviews were examined to find whether they were referenced in the 2016 AAO PPP guidelines. For comparison, we assessed whether the reliable systematic reviews published before February 2010 the last search date of the 2011 AAO PPP guidelines were referenced in the 2011 AAO PPP guidelines. Cochrane Eyes and Vision US Satellite did not provide systematic reviews to the AAO during the development of the 2011 AAO PPP guidelines. Main Outcomes and Measures Systematic review reliability was defined by reporting eligibility criteria, performing a comprehensive literature search, assessing methodologic quality of included studies, using appropriate methods for meta-analysis, and basing conclusions on review findings. Results From 99 systematic reviews on management of cataract, 46 (46%) were classified as reliable. No evidence that a comprehensive search had been conducted was the most common reason a review was classified as unreliable. All 46 reliable systematic reviews were cited in the 2016 AAO PPP guidelines, and 8 of 15 available reliable reviews (53%) were cited in the 2011 PPP guidelines. Conclusions and Relevance The partnership between Cochrane Eyes and Vision US Satellite and the AAO provides the AAO access to an evidence base of relevant and reliable systematic reviews, thereby supporting robust and efficient clinical practice guidelines development to improve the quality of eye care.

Importance Suboptimal overlap in outcomes reported in clinical trials and systematic reviews compromises efforts to compare and summarize results across these studies. Objectives To examine the most frequent outcomes used in trials and reviews of the 4 most prevalent eye diseases (age-related macular degeneration [AMD], cataract, diabetic retinopathy [DR], and glaucoma) and the overlap between outcomes in the reviews and the trials included in the reviews. Design, Setting, and Participants This cross-sectional study examined all Cochrane reviews that addressed AMD, cataract, DR, and glaucoma; were published as of July 20, 2016; and included at least 1 trial and the trials included in the reviews. For each disease, a pair of clinical experts independently classified all outcomes and resolved discrepancies. Outcomes (outcome domains) were then compared separately for each disease. Main Outcomes and Measures Proportion of review outcomes also reported in trials and vice versa. Results This study included 56 reviews that comprised 414 trials. Although the median number of outcomes per trial and per review was the same (n = 5) for each disease, the trials included a greater number of outcomes overall than did the reviews, ranging from 2.9 times greater (89 vs 30 outcomes for glaucoma) to 4.9 times greater (107 vs 22 outcomes for AMD). Most review outcomes, ranging from 14 of 19 outcomes (73.7%) (for DR) to 27 of 29 outcomes (93.1%) (for cataract), were also reported in the trials. For trial outcomes, however, the proportion also named in reviews was low, ranging from 19 of 107 outcomes (17.8%) (for AMD) to 24 of 89 outcomes (27.0%) (for glaucoma). Only 1 outcome (visual acuity) was consistently reported in greater than half the trials and greater than half the reviews. Conclusions and Relevance Although most review outcomes were reported in the trials, most trial outcomes were not reported in the reviews. The current analysis focused on outcome domains, which might underestimate the problem of inconsistent outcomes. Other important elements of an outcome (ie, specific measurement, specific metric, method of aggregation, and time points) might have differed even though the domains overlapped. Inconsistency in trial outcomes may impede research synthesis and indicates the need for disease-specific core outcome sets in ophthalmology.