Search

Author guidelines for journals could help to promote transparency, openness, and reproducibility

Background and Objective: Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024., Methods: The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement., Results: From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review's title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts., Conclusion: PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. NOTE: This paper was jointly developed by Journal of Clinical Epidemiology, Quality of Life Research, Journal of Patient Reported Outcomes, Health and Quality of Life Outcomes and jointly published by Elsevier Inc, Springer Nature Switzerland AG, and BioMed Central Ltd., part of Springer Nature. The articles are identical except for minor stylistic and spelling differences in keeping with each journal's style. Either citation can be used when citing this article., Competing Interests: Declaration of competing interest Drs Terwee and Mokkink are the founders of COSMIN; Dr Moher is a member of the PRISMA executive; Dr Tricco is the co-editor in chief of the Journal of Clinical Epidemiology. The other authors have no conflicts of interest., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

"Spin" refers to misleading reporting, interpretation, and extrapolation of findings in primary and secondary research (such as in systematic reviews). The study of spin primarily focuses on beneficial outcomes. The objectives of this research were threefold: first, to develop a framework for identifying spin associated with harms in systematic reviews of interventions; second, to apply the framework to a set of reviews, thereby pinpointing instances where spin may be present; and finally, to revise the spin examples, offering guidance on how spin can be rectified., The authors developed their framework through an iterative process that engaged an international group of researchers specializing in spin and reporting bias. The framework comprises 12 specific types of spin for harms, grouped by 7 categories across the 3 domains (reporting, interpretation, and extrapolation). The authors subsequently gathered instances of spin from a random sample of 100 systematic reviews of interventions. Of the 58 reviews that assessed harm and the 42 that did not, they found that 28 (48%) and 6 (14%), respectively, had at least 1 of the 12 types of spin for harms. Inappropriate extrapolation of the results and conclusions for harms to populations, interventions, outcomes, or settings not assessed in a review was the most common category of spin in 17 of 100 reviews., The authors revised the examples to remove spin, taking into consideration the context (for example, medical discipline, source population), findings for harms, and methodological limitations of the original reviews. They provide guidance for authors, peer reviewers, and editors in recognizing and rectifying or (preferably) avoiding spin, ultimately enhancing the clarity and accuracy of harms reporting in systematic review publications., Competing Interests: Disclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M24-0771.

Equity and health equity are fundamental pillars in fostering a just and inclusive society. While equity underscores fairness in resource allocation and opportunity, health equity aims to eradicate avoidable health disparities among social groups. The concept of harms in interventions-undesirable consequences associated with the use of interventions-often varies across populations due to biological and social factors, necessitating a nuanced understanding. An equity lens reveals disparities in harm distribution, urging researchers and policymakers to address these differences in their decision-making processes. Furthermore, interventions, even well-intentioned ones, can inadvertently exacerbate disparities, emphasizing the need for comprehensive harm assessment. Integrating equity considerations in research practices and trial methodologies, through study design or through practices such as inclusive participant recruitment, is pivotal in advancing health equity. By prioritizing interventions that address disparities and ensuring inclusivity in research, we can foster a more equitable healthcare system., (© 2024. The Author(s).)

Importance: Publishing study protocols might reduce research waste because of unclear methods or incomplete reporting; on the other hand, there might be few additional benefits of publishing protocols for registered trials that are never completed or published. No study has investigated the proportion of published protocols associated with published results., Objective: To estimate the proportion of published trial protocols for which there are not associated published results., Design, Setting, and Participants: This cross-sectional study used stratified random sampling to identify registered clinical trials with protocols published between January 2011 and August 2022 and indexed in PubMed Central. Ongoing studies and those within 1 year of the primary completion date on ClinicalTrials.gov were excluded. Published results were sought from August 2022 to March 2023 by searching ClinicalTrials.gov, emailing authors, and using an automated tool, as well as through incidental discovery., Main Outcomes and Measures: The primary outcome was a weighted estimate of the proportion of registered trials with published protocols that also had published main results. The proportion of trials with unpublished results was estimated using a weighted mean., Results: From 1500 citations that were screened, 308 clinical trial protocols were included, and it was found that 87 trials had not published their main results. Most included trials were investigator-initiated evaluations of nonregulated products. When published, results appeared a mean (SD) of 3.4 (2.0) years after protocol publications. With the use of a weighted mean, an estimated 4754 (95% CI, 4296-5226) eligible clinical trial protocols were published and indexed in PubMed Central between 2011 and 2022. In the weighted analysis, 1708 of those protocols (36%; 95% CI, 31%-41%) were not associated with publication of main results. In a sensitivity analysis excluding protocols published after 2019, an estimated 25% (95% CI, 20%-30%) of 3670 (95% CI, 3310-4032) protocol publications were not associated with publication of main results., Conclusions and Relevance: This cross-sectional study of clinical trial protocols published on PubMed Central between 2011 and 2022 suggests that many protocols were not associated with subsequent publication of results. The overall benefits of publishing study protocols might outweigh the research waste caused by unnecessary protocol publications.

Objectives: We sought to assess and report harms that were observed but not disclosed previously in clinical trials of gabapentin., Study Design and Setting: We reanalyzed individual participant data from six randomized parallel trials of gabapentin for neuropathic pain, and we conducted meta-analyses. Between 1996 and 2003, adult participants were assigned to gabapentin (600 mg-3,600 mg per day) or placebo for 7-14 weeks. We calculated the proportion of participants with: one or more adverse events (AEs), one or more serious AEs, discontinued, discontinued because AEs. We also estimated effects on AEs at three levels of aggregation using COSTART, a hierarchical system for classifying AEs: body system, midlevel system, preferred term., Results: We found evidence of important harms that were neither included in published trial reports nor included in systematic reviews. Aggregating related harms led to greater confidence that gabapentin might harm the nervous system and possibly the digestive, metabolic and nutritional, respiratory, sensory, and urogenital body systems. Nervous system harms were more common than previous reports suggest., Conclusion: Clinical trials identified harms that were not reported publicly, and journal articles overstated uncertainty about harms. Relying on journal articles to evaluate gabapentin's harms could contribute to incomplete and misleading conclusions in systematic reviews and guidelines. To prevent bias arising from the selective nonreporting of results, journal articles should describe how to access data for all harms observed in clinical trials (e.g., by sharing individual participant data)., Competing Interests: Declaration of competing interest Evan Mayo-Wilson and Tianjing Li previously received support for research about gabapentin from the Patient Centered Outcomes Research Institute (PCORI). All other authors declare they have no competing interests., (Copyright © 2023 Elsevier Inc. All rights reserved.)

Competing Interests: Competing interests: All authors have completed the ICMJE disclosure form at https://www.icmje.org/disclosure-of-interest/ and declare: no support from any organisation for the submitted work; JJK is a statistical editor for The BMJ, for which he receives remuneration; EM-W has received grants/contracts from the Patient Centered Outcomes Research Institute, National Institutes of Health, Arnold Ventures, and Robert Wood Johnson Foundation, has received consulting fees for editorial work from Origin Editorial, payment/honorariums from the American Public Health Association and National Institutes of Health, and has an unpaid leadership role in the American Psychological Association; LB has received grants/contracts from the state of Colorado, Cochrane, and the US Environmental Protection Agency, has received consulting fees for work as a conflict of interest advisor from Health Canada, has received support for travel from the National Academy of Science Engineering and Medicine, Cochrane and the World Congress on Research Integrity, and has an unpaid chair role for the National Academy of Science Engineering and Medicine committees; EHT has received an honorarium for a lecture on publication bias from the University of British Columbia, Canada; all other authors declare having no competing interests.

Evidence-based policy uses intervention research to inform consequential decisions about resource allocation. Research findings are often published in peer-reviewed journals. Because detrimental research practices associated with closed science are common, journal articles report more false-positives and exaggerated effect sizes than would be desirable. Journal implementation of standards that promote open science-such as the transparency and openness promotion (TOP) guidelines-could reduce detrimental research practices and improve the trustworthiness of research evidence on intervention effectiveness. We evaluated TOP implementation at 339 peer-reviewed journals that have been used to identify evidence-based interventions for policymaking and programmatic decisions. Each of ten open science standards in TOP was not implemented in most journals' policies (instructions to authors), procedures (manuscript submission systems), or practices (published articles). Journals implementing at least one standard typically encouraged, but did not require, an open science practice. We discuss why and how journals could improve implementation of open science standards to safeguard evidence-based policy., (© 2023. Society for Prevention Research.)

Objectives: To describe randomized controlled trial (RCT) methodology reporting over time., Study Design and Setting: We used a deep learning-based sentence classification model based on the Consolidated Standards of Reporting Trials (CONSORT) statement, considered minimum requirements for reporting RCTs. We included 176,469 RCT reports published between 1966 and 2018. We analyzed the reporting trends over 5-year time periods, grouping trials from 1966 to 1990 in a single stratum. We also explored the effect of journal impact factor (JIF) and medical discipline., Results: Population, Intervention, Comparator, Outcome (PICO) items were commonly reported during each period, and reporting increased over time (e.g., interventions: 79.1% during 1966-1990 to 87.5% during 2010-2018). Reporting of some methods information has increased, although there is room for improvement (e.g., sequence generation: 10.8-41.8%). Some items are reported infrequently (e.g., allocation concealment: 5.1-19.3%). The number of items reported and JIF are weakly correlated (Pearson's r (162,702) = 0.16, P < 0.001). The differences in the proportion of items reported between disciplines are small (<10%)., Conclusion: Our analysis provides large-scale quantitative support for the hypothesis that RCT methodology reporting has improved over time. Extending these models to all CONSORT items could facilitate compliance checking during manuscript authoring and peer review, and support metaresearch., Competing Interests: Declaration of competing interest H.K., L.J., L.H., and E.M.-W. received funding from the National Library Of Medicine of the National Institutes of Health under the award number R01LM014079. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funder had no role in considering the study design or in the collection, analysis, interpretation of data, writing of the report, or decision to submit the article for publication., (Copyright © 2023 Elsevier Inc. All rights reserved.)

Randomized controlled trials remain the reference standard for healthcare research on effects of interventions, and the need to report both benefits and harms is essential. The Consolidated Standards of Reporting Trials (the main CONSORT) statement includes one item on reporting harms (i.e., all important harms or unintended effects in each group). In 2004, the CONSORT group developed the CONSORT Harms extension; however, it has not been consistently applied and needs to be updated. Here, we describe CONSORT Harms 2022, which replaces the CONSORT Harms 2004 checklist, and shows how CONSORT Harms 2022 items could be incorporated into the main CONSORT checklist. Thirteen items from the main CONSORT were modified to improve harms reporting. Three new items were added. In this article, we describe CONSORT Harms 2022 and how it was integrated into the main CONSORT checklist and elaborate on each item relevant to complete reporting of harms in randomized controlled trials. Until future work from the CONSORT group produces an updated checklist, authors, journal reviewers, and editors of randomized controlled trials should use the integrated checklist presented in this paper., (Copyright © 2023. Published by Elsevier Inc.)

Background: Zinc deficiency is prevalent in low- and middle-income countries, and is considered a significant risk factor for morbidity, mortality, and linear growth failure. The effectiveness of preventive zinc supplementation in reducing prevalence of zinc deficiency needs to be assessed., Objectives: To assess the effects of zinc supplementation for preventing mortality and morbidity, and for promoting growth, in children aged 6 months to 12 years., Search Methods: A previous version of this review was published in 2014. In this update, we searched CENTRAL, MEDLINE, Embase, five other databases, and one trials register up to February 2022, together with reference checking and contact with study authors to identify additional studies., Selection Criteria: Randomized controlled trials (RCTs) of preventive zinc supplementation in children aged 6 months to 12 years compared with no intervention, a placebo, or a waiting list control. We excluded hospitalized children and children with chronic diseases or conditions. We excluded food fortification or intake, sprinkles, and therapeutic interventions., Data Collection and Analysis: Two review authors screened studies, extracted data, and assessed the risk of bias. We contacted study authors for missing information and used GRADE to assess the certainty of evidence. The primary outcomes of this review were all-cause mortality; and cause-specific mortality, due to all-cause diarrhea, lower respiratory tract infection (LRTI, including pneumonia), and malaria. We also collected information on a number of secondary outcomes, such as those related to diarrhea and LRTI morbidity, growth outcomes and serum levels of micronutrients, and adverse events., Main Results: We included 16 new studies in this review, resulting in a total of 96 RCTs with 219,584 eligible participants. The included studies were conducted in 34 countries; 87 of them in low- or middle-income countries. Most of the children included in this review were under five years of age. The intervention was delivered most commonly in the form of syrup as zinc sulfate, and the most common dose was between 10 mg and 15 mg daily. The median duration of follow-up was 26 weeks. We did not consider that the evidence for the key analyses of morbidity and mortality outcomes was affected by risk of bias. High-certainty evidence showed little to no difference in all-cause mortality with preventive zinc supplementation compared to no zinc (risk ratio (RR) 0.93, 95% confidence interval (CI) 0.84 to 1.03; 16 studies, 17 comparisons, 143,474 participants). Moderate-certainty evidence showed that preventive zinc supplementation compared to no zinc likely results in little to no difference in mortality due to all-cause diarrhea (RR 0.95, 95% CI 0.69 to 1.31; 4 studies, 132,321 participants); but probably reduces mortality due to LRTI (RR 0.86, 95% CI 0.64 to 1.15; 3 studies, 132,063 participants) and mortality due to malaria (RR 0.90, 95% CI 0.77 to 1.06; 2 studies, 42,818 participants); however, the confidence intervals around the summary estimates for these outcomes were wide, and we could not rule out a possibility of increased risk of mortality. Preventive zinc supplementation likely reduces the incidence of all-cause diarrhea (RR 0.91, 95% CI 0.90 to 0.93; 39 studies, 19,468 participants; moderate-certainty evidence) but results in little to no difference in morbidity due to LRTI (RR 1.01, 95% CI 0.95 to 1.08; 19 studies, 10,555 participants; high-certainty evidence) compared to no zinc. There was moderate-certainty evidence that preventive zinc supplementation likely leads to a slight increase in height (standardized mean difference (SMD) 0.12, 95% CI 0.09 to 0.14; 74 studies, 20,720 participants). Zinc supplementation was associated with an increase in the number of participants with at least one vomiting episode (RR 1.29, 95% CI 1.14 to 1.46; 5 studies, 35,192 participants; high-certainty evidence). We report a number of other outcomes, including the effect of zinc supplementation on weight and serum markers such as zinc, hemoglobin, iron, copper, etc. We also performed a number of subgroup analyses and there was a consistent finding for a number of outcomes that co-supplementation of zinc with iron decreased the beneficial effect of zinc., Authors' Conclusions: Even though we included 16 new studies in this update, the overall conclusions of the review remain unchanged. Zinc supplementation might help prevent episodes of diarrhea and improve growth slightly, particularly in children aged 6 months to 12 years of age. The benefits of preventive zinc supplementation may outweigh the harms in regions where the risk of zinc deficiency is relatively high., (Copyright © 2023 The Cochrane Collaboration. Published by John Wiley & Sons, Ltd.)

The Transparency and Openness Promotion (TOP) Guidelines provide a framework to help journals develop open science policies. Theories of behaviour change can guide understanding of why journals do (not) implement open science policies and the development of interventions to improve these policies. In this study, we used the Theoretical Domains Framework to survey 88 journal editors on their capability, opportunity and motivation to implement TOP. Likert-scale questions assessed editor support for TOP, and enablers and barriers to implementing TOP. A qualitative question asked editors to provide reflections on their ratings. Most participating editors supported adopting TOP at their journal (71%) and perceived other editors in their discipline to support adopting TOP (57%). Most editors (93%) agreed their roles include maintaining policies that reflect current best practices. However, most editors (74%) did not see implementing TOP as a high priority compared with other editorial responsibilities. Qualitative responses expressed structural barriers to implementing TOP (e.g. lack of time, resources and authority to implement changes) and varying support for TOP depending on study type, open science standard, and level of implementation. We discuss how these findings could inform the development of theoretically guided interventions to increase open science policies, procedures and practices., (© 2023 The Authors.)

To date, nutritional epidemiology has relied heavily on relatively weak methods including simple observational designs and substandard measurements. Despite low internal validity and other sources of bias, claims of causality are made commonly in this literature. Nutritional epidemiology investigations can be improved through greater scientific rigor and adherence to scientific reporting commensurate with research methods used. Some commentators advocate jettisoning nutritional epidemiology entirely, perhaps believing improvements are impossible. Still others support only normative refinements. But neither abolition nor minor tweaks are appropriate. Nutritional epidemiology, in its present state, offers utility, yet also needs marked, reformational renovation. Changing the status quo will require ongoing, unflinching scrutiny of research questions, practices, and reporting-and a willingness to admit that "good enough" is no longer good enough. As such, a workshop entitled "Toward more rigorous and informative nutritional epidemiology: the rational space between dismissal and defense of the status quo" was held from July 15 to August 14, 2020. This virtual symposium focused on: (1) Stronger Designs, (2) Stronger Measurement, (3) Stronger Analyses, and (4) Stronger Execution and Reporting. Participants from several leading academic institutions explored existing, evolving, and new better practices, tools, and techniques to collaboratively advance specific recommendations for strengthening nutritional epidemiology.

In clinical trials, harms (i.e., adverse events) are often reported by simply counting the number of people who experienced each event. Reporting only frequencies ignores other dimensions of the data that are important for stakeholders, including severity, seriousness, rate (recurrence), timing, and groups of related harms. Additionally, application of selection criteria to harms prevents most from being reported. Visualization of data could improve communication of multidimensional data. We replicated and compared the characteristics of 6 different approaches for visualizing harms: dot plot, stacked bar chart, volcano plot, heat map, treemap, and tendril plot. We considered binary events using individual participant data from a randomized trial of gabapentin for neuropathic pain. We assessed their value using a heuristic approach and a group of content experts. We produced all figures using R and share the open-source code on GitHub. Most original visualizations propose presenting individual harms (e.g., dizziness, somnolence) alone or alongside higher level (e.g., by body systems) summaries of harms, although they could be applied at either level. Visualizations can present different dimensions of all harms observed in trials. Except for the tendril plot, all other plots do not require individual participant data. The dot plot and volcano plot are favored as visualization approaches to present an overall summary of harms data. Our value assessment found the dot plot and volcano plot were favored by content experts. Using visualizations to report harms could improve communication. Trialists can use our provided code to easily implement these approaches., (© The Author(s) 2022. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health.)

Importance: Complete information in a trial protocol regarding study outcomes is crucial for obtaining regulatory approvals, ensuring standardized trial conduct, reducing research waste, and providing transparency of methods to facilitate trial replication, critical appraisal, accurate reporting and interpretation of trial results, and knowledge synthesis. However, recommendations on what outcome-specific information should be included are diverse and inconsistent. To improve reporting practices promoting transparent and reproducible outcome selection, assessment, and analysis, a need for specific and harmonized guidance as to what outcome-specific information should be addressed in clinical trial protocols exists., Objective: To develop harmonized, evidence- and consensus-based standards for describing outcomes in clinical trial protocols through integration with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 statement., Evidence Review: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for outcome-specific reporting to be addressed in clinical trial protocols., Findings: The scoping review and consultation with experts identified 108 recommendations relevant to outcome-specific reporting to be addressed in trial protocols, the majority (72%) of which were not included in the SPIRIT 2013 statement. All recommendations were consolidated into 56 items for Delphi voting; after the Delphi survey process, 19 items met criteria for further evaluation at the consensus meeting and possible inclusion in the SPIRIT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 9 items that elaborate on the SPIRIT 2013 statement checklist items and are related to completely defining and justifying the choice of primary, secondary, and other outcomes (SPIRIT 2013 statement checklist item 12) prospectively in the trial protocol, defining and justifying the target difference between treatment groups for the primary outcome used in the sample size calculations (SPIRIT 2013 statement checklist item 14), describing the responsiveness of the study instruments used to assess the outcome and providing details on the outcome assessors (SPIRIT 2013 statement checklist item 18a), and describing any planned methods to account for multiplicity relating to the analyses or interpretation of the results (SPIRIT 2013 statement checklist item 20a)., Conclusions and Relevance: This SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement provides 9 outcome-specific items that should be addressed in all trial protocols and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

Importance: Clinicians, patients, and policy makers rely on published results from clinical trials to help make evidence-informed decisions. To critically evaluate and use trial results, readers require complete and transparent information regarding what was planned, done, and found. Specific and harmonized guidance as to what outcome-specific information should be reported in publications of clinical trials is needed to reduce deficient reporting practices that obscure issues with outcome selection, assessment, and analysis., Objective: To develop harmonized, evidence- and consensus-based standards for reporting outcomes in clinical trial reports through integration with the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement., Evidence Review: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for the reporting of outcomes in clinical trial reports., Findings: The scoping review and consultation with experts identified 128 recommendations relevant to reporting outcomes in trial reports, the majority (83%) of which were not included in the CONSORT 2010 statement. All recommendations were consolidated into 64 items for Delphi voting; after the Delphi survey process, 30 items met criteria for further evaluation at the consensus meeting and possible inclusion in the CONSORT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 17 items that elaborate on the CONSORT 2010 statement checklist items and are related to completely defining and justifying the trial outcomes, including how and when they were assessed (CONSORT 2010 statement checklist item 6a), defining and justifying the target difference between treatment groups during sample size calculations (CONSORT 2010 statement checklist item 7a), describing the statistical methods used to compare groups for the primary and secondary outcomes (CONSORT 2010 statement checklist item 12a), and describing the prespecified analyses and any outcome analyses not prespecified (CONSORT 2010 statement checklist item 18)., Conclusions and Relevance: This CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement provides 17 outcome-specific items that should be addressed in all published clinical trial reports and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

Objectives: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices., Methods: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility., Results: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0-27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55-0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability., Conclusion: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies., Registration: OSF ( https://osf.io/d2t4s/ )., (© 2022. The Author(s).)

The field of prevention science aims to understand societal problems, identify effective interventions, and translate scientific evidence into policy and practice. There is growing interest among prevention scientists in the potential for transparency, openness, and reproducibility to facilitate this mission by providing opportunities to align scientific practice with scientific ideals, accelerate scientific discovery, and broaden access to scientific knowledge. The overarching goal of this manuscript is to serve as a primer introducing and providing an overview of open science for prevention researchers. In this paper, we discuss factors motivating interest in transparency and reproducibility, research practices associated with open science, and stakeholders engaged in and impacted by open science reform efforts. In addition, we discuss how and why different types of prevention research could incorporate open science practices, as well as ways that prevention science tools and methods could be leveraged to advance the wider open science movement. To promote further discussion, we conclude with potential reservations and challenges for the field of prevention science to address as it transitions to greater transparency, openness, and reproducibility. Throughout, we identify activities that aim to strengthen the reliability and efficiency of prevention science, facilitate access to its products and outputs, and promote collaborative and inclusive participation in research activities. By embracing principles of transparency, openness, and reproducibility, prevention science can better achieve its mission to advance evidence-based solutions to promote individual and collective well-being., (© 2022. The Author(s).)

Clearinghouses are influential repositories of information on the effectiveness of social interventions. To identify which interventions are "evidence-based," clearinghouses review intervention evaluations using published standards of evidence that focus primarily on internal validity and causal inferences. Open science practices can improve trust in evidence from evaluations on the effectiveness of social interventions. Including open science practices in clearinghouse standards of evidence is one of many efforts that could increase confidence in designations of interventions as "evidence-based." In this study, we examined the policies, procedures, and practices of 10 federal evidence clearinghouses that review preventive interventions-an important and influential subset of all evidence clearinghouses. We found that seven consider at least one open science practice when evaluating interventions: replication (6 of 10 clearinghouses), public availability of results (6), investigator conflicts of interest (3), design and analysis transparency (3), study registration (2), and protocol sharing (1). We did not identify any policies, procedures, or practices related to analysis plan registration, data sharing, code sharing, material sharing, and citation standards. We provide a framework with specific recommendations to help federal and other evidence clearinghouses implement the Transparency and Openness Promotion (TOP) Guidelines. Our proposed "TOP Guidelines for Clearinghouses" includes reporting whether evaluations used open science practices, incorporating open science practices in their standards for receiving "evidence-based" designations, and verifying that evaluations used open science practices. Doing so could increase the trustworthiness of evidence used for policy making and support improvements throughout the evidence ecosystem., (© 2021. The Author(s).)

The clinical guidelines that underpin the use of drugs for mental disorders are informed by evidence from randomised controlled trials (RCTs). RCTs are performed to obtain marketing authorisation from regulators. The methods used in these RCTs could be appropriate for early phases of drug development because they identify drugs with important harms and drugs that are efficacious for specific health problems and populations. RCTs done before marketing authorisation do not tend to address clinical questions that concern the effectiveness of a drug in heterogeneous and comorbid populations, the optimisation of drug sequencing and discontinuation, or the comparative benefits and harms of different drugs that could be used for the same health problem. This Review proposes an overview of some shortcomings of RCTs, at an individual level and at the whole portfolio level, and identifies some methods in planning, conducting, and carrying out analyses in RCTs that could enhance their ability to support therapeutic decisions. These suggestions include: identifying patient-important questions to be investigated by psychopharmacological RCTs; embedding pragmatic RCTs within clinical practice to improve generalisability to target populations; collecting evidence about drugs in overlooked populations; developing methods to facilitate the recruitment of patients with mental disorders and to reduce the number of patients who drop out, using specific methods; using core outcome sets to standardise the assessment of benefits and harms; and recording systematically serious objective outcomes, such as suicide or hospitalisation, to be evaluated in meta-analyses. This work is a call to address questions relevant to patients using diverse design of RCTs, thus contributing to the development of a patient-centred, evidence-based psychiatry., Competing Interests: Declaration of interests EMW declared grants from the Patient Centered Outcomes Research Institute, the US Food and Drug Administration, Arnold Ventures, the Sloan Foundation, The US National Institutes of Health (NIH), the Robert Wood Johnson Foundation, and the American Public Health Association. EM-W received payment for teaching at a summer institute in the NIH. TAF declared a grant, licenses, and consulting fees from Mitsubishi-Tanabe and Shinogi. TAF received payment for lectures from Merck. TAF also has issued or has pending patents from Tanabe-Mitsubishi. AC, PR, and VC declare no competing interests., (Copyright © 2022 Elsevier Ltd. All rights reserved.)

Background: Vitamin A deficiency (VAD) is a major public health problem in low- and middle-income countries, affecting 190 million children under five years of age and leading to many adverse health consequences, including death. Based on prior evidence and a previous version of this review, the World Health Organization has continued to recommend vitamin A supplementation (VAS) for children aged 6 to 59 months. The last version of this review was published in 2017, and this is an updated version of that review., Objectives: To assess the effects of vitamin A supplementation (VAS) for preventing morbidity and mortality in children aged six months to five years., Search Methods: We searched CENTRAL, MEDLINE, Embase, six other databases, and two trials registers up to March 2021. We also checked reference lists and contacted relevant organisations and researchers to identify additional studies., Selection Criteria: Randomised controlled trials (RCTs) and cluster-RCTs evaluating the effect of synthetic VAS in children aged six months to five years living in the community. We excluded studies involving children in hospital and children with disease or infection. We also excluded studies evaluating the effects of food fortification, consumption of vitamin A rich foods, or beta-carotene supplementation., Data Collection and Analysis: For this update, two review authors independently assessed studies for inclusion resolving discrepancies by discussion. We performed meta-analyses for outcomes, including all-cause and cause-specific mortality, disease, vision, and side effects. We used the GRADE approach to assess the quality of the evidence., Main Results: The updated search identified no new RCTs. We identified 47 studies, involving approximately 1,223,856 children. Studies were set in 19 countries: 30 (63%) in Asia, 16 of these in India; 8 (17%) in Africa; 7 (15%) in Latin America, and 2 (4%) in Australia. About one-third of the studies were in urban/periurban settings, and half were in rural settings; the remaining studies did not clearly report settings. Most studies included equal numbers of girls and boys and lasted about one year. The mean age of the children was about 33 months. The included studies were at variable overall risk of bias; however, evidence for the primary outcome was at low risk of bias. A meta-analysis for all-cause mortality included 19 trials (1,202,382 children). At longest follow-up, there was a 12% observed reduction in the risk of all-cause mortality for VAS compared with control using a fixed-effect model (risk ratio (RR) 0.88, 95% confidence interval (CI) 0.83 to 0.93; high-certainty evidence). Nine trials reported mortality due to diarrhoea and showed a 12% overall reduction for VAS (RR 0.88, 95% CI 0.79 to 0.98; 1,098,538 children; high-certainty evidence). There was no evidence of a difference for VAS on mortality due to measles (RR 0.88, 95% CI 0.69 to 1.11; 6 studies, 1,088,261 children; low-certainty evidence), respiratory disease (RR 0.98, 95% CI 0.86 to 1.12; 9 studies, 1,098,538 children; low-certainty evidence), and meningitis. VAS reduced the incidence of diarrhoea (RR 0.85, 95% CI 0.82 to 0.87; 15 studies, 77,946 children; low-certainty evidence), measles (RR 0.50, 95% CI 0.37 to 0.67; 6 studies, 19,566 children; moderate-certainty evidence), Bitot's spots (RR 0.42, 95% CI 0.33 to 0.53; 5 studies, 1,063,278 children; moderate-certainty evidence), night blindness (RR 0.32, 95% CI 0.21 to 0.50; 2 studies, 22,972 children; moderate-certainty evidence), and VAD (RR 0.71, 95% CI 0.65 to 0.78; 4 studies, 2262 children, moderate-certainty evidence). However, there was no evidence of a difference on incidence of respiratory disease (RR 0.99, 95% CI 0.92 to 1.06; 11 studies, 27,540 children; low-certainty evidence) or hospitalisations due to diarrhoea or pneumonia. There was an increased risk of vomiting within the first 48 hours of VAS (RR 1.97, 95% CI 1.44 to 2.69; 4 studies, 10,541 children; moderate-certainty evidence)., Authors' Conclusions: This update identified no new eligible studies and the conclusions remain the same. VAS is associated with a clinically meaningful reduction in morbidity and mortality in children. Further placebo-controlled trials of VAS in children between six months and five years of age would not change the conclusions of this review, although studies that compare different doses and delivery mechanisms are needed. In populations with documented VAD, it would be unethical to conduct placebo-controlled trials., (Copyright © 2022 The Cochrane Collaboration. Published by John Wiley & Sons, Ltd.)

Objective: We compared methods used with current recommendations for synthesizing harms in systematic reviews and meta-analyses (SRMAs) of gabapentin., Study Design & Setting: We followed recommended systematic review practices. We selected reliable SRMAs of gabapentin (i.e., met a pre-defined list of methodological criteria) that assessed at least one harm. We extracted and compared methods in four areas: pre-specification, searching, analysis, and reporting. Whereas our focus in this paper is on the methods used, Part 2 examines the results for harms across reviews., Results: We screened 4320 records and identified 157 SRMAs of gabapentin, 70 of which were reliable. Most reliable reviews (51/70; 73%) reported following a general guideline for SRMA conduct or reporting, but none reported following recommendations specifically for synthesizing harms. Across all domains assessed, review methods were designed to address questions of benefit and rarely included the additional methods that are recommended for evaluating harms., Conclusion: Approaches to assessing harms in SRMAs we examined are tokenistic and unlikely to produce valid summaries of harms to guide decisions. A paradigm shift is needed. At a minimal, reviewers should describe any limitations to their assessment of harms and provide clearer descriptions of methods for synthesizing harms., (Copyright © 2021 The Authors. Published by Elsevier Inc. All rights reserved.)

Objective: Most systematic reviews of interventions focus on potential benefits. Common methods and assumptions that are appropriate for assessing benefits can be inappropriate for harms. This paper provides a primer on researching harms, particularly in systematic reviews., Study Design and Setting: Commentary describing challenges with assessing harm., Results: Investigators should be familiar with various terminologies used to describe, classify, and group harms. Published reports of clinical trials include limited information about harms, so systematic reviewers should not depend on these studies and journal articles to reach conclusions about harms. Visualizations might improve communication of multiple dimensions of harms such as severity, relatedness, and timing., Conclusion: The terminology, classification, detection, collection, and reporting of harms create unique challenges that take time, expertise, and resources to navigate in both primary studies and evidence syntheses. Systematic reviewers might reach incorrect conclusions if they focus on evidence about harms found in published reports of randomized trials of a particular health problem. Systematic reviews could be improved through better identification and reporting of harms in primary studies and through better training and uptake of appropriate methods for synthesizing evidence about harms., (Copyright © 2021. Published by Elsevier Inc.)

Objective: In this methodologic study (Part 2 of 2), we examined the overlap in sources of evidence and the corresponding results for harms in systematic reviews for gabapentin., Study Design & Setting: We extracted all citations referenced as sources of evidence for harms of gabapentin from 70 systematic reviews, as well as the harms assessed and numerical results. We assessed consistency of harms between pairs of reviews with a high degree of overlap in sources of evidence (>50%) as determined by corrected covered area (CCA)., Results: We found 514 reports cited across 70 included reviews. Most reports (244/514, 48%) were not cited in more than one review. Among 18 pairs of reviews, we found reviews had differences in which harms were assessed and their choice to meta-analyze estimates or present descriptive summaries. When a specific harm was meta-analyzed in a pair of reviews, we found similar effect estimates., Conclusion: Differences in harms results across reviews can occur because the choice of harms is driven by reviewer preferences, rather than standardized approaches to selecting harms for assessment. A paradigm shift is needed in the current approach to synthesizing harms., (Copyright © 2021 The Authors. Published by Elsevier Inc. All rights reserved.)

Background: The Patient-Centered Outcomes Research Institute (PCORI) is obligated to peer review and to post publicly "Final Research Reports" of all funded projects. PCORI peer review emphasizes adherence to PCORI's Methodology Standards and principles of ethical scientific communication. During the peer review process, reviewers and editors seek to ensure that results are presented objectively and interpreted appropriately, e.g., free of spin., Methods: Two independent raters assessed PCORI peer review feedback sent to authors. We calculated the proportion of reports in which spin was identified during peer review, and the types of spin identified. We included reports submitted by April 2018 with at least one associated journal article. The same raters then assessed whether authors addressed reviewers' comments about spin. The raters also assessed whether spin identified during PCORI peer review was present in related journal articles., Results: We included 64 PCORI-funded projects. Peer reviewers or editors identified spin in 55/64 (86%) submitted research reports. Types of spin included reporting bias (46/55; 84%), inappropriate interpretation (40/55; 73%), inappropriate extrapolation of results (15/55; 27%), and inappropriate attribution of causality (5/55; 9%). Authors addressed comments about spin related to 47/55 (85%) of the reports. Of 110 associated journal articles, PCORI comments about spin were potentially applicable to 44/110 (40%) articles, of which 27/44 (61%) contained the same spin that was identified in the PCORI research report. The proportion of articles with spin was similar for articles accepted before and after PCORI peer review (63% vs 58%)., Discussion: Just as spin is common in journal articles and press releases, we found that most reports submitted to PCORI included spin. While most spin was mitigated during the funder's peer review process, we found no evidence that review of PCORI reports influenced spin in journal articles. Funders could explore interventions aimed at reducing spin in published articles of studies they support., (© 2021. The Author(s).)