Search

Evidence‐based medicine has changed clinical practice by incorporating data from randomised controlled trials (RCTs). While some biases in RCTs are well recognised, we discuss some less acknowledged. Selection bias may arise in the consent stage. Industry‐funded studies more often report a positive outcome. Post‐hoc changes of outcome measures and other mis‐reporting lowers the reliability of outcome data. Finally, even the GRADE system retains subjectivity. Conclusion: Moving from "intuition" into "evidence‐based" medicine involves grappling with several pitfalls. These pose challenges for authors, editors, reviewers, and readers. All require vigilance before drawing conclusions from presented data. [ABSTRACT FROM AUTHOR]

Context: Randomized controlled trials (RCTs) are among the cornerstones for generation of high-quality clinical evidence. However, incomplete or biased reporting of trials can hamper the process of review of trials and their results. Outcome switching, intentional, or otherwise leads to biased reporting and can result in false inferences. Aims: The aim of this study was to analyze the completeness of reporting Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist items and detect if outcome switching had occurred. Settings and Design: This cross-sectional study was conducted in the department of pharmacology. Methods: Online editions of journals published by the Indian association of medical specialties from 2017 to 2019 were accessed, and the full-text versions of the published RCTs in them were downloaded. Reporting of each item in the CONSORT checklist was recorded. The effect of trial registration and CONSORT endorsement on reporting of key methodological parameters was also determined. Protocols of registered trials were accessed, and the outcome switching was assessed. Statistical Analysis Used: Descriptive statistics were used to summarize the data. Results: Average completeness of reporting has significantly improved from 2017 to 2019. Major areas of underreporting were generalizability, protocol availability, trial registration, date of recruitment, allocation concealment, and the patient flow diagram. CONSORT endorsing journals had worse, whereas registered trials had better reporting of key methodological indicators. No overt switching of outcomes was observed in 84 out of 86 registered trials where trial protocols were available online for comparison. Conclusions: Quality of clinical trial reporting in the Indian medical journals has improved but remains inadequate. CONSORT nonendorsement prevents completeness of trial reporting.

Undisclosed discrepancies often exist between study registrations and their associated publications. Discrepancies can increase risk of bias, and when undisclosed, they disguise this increased risk of bias from readers. To remedy this issue, we developed an intervention called discrepancy review. We provided journals with peer reviewers specifically assigned to check for undisclosed discrepancies between registrations and manuscripts submitted to journals. We performed discrepancy review on 18 manuscripts submitted to Nicotine and Tobacco Research and three manuscripts submitted to the European Journal of Personality. We iteratively refined the discrepancy review process based on feedback from discrepancy reviewers, editors and authors. Authors addressed the majority of discrepancy reviewer comments, and there was no opposition to running a trial from authors, editors or discrepancy reviewers. Outcome measures for a trial of discrepancy review could include the presence of primary or secondary outcome discrepancies, whether publications that are not the primary report from a clinical trial registration are clearly described as such, whether registrations are permanent, and an overarching subjective assessment of the impact of discrepancies in published articles. We found that discrepancy review could feasibly be introduced as a regular practice at some journals interested in this process. A full trial of discrepancy review would be needed to evaluate its impact on reducing undisclosed discrepancies.

Context: Randomized controlled trials (RCTs) are among the cornerstones for generation of high-quality clinical evidence. However, incomplete or biased reporting of trials can hamper the process of review of trials and their results. Outcome switching, intentional, or otherwise leads to biased reporting and can result in false inferences. Aims: The aim of this study was to analyze the completeness of reporting Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist items and detect if outcome switching had occurred. Settings and Design: This cross-sectional study was conducted in the department of pharmacology. Methods: Online editions of journals published by the Indian association of medical specialties from 2017 to 2019 were accessed, and the full-text versions of the published RCTs in them were downloaded. Reporting of each item in the CONSORT checklist was recorded. The effect of trial registration and CONSORT endorsement on reporting of key methodological parameters was also determined. Protocols of registered trials were accessed, and the outcome switching was assessed. Statistical Analysis Used: Descriptive statistics were used to summarize the data. Results: Average completeness of reporting has significantly improved from 2017 to 2019. Major areas of underreporting were generalizability, protocol availability, trial registration, date of recruitment, allocation concealment, and the patient flow diagram. CONSORT endorsing journals had worse, whereas registered trials had better reporting of key methodological indicators. No overt switching of outcomes was observed in 84 out of 86 registered trials where trial protocols were available online for comparison. Conclusions: Quality of clinical trial reporting in the Indian medical journals has improved but remains inadequate. CONSORT nonendorsement prevents completeness of trial reporting. [ABSTRACT FROM AUTHOR]

Publication bias (the tendency for studies with positive results to be more easily published than studies with null or negative results) and outcome switching (the adjustment of study aims to match results) have long been problematic in medical research. Recent legislation, protocol-registration sites, and agreements by medical journals have led to a reduction of these problems in medical research. In medical education specifically, however, there is no such legislation, registration, or agreement. This paper argues for the creation of such a registration site and agreement by medical education journals as a matter of ethical necessity.

Undisclosed discrepancies often exist between study registrations and their associated publications. Discrepancies can increase risk of bias, and when undisclosed, they disguise this increased risk of bias from readers. To remedy this issue, we developed an intervention called discrepancy review . We provided journals with peer reviewers specifically assigned to check for undisclosed discrepancies between registrations and manuscripts submitted to journals. We performed discrepancy review on 18 manuscripts submitted to Nicotine and Tobacco Research and three manuscripts submitted to the European Journal of Personality . We iteratively refined the discrepancy review process based on feedback from discrepancy reviewers, editors and authors. Authors addressed the majority of discrepancy reviewer comments, and there was no opposition to running a trial from authors, editors or discrepancy reviewers. Outcome measures for a trial of discrepancy review could include the presence of primary or secondary outcome discrepancies, whether publications that are not the primary report from a clinical trial registration are clearly described as such, whether registrations are permanent, and an overarching subjective assessment of the impact of discrepancies in published articles. We found that discrepancy review could feasibly be introduced as a regular practice at some journals interested in this process. A full trial of discrepancy review would be needed to evaluate its impact on reducing undisclosed discrepancies., (© 2022 The Authors.)