Search

Incomplete reporting of study methods and results has become a focal point for failures in the reproducibility and translation of findings from preclinical research. Here we demonstrate that incomplete reporting of preclinical research is not limited to a few elements of research design, but rather is a broader problem that extends to the reporting of the methods and results. We evaluated 47 preclinical research studies from a systematic review of acute lung injury that use mesenchymal stem cells (MSCs) as a treatment. We operationalized the ARRIVE (Animal Research: Reporting of In Vivo Experiments) reporting guidelines for pre-clinical studies into 109 discrete reporting sub-items and extracted 5,123 data elements. Overall, studies reported less than half (47%) of all sub-items (median 51 items; range 37-64). Across all studies, the Methods Section reported less than half (45%) and the Results Section reported less than a third (29%). There was no association between journal impact factor and completeness of reporting, which suggests that incomplete reporting of preclinical research occurs across all journals regardless of their perceived prestige. Incomplete reporting of methods and results will impede attempts to replicate research findings and maximize the value of preclinical studies.

The Acute Respiratory Distress Syndrome (ARDS) is a devastating clinical condition that is associated with a 30-40% risk of death, and significant long term morbidity for those who survive. Mesenchymal stromal cells (MSC) have emerged as a potential novel treatment as in pre-clinical models they have been shown to modulate inflammation (a major pathophysiological hallmark of ARDS) while enhancing bacterial clearance and reducing organ injury and death. A systematic search of MEDLINE, EMBASE, BIOSIS and Web of Science was performed to identify pre-clinical studies that examined the efficacy MSCs as compared to diseased controls for the treatment of Acute Lung Injury (ALI) (the pre-clinical correlate of human ARDS) on mortality, a clinically relevant outcome. We assessed study quality and pooled results using random effect meta-analysis. A total of 54 publications met our inclusion criteria of which 17 (21 experiments) reported mortality and were included in the meta-analysis. Treatment with MSCs, as compared to controls, significantly decreased the overall odds of death in animals with ALI (Odds Ratio 0.24, 95% Confidence Interval 0.18-0.34, I2 8%). Efficacy was maintained across different types of animal models and means of ALI induction; MSC origin, source, route of administration and preparation; and the clinical relevance of the model (timing of MSC administration, administration of fluids and or antibiotics). Reporting of standard MSC characterization for experiments that used human MSCs and risks of bias was generally poor, and although not statistically significant, a funnel plot analysis for overall mortality suggested the presence of publication bias. The results from our meta-analysis support that MSCs substantially reduce the odds of death in animal models of ALI but important reporting elements were sub optimal and limit the strength of our conclusions.

Incomplete reporting of study methods and results has become a focal point for failures in the reproducibility and translation of findings from preclinical research. Here we demonstrate that incomplete reporting of preclinical research is not limited to a few elements of research design, but rather is a broader problem that extends to the reporting of the methods and results. We evaluated 47 preclinical research studies from a systematic review of acute lung injury that use mesenchymal stem cells (MSCs) as a treatment. We operationalized the ARRIVE (Animal Research: Reporting of In Vivo Experiments) reporting guidelines for pre-clinical studies into 109 discrete reporting sub-items and extracted 5,123 data elements. Overall, studies reported less than half (47%) of all sub-items (median 51 items; range 37–64). Across all studies, the Methods Section reported less than half (45%) and the Results Section reported less than a third (29%). There was no association between journal impact factor and completeness of reporting, which suggests that incomplete reporting of preclinical research occurs across all journals regardless of their perceived prestige. Incomplete reporting of methods and results will impede attempts to replicate research findings and maximize the value of preclinical studies. [ABSTRACT FROM AUTHOR]