Back to Search
Start Over
Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research.
- Source :
- Journal of Evaluation in Clinical Practice; Feb2012, Vol. 18 Issue 1, p12-18, 7p, 2 Charts
- Publication Year :
- 2012
-
Abstract
- Background The Cochrane Collaboration is strongly encouraging the use of a newly developed tool, the Cochrane Collaboration Risk of Bias Tool (CCRBT), for all review groups. However, the psychometric properties of this tool to date have yet to be described. Thus, the objective of this study was to add information about psychometric properties of the CCRBT including inter-rater reliability and concurrent validity, in comparison with the Effective Public Health Practice Project Quality Assessment Tool (EPHPP). Methods Both tools were used to assess the methodological quality of 20 randomized controlled trials included in our systematic review of the effectiveness of knowledge translation interventions to improve the management of cancer pain. Each study assessment was completed independently by two reviewers using each tool. We analysed the inter-rater reliability of each tool's individual domains, as well as final grade assigned to each study. Results The EPHPP had fair inter-rater agreement for individual domains and excellent agreement for the final grade. In contrast, the CCRBT had slight inter-rater agreement for individual domains and fair inter-rater agreement for final grade. Of interest, no agreement between the two tools was evident in their final grade assigned to each study. Although both tools were developed to assess 'quality of the evidence', they appear to measure different constructs. Conclusions Both tools performed quite differently when evaluating the risk of bias or methodological quality of studies in knowledge translation interventions for cancer pain. The newly introduced CCRBT assigned these studies a higher risk of bias. Its psychometric properties need to be more thoroughly validated, in a range of research fields, to understand fully how to interpret results from its application. [ABSTRACT FROM AUTHOR]
- Subjects :
- PSYCHOMETRICS
ANALYSIS of variance
COMPARATIVE studies
CONFIDENCE intervals
RESEARCH methodology
META-analysis
RESEARCH evaluation
RESEARCH funding
SCALES (Weighing instruments)
STATISTICS
EVALUATION research
RANDOMIZED controlled trials
INTER-observer reliability
RESEARCH bias
RESEARCH methodology evaluation
DATA analysis software
DESCRIPTIVE statistics
Subjects
Details
- Language :
- English
- ISSN :
- 13561294
- Volume :
- 18
- Issue :
- 1
- Database :
- Complementary Index
- Journal :
- Journal of Evaluation in Clinical Practice
- Publication Type :
- Academic Journal
- Accession number :
- 70117585
- Full Text :
- https://doi.org/10.1111/j.1365-2753.2010.01516.x