Search

Background The Cochrane Bias Methods Group recently developed the “Risk of Bias (ROB) in Non-randomized Studies of Interventions” (ROBINS-I) tool to assess ROB for non-randomized studies of interventions (NRSI). It is important to establish consistency in its application and interpretation across review teams. In addition, it is important to understand if specialized training and guidance will improve the reliability of the results of the assessments. Therefore, the objective of this cross-sectional study is to establish the inter-rater reliability (IRR), inter-consensus reliability (ICR), and concurrent validity of ROBINS-I. Furthermore, as this is a relatively new tool, it is important to understand the barriers to using this tool (e.g., time to conduct assessments and reach consensus—evaluator burden). Methods Reviewers from four participating centers will appraise the ROB of a sample of NRSI publications using the ROBINS-I tool in two stages. For IRR and ICR, two pairs of reviewers will assess the ROB for each NRSI publication. In the first stage, reviewers will assess the ROB without any formal guidance. In the second stage, reviewers will be provided customized training and guidance. At each stage, each pair of reviewers will resolve conflicts and arrive at a consensus. To calculate the IRR and ICR, we will use Gwet’s AC1 statistic. For concurrent validity, reviewers will appraise a sample of NRSI publications using both the New-castle Ottawa Scale (NOS) and ROBINS-I. We will analyze the concordance between the two tools for similar domains and for the overall judgments using Kendall’s tau coefficient. To measure the evaluator burden, we will assess the time taken to apply the ROBINS-I (without and with guidance), and the NOS. To assess the impact of customized training and guidance on the evaluator burden, we will use the generalized linear models. We will use Microsoft Excel and SAS 9.4 to manage and analyze study data, respectively. Discussion The quality of evidence from systematic reviews that include NRS depends partly on the study-level ROB assessments. The findings of this study will contribute to an improved understanding of the ROBINS-I tool and how best to use it.

ObjectivesTo identify, critically appraise and summarise evidence on the impact of employing primary healthcare professionals (PHCPs: family physicians/general practitioners (GPs), nurse practitioners (NP) and nurses with increased authority) in the emergency department (ED) triage, on patient flow outcomes.MethodsWe searched Medline (Ovid), EMBASE (Ovid), Cochrane Library (Wiley) and CINAHL (EBSCO) (inception to January 2020). Our primary outcome was the time to provider initial assessment (PIA). Secondary outcomes included time to triage, proportion of patients leaving without being seen (LWBS), length of stay (ED LOS), proportion of patients leaving against medical advice (LAMA), number of repeat ED visits and patient satisfaction. Two independent reviewers selected studies, extracted data and assessed study quality using the National Institute for Health and Care Excellence quality assessment tool.ResultsFrom 23 973 records, 40 comparative studies including 10 randomised controlled trials (RCTs) and 13 pre–post studies were included. PHCP interventions were led by NP (n=14), GP (n=3) or nurses with increased authority (n=23) at triage. In all studies, PHCP-led intervention effectiveness was compared with the traditional nurse-led triage model. Median duration of the interventions was 6 months. Study quality was generally low (confounding bias); 7 RCTs were classified as moderate quality. Most studies reported that PHCP-led triage interventions decreased the PIA (13/14), ED LOS (29/30), proportion of patients LWBS (8/10), time to triage (3/3) and repeat ED visits (5/6), and increased the patient satisfaction (8/10). The proportion of patients LAMA did not differ between groups (3/3). Evidence from RCTs (n=8) as well as other study designs showed a significant decrease in ED LOS favouring the PHCP-led interventions.ConclusionsOverall, PHCP-led triage interventions improved ED patient flow metrics. There was a significant decrease in ED LOS irrespective of the study design, favouring the PHCP-led interventions. Evidence from well-designed high-quality RCTs is required prior to widespread implementation.PROSPERO registration numberCRD42020148053.