Search

Meaningful reporting of quality metrics relies on detecting a statistical difference when a true difference in performance exists. Larger cohorts and longer time frames can produce higher rates of statistical differences. However, older data are less relevant when attempting to enact change in the clinical setting. The selection of time frames must reflect a balance between being too small (type II errors) and too long (stale data). We explored the use of power analysis to optimize time frame selection for trauma quality reporting.Using data from 22 Level III trauma centers, we tested for differences in 4 outcomes within 4 cohorts of patients. With bootstrapping, we calculated the power for rejecting the null hypothesis that no difference exists amongst the centers for different time frames. From the entire sample for each site, we simulated randomly generated datasets. Each simulated dataset was tested for whether a difference was observed from the average. Power was calculated as the percentage of simulated datasets where a difference was observed. This process was repeated for each outcome.The power calculations for the 4 cohorts revealed that the optimal time frame for Level III trauma centers to assess whether a single site's outcomes are different from the overall average was 2 years based on an 80% cutoff.Power analysis with simulated datasets allows testing of different time frames to assess outcome differences. This type of analysis allows selection of an optimal time frame for benchmarking of Level III trauma center data.

Open long-bone fractures represent a complex injury within the trauma system. Guidelines recommend antibiotics be given within 60 minutes of patient arrival to the emergency department. We sought to measure and improve the timeliness of antibiotic administration at the patient, hospital, and population level within a collaborative quality initiative.Trauma collaborative quality initiative data (January 2017 to December 2020) were analyzed from 34 American College of Surgeons Committee on Trauma verified level 1 and level 2 trauma centers. Inclusion criteria were adult patients (≥16 years), injury severity score ≥5, and open tibia or femur fracture. After the baseline year, hospitals were scored annually on a pay-for-performance metric based on patients receiving antibiotics within 120 minutes of emergency department arrival. Univariate tests examined the differences between baseline and subsequent year(s) performance. A multivariable logistic regression assessed the factors associated with meeting this target time.There were 2,624 patients with an open long-bone fracture. In the baseline year (2017), 76.9% of patients received antibiotics in ≤120 minutes, with a mean time of 57.9 ± 63.3 minutes. After implementing collaborative quality initiative-wide targets, performance significantly improved in subsequent years (2018, 2019, 2020). The collaborative quality initiative achieved their goal of ≥85% of patients receiving antibiotics in ≤120 minutes in 2019 (87.9%) and 2020 (88.5%), with a mean time of 43.3 ± 54.8 minutes (P.05 vs 2017).A pay-for-performance process measure within a statewide trauma collaborative quality initiative improved the timely administration of antibiotics to patients with open fractures. Work remains to align compliance with the guideline target of60 minutes and to identify factors involved in the delay of administration.