Search

Background: The COVID-19 pandemic has highlighted the role of infectious disease forecasting in informing public policy. However, significant barriers remain for effectively linking infectious disease forecasts to public health decision making, including a lack of model validation. Forecasting model performance and accuracy should be evaluated retrospectively to understand under which conditions models were reliable and could be improved in the future. Methods: Using archived forecasts from the California Department of Public Health's California COVID Assessment Tool (https://calcat.covid19.ca.gov/cacovidmodels/), we compared how well different forecasting models predicted COVID-19 hospitalization census across California counties and regions during periods of Alpha, Delta, and Omicron variant predominance. Results: Based on mean absolute error estimates, forecasting models had variable performance across counties and through time. When accounting for model availability across counties and dates, some individual models performed consistently better than the ensemble model, but model rankings still differed across counties. Local transmission trends, variant prevalence, and county population size were informative predictors for determining which model performed best for a given county based on a random forest classification analysis. Overall, the ensemble model performed worse in less populous counties, in part because of fewer model contributors in these locations. Conclusions: Ensemble model predictions could be improved by incorporating geographic heterogeneity in model coverage and performance. Consistency in model reporting and improved model validation can strengthen the role of infectious disease forecasting in real-time public health decision making. [ABSTRACT FROM AUTHOR]

Importance: A SARS-CoV-2 vaccine was approved for adolescents aged 12 to 15 years on May 10, 2021, with approval for younger age groups following thereafter. The population level impact of the pediatric COVID-19 vaccination program has not yet been established., Objective: To identify whether California's pediatric COVID-19 immunization program was associated with changes in pediatric COVID-19 incidence and hospitalizations., Design, Setting, and Participants: A case series on COVID-19 vaccination including children aged 6 months to 15 years was conducted in California. Data were obtained on COVID-19 cases in California between April 1, 2020, and February 27, 2023., Exposure: Postvaccination evaluation periods spanned 141 days (June 10 to October 29, 2021) for adolescents aged 12 to 15 years, 199 days (November 29, 2021, to June 17, 2022) for children aged 5 to 11 years, and 225 days (July 17, 2022, to February 27, 2023) for those aged 6 to 59 months. During these periods, statewide vaccine coverage reached 53.5% among adolescents aged 12 to 15 years, 34.8% among children aged 5 to 11 years, and 7.9% among those aged 6 to 59 months., Main Outcomes and Measures: Age-stepped implementation of COVID-19 vaccination was used to compare observed county-level incidence and hospitalization rates during periods when each age group became vaccine eligible to counterfactual rates predicted from observations among other age groups. COVID-19 case and hospitalization data were obtained from the California reportable disease surveillance system., Results: Between April 1, 2020, and February 27, 2023, a total of 3 913 063 pediatric COVID-19 cases and 12 740 hospitalizations were reported in California. Reductions of 146 210 cases (95% prediction interval [PI], 136 056-158 948) were estimated among adolescents aged 12 to 15 years, corresponding to a 37.1% (35.5%-39.1%) reduction from counterfactual predictions. Reductions of 230 134 (200 170-265 149) cases were estimated among children aged 5 to 11 years, corresponding to a 23.7% (20.6%-27.3%) reduction from counterfactual predictions. No evidence of reductions in COVID-19 cases statewide were found among children aged 6 to 59 months (estimated averted cases, -259; 95% PI, -1938 to 1019), although low transmission during the evaluation period may have limited the ability to do so. An estimated 168 hospitalizations (95% PI, 42-324) were averted among children aged 6 to 59 months, corresponding to a 24.4% (95% PI, 6.1%-47.1%) reduction. In meta-analyses, county-level vaccination coverage was associated with averted cases for all age groups. Despite low vaccination coverage, pediatric COVID-19 immunization in California averted 376 085 (95% PI, 348 355-417 328) reported cases and 273 (95% PI, 77-605) hospitalizations among children aged 6 months to 15 years over approximately 4 to 7 months following vaccination availability., Conclusions and Relevance: The findings of this case series analysis of 3 913 063 cases suggest reduced pediatric SARS-CoV-2 transmission following immunization. These results support the use of COVID-19 vaccines to reduce COVID-19 incidence and hospitalization in pediatric populations.