Search

Background: The Covid-19 pandemic has been characterized by the emergence of novel SARS-CoV-2 variants, each with distinct properties influencing transmission dynamics, immune escape, and virulence, which, in turn, influence their impact on local populations. Swift analysis of the properties of newly emerged variants is essential in the initial days and weeks to enhance readiness and facilitate the scaling of clinical and public health system responses., Methods: This paper introduces a two-variant metapopulation compartmental model of disease transmission to simulate the dynamics of disease transmission during a period of transition to a newly dominant strain. Leveraging novel S-gene dropout analysis data and genomic sequencing data, combined with confirmed Covid-19 case data, we estimate the epidemiological characteristics of the Omicron variant, which replaced the Delta variant in late 2021 in Philadelphia, PA. We utilized a grid-search method to identify plausible combinations of model parameters, followed by an ensemble adjustment Kalman filter for parameter inference., Results: The model successfully estimated key epidemiological parameters; we estimated the ascertainment rate of 0.22 (95% credible interval 0.15-0.29) and transmission rate of 5.0 (95% CI 2.4-6.6) for the Omicron variant., Conclusions: The study demonstrates the potential for this model-inference framework to provide real-time insights during the emergence of novel variants, aiding in timely public health responses., (© 2024. The Author(s).)

Accurate forecasts can enable more effective public health responses during seasonal influenza epidemics. For the 2021-22 and 2022-23 influenza seasons, 26 forecasting teams provided national and jurisdiction-specific probabilistic predictions of weekly confirmed influenza hospital admissions for one-to-four weeks ahead. Forecast skill is evaluated using the Weighted Interval Score (WIS), relative WIS, and coverage. Six out of 23 models outperform the baseline model across forecast weeks and locations in 2021-22 and 12 out of 18 models in 2022-23. Averaging across all forecast targets, the FluSight ensemble is the 2 nd most accurate model measured by WIS in 2021-22 and the 5 th most accurate in the 2022-23 season. Forecast skill and 95% coverage for the FluSight ensemble and most component models degrade over longer forecast horizons. In this work we demonstrate that while the FluSight ensemble was a robust predictor, even ensembles face challenges during periods of rapid change., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020 to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to inform pandemic-related decision making., Competing Interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: APP report grants from Metabiota Inc outside the submitted work. J.S. and Columbia University declare partial ownership of SK Analytics. No other authors have competing interests to declare., (Copyright: This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.)

By August 1, 2022, the SARS-CoV-2 virus had caused over 90 million cases of COVID-19 and one million deaths in the United States. Since December 2020, SARS-CoV-2 vaccines have been a key component of US pandemic response; however, the impacts of vaccination are not easily quantified. Here, we use a dynamic county-scale metapopulation model to estimate the number of cases, hospitalizations, and deaths averted due to vaccination during the first six months of vaccine availability. We estimate that COVID-19 vaccination was associated with over 8 million fewer confirmed cases, over 120 thousand fewer deaths, and 700 thousand fewer hospitalizations during the first six months of the campaign., Competing Interests: TKY, MG, SP and JS are employees of Columbia University, which received funding from Pfizer in connection with the development of this study and of this manuscript. JS and Columbia University disclose partial ownership of SK Analytics. JS discloses consulting for BNI. MDF, FJA, MMM, and FK are employees of Pfizer and may hold stock or stock options. DS was employed at Pfizer at the time this work was conducted and he may own stock or stock options. This does not alter our adherence to PLOS ONE policies on sharing data and materials., (Copyright: © 2023 Yamana et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

In Spring 2021, the highly transmissible SARS-CoV-2 Delta variant began to cause increases in cases, hospitalizations, and deaths in parts of the United States. At the time, with slowed vaccination uptake, this novel variant was expected to increase the risk of pandemic resurgence in the US in summer and fall 2021. As part of the COVID-19 Scenario Modeling Hub, an ensemble of nine mechanistic models produced 6-month scenario projections for July-December 2021 for the United States. These projections estimated substantial resurgences of COVID-19 across the US resulting from the more transmissible Delta variant, projected to occur across most of the US, coinciding with school and business reopening. The scenarios revealed that reaching higher vaccine coverage in July-December 2021 reduced the size and duration of the projected resurgence substantially, with the expected impacts was largely concentrated in a subset of states with lower vaccination coverage. Despite accurate projection of COVID-19 surges occurring and timing, the magnitude was substantially underestimated 2021 by the models compared with the of the reported cases, hospitalizations, and deaths occurring during July-December, highlighting the continued challenges to predict the evolving COVID-19 pandemic. Vaccination uptake remains critical to limiting transmission and disease, particularly in states with lower vaccination coverage. Higher vaccination goals at the onset of the surge of the new variant were estimated to avert over 1.5 million cases and 21,000 deaths, although may have had even greater impacts, considering the underestimated resurgence magnitude from the model., Competing Interests: ST, CS, MQ, LM, RB, KS, EH, LC, JL, JK, HH, MK, KT, SW, LS, KR, JL, JD, JK, EL, JP, AH, DK, MC, JD, KM, XX, AP, AV, AS, PP, SV, AA, BL, BK, JO, MO, GH, BH, JC, AV, MM, SH, PB, DM, SC, RP, DJ, JT, MG, TY, SP, JH, RS, MB, MJ, CV No competing interests declared, JL has served as an expert witness on cases where the likely length of the pandemic was of issue, JS and Columbia University disclose partial ownership of SK Analytics. Discloses consulting for BNI, MR reports stock ownership in Becton Dickinson & Co, which manufactures medical equipment used in COVID testing, vaccination, and treatment

Short-term probabilistic forecasts of the trajectory of the COVID-19 pandemic in the United States have served as a visible and important communication channel between the scientific modeling community and both the general public and decision-makers. Forecasting models provide specific, quantitative, and evaluable predictions that inform short-term decisions such as healthcare staffing needs, school closures, and allocation of medical supplies. Starting in April 2020, the US COVID-19 Forecast Hub (https://covid19forecasthub.org/) collected, disseminated, and synthesized tens of millions of specific predictions from more than 90 different academic, industry, and independent research groups. A multimodel ensemble forecast that combined predictions from dozens of groups every week provided the most consistently accurate probabilistic forecasts of incident deaths due to COVID-19 at the state and national level from April 2020 through October 2021. The performance of 27 individual models that submitted complete forecasts of COVID-19 deaths consistently throughout this year showed high variability in forecast skill across time, geospatial units, and forecast horizons. Two-thirds of the models evaluated showed better accuracy than a naïve baseline model. Forecast accuracy degraded as models made predictions further into the future, with probabilistic error at a 20-wk horizon three to five times larger than when predicting at a 1-wk horizon. This project underscores the role that collaboration and active coordination between governmental public-health agencies, academic modeling teams, and industry partners can play in developing modern modeling capabilities to support local, state, and federal response to outbreaks.

The COVID-19 pandemic disrupted health systems and economies throughout the world during 2020 and was particularly devastating for the United States, which experienced the highest numbers of reported cases and deaths during 2020 1-3 . Many of the epidemiological features responsible for observed rates of morbidity and mortality have been reported 4-8 ; however, the overall burden and characteristics of COVID-19 in the United States have not been comprehensively quantified. Here we use a data-driven model-inference approach to simulate the pandemic at county-scale in the United States during 2020 and estimate critical, time-varying epidemiological properties underpinning the dynamics of the virus. The pandemic in the United States during 2020 was characterized by national ascertainment rates that increased from 11.3% (95% credible interval (CI): 8.3-15.9%) in March to 24.5% (18.6-32.3%) during December. Population susceptibility at the end of the year was 69.0% (63.6-75.4%), indicating that about one third of the US population had been infected. Community infectious rates, the percentage of people harbouring a contagious infection, increased above 0.8% (0.6-1.0%) before the end of the year, and were as high as 2.4% in some major metropolitan areas. By contrast, the infection fatality rate fell to 0.3% by year's end., (© 2021. The Author(s), under exclusive licence to Springer Nature Limited.)

The 2020 Atlantic hurricane season was extremely active and included, as of early November, six hurricanes that made landfall in the United States during the global coronavirus disease 2019 (COVID-19) pandemic. Such an event would necessitate a large-scale evacuation, with implications for the trajectory of the pandemic. Here we model how a hypothetical hurricane evacuation from four counties in southeast Florida would affect COVID-19 case levels. We find that hurricane evacuation increases the total number of COVID-19 cases in both origin and destination locations; however, if transmission rates in destination counties can be kept from rising during evacuation, excess evacuation-induced case numbers can be minimized by directing evacuees to counties experiencing lower COVID-19 transmission rates. Ultimately, the number of excess COVID-19 cases produced by the evacuation depends on the ability of destination counties to meet evacuee needs while minimizing virus exposure through public health directives. These results are relevant to disease transmission during evacuations stemming from additional climate-related hazards such as wildfires and floods., Competing Interests: J. S. and Columbia University disclose partial ownership of SK Analytics. J. S. also discloses consulting for Merck and BNI., (©2020. The Authors.)

Recent research has advanced infectious disease forecasting from an aspiration to an operational reality. The accuracy of such operational forecasting depends on the quantity and quality of observations available for system optimization. In particular, for forecasting systems that use combined mechanistic model-inference approaches, a broad suite of epidemiological observations could be utilized, if these data were available in near real time. In cases where such data are limited, an in silica, synthetic framework for evaluating the potential benefits of observations on forecasting accuracy can allow researchers and public health officials to more optimally allocate resources for disease surveillance and monitoring. Here, we demonstrate the application of such a framework, using a model-inference system designed to predict dengue, and identify the type and quality of observations that would improve forecasting accuracy., Competing Interests: Declaration of Competing Interest J.S. and Columbia University declare partial ownership of SK Analytics. T.Y consulted for SK Analytics., (Copyright © 2019 The Authors. Published by Elsevier B.V. All rights reserved.)

A wide range of research has promised new tools for forecasting infectious disease dynamics, but little of that research is currently being applied in practice, because tools do not address key public health needs, do not produce probabilistic forecasts, have not been evaluated on external data, or do not provide sufficient forecast skill to be useful. We developed an open collaborative forecasting challenge to assess probabilistic forecasts for seasonal epidemics of dengue, a major global public health problem. Sixteen teams used a variety of methods and data to generate forecasts for 3 epidemiological targets (peak incidence, the week of the peak, and total incidence) over 8 dengue seasons in Iquitos, Peru and San Juan, Puerto Rico. Forecast skill was highly variable across teams and targets. While numerous forecasts showed high skill for midseason situational awareness, early season skill was low, and skill was generally lowest for high incidence seasons, those for which forecasts would be most valuable. A comparison of modeling approaches revealed that average forecast skill was lower for models including biologically meaningful data and mechanisms and that both multimodel and multiteam ensemble forecasts consistently outperformed individual model forecasts. Leveraging these insights, data, and the forecasting framework will be critical to improve forecast skill and the application of forecasts in real time for epidemic preparedness and response. Moreover, key components of this project-integration with public health needs, a common forecasting framework, shared and standardized data, and open participation-can help advance infectious disease forecasting beyond dengue., Competing Interests: The authors declare no competing interest., (Copyright © 2019 the Author(s). Published by PNAS.)

Seasonal influenza results in substantial annual morbidity and mortality in the United States and worldwide. Accurate forecasts of key features of influenza epidemics, such as the timing and severity of the peak incidence in a given season, can inform public health response to outbreaks. As part of ongoing efforts to incorporate data and advanced analytical methods into public health decision-making, the United States Centers for Disease Control and Prevention (CDC) has organized seasonal influenza forecasting challenges since the 2013/2014 season. In the 2017/2018 season, 22 teams participated. A subset of four teams created a research consortium called the FluSight Network in early 2017. During the 2017/2018 season they worked together to produce a collaborative multi-model ensemble that combined 21 separate component models into a single model using a machine learning technique called stacking. This approach creates a weighted average of predictive densities where the weight for each component is determined by maximizing overall ensemble accuracy over past seasons. In the 2017/2018 influenza season, one of the largest seasonal outbreaks in the last 15 years, this multi-model ensemble performed better on average than all individual component models and placed second overall in the CDC challenge. It also outperformed the baseline multi-model ensemble created by the CDC that took a simple average of all models submitted to the forecasting challenge. This project shows that collaborative efforts between research teams to develop ensemble forecasting approaches can bring measurable improvements in forecast accuracy and important reductions in the variability of performance from year to year. Efforts such as this, that emphasize real-time testing and evaluation of forecasting models and facilitate the close collaboration between public health officials and modeling researchers, are essential to improving our understanding of how best to use forecasts to improve public health response to seasonal and emerging epidemic threats., Competing Interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: JS and Columbia University disclose partial ownership of SK Analytics.

Influenza infects an estimated 9-35 million individuals each year in the United States and is a contributing cause for between 12,000 and 56,000 deaths annually. Seasonal outbreaks of influenza are common in temperate regions of the world, with highest incidence typically occurring in colder and drier months of the year. Real-time forecasts of influenza transmission can inform public health response to outbreaks. We present the results of a multiinstitution collaborative effort to standardize the collection and evaluation of forecasting models for influenza in the United States for the 2010/2011 through 2016/2017 influenza seasons. For these seven seasons, we assembled weekly real-time forecasts of seven targets of public health interest from 22 different models. We compared forecast accuracy of each model relative to a historical baseline seasonal average. Across all regions of the United States, over half of the models showed consistently better performance than the historical baseline when forecasting incidence of influenza-like illness 1 wk, 2 wk, and 3 wk ahead of available data and when forecasting the timing and magnitude of the seasonal peak. In some regions, delays in data reporting were strongly and negatively associated with forecast accuracy. More timely reporting and an improved overall accessibility to novel and traditional data sources are needed to improve forecasting accuracy and its integration with real-time public health decision making., Competing Interests: Conflict of interest statement: J.S. and Columbia University disclose partial ownership of SK Analytics., (Copyright © 2019 the Author(s). Published by PNAS.)

Recent research has produced a number of methods for forecasting seasonal influenza outbreaks. However, differences among the predicted outcomes of competing forecast methods can limit their use in decision-making. Here, we present a method for reconciling these differences using Bayesian model averaging. We generated retrospective forecasts of peak timing, peak incidence, and total incidence for seasonal influenza outbreaks in 48 states and 95 cities using 21 distinct forecast methods, and combined these individual forecasts to create weighted-average superensemble forecasts. We compared the relative performance of these individual and superensemble forecast methods by geographic location, timing of forecast, and influenza season. We find that, overall, the superensemble forecasts are more accurate than any individual forecast method and less prone to producing a poor forecast. Furthermore, we find that these advantages increase when the superensemble weights are stratified according to the characteristics of the forecast or geographic location. These findings indicate that different competing influenza prediction systems can be combined into a single more accurate forecast product for operational delivery in real time.

In recent years, a number of systems capable of predicting future infectious disease incidence have been developed. As more of these systems are operationalized, it is important that the forecasts generated by these different approaches be formally reconciled so that individual forecast error and bias are reduced. Here we present a first example of such multi-system, or superensemble, forecast. We develop three distinct systems for predicting dengue, which are applied retrospectively to forecast outbreak characteristics in San Juan, Puerto Rico. We then use Bayesian averaging methods to combine the predictions from these systems and create superensemble forecasts. We demonstrate that on average, the superensemble approach produces more accurate forecasts than those made from any of the individual forecasting systems., (© 2016 The Author(s).)

Background: Climate change is expected to affect the distribution of environmental suitability for malaria transmission by altering temperature and rainfall patterns; however, the local and global impacts of climate change on malaria transmission are uncertain., Objective: We assessed the effect of climate change on malaria transmission in West Africa., Methods: We coupled a detailed mechanistic hydrology and entomology model with climate projections from general circulation models (GCMs) to predict changes in vectorial capacity, an indication of the risk of human malaria infections, resulting from changes in the availability of mosquito breeding sites and temperature-dependent development rates. Because there is strong disagreement in climate predictions from different GCMs, we focused on the GCM projections that produced the best and worst conditions for malaria transmission in each zone of the study area., Results: Simulation-based estimates suggest that in the desert fringes of the Sahara, vectorial capacity would increase under the worst-case scenario, but not enough to sustain transmission. In the transitional zone of the Sahel, climate change is predicted to decrease vectorial capacity. In the wetter regions to the south, our estimates suggest an increase in vectorial capacity under all scenarios. However, because malaria is already highly endemic among human populations in these regions, we expect that changes in malaria incidence would be small., Conclusion: Our findings highlight the importance of rainfall in shaping the impact of climate change on malaria transmission in future climates. Even under the GCM predictions most conducive to malaria transmission, we do not expect to see a significant increase in malaria prevalence in this region.

Background: Low levels of relative humidity are known to decrease the lifespan of mosquitoes. However, most current models of malaria transmission do not account for the effects of relative humidity on mosquito survival. In the Sahel, where relative humidity drops to levels <20% for several months of the year, we expect relative humidity to play a significant role in shaping the seasonal profile of mosquito populations. Here, we present a new formulation for Anopheles gambiae sensu lato (s.l.) mosquito survival as a function of temperature and relative humidity and investigate the effect of humidity on simulated mosquito populations., Methods: Using existing observations on relationships between temperature, relative humidity and mosquito longevity, we developed a new equation for mosquito survival as a function of temperature and relative humidity. We collected simultaneous field observations on temperature, wind, relative humidity, and anopheline mosquito populations for two villages from the Sahel region of Africa, which are presented in this paper. We apply this equation to the environmental data and conduct numerical simulations of mosquito populations using the Hydrology, Entomology and Malaria Transmission Simulator (HYDREMATS)., Results: Relative humidity drops to levels that are uncomfortable for mosquitoes at the end of the rainy season. In one village, Banizoumbou, water pools dried up and interrupted mosquito breeding shortly after the end of the rainy season. In this case, relative humidity had little effect on the mosquito population. However, in the other village, Zindarou, the relatively shallow water table led to water pools that persisted several months beyond the end of the rainy season. In this case, the decrease in mosquito survival due to relative humidity improved the model's ability to reproduce the seasonal pattern of observed mosquito abundance., Conclusions: We proposed a new equation to describe Anopheles gambiae s.l. mosquito survival as a function of temperature and relative humidity. We demonstrated that relative humidity can play a significant role in mosquito population and malaria transmission dynamics. Future modeling work should account for these effects of relative humidity.

Background: Individuals continuously exposed to malaria gradually acquire immunity that protects from severe disease and high levels of parasitization. Acquired immunity has been incorporated into numerous models of malaria transmission of varying levels of complexity (e.g. Bull World Health Organ 50:347, 1974; Am J Trop Med Hyg 75:19, 2006; Math Biosci 90:385-396, 1988). Most such models require prescribing inputs of mosquito biting rates or other entomological or epidemiological information. Here, we present a model with a novel structure that uses environmental controls of mosquito population dynamics to simulate the mosquito biting rates, malaria prevalence as well as variability in protective immunity of the population., Methods: A simple model of acquired immunity to malaria is presented and tested within the framework of the Hydrology, Entomology and Malaria Transmission Simulator (HYDREMATS), a coupled hydrology and agent-based entomology model. The combined model uses environmental data including rainfall, temperature, and topography to simulate malaria prevalence and level of acquired immunity in the human population. The model is used to demonstrate the effect of acquired immunity on malaria prevalence in two Niger villages that are hydrologically and entomologically very different. Simulations are conducted for the year 2006 and compared to malaria prevalence observations collected from the two villages., Results: Blood smear samples from children show no clear difference in malaria prevalence between the two villages despite pronounced differences in observed mosquito abundance. The similarity in prevalence is attributed to the moderating effect of acquired immunity, which depends on prior exposure to the parasite through infectious bites - and thus the hydrologically determined mosquito abundance. Modelling the level of acquired immunity can affect village vulnerability to climatic anomalies., Conclusions: The model presented has a novel structure constituting a mechanistic link between spatial and temporal environmental variability and village-scale malaria transmission. Incorporating acquired immunity into the model has allowed simulation of prevalence in the two villages, and isolation of the effects of acquired immunity in dampening the difference in prevalence between the two villages. Without these effects, the difference in prevalence between the two villages would have been significantly larger in response to the large differences in mosquito populations and the associated biting rates.

Background: Early warnings of malaria transmission allow health officials to better prepare for future epidemics. Monitoring rainfall is recognized as an important part of malaria early warning systems. The Hydrology, Entomology and Malaria Simulator (HYDREMATS) is a mechanistic model that relates rainfall to malaria transmission, and could be used to provide early warnings of malaria epidemics., Methods: HYDREMATS is used to make predictions of mosquito populations and vectorial capacity for 2005, 2006, and 2007 in Banizoumbou village in western Niger. HYDREMATS is forced by observed rainfall, followed by a rainfall prediction based on the seasonal mean rainfall for a period two or four weeks into the future., Results: Predictions made using this method provided reasonable estimates of mosquito populations and vectorial capacity, two to four weeks in advance. The predictions were significantly improved compared to those made when HYDREMATS was forced with seasonal mean rainfall alone., Conclusions: HYDREMATS can be used to make reasonable predictions of mosquito populations and vectorial capacity, and provide early warnings of the potential for malaria epidemics in Africa.