Search

We present MacKenzie, a HPC-driven multi-cluster workflow system that was used repeatedly to configure and execute fine-grained US national-scale epidemic simulation models during the COVID-19 pandemic. Mackenzie supported federal and Virginia policymakers, in real-time, for a large number of "what-if" scenarios during the COVID-19 pandemic, and continues to be used to answer related questions as COVID-19 transitions to the endemic stage of the disease. MacKenzie is a novel HPC meta-scheduler that can execute US-scale simulation models and associated workflows that typically present significant big data challenges. The meta-scheduler optimizes the total execution time of simulations in the workflow, and helps improve overall human productivity. As an exemplar of the kind of studies that can be conducted using Mackenzie, we present a modeling study to understand the impact of vaccine-acceptance in controlling the spread of COVID-19 in the US. We use a 288 million node synthetic social contact network (digital twin) spanning all 50 US states plus Washington DC, comprised of 3300 counties, with 12 billion daily interactions. The highly-resolved agent-based model used for the epidemic simulations uses realistic information about disease progression, vaccine uptake, production schedules, acceptance trends, prevalence, and social distancing guidelines. Computational experiments show that, for the simulation workload discussed above, MacKenzie is able to scale up well to 10K CPU cores. Our modeling results show that, when compared to faster and accelerating vaccinations, slower vaccination rates due to vaccine hesitancy cause averted infections to drop from 6.7M to 4.5M, and averted total deaths to drop from 39.4K to 28.2K across the US. This occurs despite the fact that the final vaccine coverage is the same in both scenarios. We also find that if vaccine acceptance could be increased by 10% in all states, averted infections could be increased from 4.5M to 4.7M (a 4.4% improvement) and total averted deaths could be increased from 28.2K to 29.9K (a 6% improvement) nationwide., Competing Interests: Parantapa Bhattacharya reports financial support was provided by Centers for Disease Control and Prevention. Parantapa Bhattacharya reports financial support was provided by Virginia Department of Health. Parantapa Bhattacharya reports financial support was provided by National Science Foundation. Parantapa Bhattacharya reports financial support was provided by National Institutes of Health.

Scenario-based modeling frameworks have been widely used to support policy-making at state and federal levels in the United States during the COVID-19 response. While custom-built models can be used to support one-off studies, sustained updates to projections under changing pandemic conditions requires a robust, integrated, and adaptive framework. In this paper, we describe one such framework, UVA-adaptive, that was built to support the CDC-aligned Scenario Modeling Hub (SMH) across multiple rounds, as well as weekly/biweekly projections to Virginia Department of Health (VDH) and US Department of Defense during the COVID-19 response. Building upon an existing metapopulation framework, PatchSim, UVA-adaptive uses a calibration mechanism relying on adjustable effective transmissibility as a basis for scenario definition while also incorporating real-time datasets on case incidence, seroprevalence, variant characteristics, and vaccine uptake. Through the pandemic, our framework evolved by incorporating available data sources and was extended to capture complexities of multiple strains and heterogeneous immunity of the population. Here we present the version of the model that was used for the recent projections for SMH and VDH, describe the calibration and projection framework, and demonstrate that the calibrated transmissibility correlates with the evolution of the pathogen as well as associated societal dynamics., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier B.V. All rights reserved.)

Background: Coronavirus Disease 2019 (COVID-19) continues to cause significant hospitalizations and deaths in the United States. Its continued burden and the impact of annually reformulated vaccines remain unclear. Here, we present projections of COVID-19 hospitalizations and deaths in the United States for the next 2 years under 2 plausible assumptions about immune escape (20% per year and 50% per year) and 3 possible CDC recommendations for the use of annually reformulated vaccines (no recommendation, vaccination for those aged 65 years and over, vaccination for all eligible age groups based on FDA approval)., Methods and Findings: The COVID-19 Scenario Modeling Hub solicited projections of COVID-19 hospitalization and deaths between April 15, 2023 and April 15, 2025 under 6 scenarios representing the intersection of considered levels of immune escape and vaccination. Annually reformulated vaccines are assumed to be 65% effective against symptomatic infection with strains circulating on June 15 of each year and to become available on September 1. Age- and state-specific coverage in recommended groups was assumed to match that seen for the first (fall 2021) COVID-19 booster. State and national projections from 8 modeling teams were ensembled to produce projections for each scenario and expected reductions in disease outcomes due to vaccination over the projection period. From April 15, 2023 to April 15, 2025, COVID-19 is projected to cause annual epidemics peaking November to January. In the most pessimistic scenario (high immune escape, no vaccination recommendation), we project 2.1 million (90% projection interval (PI) [1,438,000, 4,270,000]) hospitalizations and 209,000 (90% PI [139,000, 461,000]) deaths, exceeding pre-pandemic mortality of influenza and pneumonia. In high immune escape scenarios, vaccination of those aged 65+ results in 230,000 (95% confidence interval (CI) [104,000, 355,000]) fewer hospitalizations and 33,000 (95% CI [12,000, 54,000]) fewer deaths, while vaccination of all eligible individuals results in 431,000 (95% CI: 264,000-598,000) fewer hospitalizations and 49,000 (95% CI [29,000, 69,000]) fewer deaths., Conclusions: COVID-19 is projected to be a significant public health threat over the coming 2 years. Broad vaccination has the potential to substantially reduce the burden of this disease, saving tens of thousands of lives each year., Competing Interests: JE is president of General Biodefense LLC, a private consulting group for public health informatics, and has interest in READE.ai, a medical artificial intelligence solutions company. MR reports stock ownership in Becton Dickinson & Co., which manufactures medical equipment used in COVID-19 testing, vaccination, and treatment. JL has served as an expert witness on cases where the likely length of the pandemic was of issue. The remaining authors declare no competing interests., (Copyright: © 2024 Jung et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Our ability to forecast epidemics far into the future is constrained by the many complexities of disease systems. Realistic longer-term projections may, however, be possible under well-defined scenarios that specify the future state of critical epidemic drivers. Since December 2020, the U.S. COVID-19 Scenario Modeling Hub (SMH) has convened multiple modeling teams to make months ahead projections of SARS-CoV-2 burden, totaling nearly 1.8 million national and state-level projections. Here, we find SMH performance varied widely as a function of both scenario validity and model calibration. We show scenarios remained close to reality for 22 weeks on average before the arrival of unanticipated SARS-CoV-2 variants invalidated key assumptions. An ensemble of participating models that preserved variation between models (using the linear opinion pool method) was consistently more reliable than any single model in periods of valid scenario assumptions, while projection interval coverage was near target levels. SMH projections were used to guide pandemic response, illustrating the value of collaborative hubs for longer-term scenario projections., (© 2023. The Author(s).)

For integers m and n , we study the problem of finding good lower bounds for the size of progression-free sets in ( Z m n , + ) . Let r k ( Z m n ) denote the maximal size of a subset of Z m n without arithmetic progressions of length  k and let P - ( m ) denote the least prime factor of  m . We construct explicit progression-free sets and obtain the following improved lower bounds for r k ( Z m n ) :If k ≥ 5 is odd and P - ( m ) ≥ ( k + 2 ) / 2 , then r k ( Z m n ) ≫ m , k ⌊ k - 1 k + 1 m + 1 ⌋ n n ⌊ k - 1 k + 1 m ⌋ / 2 . If k ≥ 4 is even, P - ( m ) ≥ k and m ≡ - 1 mod k , then r k ( Z m n ) ≫ m , k ⌊ k - 2 k m + 2 ⌋ n n ⌊ k - 2 k m + 1 ⌋ / 2 . Moreover, we give some further improved lower bounds on r k ( Z p n ) for primes p ≤ 31 and progression lengths 4 ≤ k ≤ 8 ., (© The Author(s) 2022.)

This paper describes an integrated, data-driven operational pipeline based on national agent-based models to support federal and state-level pandemic planning and response. The pipeline consists of ( i ) an automatic semantic-aware scheduling method that coordinates jobs across two separate high performance computing systems; ( ii ) a data pipeline to collect, integrate and organize national and county-level disaggregated data for initialization and post-simulation analysis; ( iii ) a digital twin of national social contact networks made up of 288 Million individuals and 12.6 Billion time-varying interactions covering the US states and DC; ( iv ) an extension of a parallel agent-based simulation model to study epidemic dynamics and associated interventions. This pipeline can run 400 replicates of national runs in less than 33 h, and reduces the need for human intervention, resulting in faster turnaround times and higher reliability and accuracy of the results. Scientifically, the work has led to significant advances in real-time epidemic sciences., Competing Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article., (© The Author(s) 2022.)

Background: The COVID-19 Scenario Modeling Hub convened nine modeling teams to project the impact of expanding SARS-CoV-2 vaccination to children aged 5-11 years on COVID-19 burden and resilience against variant strains., Methods: Teams contributed state- and national-level weekly projections of cases, hospitalizations, and deaths in the United States from September 12, 2021 to March 12, 2022. Four scenarios covered all combinations of 1) vaccination (or not) of children aged 5-11 years (starting November 1, 2021), and 2) emergence (or not) of a variant more transmissible than the Delta variant (emerging November 15, 2021). Individual team projections were linearly pooled. The effect of childhood vaccination on overall and age-specific outcomes was estimated using meta-analyses., Findings: Assuming that a new variant would not emerge, all-age COVID-19 outcomes were projected to decrease nationally through mid-March 2022. In this setting, vaccination of children 5-11 years old was associated with reductions in projections for all-age cumulative cases (7.2%, mean incidence ratio [IR] 0.928, 95% confidence interval [CI] 0.880-0.977), hospitalizations (8.7%, mean IR 0.913, 95% CI 0.834-0.992), and deaths (9.2%, mean IR 0.908, 95% CI 0.797-1.020) compared with scenarios without childhood vaccination. Vaccine benefits increased for scenarios including a hypothesized more transmissible variant, assuming similar vaccine effectiveness. Projected relative reductions in cumulative outcomes were larger for children than for the entire population. State-level variation was observed., Interpretation: Given the scenario assumptions (defined before the emergence of Omicron), expanding vaccination to children 5-11 years old would provide measurable direct benefits, as well as indirect benefits to the all-age U.S. population, including resilience to more transmissible variants., Funding: Various (see acknowledgments)., Competing Interests: JL has served as an expert witness on cases where the likely length of the pandemic was of issue. MCR reports stock ownership in Becton Dickinson & Co., which manufactures medical equipment used in COVID-19 testing, vaccination, and treatment. JS and Columbia University disclose partial ownership of SK Analytics. JS discloses consulting for BNI. There are no other competing interests to declare.

In Spring 2021, the highly transmissible SARS-CoV-2 Delta variant began to cause increases in cases, hospitalizations, and deaths in parts of the United States. At the time, with slowed vaccination uptake, this novel variant was expected to increase the risk of pandemic resurgence in the US in summer and fall 2021. As part of the COVID-19 Scenario Modeling Hub, an ensemble of nine mechanistic models produced 6-month scenario projections for July-December 2021 for the United States. These projections estimated substantial resurgences of COVID-19 across the US resulting from the more transmissible Delta variant, projected to occur across most of the US, coinciding with school and business reopening. The scenarios revealed that reaching higher vaccine coverage in July-December 2021 reduced the size and duration of the projected resurgence substantially, with the expected impacts was largely concentrated in a subset of states with lower vaccination coverage. Despite accurate projection of COVID-19 surges occurring and timing, the magnitude was substantially underestimated 2021 by the models compared with the of the reported cases, hospitalizations, and deaths occurring during July-December, highlighting the continued challenges to predict the evolving COVID-19 pandemic. Vaccination uptake remains critical to limiting transmission and disease, particularly in states with lower vaccination coverage. Higher vaccination goals at the onset of the surge of the new variant were estimated to avert over 1.5 million cases and 21,000 deaths, although may have had even greater impacts, considering the underestimated resurgence magnitude from the model., Competing Interests: ST, CS, MQ, LM, RB, KS, EH, LC, JL, JK, HH, MK, KT, SW, LS, KR, JL, JD, JK, EL, JP, AH, DK, MC, JD, KM, XX, AP, AV, AS, PP, SV, AA, BL, BK, JO, MO, GH, BH, JC, AV, MM, SH, PB, DM, SC, RP, DJ, JT, MG, TY, SP, JH, RS, MB, MJ, CV No competing interests declared, JL has served as an expert witness on cases where the likely length of the pandemic was of issue, JS and Columbia University disclose partial ownership of SK Analytics. Discloses consulting for BNI, MR reports stock ownership in Becton Dickinson & Co, which manufactures medical equipment used in COVID testing, vaccination, and treatment

After a period of rapidly declining U.S. COVID-19 incidence during January-March 2021, increases occurred in several jurisdictions (1,2) despite the rapid rollout of a large-scale vaccination program. This increase coincided with the spread of more transmissible variants of SARS-CoV-2, the virus that causes COVID-19, including B.1.1.7 (1,3) and relaxation of COVID-19 prevention strategies such as those for businesses, large-scale gatherings, and educational activities. To provide long-term projections of potential trends in COVID-19 cases, hospitalizations, and deaths, COVID-19 Scenario Modeling Hub teams used a multiple-model approach comprising six models to assess the potential course of COVID-19 in the United States across four scenarios with different vaccination coverage rates and effectiveness estimates and strength and implementation of nonpharmaceutical interventions (NPIs) (public health policies, such as physical distancing and masking) over a 6-month period (April-September 2021) using data available through March 27, 2021 (4). Among the four scenarios, an accelerated decline in NPI adherence (which encapsulates NPI mandates and population behavior) was shown to undermine vaccination-related gains over the subsequent 2-3 months and, in combination with increased transmissibility of new variants, could lead to surges in cases, hospitalizations, and deaths. A sharp decline in cases was projected by July 2021, with a faster decline in the high-vaccination scenarios. High vaccination rates and compliance with public health prevention measures are essential to control the COVID-19 pandemic and to prevent surges in hospitalizations and deaths in the coming months., Competing Interests: All authors have completed and submitted the International Committee of Medical Journal Editors form for disclosure of potential conflicts of interest. Katriona Shea reports receipt of two National Science Foundation (NSF) COVID-19 RAPID awards, and a Huck Institutes of the Life Sciences Coronavirus Research Seed Grant. Rebecca Borchering reports funding from an NSF COVID-19 RAPID award. Katharine Tallaksen, Kaitlin Rainwater-Lovett, Laura Asher, Luke C. Mullany, Molly E. Gallagher, Matt Kinsey, Richard F. Obrecht, and Lauren Shin report funding from the U.S. Department of Health and Human Services (HHS), Office of the Assistant Secretary for Preparedness and Response to the Johns Hopkins Applied Physics Laboratory. Matteo Chinazzi reports grants from the National Institutes of Health (NIH), the Council of State and Territorial Epidemiologists (CSTE), and Metabiota to Northeastern University. Ana Pastore y Piontti reports funding from Metabiota, Inc. to Northeastern University and royalties from Springer Publishing. Joseph Lemaitre reports funding from the Swiss National Science Foundation, State of California, HHS, and the Department of Homeland Security (DHS). Kyra H. Grantz reports support from the California Department of Public Health, Johns Hopkins Bloomberg School of Public Health, NIH, and travel support from the World Health Organization (WHO). Elizabeth Lee and Claire Smith report support from the California Department of Public Health, Johns Hopkins Bloomberg School of Public Health, Johns Hopkins Health System, HHS, and DHS, and computing resources from Amazon Web Services, Johns Hopkins University Modeling and Policy Hub, and the Office of the Dean at the Johns Hopkins Bloomberg School of Public Health. Justin Lessler reports support from DHHS, DHS, California Institute of Technology, NIH, honorarium from the American Association for Cancer Research, personal fees for expert testimony from Paul, Weiss, Rifkind, Wharton & Garrison, LLP. Lindsay Keegan reports support from the State of California, and NIH, a University of Utah Immunology, Inflammation, and Infectious Disease Seed Grant, and a scholarship from the University of Washington Summer Institute in Statistics and Modeling of Infectious Diseases. Lucie Contamin, John Levander, Jessica Salerno, and Willem Gijsbert van Panhuis report a National Institute of General Medical Sciences grant. Ajitesh Srivastava reports a grant from the National Science Foundation. Michael C. Runge reports stock ownership in Becton Dickinson & Co., which manufactures medical equipment used in COVID testing, vaccination, and treatment. Alessandro Vespignani reports grants from NIH, NSF, WHO, CSTE, Metabiota Inc., Templeton Foundation, Scientific Interchange Foundation, Bill & Melinda Gates Foundation; royalties from Cambridge University Press, World Scientific, Springer Publishing, and Il Saggiatore; consulting fees from Human Technopole Foundation, Institute for Scientific Interchange Foundation, honorarium for lecture module at University of Washington; Scientific Advisory Board member of the Institute for Scientific Interchange Foundation, Italy, Supervisory Board member of the Human Technopole Foundation, Italy; and gifts to Northeastern University from the McGovern Foundation, the Chleck Foundation, the Sternberg Family, J. Pallotta, and Google Cloud research credits for COVID-19 from Google. Akhil Sai Peddireddy, Pyrros A. Telionis, Anil Vullikanti, Jiangzhuo Chen, Benjamin Hurt, Brian D. Klahn, Bryan Lewis, James Schlitt, Joseph Outten, Lijing Wang, Madhav Marathe, Patrick Corbett, Przemyslaw Porebski, and Srinivasan Venkatramanan report institutional support from the National Science Foundation, Expeditions, NIH, the U.S. Department of Defense, Virginia Department of Health, Virginia Department of Emergency Management, University of Virginia (internal seed grants), and Accuweather. No other potential conflicts of interest were disclosed.

COPASI is software used for the creation, modification, simulation and computational analysis of kinetic models in various fields. It is open-source, available for all major platforms and provides a user-friendly graphical user interface, but is also controllable via the command line and scripting languages. These are likely reasons for its wide acceptance. We begin this review with a short introduction describing the general approaches and techniques used in computational modeling in the biosciences. Next we introduce the COPASI package, and its capabilities, before looking at typical applications of COPASI in biotechnology., (Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.)