Search

Abstract In the ENSEMBLE randomized, placebo-controlled phase 3 trial (NCT04505722), estimated single-dose Ad26.COV2.S vaccine efficacy (VE) was 56% against moderate to severe–critical COVID-19. SARS-CoV-2 Spike sequences were determined from 484 vaccine and 1,067 placebo recipients who acquired COVID-19. In this set of prespecified analyses, we show that in Latin America, VE was significantly lower against Lambda vs. Reference and against Lambda vs. non-Lambda [family-wise error rate (FWER) p

Metabolomics has been used extensively to capture the exposome. We investigated whether prospectively measured metabolites provided predictive power beyond well-established risk factors among 758 women with adjudicated cancers [n = 577 breast (BC) and n = 181 colorectal (CRC)] and n = 758 controls with available specimens (collected mean 7.2 years prior to diagnosis) in the Women’s Health Initiative Bone Mineral Density subcohort. Fasting samples were analyzed by LC-MS/MS and lipidomics in serum, plus GC-MS and NMR in 24 h urine. For feature selection, we applied LASSO regression and Super Learner algorithms. Prediction models were subsequently derived using logistic regression and Super Learner procedures, with performance assessed using cross-validation (CV). For BC, metabolites did not increase predictive performance over established risk factors (CV-AUCs~0.57). For CRC, prediction increased with the addition of metabolites (median CV-AUC across platforms increased from ~0.54 to ~0.60). Metabolites related to energy metabolism: adenosine, 2-hydroxyglutarate, N-acetyl-glycine, taurine, threonine, LPC (FA20:3), acetate, and glycerate; protein metabolism: histidine, leucic acid, isoleucine, N-acetyl-glutamate, allantoin, N-acetyl-neuraminate, hydroxyproline, and uracil; and dietary/microbial metabolites: myo-inositol, trimethylamine-N-oxide, and 7-methylguanine, consistently contributed to CRC prediction. Energy metabolism may play a key role in the development of CRC and may be evident prior to disease development.

Abstract Background Central nervous system (CNS) active medications have been consistently linked to falls in older people. However, few randomized trials have evaluated whether CNS-active medication reduction reduces falls and fall-related injuries. The objective of the Reducing CNS-active Medications to Prevent Falls and Injuries in Older Adults (STOP-FALLS) trial is to test the effectiveness of a health-system-embedded deprescribing intervention focused on CNS-active medications on the incidence of medically treated falls among community-dwelling older adults. Methods We will conduct a pragmatic, cluster-randomized, parallel-group, controlled clinical trial within Kaiser Permanente Washington to test the effectiveness of a 12-month deprescribing intervention consisting of (1) an educational brochure and self-care handouts mailed to older adults prescribed one or more CNS-active medications (aged 60 + : opioids, benzodiazepines and Z-drugs; aged 65 + : skeletal muscle relaxants, tricyclic antidepressants, and antihistamines) and (2) decision support for their primary health care providers. Outcomes are examined over 18–26 months post-intervention. The primary outcome is first incident (post-baseline) medically treated fall as determined from health plan data. Our sample size calculations ensure at least 80% power to detect a 20% reduction in the rate of medically treated falls for participants receiving care within the intervention (n = 9) versus usual care clinics (n = 9) assuming 18 months of follow-up. Secondary outcomes include medication discontinuation or dose reduction of any target medications. Safety outcomes include serious adverse drug withdrawal events, unintentional overdose, and death. We will also examine medication signetur fields for attempts to decrease medications. We will report factors affecting implementation of the intervention. Discussion The STOP-FALLS trial will provide new information about whether a health-system-embedded deprescribing intervention that targets older participants and their primary care providers reduces medically treated falls and CNS-active medication use. Insights into factors affecting implementation will inform future research and healthcare organizations that may be interested in replicating the intervention. Trial registration ClinicalTrial.gov NCT05689554. Registered on 18 January 2023, retrospectively registered.

Summary: Combination monoclonal broadly neutralizing antibody (bnAb) regimens are in clinical development for HIV prevention, necessitating additional knowledge of bnAb neutralization potency/breadth against circulating viruses. Williamson et al. (2021) described a software tool, Super LeArner Prediction of NAb Panels (SLAPNAP), with application to any HIV bnAb regimen with sufficient neutralization data against a set of viruses in the Los Alamos National Laboratory’s Compile, Neutralize, and Tally Nab Panels repository. SLAPNAP produces a proteomic antibody resistance (PAR) score for Env sequences based on predicted neutralization resistance and estimates variable importance of Env amino acid features. We apply SLAPNAP to compare HIV bnAb regimens undergoing clinical testing, finding improved power for downstream sieve analyses and increased precision for comparing neutralization potency/breadth of bnAb regimens due to the inclusion of PAR scores of Env sequences with much larger sample sizes available than for neutralization outcomes. SLAPNAP substantially improves bnAb regimen characterization, ranking, and down-selection.

Abstract Background: Real-world data, such as administrative claims and electronic health records, are increasingly used for safety monitoring and to help guide regulatory decision-making. In these settings, it is important to document analytic decisions transparently and objectively to assess and ensure that analyses meet their intended goals. Methods: The Causal Roadmap is an established framework that can guide and document analytic decisions through each step of the analytic pipeline, which will help investigators generate high-quality real-world evidence. Results: In this paper, we illustrate the utility of the Causal Roadmap using two case studies previously led by workgroups sponsored by the Sentinel Initiative – a program for actively monitoring the safety of regulated medical products. Each case example focuses on different aspects of the analytic pipeline for drug safety monitoring. The first case study shows how the Causal Roadmap encourages transparency, reproducibility, and objective decision-making for causal analyses. The second case study highlights how this framework can guide analytic decisions beyond inference on causal parameters, improving outcome ascertainment in clinical phenotyping. Conclusion: These examples provide a structured framework for implementing the Causal Roadmap in safety surveillance and guide transparent, reproducible, and objective analysis.

Increasing emphasis on the use of real-world evidence (RWE) to support clinical policy and regulatory decision-making has led to a proliferation of guidance, advice, and frameworks from regulatory agencies, academia, professional societies, and industry. A broad spectrum of studies use real-world data (RWD) to produce RWE, ranging from randomized trials with outcomes assessed using RWD to fully observational studies. Yet, many proposals for generating RWE lack sufficient detail, and many analyses of RWD suffer from implausible assumptions, other methodological flaws, or inappropriate interpretations. The Causal Roadmap is an explicit, itemized, iterative process that guides investigators to prespecify study design and analysis plans; it addresses a wide range of guidance within a single framework. By supporting the transparent evaluation of causal assumptions and facilitating objective comparisons of design and analysis choices based on prespecified criteria, the Roadmap can help investigators to evaluate the quality of evidence that a given study is likely to produce, specify a study to generate high-quality RWE, and communicate effectively with regulatory agencies and other stakeholders. This paper aims to disseminate and extend the Causal Roadmap framework for use by clinical and translational researchers; three companion papers demonstrate applications of the Causal Roadmap for specific use cases.

Abstract Background While random forests are one of the most successful machine learning methods, it is necessary to optimize their performance for use with datasets resulting from a two-phase sampling design with a small number of cases—a common situation in biomedical studies, which often have rare outcomes and covariates whose measurement is resource-intensive. Methods Using an immunologic marker dataset from a phase III HIV vaccine efficacy trial, we seek to optimize random forest prediction performance using combinations of variable screening, class balancing, weighting, and hyperparameter tuning. Results Our experiments show that while class balancing helps improve random forest prediction performance when variable screening is not applied, class balancing has a negative impact on performance in the presence of variable screening. The impact of the weighting similarly depends on whether variable screening is applied. Hyperparameter tuning is ineffective in situations with small sample sizes. We further show that random forests under-perform generalized linear models for some subsets of markers, and prediction performance on this dataset can be improved by stacking random forests and generalized linear models trained on different subsets of predictors, and that the extent of improvement depends critically on the dissimilarities between candidate learner predictions. Conclusion In small datasets from two-phase sampling design, variable screening and inverse sampling probability weighting are important for achieving good prediction performance of random forests. In addition, stacking random forests and simple linear models can offer improvements over random forests.

Summary: Background: The identification of baseline host determinants that associate with robust HIV-1 vaccine-induced immune responses could aid HIV-1 vaccine development. We aimed to assess both the collective and relative performance of baseline characteristics in classifying individual participants in nine different Phase 1-2 HIV-1 vaccine clinical trials (26 vaccine regimens, conducted in Africa and in the Americas) as High HIV-1 vaccine responders. Methods: This was a meta-analysis of individual participant data, with studies chosen based on participant-level (vs. study-level summary) data availability within the HIV-1 Vaccine Trials Network. We assessed the performance of 25 baseline characteristics (demographics, safety haematological measurements, vital signs, assay background measurements) and estimated the relative importance of each characteristic in classifying 831 participants as High (defined as within the top 25th percentile among positive responders or above the assay upper limit of quantification) versus Non-High responders. Immune response outcomes included HIV-1-specific serum IgG binding antibodies and Env-specific CD4+ T-cell responses assessed two weeks post-last dose, all measured at central HVTN laboratories. Three variable importance approaches based on SuperLearner ensemble machine learning were considered. Findings: Overall, 30.1%, 50.5%, 36.2%, and 13.9% of participants were categorized as High responders for gp120 IgG, gp140 IgG, gp41 IgG, and Env-specific CD4+ T-cell vaccine-induced responses, respectively. When including all baseline characteristics, moderate performance was achieved for the classification of High responder status for the binding antibody responses, with cross-validated areas under the ROC curve (CV-AUC) of 0.72 (95% CI: 0.68, 0.76) for gp120 IgG, 0.73 (0.69, 0.76) for gp140 IgG, and 0.67 (95% CI: 0.63, 0.72) for gp41 IgG. In contrast, the collection of all baseline characteristics yielded little improvement over chance for predicting High Env-specific CD4+ T-cell responses [CV-AUC: 0.53 (0.48, 0.58)]. While estimated variable importance patterns differed across the three approaches, female sex assigned at birth, lower height, and higher total white blood cell count emerged as significant predictors of High responder status across multiple immune response outcomes using Approach 1. Of these three baseline variables, total white blood cell count ranked highly across all three approaches for predicting vaccine-induced gp41 and gp140 High responder status. Interpretation: The identified features should be studied further in pursuit of intervention strategies to improve vaccine responses and may be adjusted for in analyses of immune response data to enhance statistical power. Funding: National Institute of Allergy and Infectious Diseases (UM1AI068635 to YH, UM1AI068614 to GDT, UM1AI068618 to MJM, and UM1 AI069511 to MCK), the Duke CFAR P30 AI064518 to GDT, and National Institute of Dental and Craniofacial Research (R01DE027245 to JJK). This work was also supported by the Bill and Melinda Gates Foundation. The content is solely the responsibility of the authors and does not necessarily represent the official views of any of the funding sources.

Abstract Coronavirus disease 2019 is a global pandemic affecting >3 million people in >170 countries, resulting in >200 000 deaths; 35% to 40% of patients and deaths are in the United States. The coronavirus disease 2019 crisis is placing an enormous burden on health care in the United States, including residency and fellowship training programs. The balance between mitigation, training and education, and patient care is the ultimate determinant of the role of cardiology fellows in training during the coronavirus disease 2019 crisis. On March 24, 2020, the Accreditation Council for Graduate Medical Education issued a formal response to the pandemic crisis and described a framework for operation of graduate medical education programs. Guidance for deployment of cardiology fellows in training during the coronavirus disease 2019 crisis is based on the principles of a medical mission, and adherence to preparation, protection, and support of our fellows in training. The purpose of this review is to describe our departmental strategic deployment of cardiology fellows in training using the Accreditation Council for Graduate Medical Education framework for pandemic preparedness.

Combination monoclonal broadly neutralizing antibodies (bnAbs) are currently being developed for preventing HIV-1 acquisition. Recent work has focused on predicting in vitro neutralization potency of both individual bnAbs and combination regimens against HIV-1 pseudoviruses using Env sequence features. To predict in vitro combination regimen neutralization potency against a given HIV-1 pseudovirus, previous approaches have applied mathematical models to combine individual-bnAb neutralization and have predicted this combined neutralization value; we call this the combine-then-predict (CP) approach. However, prediction performance for some individual bnAbs has exceeded that for the combination, leading to another possibility: combining the individual-bnAb predicted values and using these to predict combination regimen neutralization; we call this the predict-then-combine (PC) approach. We explore both approaches in both simulated data and data from the Los Alamos National Laboratory's Compile, Neutralize, and Tally NAb Panels repository. The CP approach is superior to the PC approach when the neutralization outcome of interest is binary (e.g., neutralization susceptibility, defined as inhibitory 80% concentration < 1 μg/mL). For continuous outcomes, the CP approach performs nearly as well as the PC approach when the individual-bnAb prediction algorithms have strong performance, and is superior to the PC approach when the individual-bnAb prediction algorithms have poor performance. This knowledge may be used when building prediction models for novel antibody combinations in the absence of in vitro neutralization data for the antibody combination; this, in turn, will aid in the evaluation and down-selection of these antibody combinations into prevention efficacy trials.

The broadly neutralizing antibody (bnAb) VRC01 is being evaluated for its efficacy to prevent HIV-1 infection in the Antibody Mediated Prevention (AMP) trials. A secondary objective of AMP utilizes sieve analysis to investigate how VRC01 prevention efficacy (PE) varies with HIV-1 envelope (Env) amino acid (AA) sequence features. An exhaustive analysis that tests how PE depends on every AA feature with sufficient variation would have low statistical power. To design an adequately powered primary sieve analysis for AMP, we modeled VRC01 neutralization as a function of Env AA sequence features of 611 HIV-1 gp160 pseudoviruses from the CATNAP database, with objectives: (1) to develop models that best predict the neutralization readouts; and (2) to rank AA features by their predictive importance with classification and regression methods. The dataset was split in half, and machine learning algorithms were applied to each half, each analyzed separately using cross-validation and hold-out validation. We selected Super Learner, a nonparametric ensemble-based cross-validated learning method, for advancement to the primary sieve analysis. This method predicted the dichotomous resistance outcome of whether the IC50 neutralization titer of VRC01 for a given Env pseudovirus is right-censored (indicating resistance) with an average validated AUC of 0.868 across the two hold-out datasets. Quantitative log IC50 was predicted with an average validated R2 of 0.355. Features predicting neutralization sensitivity or resistance included 26 surface-accessible residues in the VRC01 and CD4 binding footprints, the length of gp120, the length of Env, the number of cysteines in gp120, the number of cysteines in Env, and 4 potential N-linked glycosylation sites; the top features will be advanced to the primary sieve analysis. This modeling framework may also inform the study of VRC01 in the treatment of HIV-infected persons.

Introduction Successful global treatment as prevention (TasP) requires identifying HIV‐positive individuals at high risk for transmitting HIV, and having impact via potential infections averted. This study estimated the frequency and predictors of numbers of HIV transmissions and bacterial sexually transmitted infection (STI) acquisition among sexually active HIV‐positive individuals in care from three representative global settings. Methods HIV‐positive individuals (n=749), including heterosexual men, heterosexual women and men who have sex with men (MSM) in HIV care, were recruited from Chiang Mai (Thailand), Rio De Janeiro (Brazil) and Lusaka (Zambia). Participants were assessed on HIV and STI sexual transmission risk variables, psychosocial characteristics and bacterial STIs at enrolment and quarterly for 12 months (covering 15 months). Estimated numbers of HIV transmissions per person were calculated using reported numbers of partners and sex acts together with estimates of HIV transmissibility, accounting for ART treatment and condom use. Results An estimated 3.81 (standard error, (SE)=0.63) HIV transmissions occurred for every 100 participants over the 15 months, which decreased over time. The highest rate was 19.50 (SE=1.68) for every 100 MSM in Brazil. In a multivariable model, country×risk group interactions emerged: in Brazil, MSM had 2.85 (95% CI=1.45, 4.25, p