Search

This article represents the first in a series of tutorials on model evaluation in nonlinear mixed effect models (NLMEMs), from the International Society of Pharmacometrics (ISoP) Model Evaluation Group. Numerous tools are available for evaluation of NLMEM, with a particular emphasis on visual assessment. This first basic tutorial focuses on presenting graphical evaluation tools of NLMEM for continuous data. It illustrates graphs for correct or misspecified models, discusses their pros and cons, and recalls the definition of metrics used.

Optimal design has been used in the past mainly to optimize sampling schedules for clinical trials. Optimization on design variables other than sampling times has been published in the literature only once before. This study shows, as an example, optimization on the length of treatment periods to obtain reliable estimates of drug effects on longterm disease progression studies. Disease progression studies are high in cost, effort, and time; therefore, optimization of treatment length is highly recommended to avoid failure or loss of information. Results are provided for different drug effects (eg, protective and symptomatic) and for different lengths of studies and sampling schedules. The merits of extending the total study length versus inclusion of more samples per participants are investigated. The authors demonstrate that if no observations are taken during the washout period, a trial can lose up to 40% of its efficiency. Furthermore, when optimization of treatment length is performed using multiple possible drug effect models simultaneously, these studies show high power in discriminating between different drug effect models. [ABSTRACT FROM AUTHOR]

Degenerative cerebellar ataxias comprise a heterogeneous group of rare and ultra-rare genetic diseases. While disease-modifying treatments are now on the horizon for many ataxias, robust trial designs and analysis methods are lacking. To better inform trial designs, we applied item response theory (IRT) modeling to evaluate the natural history progression of several ataxias, assessed with the widely used scale for assessment and rating of ataxia (SARA). A longitudinal IRT model was built utilizing real-world data from the large autosomal recessive cerebellar ataxia (ARCA) registry. Disease progression was evaluated for the overall cohort as well as for the 10 most common ARCA genotypes. Sample sizes were calculated for simulated trials with autosomal recessive spastic ataxia Charlevoix-Saguenay (ARSACS) and polymerase gamma (POLG) ataxia, as showcased, across multiple design and analysis scenarios. Longitudinal IRT models were able to describe the changes in the latent variable underlying SARA as a function of time since ataxia onset for both the overall ARCA cohort and the common genotypes. The typical progression rates varied across genotypes between relatively high in POLG (~ 0.98 SARA points/year at SARA = 20) and very low in COQ8A ataxia (~ 0.003 SARA points/year at SARA = 20). Smaller trial sizes were required in case of faster progression, longer trials (~ 75-90% less with 5 years vs. 2 years), and larger drug effects (~ 70-80% less with 100% vs. 50% inhibition). Simulating under the developed IRT model, the longitudinal IRT model had the highest power, with a well-controlled type I error, compared to total score models or end-of-treatment analyses. The established longitudinal IRT framework allows efficient utilization of natural history data and ultimately facilitates the design and analysis of treatment trials in rare and ultra-rare genetic ataxias., (© 2024 The Author(s). Clinical Pharmacology & Therapeutics published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

Conventional approaches for establishing bioequivalence (BE) between test and reference formulations using non-compartmental analysis (NCA) may demonstrate low power in pharmacokinetic (PK) studies with sparse sampling. In this case, model-integrated evidence (MIE) approaches for BE assessment have been shown to increase power, but may suffer from selection bias problems if models are built on the same data used for BE assessment. This work presents model averaging methods for BE evaluation and compares the power and type I error of these methods to conventional BE approaches for simulated studies of oral and ophthalmic formulations. Two model averaging methods were examined: bootstrap model selection and weight-based model averaging with parameter uncertainty from three different sources, either from a sandwich covariance matrix, a bootstrap, or from sampling importance resampling (SIR). The proposed approaches increased power compared with conventional NCA-based BE approaches, especially for the ophthalmic formulation scenarios, and were simultaneously able to adequately control type I error. In the rich sampling scenario considered for oral formulation, the weight-based model averaging method with SIR uncertainty provided controlled type I error, that was closest to the target of 5%. In sparse-sampling designs, especially the single sample ophthalmic scenarios, the type I error was best controlled by the bootstrap model selection method., (© 2024 The Author(s). CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

By applying nonlinear mixed-effect (NLME) models, model-integrated evidence (MIE) approaches are able to analyze bioequivalence (BE) data with pharmacokinetic end points that have sparse sampling, which is problematic for non-compartmental analysis (NCA). However, MIE approaches may suffer from inflation of type I error due to underestimation of parameter uncertainty and to the assumption of asymptotic normality. In this study, we developed a MIE BE analysis method that is based on a pre-defined model and consists of several steps including model fitting, uncertainty assessment, simulation, and BE determination. The presented MIE approach has several improvements compared with the previously reported model-integrated methods: (1) treatment, sequence, and period effects are only added to absorption parameters (such as relative bioavailability and rate of absorption) instead of all PK parameters; (2) a simulation step is performed to generate confidence intervals of the pharmacokinetic metrics for BE assessment; and (3) in an effort to maintain type I error, two more advanced parameter uncertainty evaluation approaches are explored, a nonparametric (case resampling) bootstrap, and sampling importance resampling (SIR). To evaluate the developed method and compare the uncertainty assessment methods, simulation experiments were performed for BE studies using a two-way crossover design with different amounts of information (sparse to rich designs) and levels of variability. Based on the simulation results, the method using SIR for parameter uncertainty quantification controls type I error at the nominal level of 0.05 (i.e., the significance level set for BE evaluation) even for studies with small sample size and/or sparse sampling. As expected, our MIE approach for BE assessment exhibited higher power than the NCA-based method, especially as the data becomes sparser and/or more variable., (© 2024 The Author(s). CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

Population pharmacokinetic (PK) models are widely used to inform drug development by pharmaceutical companies and facilitate drug evaluation by regulatory agencies. Developing a population PK model is a multi-step, challenging, and time-consuming process involving iterative manual model fitting and evaluation. A tool for fully automatic model development (AMD) of common population PK models is presented here. The AMD tool is implemented in Pharmpy, a versatile open-source library for pharmacometrics. It consists of different modules responsible for developing the different components of population PK models, including the structural model, the inter-individual variability (IIV) model, the inter-occasional variability (IOV) model, the residual unexplained variability (RUV) model, the covariate model, and the allometry model. The AMD tool was evaluated using 10 real PK datasets involving the structural, IIV, and RUV modules in three sequences. The different sequences yielded generally consistent structural models; however, there were variations in the results of the IIV and RUV models. The final models of the AMD tool showed lower Bayesian Information Criterion (BIC) values and similar visual predictive check plots compared with the available published models, indicating reasonable quality, in addition to reasonable run time. A similar conclusion was also drawn in a simulation study. The developed AMD tool serves as a promising tool for fast and fully automatic population PK model building with the potential to facilitate the use of modeling and simulation in drug development., (© 2024 The Author(s). CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

The Scale for the Assessment and Rating of Ataxia (SARA) is widely used for assessing the severity and progression of genetic cerebellar ataxias. SARA is now considered a primary end point in several ataxia treatment trials, but its underlying composite item measurement model has not yet been tested. This work aimed to evaluate the composite properties of SARA and its items using item response theory (IRT) and to demonstrate its applicability across even ultra-rare genetic ataxias. Leveraging SARA subscores data from 1932 visits from 990 patients of the Autosomal Recessive Cerebellar Ataxias (ARCA) registry, we assessed the performance of SARA using IRT methodology. The item characteristics were evaluated over the ataxia severity range of the entire ataxia population as well as the assessment validity across 115 genetic ARCA subpopulations. A unidimensional IRT model was able to describe SARA item data, indicating that SARA captures one single latent variable. All items had high discrimination values (1.5-2.9) indicating the effectiveness of the SARA in differentiating between subjects with different disease statuses. Each item contributed between 7% and 28% of the total assessment informativeness. There was no evidence for differences between the 115 genetic ARCA subpopulations in SARA applicability. These results show the good discrimination ability of SARA with all of its items adding informational value. The IRT framework provides a thorough description of SARA on the item level, and facilitates its utilization as a clinical outcome assessment in upcoming longitudinal natural history or treatment trials, across a large number of ataxias, including ultra-rare ones., (© 2024 The Author(s). CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

For the analysis of time-to-event data, frequently used methods such as the log-rank test or the Cox proportional hazards model are based on the proportional hazards assumption, which is often debatable. Although a wide range of parametric and non-parametric methods for non-proportional hazards has been proposed, there is no consensus on the best approaches. To close this gap, we conducted a systematic literature search to identify statistical methods and software appropriate under non-proportional hazard. Our literature search identified 907 abstracts, out of which we included 211 articles, mostly methodological ones. Review articles and applications were less frequently identified. The articles discuss effect measures, effect estimation and regression approaches, hypothesis tests, and sample size calculation approaches, which are often tailored to specific non-proportional hazard situations. Using a unified notation, we provide an overview of methods available. Furthermore, we derive some guidance from the identified articles., Competing Interests: Declaration of conflicting interestsThe authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

With the evolving role of Model Integrated Evidence (MIE) in generic drug development and regulatory applications, the need for improving Model Sharing, Acceptance, and Communication with the FDA is warranted. Model Master File (MMF) refers to a quantitative model or a modeling platform that has undergone sufficient model Verification & Validation to be recognized as sharable intellectual property that is acceptable for regulatory purposes. MMF provides a framework for regulatorily acceptable modeling practice, which can be used with confidence to support MIE by both the industry and the U.S. Food and Drug Administration (FDA). In 2022, the FDA and the Center for Research on Complex Generics (CRCG) hosted a virtual public workshop to discuss the best practices for utilizing modeling approaches to support generic product development. This report summarizes the presentations and panel discussions of the workshop symposium entitled "Model Sharing, Acceptance, and Communication with the FDA". The symposium and this report serve as a kick-off discussion for further utilities of MMF and best practices of utilizing MMF in drug development and regulatory submissions. The potential advantages of MMFs have garnered acknowledgment from model developers, industries, and the FDA throughout the workshop. To foster a unified comprehension of MMFs and establish best practices for their application, further dialogue and cooperation among stakeholders are imperative. To this end, a subsequent workshop is scheduled for May 2-3, 2024, in Rockville, Maryland, aiming to delve into the practical facets and best practices of MMFs pertinent to regulatory submissions involving modeling and simulation methodologies., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Pharmacokinetic (PK) studies in children are usually small and have ethical constraints due to the medical complexities of drawing blood in this special population. Often, population PK models for the drug(s) of interest are available in adults, and these models can be extended to incorporate the expected deviations seen in children. As a consequence, there is increasing interest in the use of optimal design methodology to design PK sampling schemes in children that maximize information using a small sample size and limited number of sampling times per dosing period. As a case study, we use the novel tuberculosis drug delamanid, and show how applications of optimal design methodology can result in highly efficient and model-robust designs in children for estimating PK parameters using a limited number of sampling measurements. Using developed population PK models based on available data from adults living with and without HIV, and limited data on children without HIV, competing designs for children living with HIV were derived and assessed based on robustness to model uncertainty., (© 2023 The Authors. CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

Background: Colon microbiome composition contributes to the pathogenesis of colorectal cancer (CRC) and prognosis. We analyzed 16S rRNA sequencing data from tumor samples of patients with metastatic CRC and determined the clinical implications., Materials and Methods: We enrolled 133 patients with metastatic CRC at St. Vincent Hospital in Korea. The V3-V4 regions of the 16S rRNA gene from the tumor DNA were amplified, sequenced on an Illumina MiSeq, and analyzed using the DADA2 package., Results: After excluding samples that retained <5% of the total reads after merging, 120 samples were analyzed. The median age of patients was 63 years (range, 34-82 years), and 76 patients (63.3%) were male. The primary cancer sites were the right colon (27.5%), left colon (30.8%), and rectum (41.7%). All subjects received 5-fluouracil-based systemic chemotherapy. After removing genera with <1% of the total reads in each patient, 523 genera were identified. Rectal origin, high CEA level (≥10 ng/mL), and presence of lung metastasis showed higher richness. Survival analysis revealed that the presence of Prevotella ( p = 0.052), Fusobacterium ( p = 0.002), Selenomonas ( p <0.001), Fretibacterium ( p = 0.001), Porphyromonas ( p = 0.007), Peptostreptococcus ( p = 0.002), and Leptotrichia ( p = 0.003) were associated with short overall survival (OS, <24 months), while the presence of Sphingomonas was associated with long OS ( p = 0.070). From the multivariate analysis, the presence of Selenomonas (hazard ratio [HR], 6.35; 95% confidence interval [CI], 2.38-16.97; p <0.001) was associated with poor prognosis along with high CEA level., Conclusion: Tumor microbiome features may be useful prognostic biomarkers for metastatic CRC., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2024 An, Partha, Lee, Lau, Pavlichin, Almeda, Hooker, Shin and Ji.)

Background: Recommendations for statistical methods in rare disease trials are scarce, especially for cross-over designs. As a result various state-of-the-art methodologies were compared as neutrally as possible using an illustrative data set from epidermolysis bullosa research to build recommendations for count, binary, and ordinal outcome variables. For this purpose, parametric (model averaging), semiparametric (generalized estimating equations type [GEE-like]) and nonparametric (generalized pairwise comparisons [GPC] and a marginal model implemented in the R package nparLD) methods were chosen by an international consortium of statisticians., Results: It was found that there is no uniformly best method for the aforementioned types of outcome variables, but in particular situations, there are methods that perform better than others. Especially if maximizing power is the primary goal, the prioritized unmatched GPC method was able to achieve particularly good results, besides being appropriate for prioritizing clinically relevant time points. Model averaging led to favorable results in some scenarios especially within the binary outcome setting and, like the GEE-like semiparametric method, also allows for considering period and carry-over effects properly. Inference based on the nonparametric marginal model was able to achieve high power, especially in the ordinal outcome scenario, despite small sample sizes due to separate testing of treatment periods, and is suitable when longitudinal and interaction effects have to be considered., Conclusion: Overall, a balance has to be found between achieving high power, accounting for cross-over, period, or carry-over effects, and prioritizing clinically relevant time points., (© 2023. The Author(s).)

To optimize the use of data from a small number of subjects in rare disease trials, an at first sight advantageous design is the repeated measures cross-over design. However, it is unclear how these within-treatment period and within-subject clustered data are best analyzed in small-sample trials. In a real-data simulation study based upon a recent epidermolysis bullosa simplex trial using this design, we compare non-parametric marginal models, generalized pairwise comparison models, GEE-type models and parametric model averaging for both repeated binary and count data. The recommendation of which methodology to use in rare disease trials with a repeated measures cross-over design depends on the type of outcome and the number of time points the treatment has an effect on. The non-parametric marginal model testing the treatment-time-interaction effect is suitable for detecting between group differences in the shapes of the longitudinal profiles. For binary outcomes with the treatment effect on a single time point, the parametric model averaging method is recommended, while in the other cases the unmatched generalized pairwise comparison methodology is recommended. Both provide an easily interpretable effect size measure, and do not require exclusion of periods or subjects due to incompleteness., (© 2023 The International Biometric Society.)

Simulations from population models have critical applications in drug discovery and development. Avatars or digital twins, defined as individual simulations matching clinical criteria of interest compared to observations from a real subject within a predefined margin of accuracy, may be a better option for simulations performed to inform future drug development stages in cases where an adequate model is not achievable. The aim of this work was to (1) investigate methods for generating avatars with pharmacometric models, and (2) explore the properties of the generated avatars to assess the impact of the different selection settings on the number of avatars per subject, their closeness to the individual observations, and the properties of the selected samples subset from the theoretical model parameters probability density function. Avatars were generated using different combinations of nature and number of clinical criteria, accuracy of agreement, and/or number of simulations for two examples models previously published (hemato-toxicity and integrated glucose-insulin model). The avatar distribution could be used to assess the appropriateness of the models assumed parameter distribution. Similarly it could be used to assess the models ability to properly describe the trajectories of the observations. Avatars can give nuanced information regarding the ability of a model to simulate data similar to the observations both at the population and at the individual level. Further potential applications for avatars may be as a diagnostic tool, an alternative to simulations with insurance to replicate key clinical features, and as an individual measure of model fit., (© 2023. The Author(s).)

On November 30, 2021, the US Food and Drug administration (FDA) and the Center for Research on Complex Generics (CRCG) hosted a virtual public workshop titled "Establishing the Suitability of Model-Integrated Evidence (MIE) to Demonstrate Bioequivalence for Long-Acting Injectable and Implantable (LAI) Drug Products." This workshop brought relevant parties from the industry, academia, and the FDA in the field of modeling and simulation to explore, identify, and recommend best practices on utilizing MIE for bioequivalence (BE) assessment of LAI products. This report summerized presentations and panel discussions for topics including challenges and opportunities in development and assessment of generic LAI products, current status of utilizing MIE, recent research progress of utilizing MIE in generic LAI products, alternative designs for BE studies of LAI products, and model validation/verification strategies associated with different types of MIE approaches., (© 2023 The Authors. CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.)

Background: Gastric cancer is a leading cause of cancer morbidity and mortality. Developing information systems which integrate clinical and genomic data may accelerate discoveries to improve cancer prevention, detection, and treatment. To support translational research in gastric cancer, we developed the Gastric Cancer Registry (GCR), a North American repository of clinical and cancer genomics data., Methods: Participants self-enrolled online. Entry criteria into the GCR included the following: (i) diagnosis of gastric cancer, (ii) history of gastric cancer in a first- or second-degree relative, or (iii) known germline mutation in the gene CDH1. Participants provided demographic and clinical information through a detailed survey. Some participants provided specimens of saliva and tumor samples. Tumor samples underwent exome sequencing, whole-genome sequencing, and transcriptome sequencing., Results: From 2011 to 2021, 567 individuals registered and returned the clinical questionnaire. For this cohort 65% had a personal history of gastric cancer, 36% reported a family history of gastric cancer, and 14% had a germline CDH1 mutation. 89 patients with gastric cancer provided tumor samples. For the initial study, 41 tumors were sequenced using next-generation sequencing. The data was analyzed for cancer mutations, copy-number variations, gene expression, microbiome, neoantigens, immune infiltrates, and other features. We developed a searchable, web-based interface (the GCR Genome Explorer) to enable researchers' access to these datasets., Conclusions: The GCR is a unique, North American gastric cancer registry which integrates clinical and genomic annotation., Impact: Available for researchers through an open access, web-based explorer, the GCR Genome Explorer will accelerate collaborative gastric cancer research across the United States and world., (©2022 American Association for Cancer Research.)

We developed a single-cell approach to detect CRISPR-modified mRNA transcript structures. This method assesses how genetic variants at splicing sites and splicing factors contribute to alternative mRNA isoforms. We determine how alternative splicing is regulated by editing target exon-intron segments or splicing factors by CRISPR-Cas9 and their consequences on transcriptome profile. Our method combines long-read sequencing to characterize the transcript structure and short-read sequencing to match the single-cell gene expression profiles and gRNA sequence and therefore provides targeted genomic edits and transcript isoform structure detection at single-cell resolution., (© 2021. The Author(s).)

This NONMEM tutorial shows how to evaluate and optimize clinical trial designs, using algorithms developed in design software, such as PopED and PFIM 4.0. Parameter precision and model parameter estimability is obtained by assessing the Fisher Information Matrix (FIM), providing expected model parameter uncertainty. Model parameter identifiability may be uncovered by very large standard errors or inability to invert an FIM. Because evaluation of FIM is more efficient than clinical trial simulation, more designs can be investigated, and the design of a clinical trial can be optimized. This tutorial provides simple and complex pharmacokinetic/pharmacodynamic examples on obtaining optimal sample times, doses, or best division of subjects among design groups. Robust design techniques accounting for likely variability among subjects are also shown. A design evaluator and optimizer within NONMEM allows any control stream first developed for trial design exploration to be subsequently used for estimation of parameters of simulated or clinical data, without transferring the model to another software. Conversely, a model developed in NONMEM could be used for design optimization. In addition, the $DESIGN feature can be used on any model file and dataset combination to retrospectively evaluate the model parameter uncertainty one would expect given that the model generated the data, particularly if outliers of the actual data prevent a reasonable assessment of the variance-covariance. The NONMEM trial design feature is suitable for standard continuous data, whereas more elaborate trial designs or with noncontinuous data-types can still be accomplished in optimal design dedicated software like PopED and PFIM., (© 2021 The Authors. CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

On May 4, 2020, the US Food and Drug Administration (FDA) hosted an online public workshop titled "FY 2020 Generic Drug Regulatory Science Initiatives Public Workshop" to provide an overview of the status of the science and research priorities and to solicit input on the development of Generic Drug User Fee Amendments fiscal year 2021 priorities. This report summarizes the podium presentations and the outcome of discussions along with innovative ways to overcome challenges and significant opportunities related to model-based approaches in bioequivalence assessment for breakout session 4 titled, "Data analysis and model-based bioequivalence (BE)." This session focused on the application of model-based approaches in the generic drug development, with a vision of accelerating regulatory decision making for abbreviated new drug application assessments. The session included both podium presentations and panel discussions with three topics of interest: (i) in vitro study evaluation methods and their clinical relevance, (ii) challenges in model-based BE, (iii) emerging expertise and tools in implementing new BE approaches., (© 2020 The Authors Clinical Pharmacology & Therapeutics © 2020 American Society for Clinical Pharmacology and Therapeutics.)

Metaheuristics is a powerful optimization tool that is increasingly used across disciplines to tackle general purpose optimization problems. Nature-inspired metaheuristic algorithms is a subclass of metaheuristic algorithms and have been shown to be particularly flexible and useful in solving complicated optimization problems in computer science and engineering. A common practice with metaheuristics is to hybridize it with another suitably chosen algorithm for enhanced performance. This paper reviews metaheuristic algorithms and demonstrates some of its utility in tackling pharmacometric problems. Specifically, we provide three applications using one of its most celebrated members, particle swarm optimization (PSO), and show that PSO can effectively estimate parameters in complicated nonlinear mixed-effects models and to gain insights into statistical identifiability issues in a complex compartment model. In the third application, we demonstrate how to hybridize PSO with sparse grid, which is an often-used technique to evaluate high dimensional integrals, to search for D -efficient designs for estimating parameters in nonlinear mixed-effects models with a count outcome. We also show the proposed hybrid algorithm outperforms its competitors when sparse grid is replaced by its competitor, adaptive gaussian quadrature to approximate the integral, or when PSO is replaced by three notable nature-inspired metaheuristic algorithms., (© 2021 The Authors. CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

Modern drug development problems are very complex and require integration of various scientific fields. Traditionally, statistical methods have been the primary tool for design and analysis of clinical trials. Increasingly, pharmacometric approaches using physiology-based drug and disease models are applied in this context. In this paper, we show that statistics and pharmacometrics have more in common than what keeps them apart, and collectively, the synergy from these two quantitative disciplines can provide greater advances in clinical research and development, resulting in novel and more effective medicines to patients with medical need., (© 2021 The Authors. CPT: Pharmacometrics & Systems Pharmacology published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.)

Background: The genome of SARS-CoV-2 is susceptible to mutations during viral replication due to the errors generated by RNA-dependent RNA polymerases. These mutations enable the SARS-CoV-2 to evolve into new strains. Viral quasispecies emerge from de novo mutations that occur in individual patients. In combination, these sets of viral mutations provide distinct genetic fingerprints that reveal the patterns of transmission and have utility in contact tracing., Methods: Leveraging thousands of sequenced SARS-CoV-2 genomes, we performed a viral pangenome analysis to identify conserved genomic sequences. We used a rapid and highly efficient computational approach that relies on k-mers, short tracts of sequence, instead of conventional sequence alignment. Using this method, we annotated viral mutation signatures that were associated with specific strains. Based on these highly conserved viral sequences, we developed a rapid and highly scalable targeted sequencing assay to identify mutations, detect quasispecies variants, and identify mutation signatures from patients. These results were compared to the pangenome genetic fingerprints., Results: We built a k-mer index for thousands of SARS-CoV-2 genomes and identified conserved genomics regions and landscape of mutations across thousands of virus genomes. We delineated mutation profiles spanning common genetic fingerprints (the combination of mutations in a viral assembly) and a combination of mutations that appear in only a small number of patients. We developed a targeted sequencing assay by selecting primers from the conserved viral genome regions to flank frequent mutations. Using a cohort of 100 SARS-CoV-2 clinical samples, we identified genetic fingerprints consisting of strain-specific mutations seen across populations and de novo quasispecies mutations localized to individual infections. We compared the mutation profiles of viral samples undergoing analysis with the features of the pangenome., Conclusions: We conducted an analysis for viral mutation profiles that provide the basis of genetic fingerprints. Our study linked pangenome analysis with targeted deep sequenced SARS-CoV-2 clinical samples. We identified quasispecies mutations occurring within individual patients and determined their general prevalence when compared to over 70,000 other strains. Analysis of these genetic fingerprints may provide a way of conducting molecular contact tracing.

The International Prostate Symptom Score (IPSS), the quality of life (QoL) score, and the benign prostatic hyperplasia impact index (BII) are three different scales commonly used to assess the severity of lower urinary tract symptoms associated with benign prostatic hyperplasia (BPH-LUTS). Based on a phase II clinical trial including 403 patients with moderate to severe BPH-LUTS, the objectives of this study were to (i) develop traditional pharmacometric and bounded integer (BI) models for the IPSS, QoL score, and BII endpoints, respectively; (ii) compare the power and type I error in detecting drug effects of BI modeling with traditional methods through simulation; and (iii) obtain quantitative translation between scores on the three abovementioned scales using a BI modeling framework. All developed models described the data adequately. Pharmacometric modeling using a continuous variable (CV) approach was overall found to be the most robust in terms of type I error and power to detect a drug effect. In most cases, BI modeling showed similar performance to the CV approach, yet severely inflated type I error was generally observed when inter-individual variability (IIV) was incorporated in the BI variance function (g()). BI modeling without IIV in g() showed greater type I error control compared to the ordered categorical approach. Lastly, a multiple-scale BI model was developed and estimated the relationship between scores on the three BPH-LUTS scales with overall low uncertainty. The current study yields greater understanding of the operating characteristics of the novel BI modeling approach and highlights areas potentially requiring further improvement.

Item response theory (IRT) was used to characterize the time course of lower urinary tract symptoms due to benign prostatic hyperplasia (BPH-LUTS) measured by item-level International Prostate Symptom Scores (IPSS). The Fisher information content of IPSS items was determined and the power to detect a drug effect using the IRT approach was examined. Data from 403 patients with moderate-to-severe BPH-LUTS in a placebo-controlled phase II trial studying the effect of degarelix over 6 months were used for modeling. Three pharmacometric models were developed: a model for total IPSS, a unidimensional IRT model, and a bidimensional IRT model, the latter separating voiding and storage items. The population-level time course of BPH-LUTS in all models was described by initial improvement followed by worsening. In the unidimensional IRT model, the combined information content of IPSS voiding items represented 72% of the total information content, indicating that the voiding subscore may be more sensitive to changes in BPH-LUTS compared with the storage subscore. The pharmacometric models showed considerably higher power to detect a drug effect compared with a cross-sectional and while-on-treatment analysis of covariance, respectively. Compared with the sample size required to detect a drug effect at 80% power with the total IPSS model, a reduction of 5.9% and 11.7% was obtained with the unidimensional and bidimensional IPSS IRT model, respectively. Pharmacometric IRT analysis of the IPSS within BPH-LUTS may increase the precision and efficiency of treatment effect assessment, albeit to a more limited extent compared with applications in other therapeutic areas.

In clinical trials within lower urinary tract symptoms due to benign prostatic hyperplasia (BPH-LUTS), the International Prostate Symptom Score (IPSS) is commonly the primary efficacy outcome while the Quality of Life (QoL) score and the BPH Impact Index (BII) are common secondary efficacy markers. The current study aimed to characterize BPH-LUTS progression using responses to the IPSS, the QoL, and the BII in an integrated item response theory (IRT) framework and assess the Fisher information of each scale. The power of this approach to detect a drug effect was compared with an IRT approach considering only IPSS responses. A unidimensional and a bidimensional pharmacometric IRT model, based on item-level IPSS responses in a clinical trial with 403 patients, were extended by incorporating patients' QoL and summary BII scores over the 6-month trial period. In the developed unidimensional integrated model, the QoL score was found to be the most informative, representing 17% of the total Fisher information, while the combined information content of the seven IPSS items represented 70.6%. In the bidimensional model, "storage" and both storage and "voiding" disability drove QoL and summary BII responses, respectively. Sample size reduction of 16% to detect a drug effect at 80% power was obtained with the unidimensional integrated IRT model compared with its counterpart IPSS IRT model. This study shows that utilizing the information content across the IPSS, QoL, and BII scales in an integrated IRT framework results in a modest but meaningful increase in power to detect a drug effect.

Parameter estimation of a nonlinear model based on maximizing the likelihood using gradient-based numerical optimization methods can often fail due to premature termination of the optimization algorithm. One reason for such failure is that these numerical optimization methods cannot distinguish between the minimum, maximum, and a saddle point; hence, the parameters found by these optimization algorithms can possibly be in any of these three stationary points on the likelihood surface. We have found that for maximization of the likelihood for nonlinear mixed effects models used in pharmaceutical development, the optimization algorithm Broyden-Fletcher-Goldfarb-Shanno (BFGS) often terminates in saddle points, and we propose an algorithm, saddle-reset, to avoid the termination at saddle points, based on the second partial derivative test. In this algorithm, we use the approximated Hessian matrix at the point where BFGS terminates, perturb the point in the direction of the eigenvector associated with the lowest eigenvalue, and restart the BFGS algorithm. We have implemented this algorithm in industry standard software for nonlinear mixed effects modeling (NONMEM, version 7.4 and up) and showed that it can be used to avoid termination of parameter estimation at saddle points, as well as unveil practical parameter non-identifiability. We demonstrate this using four published pharmacometric models and two models specifically designed to be practically non-identifiable.

Ethionamide has proven efficacy against both drug-susceptible and some drug-resistant strains of Mycobacterium tuberculosis Limited information on its pharmacokinetics in children is available, and current doses are extrapolated from weight-based adult doses. Pediatric doses based on more robust evidence are expected to improve antituberculosis treatment, especially in small children. In this analysis, ethionamide concentrations in children from 2 observational clinical studies conducted in Cape Town, South Africa, were pooled. All children received ethionamide once daily at a weight-based dose of approximately 20 mg/kg of body weight (range, 10.4 to 25.3 mg/kg) in combination with other first- or second-line antituberculosis medications and with antiretroviral therapy in cases of HIV coinfection. Pharmacokinetic parameters were estimated using nonlinear mixed-effects modeling. The MDR-PK1 study contributed data for 110 children on treatment for multidrug-resistant tuberculosis, while the DATiC study contributed data for 9 children treated for drug-susceptible tuberculosis. The median age of the children in the studies combined was 2.6 years (range, 0.23 to 15 years), and the median weight was 12.5 kg (range, 2.5 to 66 kg). A one-compartment, transit absorption model with first-order elimination best described ethionamide pharmacokinetics in children. Allometric scaling of clearance (typical value, 8.88 liters/h), the volume of distribution (typical value, 21.4 liters), and maturation of clearance and absorption improved the model fit. HIV coinfection decreased the ethionamide bioavailability by 22%, rifampin coadministration increased clearance by 16%, and ethionamide administration by use of a nasogastric tube increased the rate, but the not extent, of absorption. The developed model was used to predict pediatric doses achieving the same drug exposure achieved in 50- to 70-kg adults receiving 750-mg once-daily dosing. Based on model predictions, we recommend a weight-banded pediatric dosing scheme using scored 125-mg tablets., (Copyright © 2020 American Society for Microbiology.)

Combinations of pharmacological treatments are increasingly being investigated for potentially higher clinical benefit, especially when the combined drugs are expected to act via synergistic interactions. The clinical development of combination treatments is particularly challenging, particularly during the dose-selection phase, where a vast range of possible combination doses exists. The purpose of this work was to evaluate the added value of using optimal design for guiding the dose allocation in drug combination dose-finding studies as compared with a typical drug-combination trial. Optimizations were performed using local [D(s)-optimality] and global [ED(s)-optimality] optimal designs to maximize the precision of model parameters in a number of potential exposure-response (E-R) surfaces. A compound criterion [D(s)/V-optimality] was used to optimize the precision of model predictions in specific parts of the E-R surfaces. Optimal designs provided unbiased estimates and significantly improved the accuracy of results relative to the typical design. It was possible to improve the efficiency and overall parameter precision up to 7832% and 96.6% respectively. When the compound criterion was used, the probability to accurately identify the optimal dose-combination increased from 71% for the typical design up to 91%. These results indicate that optimal design methodology in tandem with E-R analyses is a beneficial tool that can be used for appropriate dose allocation in dose-finding studies for drug combinations.

Neutropenia and febrile neutropenia (FN) are serious side effects of cytotoxic chemotherapy which may be alleviated with the administration of recombinant granulocyte colony-stimulating factor (GCSF) derivatives, such as pegfilgrastim (PG) which increases absolute neutrophil count (ANC). In this work, a population pharmacokinetic-pharmacodynamic (PKPD) model was developed based on data obtained from healthy volunteers receiving multiple administrations of PG. The developed model was a bidirectional PKPD model, where PG stimulated the proliferation, maturation, and margination of neutrophils and where circulating neutrophils in turn increased the elimination of PG. Simulations from the developed model show disproportionate changes in response with changes in dose. A dose increase of 10% from the 6 mg therapeutic dose taken as a reference leads to area under the curve (AUC) increases of ~50 and ~5% for PK and PD, respectively. A full random effects covariate model showed that little of the parameter variability could be explained by sex, age, body size, and race. As a consequence, little of the secondary parameter variability (C max and AUC of PG and ANC) could be explained by these covariates.

Monoclonal antibodies against soluble targets are often rich and include the sampling of multiple analytes over a lengthy period of time. Predictive models built on data obtained in such studies can be useful in all drug development phases. If adequate model predictions can be maintained with a reduced design (e.g. fewer samples or shorter duration) the use of such designs may be advocated. The effect of reducing and optimizing a rich design based on a published study for Omalizumab (OMA) was evaluated as an example. OMA pharmacokinetics were characterized using a target-mediated drug disposition model considering the binding of OMA to free IgE and the subsequent formation of an OMA-IgE complex. The performance of the reduced and optimized designs was evaluated with respect to: efficiency, parameter uncertainty and predictions of free target. It was possible to reduce the number of samples in the study by 30% while still maintaining an efficiency of almost 90%. A reduction in sampling duration by two-thirds resulted in an efficiency of 75%. Omission of any analyte measurement or a reduction of the number of dose levels was detrimental to the efficiency of the designs (efficiency ≤ 51%). However, other metrics were, in some cases, relatively unaffected, showing that multiple metrics may be needed to obtain balanced assessments of design performance.

In dose-response studies with censored time-to-event outcomes, D-optimal designs depend on the true model and the amount of censored data. In practice, such designs can be implemented adaptively, by performing dose assignments according to updated knowledge of the dose-response curve at interim analysis. It is also essential that treatment allocation involves randomization-to mitigate various experimental biases and enable valid statistical inference at the end of the trial. In this work, we perform a comparison of several adaptive randomization procedures that can be used for implementing D-optimal designs for dose-response studies with time-to-event outcomes with small to moderate sample sizes. We consider single-stage, two-stage, and multi-stage adaptive designs. We also explore robustness of the designs to experimental (chronological and selection) biases. Simulation studies provide evidence that both the choice of an allocation design and a randomization procedure to implement the target allocation impact the quality of dose-response estimation, especially for small samples. For best performance, a multi-stage adaptive design with small cohort sizes should be implemented using a randomization procedure that closely attains the targeted D-optimal design at each stage. The results of the current work should help clinical investigators select an appropriate randomization procedure for their dose-response study.

The exposure-response relationship of combinatory drug effects can be quantitatively described using pharmacodynamic interaction models, which can be used for the selection of optimal dose combinations. The aim of this simulation study was to evaluate the reliability of parameter estimates and the probability for accurate dose identification for various underlying exposure-response profiles, under a number of different phase II designs. An efficacy variable driven by the combined exposure of two theoretical compounds was simulated and model parameters were estimated using two different models, one estimating all parameters and one assuming that adequate previous knowledge for one drug is readily available. Estimation of all pharmacodynamic parameters under a realistic, in terms of sample size and study design, phase II trial, proved to be challenging. Inaccurate estimates were found in all exposure-response scenarios, except for situations where no pharmacodynamic interaction was present, with the drug potency and interaction parameters being the hardest to estimate. When previous knowledge of the exposure-response relationship of one of the monocomponents is available, such information should be utilized, as it enabled relevant improvements in parameter estimation and in correct dose identification. No general trends for classification of the performance of the tested study designs across different scenarios could be identified. This study shows that pharmacodynamic interactions models can be used for the exposure-response analysis of clinical endpoints especially when accompanied by appropriate dose selection in regard to the expected drug potencies and appropriate trial size and if information regarding the exposure-response profile of one monocomponent is available.

The middle initial in the fifth author's name is incorrect in the original article. "Lena F. Friberg" should be "Lena E. Friberg". The original article was corrected.

Design of phase 1 combination therapy trials is complex compared to single therapy trials. In this work, model-based adaptive optimal design (MBAOD) was exemplified and evaluated for a combination of paclitaxel and a hypothetical new compound in a phase 1 study to determine the best dosing regimen for a phase 2 trial. Neutropenia was assumed as the main toxicity and the dose optimization process targeted a 33% probability of grade 4 neutropenia and maximal efficacy (based on preclinical studies) by changing the dose amount of both drugs and the dosing schedule for the new drug. Different starting conditions (e.g., initial dose), search paths (e.g., maximal change in dose intensity per step), and stopping criteria (e.g., "3 + 3 rule") were explored. The MBAOD approach was successfully implemented allowing the possibility of flexible designs with the modification of doses and dosing schedule throughout the trial. The 3 + 3 rule was shown to be highly conservative (selection of a dosing regimen with at least 90% of the possible maximal efficacy in less than 21% of the cases) but also safer (selection of a toxic design in less than 2% of the cases). Without the 3 + 3 rule, better performance was observed (>67% of selected designs were associated with at least 90% of possible maximal efficacy) while the proportion of DLTs per trial was similar. Overall, MBAOD is a promising tool in the context of dose finding studies of combination treatments and was showed to be flexible enough to be associated with requirements imposed by clinical protocols.

We consider optimal design problems for dose-finding studies with censored Weibull time-to-event outcomes. Locally D-optimal designs are investigated for a quadratic dose-response model for log-transformed data subject to right censoring. Two-stage adaptive D-optimal designs using maximum likelihood estimation (MLE) model updating are explored through simulation for a range of different dose-response scenarios and different amounts of censoring in the model. The adaptive optimal designs are found to be nearly as efficient as the locally D-optimal designs. A popular equal allocation design can be highly inefficient when the amount of censored data is high and when the Weibull model hazard is increasing. The issues of sample size planning/early stopping for an adaptive trial are investigated as well. The adaptive D-optimal design with early stopping can potentially reduce study size while achieving similar estimation precision as the fixed allocation design.

Population model-based (pharmacometric) approaches are widely used for the analyses of phase IIb clinical trial data to increase the accuracy of the dose selection for phase III clinical trials. On the other hand, if the analysis is based on one selected model, model selection bias can potentially spoil the accuracy of the dose selection process. In this paper, four methods that assume a number of pre-defined model structure candidates, for example a set of dose-response shape functions, and then combine or select those candidate models are introduced. The key hypothesis is that by combining both model structure uncertainty and model parameter uncertainty using these methodologies, we can make a more robust model based dose selection decision at the end of a phase IIb clinical trial. These methods are investigated using realistic simulation studies based on the study protocol of an actual phase IIb trial for an oral asthma drug candidate (AZD1981). Based on the simulation study, it is demonstrated that a bootstrap model selection method properly avoids model selection bias and in most cases increases the accuracy of the end of phase IIb decision. Thus, we recommend using this bootstrap model selection method when conducting population model-based decision-making at the end of phase IIb clinical trials.

Optimal designs for nonlinear models are dependent on the choice of parameter values. Various methods have been proposed to provide designs that are robust to uncertainty in the prior choice of parameter values. These methods are generally based on estimating the expectation of the determinant (or a transformation of the determinant) of the information matrix over the prior distribution of the parameter values. For high dimensional models this can be computationally challenging. For nonlinear mixed-effects models the question arises as to the importance of accounting for uncertainty in the prior value of the variances of the random effects parameters. In this work we explore the influence of the variance of the random effects parameters on the optimal design. We find that the method for approximating the expectation and variance of the likelihood is of potential importance for considering the influence of random effects. The most common approximation to the likelihood, based on a first-order Taylor series approximation, yields designs that are relatively insensitive to the prior value of the variance of the random effects parameters and under these conditions it appears to be sufficient to consider uncertainty on the fixed-effects parameters only.

Optimizing designs using robust (global) optimality criteria has been shown to be a more flexible approach compared to using local optimality criteria. Additionally, model based adaptive optimal design (MBAOD) may be less sensitive to misspecification in the prior information available at the design stage. In this work, we investigate the influence of using a local (lnD) or a robust (ELD) optimality criterion for a MBAOD of a simulated dose optimization study, for rich and sparse sampling schedules. A stopping criterion for accurate effect prediction is constructed to determine the endpoint of the MBAOD by minimizing the expected uncertainty in the effect response of the typical individual. 50 iterations of the MBAODs were run using the MBAOD R-package, with the concentration from a one-compartment first-order absorption pharmacokinetic model driving the population effect response in a sigmoidal EMAX pharmacodynamics model. The initial cohort consisted of eight individuals in two groups and each additional cohort added two individuals receiving a dose optimized as a discrete covariate. The MBAOD designs using lnD and ELD optimality with misspecified initial model parameters were compared by evaluating the efficiency relative to an lnD-optimal design based on the true parameter values. For the explored example model, the MBAOD using ELD-optimal designs converged quicker to the theoretically optimal lnD-optimal design based on the true parameters for both sampling schedules. Thus, using a robust optimality criterion in MBAODs could reduce the number of adaptations required and improve the practicality of adaptive trials using optimal design.

Purpose: The aim of the current population pharmacokinetic study was to quantify oxycodone pharmacokinetics in children ranging from preterm neonates to children up to 7 years of age., Methods: Data on intravenous or intramuscular oxycodone administration were obtained from three previously published studies (n = 119). The median [range] postmenstrual age of the subjects was 299 days [170 days-7.8 years]. A population pharmacokinetic model was built using 781 measurements of oxycodone plasma concentration. The model was used to simulate repeated intravenous oxycodone administration in four representative infants covering the age range from an extremely preterm neonate to 1-year old infant., Results: The rapid maturation of oxycodone clearance was best described with combined allometric scaling and maturation function. Central and peripheral volumes of distribution were nonlinearly related to bodyweight. The simulations on repeated intravenous administration in virtual patients indicated that oxycodone plasma concentration can be kept between 10 and 50 ng/ml with a high probability when the maintenance dose is calculated using the typical clearance and the dose interval is 4 h., Conclusions: Oxycodone clearance matures rapidly after birth, and between-subject variability is pronounced in neonates. The pharmacokinetic model developed may be used to evaluate different multiple dosing regimens, but the safety of repeated doses should be ensured.

With the increasing popularity of optimal design in drug development it is important to understand how the approximations and implementations of the Fisher information matrix (FIM) affect the resulting optimal designs. The aim of this work was to investigate the impact on design performance when using two common approximations to the population model and the full or block-diagonal FIM implementations for optimization of sampling points. Sampling schedules for two example experiments based on population models were optimized using the FO and FOCE approximations and the full and block-diagonal FIM implementations. The number of support points was compared between the designs for each example experiment. The performance of these designs based on simulation/estimations was investigated by computing bias of the parameters as well as through the use of an empirical D-criterion confidence interval. Simulations were performed when the design was computed with the true parameter values as well as with misspecified parameter values. The FOCE approximation and the Full FIM implementation yielded designs with more support points and less clustering of sample points than designs optimized with the FO approximation and the block-diagonal implementation. The D-criterion confidence intervals showed no performance differences between the full and block diagonal FIM optimal designs when assuming true parameter values. However, the FO approximated block-reduced FIM designs had higher bias than the other designs. When assuming parameter misspecification in the design evaluation, the FO Full FIM optimal design was superior to the FO block-diagonal FIM design in both of the examples., Competing Interests: The authors have declared no conflict of interest.