Search

This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing step for enhanced model robustness. The significance of our autoencoder-based approach is evident in its capacity to learn normal representation without prior anomaly knowledge. Through the KDE step on reconstruction errors, our method addresses the versatility of anomalies, departing from assumptions tied to larger reconstruction errors for anomalous events. Our proposed likelihood measure then distinguishes normal from anomalous events, providing a concise yet comprehensive anomaly detection solution. The extensive experimental results support the feasibility of our proposed method, yielding significantly improved classification performance by nearly 10% on the UCR benchmark data.

Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC.

Scientific computing heavily relies on data shared by the community, especially in distributed data-intensive applications. This research focuses on predicting slow connections that create bottlenecks in distributed workflows. In this study, we analyze network traffic logs collected between January 2021 and August 2022 at the National Energy Research Scientific Computing Center (NERSC). Based on the observed patterns, we define a set of features primarily based on history for identifying low-performing data transfers. Typically, there are far fewer slow connections on well-maintained networks, which creates difficulty in learning to identify these abnormally slow connections from the normal ones. We devise several stratified sampling techniques to address the class-imbalance challenge and study how they affect the machine learning approaches. Our tests show that a relatively simple technique that undersamples the normal cases to balance the number of samples in two classes (normal and slow) is very effective for model training. This model predicts slow connections with an F1 score of 0.926.

Entry into parenthood is a major disruptive event to travel behavior, and gender gaps in mobility choices are often widened during parenthood. The exact timing of gender gap formation and their long-term effects on different subpopulations are less studied in the literature. Leveraging a longitudinal dataset from the 2018 WholeTraveler Study, this paper examines the effects of parenthood on a diverse set of short- to long-term outcomes related to the three hierarchical domains of mobility biography: mode choice, vehicle ownership, spatial mobility, and career decisions. The progress of the effects is evaluated over a sequential set of parenting stages and differentiated across three subpopulations. We find that individuals classified as “Have-it-alls”, who start their careers, partner up, and have children concurrently and early, significantly increase their car uses two years prior to childbirth (“nesting period”), and they then relocate to less transit-accessible areas and consequently reduce their reliance on public transportation while they have children in the household. In contrast, individuals categorized as “Couples”, who start careers and partnerships early but delay parenthood, and “Singles”, who postpone partnership and parenthood, have less pronounced changes in travel behavior throughout the parenting stages. The cohort-level effects are found to be driven primarily by women, whose career development is on average more negatively impacted by parenting events than men, regardless of their life course trajectory. Early career decisions made by women upon entering parenthood contribute to gender gaps in mid- to longer-term mobility decisions, signifying the importance of early intervention.

What makes you hold on to that old car? While the vast majority of household vehicles are still powered by conventional internal combustion engines, the progress of adopting emerging vehicle technologies will critically depend on how soon the existing vehicles are transacted out of the household fleet. Leveraging a nationally representative longitudinal data set, the Panel Study of Income Dynamics, this study examines how household decisions to dispose of or replace a given vehicle are: 1) influenced by the vehicle’s attributes, 2) mediated by households’ concurrent socio-demographic and economic attributes, and 3) triggered by key life cycle events. Coupled with a newly developed machine learning interpretation tool, TreeExplainer, we demonstrate an innovative use of machine learning models to augment traditional logit modeling to both generate behavioral insights and improve model performance. We find the two gradient-boosting-based methods, CatBoost and LightGBM, are the best performing machine learning models for this problem. The multinomial logistic model can achieve similar performance levels after its model specification is informed by TreeExplainer. Both machine learning and multinomial logit models suggest that while older vehicles are more likely to be disposed of or replaced than newer ones, such probability decreases as the vehicles serve the family longer. Pickup trucks and sport utility vehicles are less likely to be disposed of or replaced than cars, and leased vehicles are more likely to be transacted than owned vehicles. We find that married families, families with higher education levels, homeowners, and older families tend to keep their vehicles longer. Life events such as childbirth, residential relocation, and change of household composition and income are found to increase vehicle disposal and/or replacement. We provide additional insights on the timing of vehicle replacement or disposal, in particular, the presence of children and childbirth events are more strongly associated with vehicle replacement among younger parents.

The most common source of transformer failure is in the insulation, and the most prevalent warning signal for insulation weakness is partial discharge (PD). Locating the positions of these partial discharges would help repair the transformer to prevent failures. This work investigates algorithms that could be deployed to locate the position of a PD event using data from ultra-high frequency (UHF) sensors inside the transformer. These algorithms typically proceed in two steps: first determining the signal arrival time, and then locating the position based on time differences. This paper reviews available methods for each task and then propose new algorithms: a convolutional iterative filter with thresholding (CIFT) to determine the signal arrival time and a reference table of travel times to resolve the source location. The effectiveness of these algorithms are tested with a set of laboratory-triggered PD events and two sets of simulated PD events inside transformers in production use. Tests show the new approach provides more accurate locations than the best-known data analysis algorithms, and the difference is particularly large, 3.7X, when the signal sources are far from sensors.

Daily transportation mode choice is largely habitual, but transitions between life events may disrupt travel habits and can shift choices between alternative transportation modes. Although much is known about general mode switches following life event transitions, less is understood about differences that may exist between subpopulations, especially from a long-term perspective. Understanding these differences will help planners and policymakers introduce more targeted policy interventions to promote sustainable transportation modes and inform longer-term predictions. Extending beyond existing literature, we use data collected from a retrospective survey to investigate the effects of life course events on mode use situated within different long-term life trajectory contexts. We apply a machine-learning method called joint social sequence clustering to define five distinct and interpretable cohorts based on trajectory patterns in family and career domains over their life courses. We use these patterns as an innovative contextual system to investigate (1) the heterogeneous effects of life events on travel mode use and (2) further differentiation between gender and generation groups in these life event effects. We find that events occurring relatively early in life are more strongly associated with changes in mode-use behavior, and that mode use can also be affected by the relative order of events. This timing and order effect can have lasting impacts on mode use aggregated over entire life cycles: members of our “Have-it-alls” cohort-who finish their education, start working, partner up, and have children early in life-ramp up car use at each event, resulting in the highest rate of car use occurring the earliest among all the cohorts. Women drive more when having children primarily when their family formation and career formation are intertwined early in life, and younger generations rely relatively more on car use during familial events when their careers have a later start.

Deoxynivalenol (DON) contamination in germs and germ oil is posing a serious threat to food and feed security. However, the transformation pathway, the distribution of DON, and its degradation products in edible oil refining have not yet been reported in detail. In this work, we systematically explored the variation of DON in maize germ oil during refining and demonstrated that the DON in germ oil can be effectively removed by refining, during which a part of DON was transferred to the wastes, and another section of DON was degraded during degumming and alkali refining. Moreover, the DON degradation product was identified to be norDON B by using the ultraviolet absorption spectrum, high-performance liquid chromatography (HPLC), ultra-high-performance liquid chromatography-quadrupole time-of-flight mass spectrometry (UPLC-Q-TOF MS), and nuclear magnetic resonance (NMR) methods, and the degradation product was found to be distributed in waste products during oil refining. This study provides a scientific basis and useful reference for the production of non-mycotoxins edible oil by traditional refining.

We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2 addresses scientific data management needs ranging from scalable I/O in supercomputers, to data analysis in personal computer and cloud systems. Version 2 introduces a unified application programming interface (API) that enables seamless data movement through files, wide-area-networks, and direct memory access, as well as high-level APIs for data analysis. The internal architecture provides a set of reusable and extendable components for managing data presentation and transport mechanisms for new applications. ADIOS 2 bindings are available in C++11, C, Fortran, Python, and Matlab and are currently used across different scientific communities. ADIOS 2 provides a communal framework to tackle data management challenges as we approach the exascale era of supercomputing.

In this paper, a highly sensitive plasmonic enzyme-linked immunosorbent assay (pELISA) was developed for the naked-eye detection of fumonisin B1 (FB1). Glucose oxidase (GOx) was used as an alternative to horseradish peroxidase as the carrier of the competing antigen. GOx catalyzed the oxidation of glucose to produce hydrogen peroxide, which acted as a reducing agent to reduce Au3+ to Au on the surface of gold seeds (5 nm), This reaction led to a color change in the solution from colorless to purple, which was observable to the naked eye. Various parameters that could influence the detection performance of pELISA were investigated. The developed method exhibited a considerably high sensitivity for FB1 qualitative naked-eye detection, with a visible cut-off limit of 1.25 ng/mL. Moreover, the proposed pELISA showed a good linear range of 0.31−10 ng/mL with a half maximal inhibitory concentration (IC50) of 1.86 ng/mL, which was approximately 13-fold lower than that of a horseradish peroxidase- (HRP)-based conventional ELISA. Meanwhile, the proposed method was highly specific and accurate. In summary, the new pELISA exhibited acceptable accuracy and precision for sensitive naked-eye detection of FB1 in maize samples and can be applied for the detection of other chemical contaminants.