Search

Modern web services adopt cloud-native principles to leverage the advantages of microservices. To consistently guarantee high Quality of Service (QoS) according to Service Level Agreements (SLAs), ensure satisfactory user experiences, and minimize operational costs, each microservice must be provisioned with the right amount of resources. However, accurately provisioning microservices with adequate resources is complex and depends on many factors, including workload intensity and the complex interconnections between microservices. To address this challenge, we develop a model that captures the relationship between an end-to-end latency, requests at the front-end level, and resource utilization. We then use the developed model to predict the end-to-end latency. Our solution leverages the Temporal Fusion Transformer (TFT), an attention-based architecture equipped with interpretability features. When the prediction results indicate SLA non-compliance, we use the feature importance provided by the TFT as covariates in Kernel Ridge Regression (KRR), with the response variable being the desired latency, to learn the parameters associated with the feature importance. These learned parameters reflect the adjustments required to the features to ensure SLA compliance. We demonstrate the merit of our approach with a microservice-based application and provide a roadmap to deployment., Comment: 14 pages, 5 figures

The ocean ecology is badly impacted by large-scale oil spills, plastic waste, and chemical pollution, which destroy ecosystems and endanger marine life. Acknowledging the detrimental effects of oil spills on ecosystems, our research aims to establish the foundation for creative methods to lessen their impact. With an emphasis on the containment and prediction of oil spills, this research investigates the potential of acoustic levitation as a cutting-edge technique for environmental cleanup. Effectively separating and eliminating pollutants without causing additional ecological harm is a major issue for traditional oil spill cleanup techniques. Acoustic levitation provides a non-invasive, accurate, and effective alternative by using sound waves to precisely and subtly separate oil droplets from water in controlled environments. This proposed approach can reduce the negative effects on the environment and increase the efficacy of cleanup efforts. The findings have been examined and assessed by proof of concept experiments with oil droplets, identifying the relationship between the intensity of ultrasonic pressure and the proportion of oil droplets collected.

Ethanethiol (C$_2$H$_5$SH), a molecule detected in the interstellar medium (ISM), indicates the rich chemistry involving sulfur atoms. However, its behavior at low temperatures remains elusive, particularly the reported transition from an amorphous phase to a crystal. This study employs classical molecular dynamics (MD) simulations to reproduce the liquid-state properties of ethanethiol and to simulate the initial amorphous state of ethanethiol films deposited on a KBr substrate. The amorphous ethanethiol did not show spontaneous crystallization upon increasing temperature. Also, ethanethiol ice crystals exhibit melting behavior on KBr substrate at elevated temperatures. Our MD simulations of thin ice samples do not show any signature reversible phase change. It will be interesting to continue this study with a thicker sample, which is beyond our current computational means. These findings underscore the complexity of icy mantle morphology on cold ISM dust grains., Comment: Manuscript accepted for publication in "Astrophysics and Space Science Proceedings", Springer nature (Symposium: ISRA 2023)

Recent advancements in deep learning for Medical Artificial Intelligence have demonstrated that models can match the diagnostic performance of clinical experts in adult chest X-ray (CXR) interpretation. However, their application in the pediatric context remains limited due to the scarcity of large annotated pediatric image datasets. Additionally, significant challenges arise from the substantial variability in pediatric CXR images across different hospitals and the diverse age range of patients from 0 to 18 years. To address these challenges, we propose SCC, a novel approach that combines transfer learning with self-supervised contrastive learning, augmented by an unsupervised contrast enhancement technique. Transfer learning from a well-trained adult CXR model mitigates issues related to the scarcity of pediatric training data. Contrastive learning with contrast enhancement focuses on the lungs, reducing the impact of image variations and producing high-quality embeddings across diverse pediatric CXR images. We train SCC on one pediatric CXR dataset and evaluate its performance on two other pediatric datasets from different sources. Our results show that SCC's out-of-distribution (zero-shot) performance exceeds regular transfer learning in terms of AUC by 13.6% and 34.6% on the two test datasets. Moreover, with few-shot learning using 10 times fewer labeled images, SCC matches the performance of regular transfer learning trained on the entire labeled dataset. To test the generality of the framework, we verify its performance on three benchmark breast cancer datasets. Starting from a model trained on natural images and fine-tuned on one breast dataset, SCC outperforms the fully supervised learning baseline on the other two datasets in terms of AUC by 3.6% and 5.5% in zero-shot learning., Comment: 15 pages, 6 figures, 4 tables

Robust model predictive control algorithms are essential for addressing unavoidable errors due to the uncertainty in predicting real-world systems. However, the formulation of such algorithms typically results in a trade-off between conservatism and computational complexity. Monotone systems facilitate the efficient computation of reachable sets and thus the straightforward formulation of a robust model predictive control approach optimizing over open-loop predictions. We present an approach based on the division of reachable sets to incorporate feedback in the predictions, resulting in less conservative strategies. The concept of mixed-monotonicity enables an extension of our methodology to non-monotone systems. The potential of the proposed approaches is demonstrated through a nonlinear high-dimensional chemical tank reactor cascade case study., Comment: Submitted to "IEEE Transactions on Automatic Control", Code: https://github.com/MoritzHein/RobMPCExploitMon

We study classes of constant-depth circuits with gates that compute restricted polynomial threshold functions, recently introduced by [Kum23] as a family that strictly generalizes $\mathsf{AC}^0$. Denoting these circuit families $\mathsf{bPTFC}^0[k]$ for $\textit{bounded polynomial threshold circuits}$ parameterized by an integer-valued degree-bound $k$, we prove three hardness results separating these classes from constant-depth quantum circuits ($\mathsf{QNC}^0$). $\hspace{2em}$ - We prove that the parity halving problem [WKS+19], which $\mathsf{QNC}^0$ over qubits can solve with certainty, remains average-case hard for polynomial size $\mathsf{bPTFC}^0[k]$ circuits for all $k=\mathcal{O}(n^{1/(5d)})$. $\hspace{2em}$ - We construct a new family of relation problems based on computing $\mathsf{mod}\ p$ for each prime $p>2$, and prove a separation of $\mathsf{QNC}^0$ circuits over higher dimensional quantum systems (`qupits') against $\mathsf{bPTFC}^0[k]$ circuits for the same degree-bound parameter as above. $\hspace{2em}$ - We prove that both foregoing results are noise-robust under the local stochastic noise model, by introducing fault-tolerant implementations of non-Clifford $\mathsf{QNC}^0/|\overline{T^{1/p}}>$ circuits, that use logical magic states as advice. $\mathsf{bPTFC}^0[k]$ circuits can compute certain classes of Polynomial Threshold Functions (PTFs), which in turn serve as a natural model for neural networks and exhibit enhanced expressivity and computational capabilities. Furthermore, for large enough values of $k$, $\mathsf{bPTFC}^0[k]$ contains $\mathsf{TC}^0$ as a subclass. The main challenges we overcome include establishing classical average-case lower bounds, designing non-local games with quantum-classical gaps in winning probabilities and developing noise-resilient non-Clifford quantum circuits necessary to extend beyond qubits to higher dimensions.

Forward Error Correction (FEC) provides reliable data flow in wireless networks despite the presence of noise and interference. However, its processing demands significant fraction of a wireless network's resources, due to its computationally-expensive decoding process. This forces network designers to compromise between performance and implementation complexity. In this paper, we investigate a novel processing architecture for FEC decoding, one based on the quantum approximate optimization algorithm (QAOA), to evaluate the potential of this emerging quantum compute approach in resolving the decoding performance-complexity tradeoff. We present FDeQ, a QAOA-based FEC Decoder design targeting the popular NextG wireless Low Density Parity Check (LDPC) and Polar codes. To accelerate QAOA-based decoding towards practical utility, FDeQ exploits temporal similarity among the FEC decoding tasks. This similarity is enabled by the fixed structure of a particular FEC code, which is independent of any time-varying wireless channel noise, ambient interference, and even the payload data. We evaluate FDeQ at a variety of system parameter settings in both ideal (noiseless) and noisy QAOA simulations, and show that FDeQ achieves successful decoding with error performance at par with state-of-the-art classical decoders at low FEC code block lengths. Furthermore, we present a holistic resource estimation analysis, projecting quantitative targets for future quantum devices in terms of the required qubit count and gate duration, for the application of FDeQ in practical wireless networks, highlighting scenarios where FDeQ may outperform state-of-the-art classical FEC decoders.

Vision-based motion estimation methods show promise in accurately and unobtrusively estimating human body motion for healthcare purposes. However, these methods are not specifically designed for healthcare purposes and face challenges in real-world applications. Human pose estimation methods often lack the accuracy needed for detecting fine-grained, subtle body movements, while optical flow-based methods struggle with poor lighting conditions and unseen real-world data. These issues result in human body motion estimation errors, particularly during critical medical situations where the body is motionless, such as during unconsciousness. To address these challenges and improve the accuracy of human body motion estimation for healthcare purposes, we propose the OPPH operator designed to enhance current vision-based motion estimation methods. This operator, which considers human body movement and noise properties, functions as a multi-stage filter. Results tested on two real-world and one synthetic human motion dataset demonstrate that the operator effectively removes real-world noise, significantly enhances the detection of motionless states, maintains the accuracy of estimating active body movements, and maintains long-term body movement trends. This method could be beneficial for analyzing both critical medical events and chronic medical conditions.

The high incidence of irreproducible research has led to urgent appeals for transparency and equitable practices in open science. For the scientific disciplines that rely on computationally intensive analyses of large data sets, a granular understanding of the analysis methodology is an essential component of reproducibility. This paper discusses the guiding principles of a computational reproducibility framework that enables a scientist to proactively generate a complete reproducible trace as analysis unfolds, and share data, methods and executable tools as part of a scientific publication, allowing other researchers to verify results and easily re-execute the steps of the scientific investigation.

At first light, the Thirty Meter Telescope (TMT) near-infrared (NIR) instruments will be fed by a multiconjugate adaptive optics instrument known as the Narrow Field Infrared Adaptive Optics System (NFIRAOS). NFIRAOS will use six laser guide stars to sense atmospheric turbulence in a volume corresponding to a field of view of 2', but natural guide stars (NGSs) will be required to sense tip/tilt and focus. To achieve high sky coverage (50% at the north Galactic pole), the NFIRAOS client instruments use NIR on-instrument wavefront sensors that take advantage of the sharpening of the stars by NFIRAOS. A catalog of guide stars with NIR magnitudes as faint as 22 mag in the J band (Vega system), covering the TMT-observable sky, will be a critical resource for the efficient operation of NFIRAOS, and no such catalog currently exists. Hence, it is essential to develop such a catalog by computing the expected NIR magnitudes of stellar sources identified in deep optical sky surveys using their optical magnitudes. This paper discusses the generation of a partial NIR Guide Star Catalog (IRGSC), similar to the final IRGSC for TMT operations. The partial catalog is generated by applying stellar atmospheric models to the optical data of stellar sources from the Panoramic Survey Telescope and Rapid Response System (Pan-STARRS) optical data and then computing their expected NIR magnitudes. We validated the computed NIR magnitudes of the sources in some fields by using the available NIR data for those fields. We identified the remaining challenges of this approach. We outlined the path for producing the final IRGSC using the Pan-STARRS data. We have named the Python code to generate the IRGSC as irgsctool, which generates a list of NGS for a field using optical data from the Pan-STARRS 3pi survey and also a list of NGSs having observed NIR data from the UKIRT Infrared Deep Sky Survey if they are available.

To enhance the variational quantum eigensolver (VQE), the CAFQA method can utilize classical computational capabilities to identify a better initial state than the Hartree-Fock method. Previous research has demonstrated that the initial state provided by CAFQA recovers more correlation energy than that of the Hartree-Fock method and results in faster convergence. In the present study, we advance the investigation of CAFQA by demonstrating its advantages on a high-fidelity trapped-ion quantum computer located at the Duke Quantum Center -- this is the first experimental demonstration of CAFQA-bootstrapped VQE on a TI device and on any academic quantum device. In our VQE experiment, we use LiH and BeH$_2$ as test cases to show that CAFQA achieves faster convergence and obtains lower energy values within the specified computational budget limits. To ensure the seamless execution of VQE on this academic device, we develop a novel hardware-software interface framework that supports independent software environments for both the circuit and hardware end. This mechanism facilitates the automation of VQE-type job executions as well as mitigates the impact of random hardware interruptions. This framework is versatile and can be applied to a variety of academic quantum devices beyond the trapped-ion quantum computer platform, with support for integration with customized packages.

This study examines the pressure exerted by a cavitation bubble collapsing near a rigid wall. A laser-generated bubble in a water basin undergoes growth, collapse, second growth, and final collapse. Shock waves and liquid jets from non-spherical collapses are influenced by the stand-off ratio ${\gamma}$, defined as the bubble centroid distance from the wall divided by the bubble radius. We detail shock mechanisms, such as tip or torus collapse, for various ${\gamma}$ values. High-speed and Schlieren imaging visualize the microjet and shock waves. The microjet's evolution is tracked for large ${\gamma}$, while shock waves are captured in composite images showing multiple shock positions. Quantitative analyses of the microjet interface, shock wave velocities, and impact times are reported. Wall-mounted sensors and a needle hydrophone measure pressure and compare with high-speed observations to assess the dominant contributions to pressure changes with ${\gamma}$, revealing implications for cavitation erosion mechanisms.

Studying low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1,000-10,000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part I, we construct an ensemble weather forecasting system based on Spherical Fourier Neural Operators (SFNO), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. Using large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states, and the ML ensemble thus passes a crucial spectral test in the literature. The IFS and ML ensembles have similar Extreme Forecast Indices, and we show that the ML extreme weather forecasts are reliable and discriminating.

In Part I, we created an ensemble based on Spherical Fourier Neural Operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires several orders of magnitude fewer computational resources. Here in Part II, we generate a huge ensemble (HENS), with 7,424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. For extreme climate statistics, HENS samples events 4$\sigma$ away from the ensemble mean. At each grid cell, HENS improves the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.

The linear stability of a shear-thinning, viscoelastic fluid undergoing any of the canonical rectilinear shear flows, viz., plane Couette flow and pressure-driven flow through a channel or a tube is analyzed in the creeping-flow limit using the White--Metzner model with a power-law variation of the viscosity with shear rate. While two-dimensional disturbances are considered for plane Couette and channel flows, axisymmetric disturbances are considered for pressure-driven flow in a tube. For all these flows, when the shear-thinning exponent is less than $0.3$, there exists an identical instability at wavelengths much smaller than the relevant geometric length scale (gap between the plates or tube radius). There is also a finite-wavelength instability in these configurations governed by the details of the geometry and boundary conditions at the centerline of the channel or tube. The most unstable mode could be either of the short-wave or finite-wavelength instabilities depending on model parameters. For pressure-driven channel flow, it is possible to have sinuous or varicose unstable modes depending on the symmetry of the normal velocity eigenfunction about the channel centerline. This difference in symmetry is relevant only for the finite wavelength instability, in which case sinuous modes turn out to be more unstable, in accordance with experimental observations. In all the three configurations, the short wavelength unstable modes are localized near the walls, and are insensitive to symmetry conditions at the centerline. It is argued that this instability should be a generic feature in any wall-bounded shear flow of strongly shear-thinning viscoelastic fluids. Our predictions for the finite-wavelength instability in pressure-driven channel and pipe flows are in good agreement with experimental observations for the flow of concentrated polymer solutions in these geometries.

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.

We study the flow field induced by a sphere translating in a viscous density-stratified ambient, specifically, in the limit of small Reynolds $(Re = \rho U a/\mu \ll 1)$, and viscous Richardson numbers $(Ri_v = \gamma a^3 g/\mu U\ll 1)$, and large Peclet number $(Pe = Ua/D\gg 1)$. Here, $a$ is the sphere radius, $U$ its translational velocity, $\rho$ an appropriate reference density within the Boussinesq framework, $\mu$ the ambient viscosity, $\gamma$ the absolute value of the background density gradient, and $D$ the diffusivity of the stratifying agent. For the scenario where buoyancy forces first become comparable to viscous forces at large distances, corresponding to the Stokes-stratification regime defined by $Re \ll Ri_v^{1/3} \ll 1$ for $Pe \gg 1$, important flow features such as a vertical reverse jet and a horizontal wake, on scales larger than the primary screening length of $\mathcal{O}(aRi_v^{-1/3})$, have been identified by Varanasi and Subramanian (2022). Here, we show that the reverse jet is only the central portion of a columnar structure with multiple annular cells. In the absence of diffusion this columnar structure extends to downstream infinity with the number of annular cells diverging in this limit. We provide expressions for the boundary of the structure, and the number of cells within, as a function of the downstream distance. For small but finite diffusion, two additional length scales emerge - a secondary screening length of $O(aRi_v^{-1/2}Pe^{1/2})$, where diffusion starts to smear out density variations across cells, leading to exponentially decaying flow field; and a tertiary screening length, of $O(aRi_v^{-1/2}Pe^{1/2}\ln(Ri_v^{-1}Pe^3))$, beyond which the columnar structure ceases to exist and the downstream disturbance field reverts from an exponential to eventual algebraic decay, analogous to that prevalent at large distances upstream.

Quantum computing is moving swiftly from theoretical to practical applications, making it crucial to establish a significant quantum advantage. Despite substantial investments, access to quantum devices is still limited, with users facing issues like long wait times and inefficient resource management. Unlike the mature cloud solutions for classical computing, quantum computing lacks effective infrastructure for resource optimization. We propose a Quantum Resource Infrastructure Orchestrator (QRIO), a state-of-the-art cloud resource manager built on Kubernetes that is tailored to quantum computing. QRIO seeks to democratize access to quantum devices by providing customizable, user-friendly, open-source resource management. QRIO's design aims to ensure equitable access, optimize resource utilization, and support diverse applications, thereby speeding up innovation and making quantum computing more accessible and efficient to a broader user base. In this paper, we discuss QRIO's various features and evaluate its capability in several representative usecases., Comment: To appear at the IEEE International Symposium on Workload Characterization, 2024

The Industrial Control System (ICS) environment encompasses a wide range of intricate communication protocols, posing substantial challenges for Security Operations Center (SOC) analysts tasked with monitoring, interpreting, and addressing network activities and security incidents. Conventional monitoring tools and techniques often struggle to provide a clear understanding of the nature and intent of ICS-specific communications. To enhance comprehension, we propose a software solution powered by a Large Language Model (LLM). This solution currently focused on BACnet protocol, processes a packet file data and extracts context by using a mapping database, and contemporary context retrieval methods for Retrieval Augmented Generation (RAG). The processed packet information, combined with the extracted context, serves as input to the LLM, which generates a concise packet file summary for the user. The software delivers a clear, coherent, and easily understandable summary of network activities, enabling SOC analysts to better assess the current state of the control system., Comment: 12 pages

The Indian Institute of Astrophysics (IIA) is developing a Multi-Conjugate Adaptive Optics (MCAO) system for the Kodaikanal Tower Telescope (KTT). In this context, we have measured the daytime turbulence strength profile at the Kodaikanal Observatory. The first method based on wavefront sensor (WFS) images, called S-DIMM+ (Solar-Differential Image Motion Monitor+), was used to estimate the higher altitude turbulence up to a height of 5 - 6 km. The second method used balloon-borne temperature sensors to measure the near-Earth turbulence up to 350 m. We also carried out simulations to validate the performance of our system. We report the first-ever daytime turbulence strength profile measurements at the observatory. We have identified the presence of a strong turbulence layer about 3 km above the observatory. The measured near-Earth turbulence matches the trend that is expected from the model for daytime component of turbulence and gives an integrated $r_0$ of about 4 cm at 500 nm. This is consistent with earlier seeing measurements. This shows that a low-cost setup with a small telescope and a simple array of temperature sensors can be used for estimating the turbulence strength profile at the site., Comment: Accepted for publication in JATIS

Locations of DNA replication initiation in prokaryotes, called "origins of replication", are well-characterized. However, a mechanistic understanding of the sequence-dependence of the local unzipping of double-stranded DNA, the first step towards replication initiation, is lacking. Here, utilizing a Markov chain model that was created to address the directional nature of DNA unzipping and replication, we model the sequence dependence of local melting of double-stranded linear DNA segments. We show that generalized palindromic sequences with high nucleotide skews have a low kinetic barrier for local melting near melting temperatures. This allows for such sequences to function as replication origins. We support our claim with evidence for high-skew palindromic sequences within the replication origins of mitochondrial DNA, bacteria, archaea and plasmids., Comment: 20 pages, 9 figures

One of the reasons why stochastic dynamic games with an underlying dynamic system are challenging is since strategic players have access to enormous amount of information which leads to the use of extremely complex strategies at equilibrium. One approach to resolve this challenge is to simplify players' strategies by identifying appropriate compression of information maps so that the players can make decisions solely based on the compressed version of information, called the information state. For finite dynamic games with asymmetric information, inspired by the notion of information state for single-agent control problems, we propose two notions of information states, namely mutually sufficient information (MSI) and unilaterally sufficient information (USI). Both these information states are obtained with information compression maps independent of the strategy profile. We show that Bayes-Nash Equilibria (BNE) and Sequential Equilibria (SE) exist when all players use MSI-based strategies. We prove that when all players employ USI-based strategies the resulting sets of BNE and SE payoff profiles are the same as the sets of BNE and SE payoff profiles resulting when all players use full information-based strategies. We prove that when all players use USI-based strategies the resulting set of weak Perfect Bayesian Equilibrium (wPBE) payoff profiles can be a proper subset of all wPBE payoff profiles. We identify MSI and USI in specific models of dynamic games in the literature. We end by presenting an open problem: Do there exist strategy-dependent information compression maps that guarantee the existence of at least one equilibrium or maintain all equilibria that exist under perfect recall? We show, by a counterexample, that a well-known strategy-dependent information compression map used in the literature does not possess any of the properties of MSI or USI., Comment: 54 pages, 3 figures

We present the analysis of optical photometric and spectroscopic observations of two non-magnetic cataclysmic variables, namely CRTS J080846.2+313106 and V416 Dra. CRTS J080846.2+313106 has been found to vary with a period of 4.9116$\pm$0.0003 h, which was not found in earlier studies and is provisionally suggested as the orbital period of the system. In both long-period systems, the observed dominant signal at second harmonic of the orbital frequency and the orbital modulation during quiescence are suggestive of ellipsoidal variation from changing aspects of the secondary, with an additional contribution from the accretion stream or hotspot. However, during the outburst, the hotspot itself is overwhelmed by the increased brightness, which is possibly associated with the accretion disc. The mid-eclipse phase for V416 Dra occurs earlier and the width of the eclipse is greater during outbursts compared to quiescence, suggesting an increased accretion disc radius during outbursts. Furthermore, the investigation of accretion disc eclipse in V416 Dra implies that a total disc eclipse is possible during quiescence, whereas the disc seems to be partially obscured during outbursts, which further signifies that the disc may grow in size as the outburst progresses. Optical spectra of CRTS J080846.2+313106 and V416 Dra are typical of dwarf novae during quiescence, and they both show a significant contribution from the M2-4V secondary. The light curve patterns, orbital periods, and spectra observed in both systems look remarkably similar, and seem to resemble the characteristics of U Gem-type dwarf novae., Comment: 14 pages, 11 Figures, and 3 Tables, Accepted for publication in A&A

Edge Artificial Intelligence (AI) incorporates a network of interconnected systems and devices that receive, cache, process, and analyse data in close communication with the location where the data is captured with AI technology. Recent advancements in AI efficiency, the widespread use of Internet of Things (IoT) devices, and the emergence of edge computing have unlocked the enormous scope of Edge AI. The goal of Edge AI is to optimize data processing efficiency and velocity while ensuring data confidentiality and integrity. Despite being a relatively new field of research, spanning from 2014 to the present, it has shown significant and rapid development over the last five years. In this article, we present a systematic literature review for Edge AI to discuss the existing research, recent advancements, and future research directions. We created a collaborative edge AI learning system for cloud and edge computing analysis, including an in-depth study of the architectures that facilitate this mechanism. The taxonomy for Edge AI facilitates the classification and configuration of Edge AI systems while also examining its potential influence across many fields through compassing infrastructure, cloud computing, fog computing, services, use cases, ML and deep learning, and resource management. This study highlights the significance of Edge AI in processing real-time data at the edge of the network. Additionally, it emphasizes the research challenges encountered by Edge AI systems, including constraints on resources, vulnerabilities to security threats, and problems with scalability. Finally, this study highlights the potential future research directions that aim to address the current limitations of Edge AI by providing innovative solutions., Comment: Preprint Version, 18 Figures

Protein sequence design, determined by amino acid sequences, are essential to protein engineering problems in drug discovery. Prior approaches have resorted to evolutionary strategies or Monte-Carlo methods for protein design, but often fail to exploit the structure of the combinatorial search space, to generalize to unseen sequences. In the context of discrete black box optimization over large search spaces, learning a mutation policy to generate novel sequences with reinforcement learning is appealing. Recent advances in protein language models (PLMs) trained on large corpora of protein sequences offer a potential solution to this problem by scoring proteins according to their biological plausibility (such as the TM-score). In this work, we propose to use PLMs as a reward function to generate new sequences. Yet the PLM can be computationally expensive to query due to its large size. To this end, we propose an alternative paradigm where optimization can be performed on scores from a smaller proxy model that is periodically finetuned, jointly while learning the mutation policy. We perform extensive experiments on various sequence lengths to benchmark RL-based approaches, and provide comprehensive evaluations along biological plausibility and diversity of the protein. Our experimental results include favorable evaluations of the proposed sequences, along with high diversity scores, demonstrating that RL is a strong candidate for biological sequence design. Finally, we provide a modular open source implementation can be easily integrated in most RL training loops, with support for replacing the reward model with other PLMs, to spur further research in this domain. The code for all experiments is provided in the supplementary material., Comment: 22 pages, 7 figures, 4 tables

In coming up with solutions to real-world problems, humans implicitly adhere to constraints that are too numerous and complex to be specified completely. However, reinforcement learning (RL) agents need these constraints to learn the correct optimal policy in these settings. The field of Inverse Constraint Reinforcement Learning (ICRL) deals with this problem and provides algorithms that aim to estimate the constraints from expert demonstrations collected offline. Practitioners prefer to know a measure of confidence in the estimated constraints, before deciding to use these constraints, which allows them to only use the constraints that satisfy a desired level of confidence. However, prior works do not allow users to provide the desired level of confidence for the inferred constraints. This work provides a principled ICRL method that can take a confidence level with a set of expert demonstrations and outputs a constraint that is at least as constraining as the true underlying constraint with the desired level of confidence. Further, unlike previous methods, this method allows a user to know if the number of expert trajectories is insufficient to learn a constraint with a desired level of confidence, and therefore collect more expert trajectories as required to simultaneously learn constraints with the desired level of confidence and a policy that achieves the desired level of performance., Comment: Paper to appear in ICML 2024

Health monitoring systems have revolutionized modern healthcare by enabling the continuous capture of physiological and behavioral data, essential for preventive measures and early health intervention. While integrating this data with Large Language Models (LLMs) has shown promise in delivering interactive health advice, traditional methods like Retrieval-Augmented Generation (RAG) and fine-tuning often fail to fully utilize the complex, multi-dimensional, and temporally relevant data from wearable devices. These conventional approaches typically provide limited actionable and personalized health insights due to their inadequate capacity to dynamically integrate and interpret diverse health data streams. In response, this paper introduces a graph-augmented LLM framework designed to significantly enhance the personalization and clarity of health insights. Utilizing a hierarchical graph structure, the framework captures inter and intra-patient relationships, enriching LLM prompts with dynamic feature importance scores derived from a Random Forest Model. The effectiveness of this approach is demonstrated through a sleep analysis case study involving 20 college students during the COVID-19 lockdown, highlighting the potential of our model to generate actionable and personalized health insights efficiently. We leverage another LLM to evaluate the insights for relevance, comprehensiveness, actionability, and personalization, addressing the critical need for models that process and interpret complex health data effectively. Our findings show that augmenting prompts with our framework yields significant improvements in all 4 criteria. Through our framework, we can elicit well-crafted, more thoughtful responses tailored to a specific patient.

Variational quantum algorithms (VQAs) show potential for quantum advantage in the near term of quantum computing, but demand a level of accuracy that surpasses the current capabilities of NISQ devices. To systematically mitigate the impact of quantum device error on VQAs, we propose Clapton: Clifford-Assisted Problem Transformation for Error Mitigation in Variational Quantum Algorithms. Clapton leverages classically estimated good quantum states for a given VQA problem, classical simulable models of device noise, and the variational principle for VQAs. It applies transformations on the VQA problem's Hamiltonian to lower the energy estimates of known good VQA states in the presence of the modeled device noise. The Clapton hypothesis is that as long as the known good states of the VQA problem are close to the problem's ideal ground state and the device noise modeling is reasonably accurate (both of which are generally true), then the Clapton transformation substantially decreases the impact of device noise on the ground state of the VQA problem, thereby increasing the accuracy of the VQA solution. Clapton is built as an end-to-end application-to-device framework and achieves mean VQA initialization improvements of 1.7x to 3.7x, and up to a maximum of 13.3x, over the state-of-the-art baseline when evaluated for a variety of scientific applications from physics and chemistry on noise models and real quantum devices.

Racing autonomous cars faster than the best human drivers has been a longstanding grand challenge for the fields of Artificial Intelligence and robotics. Recently, an end-to-end deep reinforcement learning agent met this challenge in a high-fidelity racing simulator, Gran Turismo. However, this agent relied on global features that require instrumentation external to the car. This paper introduces, to the best of our knowledge, the first super-human car racing agent whose sensor input is purely local to the car, namely pixels from an ego-centric camera view and quantities that can be sensed from on-board the car, such as the car's velocity. By leveraging global features only at training time, the learned agent is able to outperform the best human drivers in time trial (one car on the track at a time) races using only local input features. The resulting agent is evaluated in Gran Turismo 7 on multiple tracks and cars. Detailed ablation experiments demonstrate the agent's strong reliance on visual inputs, making it the first vision-based super-human car racing agent., Comment: Accepted at the Reinforcement Learning Conference (RLC) 2024

We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open Model License Agreement, a permissive model license that allows distribution, modification, and use of the models and its outputs. These models perform competitively to open access models on a wide range of evaluation benchmarks, and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision. We believe that the community can benefit from these models in various research studies and commercial applications, especially for generating synthetic data to train smaller language models. Notably, over 98% of data used in our model alignment process is synthetically generated, showcasing the effectiveness of these models in generating synthetic data. To further support open research and facilitate model development, we are also open-sourcing the synthetic data generation pipeline used in our model alignment process.

Aging and chronic conditions affect older adults' daily lives, making early detection of developing health issues crucial. Weakness, common in many conditions, alters physical movements and daily activities subtly. However, detecting such changes can be challenging due to their subtle and gradual nature. To address this, we employ a non-intrusive camera sensor to monitor individuals' daily sitting and relaxing activities for signs of weakness. We simulate weakness in healthy subjects by having them perform physical exercise and observing the behavioral changes in their daily activities before and after workouts. The proposed system captures fine-grained features related to body motion, inactivity, and environmental context in real-time while prioritizing privacy. A Bayesian Network is used to model the relationships between features, activities, and health conditions. We aim to identify specific features and activities that indicate such changes and determine the most suitable time scale for observing the change. Results show 0.97 accuracy in distinguishing simulated weakness at the daily level. Fine-grained behavioral features, including non-dominant upper body motion speed and scale, and inactivity distribution, along with a 300-second window, are found most effective. However, individual-specific models are recommended as no universal set of optimal features and activities was identified across all participants.

Language-agnostic many-to-one end-to-end speech translation models can convert audio signals from different source languages into text in a target language. These models do not need source language identification, which improves user experience. In some cases, the input language can be given or estimated. Our goal is to use this additional language information while preserving the quality of the other languages. We accomplish this by introducing a simple and effective linear input network. The linear input network is initialized as an identity matrix, which ensures that the model can perform as well as, or better than, the original model. Experimental results show that the proposed method can successfully enhance the specified language, while keeping the language-agnostic ability of the many-to-one ST models.

Bayesian optimization (BO) is an integral part of automated scientific discovery -- the so-called self-driving lab -- where human inputs are ideally minimal or at least non-blocking. However, scientists often have strong intuition, and thus human feedback is still useful. Nevertheless, prior works in enhancing BO with expert feedback, such as by incorporating it in an offline or online but blocking (arrives at each BO iteration) manner, are incompatible with the spirit of self-driving labs. In this work, we study whether a small amount of randomly arriving expert feedback that is being incorporated in a non-blocking manner can improve a BO campaign. To this end, we run an additional, independent computing thread on top of the BO loop to handle the feedback-gathering process. The gathered feedback is used to learn a Bayesian preference model that can readily be incorporated into the BO thread, to steer its exploration-exploitation process. Experiments on toy and chemistry datasets suggest that even just a few intermittent, asynchronous expert feedback can be useful for improving or constraining BO. This can especially be useful for its implication in improving self-driving labs, e.g. making them more data-efficient and less costly., Comment: AABI 2024. Code: https://github.com/wiseodd/bo-async-feedback

The interactions between the Magellanic Clouds significantly affect the shape and distribution of the young stellar population, particularly in the periphery of the Small Magellanic Cloud (SMC). We present the first far-UV (FUV) map of the north-east SMC-Shell region using the Ultra Violet Imaging Telescope (UVIT) onboard AstroSat. The detected FUV stars are combined with Gaia Early Data Release 3 data to create a FUV-optical catalog of ~ 14,400 stars. FUV-optical colour-magnitude diagrams are used along with isochrones to estimate the stellar ages. The detected stars are formed in multiple episodes. We identified two episodes of star formation (~ 60 and ~ 260 Myr ago) where the episode at ~ 260 Myr is linked to the recent interaction with the Large Magellanic Cloud (LMC) and the episode at ~ 60 Myr is linked to the pericentric passage of the SMC around our Galaxy. The median proper motion (PM) and velocity dispersion are found to be similar to the SMC main body, indicating that this region has not experienced significant tidal effects. The FUV stellar surface density and the dispersion in PM suggest an extent of the inner SMC in the north-east direction to be around 2.2 deg. We detect arm-like and arc-like structures in the FUV stellar density map, and their kinematics appear to be similar to the SMC main body. These extended outer features are the spatial stellar overdensities formed over multiple episodes of star formation, but without apparent kinematic distinction., Comment: 14 pages, 11 figures, 1 appendix figure, 3 tables, Accepted for publication in Monthly Notices of the Royal Astronomical Society (MNRAS)

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that allow LLMs to recall relevant knowledge and combine it with presented information in the clinical and biomedical domain: a fundamental pre-requisite for success on down-stream tasks. Addressing this gap, we use Multiple Choice and Abstractive Question Answering to conduct a large-scale empirical study on 22 datasets in three generalist and three specialist biomedical sub-domains. Our multifaceted analysis of the performance of 15 LLMs, further broken down by sub-domain, source of knowledge and model architecture, uncovers success factors such as instruction tuning that lead to improved recall and comprehension. We further show that while recently proposed domain-adapted models may lack adequate knowledge, directly fine-tuning on our collected medical knowledge datasets shows encouraging results, even generalising to unseen specialist sub-domains. We complement the quantitative results with a skill-oriented manual error analysis, which reveals a significant gap between the models' capabilities to simply recall necessary knowledge and to integrate it with the presented context. To foster research and collaboration in this field we share M-QALM, our resources, standardised methodology, and evaluation results, with the research community to facilitate further advancements in clinical knowledge representation learning within language models., Comment: Accepted at ACL 2024 (Findings)

We present a novel inductive generalization framework for RL from logical specifications. Many interesting tasks in RL environments have a natural inductive structure. These inductive tasks have similar overarching goals but they differ inductively in low-level predicates and distributions. We present a generalization procedure that leverages this inductive relationship to learn a higher-order function, a policy generator, that generates appropriately adapted policies for instances of an inductive task in a zero-shot manner. An evaluation of the proposed approach on a set of challenging control benchmarks demonstrates the promise of our framework in generalizing to unseen policies for long-horizon tasks.

Planar linear flows are a one-parameter family, with the parameter $\hat{\alpha}\in [-1,1]$ being a measure of the relative magnitudes of extension and vorticity; $\hat{\alpha} = -1$, $0$ and $1$ correspond to solid-body rotation, simple shear flow and planar extension, respectively. For a neutrally buoyant spherical drop in a hyperbolic planar linear flow with $\hat{\alpha}\in(0,1]$, the near-field streamlines are closed for $0 \leq \hat{\alpha} < 1$ and for $\lambda > \lambda_c = 2 \hat{\alpha} / (1 - \hat{\alpha})$, $\lambda$ being the drop-to-medium viscosity ratio; all streamlines are closed for an ambient elliptic linear flow with $\hat{\alpha}\in[-1,0)$. We use both analytical and numerical tools to show that drop deformation, as characterized by a non-zero capillary number ($Ca$), destroys the aforementioned closed-streamline topology. While inertia has previously been shown to transform closed Stokesian streamlines into open spiraling ones that run from upstream to downstream infinity, the streamline topology around a deformed drop, for small but finite $Ca$, is more complicated. Only a subset of the original closed streamlines transforms to open spiraling ones, while the remaining ones densely wind around a configuration of nested invariant tori. Our results contradict previous efforts pointing to the persistence of the closed streamline topology exterior to a deformed drop and have important implications for transport and mixing.

Despite the ubiquity of ice, a molecular-resolution image of ice crystallized from liquid water or the resulting defect structure has never been obtained. Here, we report the stabilization and angstrom-resolution electron imaging of ice Ih crystallized from liquid water. We combine lattice mapping with molecular dynamics simulations to reveal that ice formation is highly tolerant to nanoscale defects such as misoriented subdomains and trapped gas bubbles, which are stabilized by molecular-scale structural motifs. Importantly, bubble surfaces adopt low-energy nanofacets and create negligible strain fields in the surrounding crystal. These bubbles can dynamically nucleate, grow, migrate, dissolve, and coalesce under electron irradiation and be monitored in situ near a steady state. This work opens the door to understanding water crystallization behaviors at an unprecedented spatial resolution., Comment: 15 pages, 4 figures, and 1 table. Supplementary Materials: 35 pages, 25 figures, and 9 tables. Updated to resolve the equation typesetting issue and a panel ordering error in Fig. 1

This paper explores the use of 3D lidar in a physical Human-Robot Interaction (pHRI) scenario. To achieve the aforementioned, experiments were conducted to mimic a modern shop-floor environment. Data was collected from a pool of seventeen participants while performing pre-determined tasks in a shared workspace with the robot. To demonstrate an end-to-end case; a perception pipeline was developed that leverages reflectivity, signal, near-infrared, and point-cloud data from a 3-D lidar. This data is then used to perform safety based control whilst satisfying the speed and separation monitoring (SSM) criteria. In order to support the perception pipeline, a state-of-the-art object detection network was leveraged and fine-tuned by transfer learning. An analysis is provided along with results of the perception and the safety based controller. Additionally, this system is compared with the previous work., Comment: Submitted to IEEE-CASE 2024. Under Review

The development of a standard cell library involves characterization of a number of gate-level circuits at various cell-level abstractions. Verifying the behavior of these cells largely depends on the manual skills of the circuit designers. Especially challenging are the power management and data retention cells which must be checked thoroughly for voltage and power configurations in addition to their logic functionality. Also, when standard cells are extracted into various models, any inconsistencies in these models typically goes unchecked during library development. Thus, validating these cells exhaustively prior to customer delivery is highly advantageous to not only improve customer satisfaction but also to reduce design costs. We address this challenge by presenting a methodology to validate the power management and data retention cells that are used in the logical design flow of low-power chips. For a quick adoption by standard cell library design teams, the framework is fully automated and runs out-of-the-box. The proposed framework has been implemented and deployed within the Samsung Foundry ecosystem to enhance the overall quality of library design kit deliverables., Comment: 33rd Design and Verification Conference and Exhibition United States (DVCon U.S. 2021)

Data plane verification has grown into a powerful tool to ensure network correctness. However, existing monolithic data plane models have high memory requirements with large networks, and the existing method of scaling out is too limited in expressiveness to capture practical network features. In this paper, we describe Scylla, a general data plane verifier that provides fine-grained scale-out without the need for a monolithic network model. Scylla creates models for what we call intent-based slices, each of which is constructed at a fine (rule-level) granularity with just enough to verify a given set of intents. The sliced models are retained in memory across a cluster and are incrementally updated in a distributed compute cluster in response to network updates. Our experiments show that Scylla makes the scaling problem more granular -- tied to the size of the intent-based slices rather than that of the overall network. This enables Scylla to verify large, complex networks in minimum units of work that are significantly smaller (in both memory and time) than past techniques, enabling fast scale-out verification with minimal resource requirement.

The increasing size of deep neural networks necessitates effective model compression to improve computational efficiency and reduce their memory footprint. Sparsity and quantization are two prominent compression methods that have individually demonstrated significant reduction in computational and memory footprints while preserving model accuracy. While effective, the interplay between these two methods remains an open question. In this paper, we investigate the interaction between these two methods and assess whether their combination impacts final model accuracy. We mathematically prove that applying sparsity before quantization is the optimal sequence for these operations, minimizing error in computation. Our empirical studies across a wide range of models, including OPT and Llama model families (125M-8B) and ViT corroborate these theoretical findings. In addition, through rigorous analysis, we demonstrate that sparsity and quantization are not orthogonal; their interaction can significantly harm model accuracy, with quantization error playing a dominant role in this degradation. Our findings extend to the efficient deployment of large models in resource-limited compute platforms and reduce serving cost, offering insights into best practices for applying these compression methods to maximize efficacy without compromising accuracy.