Search

Optical memristors represent a monumental leap in the fusion of photonics and electronics, heralding a new era of applications from neuromorphic computing to artificial intelligence. However, current technologies are hindered by complex fabrication, limited endurance, high optical loss or low modulation depth. For the first time, we reveal optical non-volatility in thin-film Lead Zirconate Titanate (PZT) by electrically manipulating the ferroelectric domains to control the refractive index, providing a brand-new routine for optical memristors. The developed PZT optical memristors offer unprecedented advantages more than exceptional performance metrics like low loss of <2 dB/cm, high precision exceeding 6-bits, large modulation depth with an index change as large as 4.6x10-3. Additionally, these devices offer impressive stability, maintaining minimal wavelength variation for over three weeks and enduring more than 10,000 cycles, and require a mere 0.8 pJ of energy for non-volatile operation. The wafer-scale sol-gel fabrication process also ensures compatible with standardized mass fabrication processes and high scalability for photonic integration. Specially, these devices also demonstrate unique functional duality: setting above a threshold voltage enables non-volatile behaviors, below this threshold allows volatile high-speed optical modulation. This marks the first-ever optical memristor capable of performing high-speed (48 Gbps) and energy-efficient (450 fJ/bit) signal processing and non-volatile retention on a single platform, and is also the inaugural demonstration of scalable functional systems. The PZT optical memristors developed here facilitate the realization of novel paradigms for high-speed and energy-efficient optical interconnects, programmable PICs, quantum computing, neural networks, in-memory computing and brain-like architecture.

In this paper, we investigate a secure communication architecture based on unmanned aerial vehicle (UAV), which enhances the security performance of the communication system through UAV trajectory optimization. We formulate a control problem of minimizing the UAV flight path and power consumption while maximizing secure communication rate over infinite horizon by jointly optimizing UAV trajectory, transmit beamforming vector, and artificial noise (AN) vector. Given the non-uniqueness of optimization objective and significant coupling of the optimization variables, the problem is a non-convex optimization problem which is difficult to solve directly. To address this complex issue, an alternating-iteration technique is employed to decouple the optimization variables. Specifically, the problem is divided into three subproblems, i.e., UAV trajectory, transmit beamforming vector, and AN vector, which are solved alternately. Additionally, considering the susceptibility of UAV trajectory to disturbances, the model predictive control (MPC) approach is applied to obtain UAV trajectory and enhance the system robustness. Numerical results demonstrate the superiority of the proposed optimization algorithm in maintaining accurate UAV trajectory and high secure communication rate compared with other benchmark schemes.

In this paper, we propose a full-duplex integrated sensing and communication (ISAC) system enabled by a movable antenna (MA). By leveraging the characteristic of MA that can increase the spatial diversity gain, the performance of the system can be enhanced. We formulate a problem of minimizing the total transmit power consumption via jointly optimizing the discrete position of MA elements, beamforming vectors, sensing signal covariance matrix and user transmit power. Given the significant coupling of optimization variables, the formulated problem presents a non-convex optimization challenge that poses difficulties for direct resolution. To address this challenging issue, the discrete binary particle swarm optimization (BPSO) algorithm framework is employed to solve the formulated problem. Specifically, the discrete positions of MA elements are first obtained by iteratively solving the fitness function. The difference-of-convex (DC) programming and successive convex approximation (SCA) are used to handle non-convex and rank-1 terms in the fitness function. Once the BPSO iteration is complete, the discrete positions of MA elements can be determined, and we can obtain the solutions for beamforming vectors, sensing signal covariance matrix and user transmit power. Numerical results demonstrate the superiority of the proposed system in reducing the total transmit power consumption compared with fixed antenna arrays.

Attaining superconducting critical temperatures (Tc) beyond the limit around 14 K observed thus far in spinel compounds AB2X4 (A, B = transition metals, X = O/chalcogen) could elucidate interaction intricacies and inform materials design. This work spotlights CuIr2S4, which exhibits a distinct metal-insulator transition below 230 K, as an unconventional candidate for activation under high pressure. Through transport, diffraction, and spectroscopy experiments conducted at pressures up to 224 GPa, we unveil pressure-tuning that suppressed CuIr2S4's transition, yielding two superconducting phases with an un-precedented Tc for spinels. Initially, 3.8 K onset rose monotonically, reaching 18.2 K at 133 GPa. Unexpectedly, a distinct phase with Tc = 2.2 K distinctly emerged at higher pressures, intimating unconventional couplings. Our findings suggest that both geometric frustration and electron-electron interactions play crucial roles in the superconductivity observed in CuIr2S4. The findings stretch perceived temperature limits in spinels and provide structure-property insights to guide the optimiza-tion of quantum materials interactions for tailored targeted functionalities., Comment: 12 pages, 7 gifures

We report transport studies on the layered van der Waals topological crystalline insulator Ta$_2$Pd$_3$Te$_5$. The temperature-dependent resistance at high temperature is dominated by a bulk insulating gap and tend to saturate at low temperatures. Low temperature magnetotransport shows that Ta$_2$Pd$_3$Te$_5$ exhibits weak antilocatization (WAL) effect in both perpendicular orientation and parallel orientation, suggesting an contribution of the WAL effect from both topological edge states and bulk states. By measuring the anisotropic magnetoconductance and then subtracting the contribution of bulk states, the WAL effect associated with topological edge states can be revealed and analyzed quantitatively based on the two-dimensional Hikami-Larkin-Nagaoka model. Our results have important implications in understanding the WAL phenomena in Ta$_2$Pd$_3$Te$_5$., Comment: 8 pages, 5 figures

Many nations are promoting the green transition in the energy sector to attain neutral carbon emissions by 2050. Smart Grid 2.0 (SG2) is expected to explore data-driven analytics and enhance communication technologies to improve the efficiency and sustainability of distributed renewable energy systems. These features are beyond smart metering and electric surplus distribution in conventional smart grids. Given the high dependence on communication networks to connect distributed microgrids in SG2, potential cascading failures of connectivity can cause disruption to data synchronization to the remote control systems. This paper reviews security threats and defense tactics for three stakeholders: power grid operators, communication network providers, and consumers. Through the survey, we found that SG2's stakeholders are particularly vulnerable to substation attacks/vandalism, malware/ransomware threats, blockchain vulnerabilities and supply chain breakdowns. Furthermore, incorporating artificial intelligence (AI) into autonomous energy management in distributed energy resources of SG2 creates new challenges. Accordingly, adversarial samples and false data injection on electricity reading and measurement sensors at power plants can fool AI-powered control functions and cause messy error-checking operations in energy storage, wrong energy estimation in electric vehicle charging, and even fraudulent transactions in peer-to-peer energy trading models. Scalable blockchain-based models, physical unclonable function, interoperable security protocols, and trustworthy AI models designed for managing distributed microgrids in SG2 are typical promising protection models for future research., Comment: 30 pages, 21 figures, 5 tables, accepted to appear in IEEE COMST

High-quality training triplets (instruction, original image, edited image) are essential for instruction-based image editing. Predominant training datasets (e.g., InsPix2Pix) are created using text-to-image generative models (e.g., Stable Diffusion, DALL-E) which are not trained for image editing. Accordingly, these datasets suffer from inaccurate instruction following, poor detail preserving, and generation artifacts. In this paper, we propose to address the training data quality issue with multi-perspective reward data instead of refining the ground-truth image quality. 1) we first design a quantitative metric system based on best-in-class LVLM (Large Vision Language Model), i.e., GPT-4o in our case, to evaluate the generation quality from 3 perspectives, namely, instruction following, detail preserving, and generation quality. For each perspective, we collected quantitative score in $0\sim 5$ and text descriptive feedback on the specific failure points in ground-truth edited images, resulting in a high-quality editing reward dataset, i.e., RewardEdit20K. 2) We further proposed a novel training framework to seamlessly integrate the metric output, regarded as multi-reward, into editing models to learn from the imperfect training triplets. During training, the reward scores and text descriptions are encoded as embeddings and fed into both the latent space and the U-Net of the editing models as auxiliary conditions. During inference, we set these additional conditions to the highest score with no text description for failure points, to aim at the best generation outcome. Experiments indicate that our multi-reward conditioned model outperforms its no-reward counterpart on two popular editing pipelines, i.e., InsPix2Pix and SmartEdit. The code and dataset will be released.

Recent predictions of metastable high-temperature hydride superconductors give hope that superconductivity at ambient conditions is within reach. In this work, we predict RbPH$_3$ as a new compound with a superconducting critical temperature around 100 K at ambient pressure, dynamically stabilized thanks to ionic quantum anharmonic effects. RbPH$_3$ is thermodynamically stable at 30 GPa in a perovskite $Pm\bar{3}m$ phase, allowing its experimental synthesis at moderate pressures far from the megabar regime. With lowering pressure it is expected to transform to a $R3m$ phase that should stay dynamically stable thanks to quantum fluctuations down to ambient pressures. Both phases are metallic, with the $R3m$ phase having three distinct Fermi surfaces, composed mostly of states with phosphorus and hydrogen character. The structures are held together by strong P-H covalent bonds, resembling the pattern observed in the high-temperature superconducting H$_3$S, with extra electrons donated by rubidium. These results demonstrate that quantum ionic fluctuations, neglected thus far in high-throughput calculations, can stabilize at ambient pressure hydride superconductors with a high critical temperature.

The outstanding capabilities of large language models (LLMs) render them a crucial component in various autonomous agent systems. While traditional methods depend on the inherent knowledge of LLMs without fine-tuning, more recent approaches have shifted toward the reinforcement learning strategy to further enhance agents' ability to solve complex interactive tasks with environments and tools. However, previous approaches are constrained by the sparse reward issue, where existing datasets solely provide a final scalar reward for each multi-step reasoning chain, potentially leading to ineffectiveness and inefficiency in policy learning. In this paper, we introduce StepAgent, which utilizes step-wise reward to optimize the agent's reinforcement learning process. Inheriting the spirit of novice-to-expert theory, we first compare the actions of the expert and the agent to automatically generate intermediate rewards for fine-grained optimization. Additionally, we propose implicit-reward and inverse reinforcement learning techniques to facilitate agent reflection and policy adjustment. Further theoretical analysis demonstrates that the action distribution of the agent can converge toward the expert action distribution over multiple training cycles. Experimental results across various datasets indicate that StepAgent outperforms existing baseline methods.

Reconstructing the 3D anatomical structures of the oral cavity, which originally reside in the cone-beam CT (CBCT), from a single 2D Panoramic X-ray(PX) remains a critical yet challenging task, as it can effectively reduce radiation risks and treatment costs during the diagnostic in digital dentistry. However, current methods are either error-prone or only trained/evaluated on small-scale datasets (less than 50 cases), resulting in compromised trustworthiness. In this paper, we propose PX2Tooth, a novel approach to reconstruct 3D teeth using a single PX image with a two-stage framework. First, we design the PXSegNet to segment the permanent teeth from the PX images, providing clear positional, morphological, and categorical information for each tooth. Subsequently, we design a novel tooth generation network (TGNet) that learns to transform random point clouds into 3D teeth. TGNet integrates the segmented patch information and introduces a Prior Fusion Module (PFM) to enhance the generation quality, especially in the root apex region. Moreover, we construct a dataset comprising 499 pairs of CBCT and Panoramic X-rays. Extensive experiments demonstrate that PX2Tooth can achieve an Intersection over Union (IoU) of 0.793, significantly surpassing previous methods, underscoring the great potential of artificial intelligence in digital dentistry., Comment: Ma W, Wu H, Xiao Z, et al. PX2Tooth: Reconstructing the 3D Point Cloud Teeth from a Single Panoramic X-Ray[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer Nature Switzerland, 2024: 411-421

Subjective speech quality assessment (SSQA) is critical for evaluating speech samples as perceived by human listeners. While model-based SSQA has enjoyed great success thanks to the development of deep neural networks (DNNs), generalization remains a key challenge, especially for unseen, out-of-domain data. To benchmark the generalization abilities of SSQA models, we present MOS-Bench, a diverse collection of datasets. In addition, we also introduce SHEET, an open-source toolkit containing complete recipes to conduct SSQA experiments. We provided benchmark results for MOS-Bench, and we also explored multi-dataset training to enhance generalization. Additionally, we proposed a new performance metric, best score difference/ratio, and used latent space visualizations to explain model behavior, offering valuable insights for future research., Comment: Submitted to Transactions on Audio, Speech and Language Processing. This work has been submitted to the IEEE for possible publication

Numerical methods for contact mechanics are of great importance in engineering applications, enabling the prediction and analysis of complex surface interactions under various conditions. In this work, we propose an energy-based physics-informed neural network (PINNs) framework for solving frictionless contact problems under large deformation. Inspired by microscopic Lennard-Jones potential, a surface contact energy is used to describe the contact phenomena. To ensure the robustness of the proposed PINN framework, relaxation, gradual loading and output scaling techniques are introduced. In the numerical examples, the well-known Hertz contact benchmark problem is conducted, demonstrating the effectiveness and robustness of the proposed PINNs framework. Moreover, challenging contact problems with the consideration of geometrical and material nonlinearities are tested. It has been shown that the proposed PINNs framework provides a reliable and powerful tool for nonlinear contact mechanics. More importantly, the proposed PINNs framework exhibits competitive computational efficiency to the commercial FEM software when dealing with those complex contact problems. The codes used in this manuscript are available at https://github.com/JinshuaiBai/energy_PINN_Contact.(The code will be available after acceptance), Comment: 22 pages, 9 figures

We utilize an ergodic theory framework to explore sublinear expectation theory. Specifically, we investigate the pointwise Birkhoff's ergodic theorem for invariant sublinear expectation systems. By further assuming that these sublinear expectation systems are ergodic, we derive stronger results. Furthermore, we relax the conditions for the law of large numbers and the strong law of large numbers under sublinear expectations from independent and identical distribution to $\alpha$-mixing. These results can be applied to a class of stochastic differential equations driven by $G$-Brownian motion (i.e., $G$-SDEs), such as $G$-Ornstein-Uhlenbeck processes. As byproducts, we also obtain a series of applications for classical ergodic theory and capacity theory.

Recent advancements in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis. However, synthetic data generation via prompting LLMs remains challenging due to LLMs' limited understanding of target data distributions and the complexity of prompt engineering, especially for structured formatted data. To address these issues, we introduce DiffLM, a controllable data synthesis framework based on variational autoencoder (VAE), which further (1) leverages diffusion models to reserve more information of original distribution and format structure in the learned latent distribution and (2) decouples the learning of target distribution knowledge from the LLM's generative objectives via a plug-and-play latent feature injection module. As we observed significant discrepancies between the VAE's latent representations and the real data distribution, the latent diffusion module is introduced into our framework to learn a fully expressive latent distribution. Evaluations on seven real-world datasets with structured formatted data (i.e., Tabular, Code and Tool data) demonstrate that DiffLM generates high-quality data, with performance on downstream tasks surpassing that of real data by 2-7 percent in certain cases. The data and code will be publicly available upon completion of internal review., Comment: 17 pages, 8 figures

The subtraction function plays a pivotal role in calculations involving the forward Compton amplitude, which is crucial for predicting the Lamb shift in muonic atom, as well as the proton-neutron mass difference. In this work, we present a lattice QCD calculation of the subtraction function using two domain wall fermion gauge ensembles at the physical pion mass. We utilize a recently proposed subtraction point, demonstrating its advantage in mitigating statistical and systematic uncertainties by eliminating the need for ground-state subtraction. Our results reveal significant contributions from $N\pi$ intermediate states to the subtraction function. Incorporating these contributions, we compute the proton, neutron and nucleon isovector subtraction functions at photon momentum transfer $Q^2\in[0,2]$ GeV$^2$. For the proton subtraction function, we compare our lattice results with chiral perturbation theory prediction at low $Q^2$ and with the results from the perturbative operator-product expansion at high $Q^2$. Finally, using these subtraction functions as input, we determine their contribution to two-photon exchange effects in the Lamb shift and isovector nucleon electromagnetic self-energy., Comment: 10 pages, 10 figures

Let $\mathrm{Mp}(2n)$ be the metaplectic group of rank $n$ over a local field $F$ of characteristic zero. In this note, we determine the behavior of endoscopic transfer for $\mathrm{Mp}(2n)$ under variation of additive characters of $F$. The arguments are based on properties of transfer factor, requiring no deeper results from representation theory. Combined with the endoscopic character relations of Luo, this provides a simple and uniform proof of a theorem of Gan-Savin, which describes how the local Langlands correspondence for $\mathrm{Mp}(2n)$ depends on the additive characters., Comment: 20 pages

Feeding power amplifiers (PAs) with constant envelope (CE) signals is an effective way to reduce the power consumption in massive multiple-input-multiple-output (MIMO) systems. The nonlinear distortion caused by CE signaling must be mitigated by means of signal processing to improve the achievable sum rates. To this purpose, many linear and nonlinear precoding techniques have been developed for the CE MIMO downlink. The vast majority of these CE precoding techniques do not include a power allocation scheme, which is indispensable to achieve adequate performances in the downlink with channel gain imbalances between users. In this paper, we present two algorithms to produce a power allocation scheme for regularized zero-forcing (RZF) precoding in CE MIMO downlink. Both techniques are based on transforming the CE quantized MIMO downlink to an approximately equivalent system of parallel single-input-single-output (SISO) channels. The first technique is proven to solve the sum rate maximization problem in the approximate system optimally, whereas the second technique obtains the local maximum with lower complexity. We also extend another state-of-the-art quantization aware sum rate maximization algorithm with linear precoding to the CE downlink. Numerical results illustrate significant gains for the performance of the RZF precoder when the CE quantization is taken into account in a power allocation. Another key numerical result is that the proposed RZF techniques achieve almost the identical performance so that the one with lower computational complexity is chosen as the main method. Results also show that the proposed RZF precoding schemes perform at least as good as the state-of-the-art method with an advantage that the main RZF method has significantly lower computational complexity than the state-of-the-art., Comment: This paper has been submitted to IEEE Transactions on Vehicular Technology for review and was presented in part at 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall)

State-of-the-art methods for Transformer-based semantic segmentation typically adopt Transformer decoders that are used to extract additional embeddings from image embeddings via cross-attention, refine either or both types of embeddings via self-attention, and project image embeddings onto the additional embeddings via dot-product. Despite their remarkable success, these empirical designs still lack theoretical justifications or interpretations, thus hindering potentially principled improvements. In this paper, we argue that there are fundamental connections between semantic segmentation and compression, especially between the Transformer decoders and Principal Component Analysis (PCA). From such a perspective, we derive a white-box, fully attentional DEcoder for PrIncipled semantiC segemenTation (DEPICT), with the interpretations as follows: 1) the self-attention operator refines image embeddings to construct an ideal principal subspace that aligns with the supervision and retains most information; 2) the cross-attention operator seeks to find a low-rank approximation of the refined image embeddings, which is expected to be a set of orthonormal bases of the principal subspace and corresponds to the predefined classes; 3) the dot-product operation yields compact representation for image embeddings as segmentation masks. Experiments conducted on dataset ADE20K find that DEPICT consistently outperforms its black-box counterpart, Segmenter, and it is light weight and more robust., Comment: NeurIPS2024. Code:https://github.com/QishuaiWen/DEPICT/

Reconstructing from multi-view images is a longstanding problem in 3D vision, where neural radiance fields (NeRFs) have shown great potential and get realistic rendered images of novel views. Currently, most NeRF methods either require accurate camera poses or a large number of input images, or even both. Reconstructing NeRF from few-view images without poses is challenging and highly ill-posed. To address this problem, we propose CAD-NeRF, a method reconstructed from less than 10 images without any known poses. Specifically, we build a mini library of several CAD models from ShapeNet and render them from many random views. Given sparse-view input images, we run a model and pose retrieval from the library, to get a model with similar shapes, serving as the density supervision and pose initializations. Here we propose a multi-view pose retrieval method to avoid pose conflicts among views, which is a new and unseen problem in uncalibrated NeRF methods. Then, the geometry of the object is trained by the CAD guidance. The deformation of the density field and camera poses are optimized jointly. Then texture and density are trained and fine-tuned as well. All training phases are in self-supervised manners. Comprehensive evaluations of synthetic and real images show that CAD-NeRF successfully learns accurate densities with a large deformation from retrieved CAD models, showing the generalization abilities., Comment: The article has been accepted by Frontiers of Computer Science (FCS)

The goal of Multilingual Visual Answer Localization (MVAL) is to locate a video segment that answers a given multilingual question. Existing methods either focus solely on visual modality or integrate visual and subtitle modalities. However, these methods neglect the audio modality in videos, consequently leading to incomplete input information and poor performance in the MVAL task. In this paper, we propose a unified Audio-Visual-Textual Span Localization (AVTSL) method that incorporates audio modality to augment both visual and textual representations for the MVAL task. Specifically, we integrate features from three modalities and develop three predictors, each tailored to the unique contributions of the fused modalities: an audio-visual predictor, a visual predictor, and a textual predictor. Each predictor generates predictions based on its respective modality. To maintain consistency across the predicted results, we introduce an Audio-Visual-Textual Consistency module. This module utilizes a Dynamic Triangular Loss (DTL) function, allowing each modality's predictor to dynamically learn from the others. This collaborative learning ensures that the model generates consistent and comprehensive answers. Extensive experiments show that our proposed method outperforms several state-of-the-art (SOTA) methods, which demonstrates the effectiveness of the audio modality.

Precision therapy for liver cancer necessitates accurately delineating liver sub-regions to protect healthy tissue while targeting tumors, which is essential for reducing recurrence and improving survival rates. However, the segmentation of hepatic segments, known as Couinaud segmentation, is challenging due to indistinct sub-region boundaries and the need for extensive annotated datasets. This study introduces LiverFormer, a novel Couinaud segmentation model that effectively integrates global context with low-level local features based on a 3D hybrid CNN-Transformer architecture. Additionally, a registration-based data augmentation strategy is equipped to enhance the segmentation performance with limited labeled data. Evaluated on CT images from 123 patients, LiverFormer demonstrated high accuracy and strong concordance with expert annotations across various metrics, allowing for enhanced treatment planning for surgery and radiation therapy. It has great potential to reduces complications and minimizes potential damages to surrounding tissue, leading to improved outcomes for patients undergoing complex liver cancer treatments.

In Industry 4.0 systems, a considerable number of resource-constrained Industrial Internet of Things (IIoT) devices engage in frequent data interactions due to the necessity for model training, which gives rise to concerns pertaining to security and privacy. In order to address these challenges, this paper considers a digital twin (DT) and blockchain-assisted federated learning (FL) scheme. To facilitate the FL process, we initially employ fog devices with abundant computational capabilities to generate DT for resource-constrained edge devices, thereby aiding them in local training. Subsequently, we formulate an FL delay minimization problem for FL, which considers both of model transmission time and synchronization time, also incorporates cooperative jamming to ensure secure synchronization of DT. To address this non-convex optimization problem, we propose a decomposition algorithm. In particular, we introduce upper limits on the local device training delay and the effects of aggregation jamming as auxiliary variables, thereby transforming the problem into a convex optimization problem that can be decomposed for independent solution. Finally, a blockchain verification mechanism is employed to guarantee the integrity of the model uploading throughout the FL process and the identities of the participants. The final global model is obtained from the verified local and global models within the blockchain through the application of deep learning techniques. The efficacy of our proposed cooperative interference-based FL process has been verified through numerical analysis, which demonstrates that the integrated DT blockchain-assisted FL scheme significantly outperforms the benchmark schemes in terms of execution time, block optimization, and accuracy.

Static verification is a powerful method for enhancing software quality, but it demands significant human labor and resources. This is particularly true of static verifiers that reason about heap manipulating programs using an ownership logic. LLMs have shown promise in a number of software engineering activities, including code generation, test generation, proof generation for theorem provers, and specification generation for static verifiers. However, prior work has not explored how well LLMs can perform specification generation for specifications based in an ownership logic, such as separation logic. To address this gap, this paper explores the effectiveness of large language models (LLMs), specifically OpenAI's GPT models, in generating fully correct specifications based on separation logic for static verification of human-written programs in VeriFast. Our first experiment employed traditional prompt engineering and the second used Chain-of-Thought (CoT) Prompting to identify and address common errors generated across the GPT models. The results indicate that GPT models can successfully generate specifications for verifying heap manipulating code with VeriFast. Furthermore, while CoT prompting significantly reduces syntax errors generated by the GPT models, it does not greatly improve verification error rates compared to prompt engineering.

When learning an input-output mapping from very few examples, is it better to first infer a latent function that explains the examples, or is it better to directly predict new test outputs, e.g. using a neural network? We study this question on ARC, a highly diverse dataset of abstract reasoning tasks. We train neural models for induction (inferring latent functions) and transduction (directly predicting the test output for a given test input). Our models are trained on synthetic data generated by prompting LLMs to produce Python code specifying a function to be inferred, plus a stochastic subroutine for generating inputs to that function. We find inductive and transductive models solve very different problems, despite training on the same problems, and despite sharing the same neural architecture.

In this paper, we introduce Hunyuan-Large, which is currently the largest open-source Transformer-based mixture of experts model, with a total of 389 billion parameters and 52 billion activation parameters, capable of handling up to 256K tokens. We conduct a thorough evaluation of Hunyuan-Large's superior performance across various benchmarks including language understanding and generation, logical reasoning, mathematical problem-solving, coding, long-context, and aggregated tasks, where it outperforms LLama3.1-70B and exhibits comparable performance when compared to the significantly larger LLama3.1-405B model. Key practice of Hunyuan-Large include large-scale synthetic data that is orders larger than in previous literature, a mixed expert routing strategy, a key-value cache compression technique, and an expert-specific learning rate strategy. Additionally, we also investigate the scaling laws and learning rate schedule of mixture of experts models, providing valuable insights and guidances for future model development and optimization. The code and checkpoints of Hunyuan-Large are released to facilitate future innovations and applications. Codes: https://github.com/Tencent/Hunyuan-Large Models: https://huggingface.co/tencent/Tencent-Hunyuan-Large, Comment: 17 pages, 4 Figures

Under the notion of ergodicity of upper probability in the sense of Feng and Zhao (2021) that any invariant set either has capacity $0$ or its complement has capacity 0, we introduce the definition of finite ergodic components (FEC). We prove an invariant upper probability has FEC if and only if it is in the regime that any invariant set has either capacity $0$ or capacity $1$, proposed by Cerreia-Vioglio, Maccheroni, and Marinacci (2016). Furthermore, this is also equivalent to that the eigenvalue $1$ of the Koopman operator is of finite multiplicity, while in the ergodic upper probability regime, as in the classical ergodic probability case, the eigenvalue $1$ of the Koopman operator is simple. Additionally, we obtain the equivalence of the law of large numbers with multiple values, the asymptotic independence and the FEC. Furthermore, we apply these to obtain the corresponding results for non-invariant probabilities.

Point cloud registration, a fundamental task in 3D vision, has achieved remarkable success with learning-based methods in outdoor environments. Unsupervised outdoor point cloud registration methods have recently emerged to circumvent the need for costly pose annotations. However, they fail to establish reliable optimization objectives for unsupervised training, either relying on overly strong geometric assumptions, or suffering from poor-quality pseudo-labels due to inadequate integration of low-level geometric and high-level contextual information. We have observed that in the feature space, latent new inlier correspondences tend to cluster around respective positive anchors that summarize features of existing inliers. Motivated by this observation, we propose a novel unsupervised registration method termed INTEGER to incorporate high-level contextual information for reliable pseudo-label mining. Specifically, we propose the Feature-Geometry Coherence Mining module to dynamically adapt the teacher for each mini-batch of data during training and discover reliable pseudo-labels by considering both high-level feature representations and low-level geometric cues. Furthermore, we propose Anchor-Based Contrastive Learning to facilitate contrastive learning with anchors for a robust feature space. Lastly, we introduce a Mixed-Density Student to learn density-invariant features, addressing challenges related to density variation and low overlap in the outdoor scenario. Extensive experiments on KITTI and nuScenes datasets demonstrate that our INTEGER achieves competitive performance in terms of accuracy and generalizability., Comment: Accepted by NeurIPS2024

Numerous industrial sectors necessitate models capable of providing robust forecasts across various horizons. Despite the recent strides in crafting specific architectures for time-series forecasting and developing pre-trained universal models, a comprehensive examination of their capability in accommodating varied-horizon forecasting during inference is still lacking. This paper bridges this gap through the design and evaluation of the Elastic Time-Series Transformer (ElasTST). The ElasTST model incorporates a non-autoregressive design with placeholders and structured self-attention masks, warranting future outputs that are invariant to adjustments in inference horizons. A tunable version of rotary position embedding is also integrated into ElasTST to capture time-series-specific periods and enhance adaptability to different horizons. Additionally, ElasTST employs a multi-scale patch design, effectively integrating both fine-grained and coarse-grained information. During the training phase, ElasTST uses a horizon reweighting strategy that approximates the effect of random sampling across multiple horizons with a single fixed horizon setting. Through comprehensive experiments and comparisons with state-of-the-art time-series architectures and contemporary foundation models, we demonstrate the efficacy of ElasTST's unique design elements. Our findings position ElasTST as a robust solution for the practical necessity of varied-horizon forecasting., Comment: NeurIPS 2024

With the advent of next-generation surveys, constraints on cosmological parameters are anticipated to become more stringent, particularly for the total neutrino mass. This study forecasts these constraints utilizing galaxy clusters from the Chinese Space Station Telescope (CSST). Employing Fisher matrix analysis, we derive the constraint $\sigma(M_\nu)$ from cluster number counts, cluster power spectrum, and their combination. The investigation ranges from the standard cosmological model with neutrinos $\nu\Lambda$CDM to the inclusion of dynamic dark energy in the $\nu w_0 w_a$CDM model, revealing a minor impact of dark energy on neutrino constraints. We examine the largest source of systematic uncertainty arising from the mass-observable relation and find that, with perfect knowledge of the scaling relation parameters, CSST clusters have the potential to enhance precision, tightening constraints to $0.034$ eV. We also study the effects of the maximum redshift $z_{max}$ and other uncertainties, including redshift, halo mass function, and bias. Furthermore, we emphasize the significance of accounting for the growth-induced scale-dependent bias (GISDB) effect, which is expected to have an impact of 1.5 to 2.2 times on the final constraint., Comment: prepare to submit to PhRvD

The efficacy of mathematical models heavily depends on the quality of the training data, yet collecting sufficient data is often expensive and challenging. Many modeling applications require inferring parameters only as a means to predict other quantities of interest (QoI). Because models often contain many unidentifiable (sloppy) parameters, QoIs often depend on a relatively small number of parameter combinations. Therefore, we introduce an information-matching criterion based on the Fisher Information Matrix to select the most informative training data from a candidate pool. This method ensures that the selected data contain sufficient information to learn only those parameters that are needed to constrain downstream QoIs. It is formulated as a convex optimization problem, making it scalable to large models and datasets. We demonstrate the effectiveness of this approach across various modeling problems in diverse scientific fields, including power systems and underwater acoustics. Finally, we use information-matching as a query function within an Active Learning loop for material science applications. In all these applications, we find that a relatively small set of optimal training data can provide the necessary information for achieving precise predictions. These results are encouraging for diverse future applications, particularly active learning in large machine learning models.

Remote Sensing Image Captioning (RSIC) presents unique challenges and plays a critical role in applications. Traditional RSIC methods often struggle to produce rich and diverse descriptions. Recently, with advancements in VLMs, efforts have emerged to integrate these models into the remote sensing domain and to introduce descriptive datasets specifically designed to enhance VLM training. This paper proposes RS-MoE, a first Mixture of Expert based VLM specifically customized for remote sensing domain. Unlike traditional MoE models, the core of RS-MoE is the MoE Block, which incorporates a novel Instruction Router and multiple lightweight Large Language Models (LLMs) as expert models. The Instruction Router is designed to generate specific prompts tailored for each corresponding LLM, guiding them to focus on distinct aspects of the RSIC task. This design not only allows each expert LLM to concentrate on a specific subset of the task, thereby enhancing the specificity and accuracy of the generated captions, but also improves the scalability of the model by facilitating parallel processing of sub-tasks. Additionally, we present a two-stage training strategy for tuning our RS-MoE model to prevent performance degradation due to sparsity. We fine-tuned our model on the RSICap dataset using our proposed training strategy. Experimental results on the RSICap dataset, along with evaluations on other traditional datasets where no additional fine-tuning was applied, demonstrate that our model achieves state-of-the-art performance in generating precise and contextually relevant captions. Notably, our RS-MoE-1B variant achieves performance comparable to 13B VLMs, demonstrating the efficiency of our model design. Moreover, our model demonstrates promising generalization capabilities by consistently achieving state-of-the-art performance on the Remote Sensing Visual Question Answering (RSVQA) task.

In computer graphics, simplifying a polygonal mesh surface~$\mathcal{M}$ into a geometric proxy that maintains close conformity to~$\mathcal{M}$ is crucial, as it can significantly reduce computational demands in various applications. In this paper, we introduce the Implicit Thin Shell~(ITS), a concept designed to implicitly represent the sandwich-walled space surrounding~$\mathcal{M}$, defined as~$\{\textbf{x}\in\mathbb{R}^3|\epsilon_1\leq f(\textbf{x}) \leq \epsilon_2, \epsilon_1< 0, \epsilon_2>0\}$. Here, $f$ is an approximation of the signed distance function~(SDF) of~$\mathcal{M}$, and we aim to minimize the thickness~$\epsilon_2-\epsilon_1$. To achieve a balance between mathematical simplicity and expressive capability in~$f$, we employ a tri-variate tensor-product B-spline to represent~$f$. This representation is coupled with adaptive knot grids that adapt to the inherent shape variations of~$\mathcal{M}$, while restricting~$f$'s basis functions to the first degree. In this manner, the analytical form of~$f$ can be rapidly determined by solving a sparse linear system. Moreover, the process of identifying the extreme values of~$f$ among the infinitely many points on~$\mathcal{M}$ can be simplified to seeking extremes among a finite set of candidate points. By exhausting the candidate points, we find the extreme values~$\epsilon_1<0$ and $\epsilon_2>0$ that minimize the thickness. The constructed ITS is guaranteed to wrap~$\mathcal{M}$ rigorously, without any intersections between the bounding surfaces and~$\mathcal{M}$. ITS offers numerous potential applications thanks to its rigorousness, tightness, expressiveness, and computational efficiency. We demonstrate the efficacy of ITS in rapid inside-outside tests and in mesh simplification through the control of global error.

We extend the concept of the m-weak group MP inverse of a square matrix to a rectangular matrix, called the W-weighted m-weak group MP inverse, which also unifies the W-weighted weak core inverse and W-weighted DMP inverse. Some properties, characterizations and representations of this new generalized inverse are shown. Additionally, applications of the W-weighted weak group MP inverse are given in solving a constrained optimization problem and a class of consistent matrix equations.

To meet the growing demand for accurate, rapid, and cost-effective at-home clinical testing, we developed a radical-mediated enzyme assay (REEA) integrated with a paper fluidic system and electrically read by a handheld field-effect transistor (FET) device. The REEA utilizes horseradish peroxidase (HRP) to catalyze the conversion of aromatic substrates into radical forms, producing protons detected by an ion-sensitive FET for biomarker quantification. Through screening 14 phenolic compounds, halogenated phenols emerged as optimal substrates for the REEA. Encased in an affordable cartridge ($0.55 per test), the system achieved a detection limit of 146 fg/mL for estradiol (E2), with a coefficient of variation (CV) below 9.2% in E2-spiked samples and an r2 of 0.963 across a measuring range of 19 to 4,551 pg/mL in clinical plasma samples, providing results in under 10 minutes. This adaptable system not only promises to offer a fast and reliable platform, but also holds significant potential for expansion to a wide array of biomarkers, paving the way for broader clinical and home-based applications.

Precise alignment of multi-modal images with inherent feature discrepancies poses a pivotal challenge in deformable image registration. Traditional learning-based approaches often consider registration networks as black boxes without interpretability. One core insight is that disentangling alignment features and non-alignment features across modalities bring benefits. Meanwhile, it is challenging for the prominent methods for image registration tasks, such as convolutional neural networks, to capture long-range dependencies by their local receptive fields. The methods often fail when the given image pair has a large misalignment due to the lack of effectively learning long-range dependencies and correspondence. In this paper, we propose MambaReg, a novel Mamba-based architecture that integrates Mamba's strong capability in capturing long sequences to address these challenges. With our proposed several sub-modules, MambaReg can effectively disentangle modality-independent features responsible for registration from modality-dependent, non-aligning features. By selectively attending to the relevant features, our network adeptly captures the correlation between multi-modal images, enabling focused deformation field prediction and precise image alignment. The Mamba-based architecture seamlessly integrates the local feature extraction power of convolutional layers with the long-range dependency modeling capabilities of Mamba. Experiments on public non-rigid RGB-IR image datasets demonstrate the superiority of our method, outperforming existing approaches in terms of registration accuracy and deformation field smoothness.

Carbon dots (CDs) shows great application potential with their unique and excellent performances. Coal and its derivatives are rich in aromatic ring structure, which is suitable for preparing CDs in microstructure. Coal burning dust from coal-fired power plants can be utilized as a rich resource to separate and extract CDs. It has been shown in our results that there have two main possible mechanisms for the formation of CDs in coal burning dust. One is the self-assembly of polycyclic aromatic hydrocarbons contained in coal or produced by incomplete combustion of coal. The other mechanism is that the bridge bonds linking different aromatic structures in coal are breaking which would form CDs with different functional groups when the coals are burning at high temperature. Under violet light excitation at 310-340 nm or red light at 610-640 nm, CDs extracted from coal burning dust can emit purple fluorescence around 410 nm. The mechanism of up-conversion fluorescence emission of CDs is due to a two-photon absorption process. The recycling of CDs from coal burning dust from coal-fired power plants are not only good to protect environment but also would be helpful for mass production of CDs.

Generalized eigenvalue problems (GEPs) find applications in various fields of science and engineering. For example, principal component analysis, Fisher's discriminant analysis, and canonical correlation analysis are specific instances of GEPs and are widely used in statistical data processing. In this work, we study GEPs under generative priors, assuming that the underlying leading generalized eigenvector lies within the range of a Lipschitz continuous generative model. Under appropriate conditions, we show that any optimal solution to the corresponding optimization problems attains the optimal statistical rate. Moreover, from a computational perspective, we propose an iterative algorithm called the Projected Rayleigh Flow Method (PRFM) to approximate the optimal solution. We theoretically demonstrate that under suitable assumptions, PRFM converges linearly to an estimated vector that achieves the optimal statistical rate. Numerical results are provided to demonstrate the effectiveness of the proposed method.

Aside from regular beamline experiments at light sources, the preparation steps before these experiments are also worth systematic consideration in terms of automation; a representative category in these steps is attitude tuning, which typically appears in names like beam focusing, sample alignment etc. With the goal of saving time and manpower in both writing and using in mind, a Mamba-based attitude-tuning framework is created. It supports flexible input/output ports, easy integration of diverse evaluation functions, and free selection of optimisation algorithms; with the help from Mamba's infrastructure, machine learning (ML) and artificial intelligence (AI) technologies can also be readily integrated. The tuning of a polycapillary lens and of an X-ray emission spectrometer are given as examples for the general use of this framework, featuring powerful command-line interfaces (CLIs) and friendly graphical user interfaces (GUIs) that allow comfortable human-in-the-loop control. The tuning of a Raman spectrometer demonstrates more specialised use of the framework with customised optimisation algorithms. With similar applications in mind, our framework is estimated to be capable of fulfilling a majority of attitude-tuning needs. Also reported is a virtual-beamline mechanism based on easily customisable simulated detectors and motors, which facilitates both testing for developers and training for users., Comment: 12 pages, 8 figures

The Water Cherenkov Detector Array (WCDA) is one of the components of Large High Altitude Air Shower Observatory (LHAASO) and can monitor any sources over two-thirds of the sky for up to 7 hours per day with >98\% duty cycle. In this work, we report the detection of two outbursts of the Fanaroff-Riley I radio galaxy NGC 1275 that were detected by LHAASO-WCDA between November 2022 and January 2023 with statistical significance of 5.2~$\sigma$ and 8.3~$\sigma$. The observed spectral energy distribution in the range from 500 GeV to 3 TeV is fitted by a power-law with a best-fit spectral index of $\alpha=-3.37\pm0.52$ and $-3.35\pm0.29$, respectively. The outburst flux above 0.5~TeV was ($4.55\pm 4.21)\times~10^{-11}~\rm cm^{-2}~s^{-1}$ and ($3.45\pm 1.78)\times~10^{-11}~\rm cm^{-2}~s^{-1}$, corresponding to 60\%, 45\% of Crab Nebula flux. Variation analysis reveals the variability time-scale of days at the TeV energy band. A simple test by one-zone synchrotron self-Compton model reproduces the data in the gamma-ray band well., Comment: 11 pages, 8 figures, 3 tables

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate a diverse set of policies in a policy pool, which serves to improve the generalization capability of the final agent. However, these frameworks may struggle to capture the full spectrum of potential strategies, especially in real-world scenarios that demand agents balance cooperation with competition. In such settings, agents need strategies that can adapt to varying and often conflicting goals. Drawing inspiration from Social Value Orientation (SVO)-where individuals maintain stable value orientations during interactions with others-we propose a novel framework called \emph{Role Play} (RP). RP employs role embeddings to transform the challenge of policy diversity into a more manageable diversity of roles. It trains a common policy with role embedding observations and employs a role predictor to estimate the joint role embeddings of other agents, helping the learning agent adapt to its assigned role. We theoretically prove that an approximate optimal policy can be achieved by optimizing the expected cumulative reward relative to an approximate role-based policy. Experimental results in both cooperative (Overcooked) and mixed-motive games (Harvest, CleanUp) reveal that RP consistently outperforms strong baselines when interacting with unseen agents, highlighting its robustness and adaptability in complex environments.

Advancements in artificial intelligence (AI) have transformed many scientific fields, with microbiology and microbiome research now experiencing significant breakthroughs through machine learning and deep learning applications. This review provides a comprehensive overview of AI-driven approaches tailored for microbiology and microbiome studies, emphasizing both technical advancements and biological insights. We begin with an introduction to foundational AI techniques, including primary machine learning paradigms and various deep learning architectures, and offer guidance on choosing between machine learning and deep learning methods based on specific research goals. The primary section on application scenarios spans diverse research areas, from taxonomic profiling, functional annotation & prediction, microbe-X interactions, microbial ecology, metabolic modeling, precision nutrition, clinical microbiology, to prevention & therapeutics. Finally, we discuss challenges unique to this field, including the balance between interpretability and complexity, the "small n, large p" problem, and the critical need for standardized benchmarking datasets to validate and compare models. Together, this review underscores AI's transformative role in microbiology and microbiome research, paving the way for innovative methodologies and applications that enhance our understanding of microbial life and its impact on our planet and our health.

We investigate the wavepacket dynamics in an interacting Floquet system described by the Gross-Pitaevskii equation with a ratchet potential. Under quantum resonance conditions, we thoroughly examine the exotic dynamics of directed current, mean energy, and quantum scrambling, based on the exact expression of a time-evolving wavepacket. The directed current is controlled by the phase of the ratchet potential and remains independent of the self-interaction strength. Interestingly, the phase modulation induced by self-interaction dominates the quadratic growth of both mean energy and Out-of-Time-Ordered Correlators (OTOCs). In the quantum nonresonance condition, the disorder in momentum space, induced by the pseudorandom feature of the free evolution operator, suppresses the directed current at all times. Meanwhile, the disorder also leads to the dynamical localization of the mean energy and the freezing of quantum scrambling for initially finite time interval. The dynamical localization can be effectively manipulated by the phase, with underlying physics rooted in the different quasi-eigenenergy spectrum modulated by ratchet potential. Both the mean energy and OTOCs exponentially increase after long time evolution, which is governed by the classically chaotic dynamics dependent on the self-interaction. Possible applications of our findings on quantum control are discussed., Comment: 8 pages, 5 figures

The disorder parameter, which is the expectation value of the symmetry transformation acting on a subsystem, can be used to characterize symmetric phases as an analogy to detecting spontaneous symmetry breaking (SSB) phases using local order parameters. In a dual picture, disorder parameters actually detect SSB of higher-form symmetries. In this work, we show that the non-local disorder parameters can be conveniently and efficiently evaluated using infinite projected entangled pair states (iPEPS). Moreover, we propose a finite entanglement scaling theory of the disorder parameter within the quantum critical region and validate the scaling theory with variationally optimized iPEPS. We find from the finite entanglement scaling that the disorder parameter satisfies perimeter law at a critical point, i.e., proportional to boundary size of the subsystem, indicating spontaneous higher-from symmetry breaking at the critical point of the dual model., Comment: 7+4 pages, 4+3 figures

In time-series analysis, many recent works seek to provide a unified view and representation for time-series across multiple domains, leading to the development of foundation models for time-series data. Despite diverse modeling techniques, existing models are black boxes and fail to provide insights and explanations about their representations. In this paper, we present VQShape, a pre-trained, generalizable, and interpretable model for time-series representation learning and classification. By introducing a novel representation for time-series data, we forge a connection between the latent space of VQShape and shape-level features. Using vector quantization, we show that time-series from different domains can be described using a unified set of low-dimensional codes, where each code can be represented as an abstracted shape in the time domain. On classification tasks, we show that the representations of VQShape can be utilized to build interpretable classifiers, achieving comparable performance to specialist models. Additionally, in zero-shot learning, VQShape and its codebook can generalize to previously unseen datasets and domains that are not included in the pre-training process. The code and pre-trained weights are available at https://github.com/YunshiWen/VQShape., Comment: Accepted by Neural Information Processing Systems (NeurIPS) 2024

We introduce SPOT, an object-centric imitation learning framework. The key idea is to capture each task by an object-centric representation, specifically the SE(3) object pose trajectory relative to the target. This approach decouples embodiment actions from sensory inputs, facilitating learning from various demonstration types, including both action-based and action-less human hand demonstrations, as well as cross-embodiment generalization. Additionally, object pose trajectories inherently capture planning constraints from demonstrations without the need for manually crafted rules. To guide the robot in executing the task, the object trajectory is used to condition a diffusion policy. We show improvement compared to prior work on RLBench simulated tasks. In real-world evaluation, using only eight demonstrations shot on an iPhone, our approach completed all tasks while fully complying with task constraints. Project page: https://nvlabs.github.io/object_centric_diffusion

Conventional histopathology has long been essential for disease diagnosis, relying on visual inspection of tissue sections. Immunohistochemistry aids in detecting specific biomarkers but is limited by its single-marker approach, restricting its ability to capture the full tissue environment. The advent of multiplexed imaging technologies, like multiplexed immunofluorescence and spatial transcriptomics, allows for simultaneous visualization of multiple biomarkers in a single section, enhancing morphological data with molecular and spatial information. This provides a more comprehensive view of the tissue microenvironment, cellular interactions, and disease mechanisms - crucial for understanding disease progression, prognosis, and treatment response. However, the extensive data from multiplexed imaging necessitates sophisticated computational methods for preprocessing, segmentation, feature extraction, and spatial analysis. These tools are vital for managing large, multidimensional datasets, converting raw imaging data into actionable insights. By automating labor-intensive tasks and enhancing reproducibility and accuracy, computational tools are pivotal in diagnostics and research. This review explores the current landscape of multiplexed imaging in pathology, detailing workflows and key technologies like PathML, an AI-powered platform that streamlines image analysis, making complex dataset interpretation accessible for clinical and research settings., Comment: 54 pages (39 manuscript + 14 supplementary), 3 figures (figure 1, 2 and supplementary figure 1), 6 Tables (Table 1, 2, 3 and supplementary table 1,2,3)

Traditional time series forecasting models mainly rely on historical numeric values to predict future outcomes.While these models have shown promising results, they often overlook the rich information available in other modalities, such as textual descriptions of special events, which can provide crucial insights into future dynamics.However, research that jointly incorporates text in time series forecasting remains relatively underexplored compared to other cross-modality work. Additionally, the modality gap between time series data and textual information poses a challenge for multimodal learning. To address this task, we propose Text2Freq, a cross-modality model that integrates text and time series data via the frequency domain. Specifically, our approach aligns textual information to the low-frequency components of time series data, establishing more effective and interpretable alignments between these two modalities. Our experiments on paired datasets of real-world stock prices and synthetic texts show that Text2Freq achieves state-of-the-art performance, with its adaptable architecture encouraging future research in this field., Comment: 7 pages, 3 figures, and be accepted by NeurIPS 2024 Workshop: Time Series in the Age of Large Models

If a scalar field couples to the Ricci scalar with a large non-minimal coupling, the Standard Model coupling parameters can differ above and below an intermediate field range of the scalar due to the non-renormalizability. In this paper, we study, for the first time, the threshold effects on a gauge coupling in both Metric and Palatini formulations of gravity. We find that the gauge coupling naturally jumps around this intermediate scale since counter terms for the renormalization behave so. If the gauge coupling becomes strong with a large scalar field value due to this effect, there can be an enhanced small instanton contribution, the dilute gas approximation of which is justified because the gauge sector decouples when the scalar wave mode is very short. Using these findings, we discuss the QCD axion quality problem, the heavy QCD axion, the QCD axion abundance, and the suppression of isocurvature perturbations. We show that axion physics may differ substantially from na\"{i}ve expectations when we introduce a large non-minimal coupling for any scalar field., Comment: 25 pages, 4 figures, v2: version submitted to journal

We introduce the notion of common conditional expectation to investigate Birkhoff's ergodic theorem and subadditive ergodic theorem for invariant upper probabilities. If in addition, the upper probability is ergodic, we construct an invariant probability to characterize the limit of the ergodic mean. Moreover, this skeleton probability is the unique ergodic probability in the core of the upper probability, that is equal to all probabilities in the core on all invariant sets. We have the following applications of these two theorems: $\bullet$ provide a strong law of large numbers for ergodic stationary sequence on upper probability spaces; $\bullet$ prove the multiplicative ergodic theorem on upper probability spaces; $\bullet$ establish a criterion for the ergodicity of upper probabilities in terms of independence. Furthermore, we introduce and study weak mixing for capacity preserving systems. Using the skeleton idea, we also provide several characterizations of weak mixing for invariant upper probabilities. Finally, we provide examples of ergodic and weakly mixing capacity preserving systems. As applications, we obtain new results in the classical ergodic theory. e.g. in characterizing dynamical properties on measure preserving systems, such as weak mixing, periodicity. Moreover, we use our results in the nonlinear theory to obtain the asymptotic independence, Birkhoff's type ergodic theorem, subadditive ergodic theorem, and multiplicative ergodic theorem for non-invariant probabilities.

Serverless computing is an emerging cloud computing paradigm that enables developers to build applications at the function level, known as serverless applications. Amazon Web Services (AWS), the leading provider in this domain, provides the Serverless Application Model (AWS SAM), the most widely adopted configuration schema for configuring and managing serverless applications through a specified file. However, misconfigurations pose a significant challenge in serverless development. Traditional data-driven techniques may struggle with serverless applications because the complexity of serverless configurations hinders pattern recognition, and it is challenging to gather complete datasets that cover all possible configurations. Leveraging vast amounts of publicly available data during pre-training, LLMs can have the potential to assist in identifying and explaining misconfigurations in serverless applications. In this paper, we introduce SlsDetector, the first framework leveraging LLMs to detect misconfigurations in serverless applications. SlsDetector utilizes effective prompt engineering with zero-shot learning to identify configuration issues. It designs multi-dimensional constraints specifically tailored to the configuration characteristics of serverless applications and leverages the Chain of Thought technique to enhance LLMs inferences. We evaluate SlsDetector on a curated dataset of 110 configuration files. Our results show that SlsDetector, based on ChatGPT-4o, achieves a precision of 72.88%, recall of 88.18%, and F1-score of 79.75%, outperforming state-of-the-art data-driven approaches by 53.82, 17.40, and 49.72 percentage points, respectively. Furthermore, we investigate the generalization capability of SlsDetector by applying recent LLMs, including Llama 3.1 (405B) Instruct Turbo and Gemini 1.5 Pro, with results showing consistently high effectiveness across these models.