Search

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers have moved beyond simple autoregressive token generation by introducing the concept of "thought" -- a sequence of tokens representing intermediate steps in the reasoning process. This innovative paradigm enables LLMs' to mimic complex human reasoning processes, such as tree search and reflective thinking. Recently, an emerging trend of learning to reason has applied reinforcement learning (RL) to train LLMs to master reasoning processes. This approach enables the automatic generation of high-quality reasoning trajectories through trial-and-error search algorithms, significantly expanding LLMs' reasoning capacity by providing substantially more training data. Furthermore, recent studies demonstrate that encouraging LLMs to "think" with more tokens during test-time inference can further significantly boost reasoning accuracy. Therefore, the train-time and test-time scaling combined to show a new research frontier -- a path toward Large Reasoning Model. The introduction of OpenAI's o1 series marks a significant milestone in this research direction. In this survey, we present a comprehensive review of recent progress in LLM reasoning. We begin by introducing the foundational background of LLMs and then explore the key technical components driving the development of large reasoning models, with a focus on automated data construction, learning-to-reason techniques, and test-time scaling. We also analyze popular open-source projects at building large reasoning models, and conclude with open challenges and future research directions., Comment: 36 pages, 5 figures

Weak gravitational lensing requires precise measurements of galaxy shapes and therefore an accurate knowledge of the PSF model. The latter can be a source of systematics that affect the shear two-point correlation function. A key stake of weak lensing analysis is to forecast the systematics due to the PSF. Correlation functions of galaxies and the PSF, the so-called $\rho$- and $\tau$-statistics, are used to evaluate the level of systematics coming from the PSF model and PSF corrections, and contributing to the two-point correlation function used to perform cosmological inference. Our goal is to introduce a fast and simple method to estimate this level of systematics and assess its agreement with state-of-the-art approaches. We introduce a new way to estimate the covariance matrix of the $\tau$-statistics using analytical expressions. The covariance allows us to estimate parameters directly related to the level of systematics associated with the PSF and provides us with a tool to validate the PSF model used in a weak-lensing analysis. We apply those methods to data from the Ultraviolet Near-Infrared Optical Northern Survey (UNIONS). We show that the semi-analytical covariance yields comparable results than using covariances obtained from simulations or jackknife resampling. It requires less computation time and is therefore well suited for rapid comparison of the systematic level obtained from different catalogs. We also show how one can break degeneracies between parameters with a redefinition of the $\tau$-statistics. The methods developed in this work will be useful tools in the analysis of current weak-lensing data but also of Stage IV surveys such as Euclid, LSST or Roman. They provide fast and accurate diagnostics on PSF systematics that are crucial to understand in the context of cosmic shear studies., Comment: 18 pages, 13 figures, submitted to A&A

Encoding time series into tokens and using language models for processing has been shown to substantially augment the models' ability to generalize to unseen tasks. However, existing language models for time series forecasting encounter several obstacles, including aliasing distortion and prolonged inference times, primarily due to the limitations of quantization processes and the computational demands of large models. This paper introduces Apollo-Forecast, a novel framework that tackles these challenges with two key innovations: the Anti-Aliasing Quantization Module (AAQM) and the Race Decoding (RD) technique. AAQM adeptly encodes sequences into tokens while mitigating high-frequency noise in the original signals, thus enhancing both signal fidelity and overall quantization efficiency. RD employs a draft model to enable parallel processing and results integration, which markedly accelerates the inference speed for long-term predictions, particularly in large-scale models. Extensive experiments on various real-world datasets show that Apollo-Forecast outperforms state-of-the-art methods by 35.41\% and 18.99\% in WQL and MASE metrics, respectively, in zero-shot scenarios. Furthermore, our method achieves a 1.9X-2.7X acceleration in inference speed over baseline methods.

In this work we propose an efficient and accurate multi-scale optical simulation algorithm by applying a numerical version of slowly varying envelope approximation in FEM. Specifically, we employ the fast iterative method to quickly compute the phase distribution of the electric field within the computational domain and construct a novel multi-scale basis function that combines the conventional polynomial basis function together with numerically resolved phase information of optical waves. Utilizing this multi-scale basis function, the finite element method can significantly reduce the degrees of freedom required for the solution while maintaining computational accuracy, thereby improving computational efficiency. Without loss of generality, we illustrate our approach via simulating the examples of lens groups and gradient-index lenses, accompanied with performance benchmark against the standard finite element method. The results demonstrate that the proposed method achieves consistent results with the standard finite element method but with a computational speed improved by an order of magnitude., Comment: 12 pages,4 figures and 2 tables

Plasma surface high-order harmonics generation (SHHG) driven by intense laser pulses on plasma targets enables a high-quality extreme ultraviolet source with high pulse energy and outstanding spatiotemporal coherence. Optimizing the performance of SHHG is important for its applications in single-shot imaging and absorption spectroscopy. In this work, we demonstrate the optimization of laser-driven SHHG by an improved Bayesian strategy in conjunction with particle-in-cell simulations. A traditional Bayesian algorithm is first employed to optimize the SHHG intensity in a two-dimensional space of parameter. Then an improved Bayesian strategy, using the Latin hypercube sampling technique and a dynamic acquisition strategy, is developed to overcome the curse of dimensionality and the risk of local optima in a high-dimensional space optimization. The improved Bayesian optimization approach is efficient and robust in three-dimensionally optimizing the harmonic ellipticity, paving the way for the upcoming SHHG experiments with a considerable repetition rate., Comment: 7 pages, 6 figures

In this work, we present an efficient numerical implementation of the finite element method for modal analysis that leverages various symmetry operations, including spatial symmetry in point groups and space-time symmetry in pseudo-Hermiticity systems. We provide a formal and rigorous treatment, specifically deriving the boundary constraint conditions corresponding to symmetry constraints. Without loss of generality, we illustrate our approach via computing the modes of optical waveguides with complex cross-sections, accompanied with performance benchmark against the standard finite element method. The obtained results demonstrate excellent agreement between our method and standard FEM with significantly improved computational efficiency. Specifically, the calculation speed increased by a factor of $23$ in the hollow-core fiber. Furthermore, our method directly classifies and computes the modes based on symmetry, facilitating the modal analysis of complex waveguides.

This project investigates the behavior of multi-head attention in Transformer models, specifically focusing on the differences between benign and trojan models in the context of sentiment analysis. Trojan attacks cause models to perform normally on clean inputs but exhibit misclassifications when presented with inputs containing predefined triggers. We characterize attention head functions in trojan and benign models, identifying specific 'trojan' heads and analyzing their behavior.

Despite their powerful semantic understanding and code generation capabilities, Large Language Models (LLMs) still face challenges when dealing with complex tasks. Multi agent strategy generation and motion control are highly complex domains that inherently require experts from multiple fields to collaborate. To enhance multi agent strategy generation and motion control, we propose an innovative architecture that employs the concept of a cloud edge end hierarchical structure. By leveraging multiple large language models with distinct areas of expertise, we can efficiently generate strategies and perform task decomposition. Introducing the cosine similarity approach,aligning task decomposition instructions with robot task sequences at the vector level, we can identify subtasks with incomplete task decomposition and iterate on them multiple times to ultimately generate executable machine task sequences.The robot is guided through these task sequences to complete tasks of higher complexity. With this architecture, we implement the process of natural language control of robots to perform complex tasks, and successfully address the challenge of multi agent execution of open tasks in open scenarios and the problem of task decomposition.

The stock market is a crucial component of the financial system, but predicting the movement of stock prices is challenging due to the dynamic and intricate relations arising from various aspects such as economic indicators, financial reports, global news, and investor sentiment. Traditional sequential methods and graph-based models have been applied in stock movement prediction, but they have limitations in capturing the multifaceted and temporal influences in stock price movements. To address these challenges, the Multi-relational Dynamic Graph Neural Network (MDGNN) framework is proposed, which utilizes a discrete dynamic graph to comprehensively capture multifaceted relations among stocks and their evolution over time. The representation generated from the graph offers a complete perspective on the interrelationships among stocks and associated entities. Additionally, the power of the Transformer structure is leveraged to encode the temporal evolution of multiplex relations, providing a dynamic and effective approach to predicting stock investment. Further, our proposed MDGNN framework achieves the best performance in public datasets compared with state-of-the-art (SOTA) stock investment methods., Comment: 9 pages, 3 figures, accepted by AAAI 2024

The collaborative nature of federated learning (FL) poses a major threat in the form of manipulation of local training data and local updates, known as the Byzantine poisoning attack. To address this issue, many Byzantine-robust aggregation rules (AGRs) have been proposed to filter out or moderate suspicious local updates uploaded by Byzantine participants. This paper introduces a novel approach called AGRAMPLIFIER, aiming to simultaneously improve the robustness, fidelity, and efficiency of the existing AGRs. The core idea of AGRAMPLIFIER is to amplify the "morality" of local updates by identifying the most repressive features of each gradient update, which provides a clearer distinction between malicious and benign updates, consequently improving the detection effect. To achieve this objective, two approaches, namely AGRMP and AGRXAI, are proposed. AGRMP organizes local updates into patches and extracts the largest value from each patch, while AGRXAI leverages explainable AI methods to extract the gradient of the most activated features. By equipping AGRAMPLIFIER with the existing Byzantine-robust mechanisms, we successfully enhance the model's robustness, maintaining its fidelity and improving overall efficiency. AGRAMPLIFIER is universally compatible with the existing Byzantine-robust mechanisms. The paper demonstrates its effectiveness by integrating it with all mainstream AGR mechanisms. Extensive evaluations conducted on seven datasets from diverse domains against seven representative poisoning attacks consistently show enhancements in robustness, fidelity, and efficiency, with average gains of 40.08%, 39.18%, and 10.68%, respectively., Comment: Accepted by IEEE TIFS, this is the complete version

Integrating first-order logic constraints (FOLCs) with neural networks is a crucial but challenging problem since it involves modeling intricate correlations to satisfy the constraints. This paper proposes a novel neural layer, LogicMP, whose layers perform mean-field variational inference over an MLN. It can be plugged into any off-the-shelf neural network to encode FOLCs while retaining modularity and efficiency. By exploiting the structure and symmetries in MLNs, we theoretically demonstrate that our well-designed, efficient mean-field iterations effectively mitigate the difficulty of MLN inference, reducing the inference from sequential calculation to a series of parallel tensor operations. Empirical results in three kinds of tasks over graphs, images, and text show that LogicMP outperforms advanced competitors in both performance and efficiency., Comment: 28 pages, 14 figures, 12 tables

Automated detection of anomalous trajectories is an important problem with considerable applications in intelligent transportation systems. Many existing studies have focused on distinguishing anomalous trajectories from normal trajectories, ignoring the large differences between anomalous trajectories. A recent study has made great progress in identifying abnormal trajectory patterns and proposed a two-stage algorithm for anomalous trajectory detection and classification (ATDC). This algorithm has excellent performance but suffers from a few limitations, such as high time complexity and poor interpretation. Here, we present a careful theoretical and empirical analysis of the ATDC algorithm, showing that the calculation of anomaly scores in both stages can be simplified, and that the second stage of the algorithm is much more important than the first stage. Hence, we develop a FastATDC algorithm that introduces a random sampling strategy in both stages. Experimental results show that FastATDC is 10 to 20 times faster than ATDC on real datasets. Moreover, FastATDC outperforms the baseline algorithms and is comparable to the ATDC algorithm., Comment: 6 pages, 4 figures, accepted by 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE)