Search

In this paper, we propose a new method Strategist that utilizes LLMs to acquire new skills for playing multi-agent games through a self-improvement process. Our method gathers quality feedback through self-play simulations with Monte Carlo tree search and LLM-based reflection, which can then be used to learn high-level strategic skills such as how to evaluate states that guide the low-level execution.We showcase how our method can be used in both action planning and dialogue generation in the context of games, achieving good performance on both tasks. Specifically, we demonstrate that our method can help train agents with better performance than both traditional reinforcement learning-based approaches and other LLM-based skill learning approaches in games including the Game of Pure Strategy (GOPS) and The Resistance: Avalon., Comment: website: https://llm-strategist.github.io

We propose Self-Control, a novel method utilizing suffix gradients to control the behavior of large language models (LLMs) without explicit human annotations. Given a guideline expressed in suffix string and the model's self-assessment of adherence, Self-Control computes the gradient of this self-judgment concerning the model's hidden states, directly influencing the auto-regressive generation process towards desired behaviors. To enhance efficiency, we introduce Self-Control_{prefix}, a compact module that encapsulates the learned representations from suffix gradients into a Prefix Controller, facilitating inference-time control for various LLM behaviors. Our experiments demonstrate Self-Control's efficacy across multiple domains, including emotional modulation, ensuring harmlessness, and enhancing complex reasoning. Especially, Self-Control_{prefix} enables a plug-and-play control and jointly controls multiple attributes, improving model outputs without altering model parameters or increasing inference-time costs., Comment: 41 pages, 12 figures, 41 tables; Website: https://llm-self-control.github.io/

High-cadence, multiwavelength observations have continuously revealed the diversity of tidal disruption events (TDEs), thus greatly advancing our knowledge and understanding of TDEs. In this work, we conducted an intensive optical-UV and X-ray follow-up campaign of TDE AT2023lli, and found a remarkable month-long bump in its UV/optical light curve nearly two months prior to maximum brightness. The bump represents the longest separation time from the main peak among known TDEs to date. The main UV/optical outburst declines as $t^{-4.10}$, making it one of the fastest decaying optically selected TDEs. Furthermore, we detected sporadic X-ray emission 30 days after the UV/optical peak, accompanied by a reduction in the period of inactivity. It is proposed that the UV/optical bump could be caused by the self-intersection of the stream debris, whereas the primary peak is generated by the reprocessed emission of the accretion process. In addition, our results suggest that episodic X-ray radiation during the initial phase of decline may be due to the patched obscurer surrounding the accretion disk, a phenomenon associated with the inhomogeneous reprocessing process. The double TDE scenario, in which two stars are disrupted in sequence, is also a possible explanation for producing the observed early bump and main peak. We anticipate that the multicolor light curves of TDEs, especially in the very early stages, and the underlying physics can be better understood in the near future with the assistance of dedicated surveys such as the deep high-cadence survey of the 2.5-meter Wide Field Survey Telescope (WFST)., Comment: 14 pages, 8 figures,accepted for publication by ApJL

In this paper, we explore the potential of Large Language Models (LLMs) Agents in playing the strategic social deduction game, Resistance Avalon. Players in Avalon are challenged not only to make informed decisions based on dynamically evolving game phases, but also to engage in discussions where they must deceive, deduce, and negotiate with other players. These characteristics make Avalon a compelling test-bed to study the decision-making and language-processing capabilities of LLM Agents. To facilitate research in this line, we introduce AvalonBench - a comprehensive game environment tailored for evaluating multi-agent LLM Agents. This benchmark incorporates: (1) a game environment for Avalon, (2) rule-based bots as baseline opponents, and (3) ReAct-style LLM agents with tailored prompts for each role. Notably, our evaluations based on AvalonBench highlight a clear capability gap. For instance, models like ChatGPT playing good-role got a win rate of 22.2% against rule-based bots playing evil, while good-role bot achieves 38.2% win rate in the same setting. We envision AvalonBench could be a good test-bed for developing more advanced LLMs (with self-playing) and agent frameworks that can effectively model the layered complexities of such game environments.

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still fall short of human-level proficiency. Recent studies have established the effectiveness of prompts in steering LLMs towards generating desired outputs. Building on these insights, we introduce a novel framework that harnesses the potential of large-scale pre-trained language models, to iteratively enhance performance of the LLMs. Our framework incorporates three components: \textit{Normal CoT}, a \textit{Convincer}, and an \textit{Answerer}. It processes the output of a typical few-shot chain-of-thought prompt, assesses the correctness of the response, scrutinizes the answer, refines the reasoning, and ultimately produces a new solution. Experimental results on the 7 datasets of miscellaneous problems validate the efficacy of the Self-Convince framework, achieving substantial improvements compared to the baselines. This study contributes to the burgeoning body of research focused on integrating pre-trained language models with tailored prompts and iterative refinement processes to augment their performance in complex tasks.

In this article, two kinds of numerical algorithms are derived for the ultra-slow (or superslow) diffusion equation in one and two space dimensions, where the ultra-slow diffusion is characterized by the Caputo-Hadamard fractional derivative of order $\alpha \in (0,1)$. To describe the spatial interaction, the Riesz fractional derivative and the fractional Laplacian are used in one and two space dimensions, respectively. The Caputo-Hadamard derivative is discretized by two typical approximate formulae, i.e., L2-1$_{\sigma}$ and L1-2 methods. The spatial fractional derivatives are discretized by the 2-nd order finite difference methods. When L2-1$_{\sigma}$ discretization is used, the derived numerical scheme is unconditionally stable with error estimate $\mathcal{O}(\tau^{2}+h^{2})$ for all $\alpha \in (0, 1)$, in which $\tau$ and $h$ are temporal and spatial stepsizes, respectively. When L1-2 discretization is used, the derived numerical scheme is stable with error estimate $\mathcal{O}(\tau^{3-\alpha}+h^{2})$ for $\alpha \in (0, 0.3738)$. The illustrative examples displayed are in line with the theoretical analysis.

Let $G$ be a simple connected undirected graph. The Laplacian spectral ratio of $G$, denoted by $R_L(G)$, is defined as the quotient between the largest and second smallest Laplacian eigenvalues of $G$, which is closely related to the structural parameters of a graph (or network), such as diameter, $t$-tough, perfect matching, average density of cuts, and synchronizability, etc. In this paper, we obtain some bounds of the Laplacian spectral ratio, which improves the known results. In addition, we give counter-examples on the upper bound of the Laplacian spectral ratio conjecture of trees, and propose a new conjecture., Comment: 17 pages,3 figures

Polarons are entities of excess electrons dressed with local response of lattices, whose atomic-scale characterization is essential for understanding the many body physics arising from the electron-lattice entanglement, but yet difficult to achieve. Here, using scanning tunneling microscopy and spectroscopy (STM/STS), we show the visualization and manipulation of single polarons with different origin, i.e., electronic and conventional polarons, in monolayer CoCl2, that are grown on HOPG substrate via molecular beam epitaxy. Four types of polarons are identified, all inducing upward local band bending, but exhibiting distinct appearances, lattice occupations, polaronic states and local lattice distortions. First principles calculations unveil three types of polarons are stabilized by electron-electron interaction. The type-4 polaron, however, are driven by conventional lattice distortions. All the four types of polarons can be created, moved, erased, and moreover interconverted individually by the STM tip, allowing precise control of single polarons unprecedently. This finding identifies the rich category of polarons and their feasibility of manipulation in CoCl2, which can be generalized to other transition metal halides., Comment: 23 pages, 5 figures

We study the dynamic evolution of COVID-19 cased by the Omicron variant via a fractional susceptible-exposedinfected-removed (SEIR) model. Preliminary data suggest that the symptoms of Omicron infection are not prominent and the transmission is therefore more concealed, which causes a relatively slow increase in the detected cases of the new infected at the beginning of the pandemic. To characterize the specific dynamics, the Caputo-Hadamard fractional derivative is adopted to refined the classical SEIR model. Based on the reported data, we infer the fractional order, timedependent parameters, as well as unobserved dynamics of the fractional SEIR model via fractional physics-informed neural networks (fPINNs). Then, we make short-time predictions using the learned fractional SEIR model.

In a solid, electrons can be scattered both by phonons and other electrons. First proposed by Landau, scattering by phonons can lead to a composite entity called a polaron, in which a lattice distortion traps an itinerant electron (or hole) such that the distortion and carrier move in unison as a single particle with larger effective mass. While this is the traditional view of polarons, the rise of 2D systems, especially strongly correlated ones, open the prospect of electron scattering taking on a larger role in spontaneous carrier localization for such material systems. Here, we show that in transition metal halides, such electron-electron interactions can lead to polaron formation even in the absence of lattice distortion. This suggests an alternative direction for polaron formation, transport, and control in solids. This new mechanism of polaron formation is confirmed by first-principles calculation of 2D transition metal halides, CrI2, CoCl2 and CoBr2. These theoretical predictions are supported by scanning tunneling microscopy/spectroscopy measurements of polarons in CrI2.

We develop fractional buffer layers (FBLs) to absorb propagating waves without reflection in bounded domains. Our formulation is based on variable-order spatial fractional derivatives. We select a proper variable-order function so that dissipation is induced to absorb the coming waves in the buffer layers attached to the domain. In particular, we first design proper FBsL for the one-dimensional one-way and two-way wave propagation. Then, we extend our formulation to two-dimensional problems, where we introduce a consistent variable-order fractional wave equation. In each case, we obtain the fully discretized equations by employing a spectral collocation method in space and Crank-Nicolson or Adams-Bashforth method in time. We compare our results with the perfectly matched layer (PML) method and show the effectiveness of FBL in accurately suppressing any erroneously reflected waves, including corner reflections in two-dimensional rectangular domains. FBLs can be used in conjunction with any discretization method appropriate for fractional operators describing wave propagation in bounded or truncated domains.