Search

The pretraining and fine-tuning approach has become the leading technique for various NLP applications. However, recent studies reveal that fine-tuning data, due to their sensitive nature, domain-specific characteristics, and identifiability, pose significant privacy concerns. To help develop more privacy-resilient fine-tuning models, we introduce a novel active privacy auditing framework, dubbed Parsing, designed to identify and quantify privacy leakage risks during the supervised fine-tuning (SFT) of language models (LMs). The framework leverages improved white-box membership inference attacks (MIAs) as the core technology, utilizing novel learning objectives and a two-stage pipeline to monitor the privacy of the LMs' fine-tuning process, maximizing the exposure of privacy risks. Additionally, we have improved the effectiveness of MIAs on large LMs including GPT-2, Llama2, and certain variants of them. Our research aims to provide the SFT community of LMs with a reliable, ready-to-use privacy auditing tool, and to offer valuable insights into safeguarding privacy during the fine-tuning process. Experimental results confirm the framework's efficiency across various models and tasks, emphasizing notable privacy concerns in the fine-tuning process. Project code available for https://anonymous.4open.science/r/PARSING-4817/.

In pursuit of enhancing the comprehensive efficiency of production systems, our study focused on the joint optimization problem of scheduling and machine maintenance in scenarios where product rework occurs. The primary challenge lies in the interdependence between product \underline{q}uality, machine \underline{r}eliability, and \underline{p}roduction scheduling, compounded by the uncertainties from machine degradation and product quality, which is prevalent in sophisticated manufacturing systems. To address this issue, we investigated the dynamic relationship among these three aspects, named as QRP-co-effect. On this basis, we constructed an optimization model that integrates production scheduling, machine maintenance, and product rework decisions, encompassing the context of stochastic degradation and product quality uncertainties within a mixed-integer programming problem. To effectively solve this problem, we proposed a dual-module solving framework that integrates planning and evaluation for solution improvement via dynamic communication. By analyzing the structural properties of this joint optimization problem, we devised an efficient solving algorithm with an interactive mechanism that leverages \emph{in-situ} condition information regarding the production system's state and computational resources. The proposed methodology has been validated through comparative and ablation experiments. The experimental results demonstrated the significant enhancement of production system efficiency, along with a reduction in machine maintenance costs in scenarios involving rework.

Modeling stochastic and irregularly sampled time series is a challenging problem found in a wide range of applications, especially in medicine. Neural stochastic differential equations (Neural SDEs) are an attractive modeling technique for this problem, which parameterize the drift and diffusion terms of an SDE with neural networks. However, current algorithms for training Neural SDEs require backpropagation through the SDE dynamics, greatly limiting their scalability and stability. To address this, we propose Trajectory Flow Matching (TFM), which trains a Neural SDE in a simulation-free manner, bypassing backpropagation through the dynamics. TFM leverages the flow matching technique from generative modeling to model time series. In this work we first establish necessary conditions for TFM to learn time series data. Next, we present a reparameterization trick which improves training stability. Finally, we adapt TFM to the clinical time series setting, demonstrating improved performance on three clinical time series datasets both in terms of absolute performance and uncertainty prediction., Comment: NeurIPS 2024 Spotlight

Observations of the Jovian upper atmosphere at high latitudes in the UV, IR and mm/sub-mm all indicate that the chemical distributions and thermal structure are broadly influenced by auroral particle precipitations. Mid-IR and UV observations have shown that several light hydrocarbons (up to 6 carbon atoms) have altered abundances near Jupiter's main auroral ovals. Ion-neutral reactions influence the hydrocarbon chemistry, with light hydrocarbons produced in the upper stratosphere, and heavier hydrocarbons as well as aerosols produced in the lower stratosphere. One consequence of the magnetosphere-ionosphere coupling is the existence of ionospheric jets that propagate into the neutral middle stratosphere, likely acting as a dynamical barrier to the aurora-produced species. As the ionospheric jets and the background atmosphere do not co-rotate at the same rate, this creates a complex system where chemistry and dynamics are intertwined. The ion-neutral reactions produce species with a spatial distribution following the SIII longitude system in the upper stratosphere. As these species sediment down to the lower stratosphere, and because of the progressive dynamical decoupling between the ionospheric flows and the background atmosphere, the spatial distribution of the auroral-related species progressively follows a zonal distribution with increasing pressures that ultimately produces a system of polar and subpolar hazes that extends down to the bottom of the stratosphere. This paper reviews the most recent work addressing different aspects of this environment., Comment: Accepted for publication in Space Science Reviews. 65 pages, 20 figures (including appendix)

Jailbreak attack can be used to access the vulnerabilities of Large Language Models (LLMs) by inducing LLMs to generate the harmful content. And the most common method of the attack is to construct semantically ambiguous prompts to confuse and mislead the LLMs. To access the security and reveal the intrinsic relation between the input prompt and the output for LLMs, the distribution of attention weight is introduced to analyze the underlying reasons. By using statistical analysis methods, some novel metrics are defined to better describe the distribution of attention weight, such as the Attention Intensity on Sensitive Words (Attn_SensWords), the Attention-based Contextual Dependency Score (Attn_DepScore) and Attention Dispersion Entropy (Attn_Entropy). By leveraging the distinct characteristics of these metrics, the beam search algorithm and inspired by the military strategy "Feint and Attack", an effective jailbreak attack strategy named as Attention-Based Attack (ABA) is proposed. In the ABA, nested attack prompts are employed to divert the attention distribution of the LLMs. In this manner, more harmless parts of the input can be used to attract the attention of the LLMs. In addition, motivated by ABA, an effective defense strategy called as Attention-Based Defense (ABD) is also put forward. Compared with ABA, the ABD can be used to enhance the robustness of LLMs by calibrating the attention distribution of the input prompt. Some comparative experiments have been given to demonstrate the effectiveness of ABA and ABD. Therefore, both ABA and ABD can be used to access the security of the LLMs. The comparative experiment results also give a logical explanation that the distribution of attention weight can bring great influence on the output for LLMs.

Unpredictability of battery lifetime has been a key stumbling block to technology advancement of safety-critical systems such as electric vehicles and stationary energy storage systems. In this work, we present a novel hybrid fusion strategy that combines physics-based and data-driven approaches to accurately predict battery capacity. This strategy achieves an average estimation error of only 0.63% over the entire battery lifespan, utilizing merely 45 real-world data segments along with over 1.7 million simulated data segments derived from random partial charging cycles. By leveraging a thoroughly validated physics-based battery model, we extract typical aging patterns from laboratory aging data and extend them into a more comprehensive parameter space, encompassing diverse battery aging states in potential real-world applications while accounting for practical cell-to-cell variations. By bridging the gap between controlled laboratory experiments and real-world usage scenarios, this method highlights the significant potential of transferring underlying knowledge from high-fidelity physics-based models to data-driven models for predicting the behavior of complex dynamical systems.

The atmospheres within our Solar System can be categorized into four distinct climate regimes: "terrestrial", "Jovian", "condensable", and "exosphere". Beyond the three terrestrial planets (excluding Mercury) and the four giant planets, collisional atmospheres are also found on smaller celestial bodies such as Jupiter's moon Io, Saturn's moon Titan, Neptune's moon Triton, and Pluto. This article reviews the key characteristics of these atmospheres and the underlying physical and chemical processes that govern them. I focus on their thermal structures, chemical constituents, wind patterns, and the origins and losses of the atmospheres, and highlight the critical roles of surface ices and liquids, atmospheric hazes, and the space environments of their host planets in shaping these atmospheres. I dedicated this article to Prof. Zuo Xiao (1936-2024) at Peking University., Comment: Chapter accepted for Encyclopedia of Atmospheric Sciences, Third Edition. 35 pages, 8 figures, and 2 tables

Kepler-51 is a $\lesssim 1\,\mathrm{Gyr}$-old Sun-like star hosting three transiting planets with radii $\approx 6$-$9\,R_\oplus$ and orbital periods $\approx 45$-$130\,\mathrm{days}$. Transit timing variations (TTVs) measured with past Kepler and Hubble Space Telescope (HST) observations have been successfully modeled by considering gravitational interactions between the three transiting planets, yielding low masses and low mean densities ($\lesssim 0.1\,\mathrm{g/cm^3}$) for all three planets. However, the transit time of the outermost transiting planet Kepler-51d recently measured by the James Webb Space Telescope (JWST) 10 years after the Kepler observations is significantly discrepant from the prediction made by the three-planet TTV model, which we confirmed with ground-based and follow-up HST observations. We show that the departure from the three-planet model is explained by including a fourth outer planet, Kepler-51e, in the TTV model. A wide range of masses ($\lesssim M_\mathrm{Jup}$) and orbital periods ($\lesssim 10\,\mathrm{yr}$) are possible for Kepler-51e. Nevertheless, all the coplanar solutions found from our brute-force search imply masses $\lesssim 10\,M_\oplus$ for the inner transiting planets. Thus their densities remain low, though with larger uncertainties than previously estimated. Unlike other possible solutions, the one in which Kepler-51e is around the $2:1$ mean motion resonance with Kepler-51d implies low orbital eccentricities ($\lesssim 0.05$) and comparable masses ($\sim 5\,M_\oplus$) for all four planets, as is seen in other compact multi-planet systems. This work demonstrates the importance of long-term follow-up of TTV systems for probing longer period planets in a system., Comment: 48 pages, 26 figures, accepted for publication in AJ

Self-supervised depth estimation, which solely requires monocular image sequence as input, has become increasingly popular and promising in recent years. Current research primarily focuses on enhancing the prediction accuracy of the models. However, the excessive number of parameters impedes the universal deployment of the model on edge devices. Moreover, the emerging neural networks, being black-box models, are difficult to analyze, leading to challenges in understanding the rationales for performance improvements. To mitigate these issues, this study proposes a novel hybrid self-supervised depth estimation network, CCDepth, comprising convolutional neural networks (CNNs) and the white-box CRATE (Coding RAte reduction TransformEr) network. This novel network uses CNNs and the CRATE modules to extract local and global information in images, respectively, thereby boosting learning efficiency and reducing model size. Furthermore, incorporating the CRATE modules into the network enables a mathematically interpretable process in capturing global features. Extensive experiments on the KITTI dataset indicate that the proposed CCDepth network can achieve performance comparable with those state-of-the-art methods, while the model size has been significantly reduced. In addition, a series of quantitative and qualitative analyses on the inner features in the CCDepth network further confirm the effectiveness of the proposed method.

Temperate exoplanets between the sizes of Earth and Neptune, known as "sub-Neptunes", have emerged as intriguing targets for astrobiology. It is unknown whether these planets resemble Earth-like terrestrial worlds with a habitable surface, Neptune-like giant planets with deep atmospheres and no habitable surface, or something exotic in between. Recent JWST transmission spectroscopy observations of the canonical sub-Neptune K2-18 b revealed ~1% CH4, ~1% CO2, and a non-detection of CO in the atmosphere. While previous studies have proposed that the observed atmospheric composition could help constrain the lower atmosphere conditions and determine the interior structure of sub-Neptunes like K2-18 b, the possible interactions between the atmosphere and a hot, supercritical water ocean at its base remain unexplored. In this work, we investigate whether a global supercritical water ocean, resembling a planetary-scale hydrothermal system, can explain these observations on K2-18 b-like sub-Neptunes through equilibrium aqueous geochemical calculations. We find that the observed atmospheric CH4/CO2 ratio implies a minimum ocean temperature of ~715 K, whereas the corresponding CO/CO2 ratio allows ocean temperatures up to ~1060 K. These results indicate that a global supercritical water ocean on K2-18 b is plausible. While life cannot survive in this ocean, this work represents the first step towards understanding how a global supercritical water ocean may influence observable atmospheric characteristics on volatile-rich sub-Neptunes. Future observations with better constrained NH3 and CO mixing ratios could further help distinguish between possible interior compositions of K2-18 b., Comment: 15 pages, 5 figures, 1 table

Numerous biological and physical processes can be modeled as systems of interacting entities evolving continuously over time, e.g. the dynamics of communicating cells or physical particles. Learning the dynamics of such systems is essential for predicting the temporal evolution of populations across novel samples and unseen environments. Flow-based models allow for learning these dynamics at the population level - they model the evolution of the entire distribution of samples. However, current flow-based models are limited to a single initial population and a set of predefined conditions which describe different dynamics. We argue that multiple processes in natural sciences have to be represented as vector fields on the Wasserstein manifold of probability densities. That is, the change of the population at any moment in time depends on the population itself due to the interactions between samples. In particular, this is crucial for personalized medicine where the development of diseases and their respective treatment response depends on the microenvironment of cells specific to each patient. We propose Meta Flow Matching (MFM), a practical approach to integrating along these vector fields on the Wasserstein manifold by amortizing the flow model over the initial populations. Namely, we embed the population of samples using a Graph Neural Network (GNN) and use these embeddings to train a Flow Matching model. This gives MFM the ability to generalize over the initial distributions unlike previously proposed methods. We demonstrate the ability of MFM to improve prediction of individual treatment responses on a large scale multi-patient single-cell drug screen dataset.

Compressing a set of unordered points is far more challenging than compressing images/videos of regular sample grids, because of the difficulties in characterizing neighboring relations in an irregular layout of points. Many researchers resort to voxelization to introduce regularity, but this approach suffers from quantization loss. In this research, we use the KNN method to determine the neighborhoods of raw surface points. This gives us a means to determine the spatial context in which the latent features of 3D points are compressed by arithmetic coding. As such, the conditional probability model is adaptive to local geometry, leading to significant rate reduction. Additionally, we propose a dual-layer architecture where a non-learning base layer reconstructs the main structures of the point cloud at low complexity, while a learned refinement layer focuses on preserving fine details. This design leads to reductions in model complexity and coding latency by two orders of magnitude compared to SOTA methods. Moreover, we incorporate an implicit neural representation (INR) into the refinement layer, allowing the decoder to sample points on the underlying surface at arbitrary densities. This work is the first to effectively exploit content-aware local contexts for compressing irregular raw point clouds, achieving high rate-distortion performance, low complexity, and the ability to function as an arbitrary-scale upsampling network simultaneously., Comment: Accepted by ECCV 2024

We estimate the loss of nitrogen from Pluto over its lifetime, including the giant planet instability period, which we term the "Wild Years." We analyze the orbital migration of 53 simulated Plutinos, which are Kuiper Belt Objects (KBOs) captured into 3:2 mean-motion resonance with Neptune during the instability. This orbital migration brought the Plutinos from 20 to 30 au to their present-day orbits near 40 au along a nonlinear path that includes orbits with semimajor axes from 10 to 100 au. We model the thermal history that results from this migration and estimate the volatile loss rates due to the ever-changing thermal environment. Due to the early Sun's enhanced ultraviolet radiation, the photochemical destruction rate during the Wild Years was a factor of 100 higher than the present-day rate, but this only results in a loss of ~10 m global equivalent layer (GEL). The enhanced Jeans escape rate varies wildly with time, and a net loss of ~100 cm GEL is predicted. Additionally, we model the impact history during the migration and find that impacts are a net source, not loss, of N2, contributing ~100 cm GEL. The 100 cm GEL is 0.1% of the amount of N2 in Sputnik Planitia. We therefore conclude that Pluto did not lose an excessive amount of volatiles during the Wild Years, and its primordial volatile inventory can be approximated as its present-day inventory. However, significant fractions of this small total loss of N2 occurred during the Wild Years, so estimates made using present-day rates will be underestimates., Comment: accepted for publication in the Planetary Science Journal

Knowledge Graph Alignment (KGA) aims to integrate knowledge from multiple sources to address the limitations of individual Knowledge Graphs (KGs) in terms of coverage and depth. However, current KGA models fall short in achieving a ``complete'' knowledge graph alignment. Existing models primarily emphasize the linkage of cross-graph entities but overlook aligning relations across KGs, thereby providing only a partial solution to KGA. The semantic correlations embedded in relations are largely overlooked, potentially restricting a comprehensive understanding of cross-KG signals. In this paper, we propose to conceptualize relation alignment as an independent task and conduct KGA by decomposing it into two distinct but highly correlated sub-tasks: entity alignment and relation alignment. To capture the mutually reinforcing correlations between these objectives, we propose a novel Expectation-Maximization-based model, EREM, which iteratively optimizes both sub-tasks. Experimental results on real-world datasets demonstrate that EREM consistently outperforms state-of-the-art models in both entity alignment and relation alignment tasks.

Built on the power of LLMs, numerous multimodal large language models (MLLMs) have recently achieved remarkable performance on various vision-language tasks. However, most existing MLLMs and benchmarks primarily focus on single-image input scenarios, leaving the performance of MLLMs when handling realistic multiple images underexplored. Although a few benchmarks consider multiple images, their evaluation dimensions and samples are very limited. In this paper, we propose a new benchmark MIBench, to comprehensively evaluate fine-grained abilities of MLLMs in multi-image scenarios. Specifically, MIBench categorizes the multi-image abilities into three scenarios: multi-image instruction (MII), multimodal knowledge-seeking (MKS) and multimodal in-context learning (MIC), and constructs 13 tasks with a total of 13K annotated samples. During data construction, for MII and MKS, we extract correct options from manual annotations and create challenging distractors to obtain multiple-choice questions. For MIC, to enable an in-depth evaluation, we set four sub-tasks and transform the original datasets into in-context learning formats. We evaluate several open-source and closed-source MLLMs on the proposed MIBench. The results reveal that although current models excel in single-image tasks, they exhibit significant shortcomings when faced with multi-image inputs, such as limited fine-grained perception, multi-image reasoning and in-context learning abilities. The annotated data of MIBench is available at https://huggingface.co/datasets/StarBottle/MIBench., Comment: EMNLP 2024

Transmission spectroscopy has been a workhorse technique over the past two decades to constrain the physical and chemical properties of exoplanet atmospheres. One of its classical key assumptions is that the portion of the atmosphere it probes -- the terminator region -- is homogeneous. Several works in the past decade, however, have put this into question for highly irradiated, hot ($T_{eq}\gtrsim 1000$ K) gas giant exoplanets both empirically and via 3-dimensional modelling. While models predict clear differences between the evening (day-to-night) and morning (night-to-day) terminators, direct morning/evening transmission spectra in a wide wavelength range has not been reported for an exoplanet to date. Under the assumption of precise and accurate orbital parameters on WASP-39 b, here we report the detection of inhomogeneous terminators on the exoplanet WASP-39 b, which allows us to retrieve its morning and evening transmission spectra in the near-infrared ($2-5\ \mu$m) using JWST. We observe larger transit depths in the evening which are, on average, $405 \pm 88$ ppm larger than the morning ones, also having qualitatively larger features than the morning spectrum. The spectra are best explained by models in which the evening terminator is hotter than the morning terminator by $177^{+65}_{-57}$ K with both terminators having C/O ratios consistent with solar. General circulation models (GCMs) predict temperature differences broadly consistent with the above value and point towards a cloudy morning terminator and a clearer evening terminator., Comment: Published in Nature at https://www.nature.com/articles/s41586-024-07768-4. All code to produce plots (with data) can be found at https://github.com/nespinoza/wasp39-terminators

Understanding the surface temperature and interior structure of cold-to-temperate sub-Neptunes is critical for assessing their habitability, yet direct observations are challenging. In this study, we investigate the impact of water condensation on the atmospheric compositions of sub-Neptunes, focusing on the implications for JWST spectroscopic observations. By modeling the atmospheric photochemistry of two canonical sub-Neptunes, K2-18 b and LHS 1140 b, both with and without water condensation and with and without thick atmospheres, we demonstrate that water condensation can significantly affect the predicted atmospheric compositions. This effect is driven by oxygen depletion from the condensation of water vapor and primarily manifests as an increase in the C/O ratio within the photochemically active regions of the atmosphere. This change in composition particularly affects planets with thin H2-dominated atmospheres, leading to a transition in dominant nitrogen and carbon carriers from N2 and oxygen-rich species like CO/CO2 towards heavier hydrocarbons and nitriles. While our models do not fully account for the loss mechanisms of these higher-order species, such molecules can go on to form more refractory molecules or hazes. Planets with thin H2-rich atmospheres undergoing significant water condensation are thus likely to exhibit very hazy atmospheres. The relatively flat JWST spectra observed for LHS 1140 b could be consistent with such a scenario, suggesting a shallow surface with extensive water condensation or a high atmospheric C/O ratio. Conversely, the JWST observations of K2-18 b are better aligned with a volatile-rich mini-Neptune with a thick atmosphere., Comment: 21 pages, 7 figures

The recent inference of sulphur dioxide (SO$_2$) in the atmosphere of the hot ($\sim$1100 K), Saturn-mass exoplanet WASP-39b from near-infrared JWST observations suggests that photochemistry is a key process in high temperature exoplanet atmospheres. This is due to the low ($<$1 ppb) abundance of SO$_2$ under thermochemical equilibrium, compared to that produced from the photochemistry of H$_2$O and H$_2$S (1-10 ppm). However, the SO$_2$ inference was made from a single, small molecular feature in the transmission spectrum of WASP-39b at 4.05 $\mu$m, and therefore the detection of other SO$_2$ absorption bands at different wavelengths is needed to better constrain the SO$_2$ abundance. Here we report the detection of SO$_2$ spectral features at 7.7 and 8.5 $\mu$m in the 5-12 $\mu$m transmission spectrum of WASP-39b measured by the JWST Mid-Infrared Instrument (MIRI) Low Resolution Spectrometer (LRS). Our observations suggest an abundance of SO$_2$ of 0.5-25 ppm (1$\sigma$ range), consistent with previous findings. In addition to SO$_2$, we find broad water vapour absorption features, as well as an unexplained decrease in the transit depth at wavelengths longer than 10 $\mu$m. Fitting the spectrum with a grid of atmospheric forward models, we derive an atmospheric heavy element content (metallicity) for WASP-39b of $\sim$7.1-8.0 $\times$ solar and demonstrate that photochemistry shapes the spectra of WASP-39b across a broad wavelength range., Comment: Published in Nature

Efficient collaboration in the centralized training with decentralized execution (CTDE) paradigm remains a challenge in cooperative multi-agent systems. We identify divergent action tendencies among agents as a significant obstacle to CTDE's training efficiency, requiring a large number of training samples to achieve a unified consensus on agents' policies. This divergence stems from the lack of adequate team consensus-related guidance signals during credit assignments in CTDE. To address this, we propose Intrinsic Action Tendency Consistency, a novel approach for cooperative multi-agent reinforcement learning. It integrates intrinsic rewards, obtained through an action model, into a reward-additive CTDE (RA-CTDE) framework. We formulate an action model that enables surrounding agents to predict the central agent's action tendency. Leveraging these predictions, we compute a cooperative intrinsic reward that encourages agents to match their actions with their neighbors' predictions. We establish the equivalence between RA-CTDE and CTDE through theoretical analyses, demonstrating that CTDE's training process can be achieved using agents' individual targets. Building on this insight, we introduce a novel method to combine intrinsic rewards and CTDE. Extensive experiments on challenging tasks in SMAC and GRF benchmarks showcase the improved performance of our method., Comment: The AAAI-2024 paper with the appendix

This paper first investigates solvability of Hermitian-Einstein equation on a Hermitian holomorphic vector bundle on the complement of an arbitrary closed subset in a compact Hermitian manifold. The uniqueness of Hermitian-Einstein metrics on a Zariski open subset in a compact K\"{a}hler manifold was only figured out by Takuro Mochizuki recently, for this model the second part of this paper gives an affirmative answer to a question proposed by Takuro Mochizuki and it leads to an alternative approach to the unique issue. We also prove stability from solvability of Hermitian-Einstein equation, which together with the classical existence result of Carlos Simpson in particular establish a Kobayashi-Hitchin bijective correspondence. The argument is also effective in more general settings, including basic models of Takuro Mochizuki, as well as non-K\"{a}hler and semi-stable contexts., Comment: All comments are welcome

In this paper, we show the regularity and uniqueness of the twisted conical K\"ahler-Ricci flow running from a positive closed current with zero Lelong number, which extends the regularizing property of the smooth twisted K\"ahler-Ricci flow, known as Guedj-Zeriahi's existence theorem and Di Nezza-Lu's uniqueness theorem, to the conical singularity case., Comment: All comments are welcome! arXiv admin note: substantial text overlap with arXiv:2406.04590

In the realm of personalized recommender systems, the challenge of adapting to evolving user preferences and the continuous influx of new users and items is paramount. Conventional models, typically reliant on a static training-test approach, struggle to keep pace with these dynamic demands. Streaming recommendation, particularly through continual graph learning, has emerged as a novel solution. However, existing methods in this area either rely on historical data replay, which is increasingly impractical due to stringent data privacy regulations; or are inability to effectively address the over-stability issue; or depend on model-isolation and expansion strategies. To tackle these difficulties, we present GPT4Rec, a Graph Prompt Tuning method for streaming Recommendation. Given the evolving user-item interaction graph, GPT4Rec first disentangles the graph patterns into multiple views. After isolating specific interaction patterns and relationships in different views, GPT4Rec utilizes lightweight graph prompts to efficiently guide the model across varying interaction patterns within the user-item graph. Firstly, node-level prompts are employed to instruct the model to adapt to changes in the attributes or properties of individual nodes within the graph. Secondly, structure-level prompts guide the model in adapting to broader patterns of connectivity and relationships within the graph. Finally, view-level prompts are innovatively designed to facilitate the aggregation of information from multiple disentangled views. These prompt designs allow GPT4Rec to synthesize a comprehensive understanding of the graph, ensuring that all vital aspects of the user-item interactions are considered and effectively integrated. Experiments on four diverse real-world datasets demonstrate the effectiveness and efficiency of our proposal., Comment: Accepted by SIGIR 2024

The yield stress anomaly of L12 intermetallics such as Ni3Al or Ni3Ga is controlled by the so-called Kear-Wilsdorf lock (KWL), of which the formation and unlocking are governed by dislocation cross-slip. Despite the importance of L12 intermetallics for strengthening Ni-based superalloys, microscopic understanding of the KWL is limited. Here, molecular dynamics simulations are conducted by employing a dedicated machine-learning interatomic potential derived via physically-informed active-learning. The potential facilitates modelling of the dislocation behavior in Ni3Al with near ab initio accuracy. KWL formation and unlocking are observed and analyzed. The unlocking stress demonstrates a pronounced temperature dependence, contradicting the assumptions of existing analytical models. A phenomenological model is proposed to effectively describe the atomistic unlocking stresses and extrapolate them to the macroscopic scale. The model is general and applicable to other L12 intermetallics. The acquired knowledge of KWLs provides a deeper understanding on the origin of the yield stress anomaly.

In this paper, we study the limit behavior of the conical K\"ahler-Ricci flow as its cone angle tends to zero. More precisely, we prove that as the cone angle tends to zero, the conical K\"ahler-Ricci flow converges to a unique K\"ahler-Ricci flow, which is smooth outside the divisor and admits cusp singularity along the divisor., Comment: All comments are welcome!

Room-temperature (RT) two-dimensional (2D) van der Waals (vdW) ferromagnets hold immense promise for next-generation spintronic devices for information storage and processing. To achieve high-density energy-efficient spintronic devices, it is essential to understand local magnetic properties of RT 2D vdW magnets. In this work, we realize noninvasive in situ magnetic detection in vdW-layered ferromagnet Fe3GaTe2 using divacancy spins quantum sensor in silicon carbide (SiC) at RT. The structural features and magnetic properties of the Fe3GaTe2 are characterized utilizing Raman spectrum, magnetization and magneto-transport measurements. Further detailed analysis of temperature- and magnetic field-dependent optically detected magnetic resonances of the PL6 divacancy near the Fe3GaTe2 reveal that, the Curie temperature (Tc) of Fe3GaTe2 is ~360K, and the magnetization increases with external magnetic fields. Additionally, spin relaxometry technology is employed to probe the magnetic fluctuations of Fe3GaTe2, revealing a peak in the spin relaxation rate around Tc. These experiments give insights into the intriguing local magnetic properties of 2D vdW RT ferromagnet Fe3GaTe2 and pave the way for the application of SiC quantum sensors in noninvasive in situ magnetic detection of related 2D vdW magnets., Comment: 15 pages, 4 figures

Exchange bias (EB) is a cornerstone of modern magnetic memory and sensing technologies. Its extension to the realm of two-dimensional (2D) van der Waals (vdW) magnets holds promise for revolutionary advancements in miniaturized and efficient atomic spintronic devices. However, the blocking temperature of EB in 2D vdW magnets is currently well below room temperature ~130 K. This study reports a robust EB phenomenon in Fe3GaTe2 thin-layer devices, which significantly increases the blocking temperature to a near-room-temperature record of 280 K. Both the bias direction and magnitude can be isothermally tuned by adjusting the field sweep range, in striking contrast to the conventional EB in ferromagnetic/antiferromagnetic (FM/AFM) bilayers. We propose an exchange spring model in which crystal defects with higher coercivity act as the pivotal pinning source for the observed EB phenomenon, deviating from the conventional FM/AFM interface mechanism. Cumulative growth of minor loops and multiple magnetization reversal paths are observed in field cycles below the saturation field, consistent with the hard FM defects behavior of our exchange spring model. These findings provide insights into the complex magnetic order in 2D ferromagnets and open new avenues for developing practical ultrathin vdW spintronic devices with EB-like properties at room temperature., Comment: 14 pages, 5 figures

Mobile device operation tasks are increasingly becoming a popular multi-modal AI application scenario. Current Multi-modal Large Language Models (MLLMs), constrained by their training data, lack the capability to function effectively as operation assistants. Instead, MLLM-based agents, which enhance capabilities through tool invocation, are gradually being applied to this scenario. However, the two major navigation challenges in mobile device operation tasks, task progress navigation and focus content navigation, are significantly complicated under the single-agent architecture of existing work. This is due to the overly long token sequences and the interleaved text-image data format, which limit performance. To address these navigation challenges effectively, we propose Mobile-Agent-v2, a multi-agent architecture for mobile device operation assistance. The architecture comprises three agents: planning agent, decision agent, and reflection agent. The planning agent generates task progress, making the navigation of history operations more efficient. To retain focus content, we design a memory unit that updates with task progress. Additionally, to correct erroneous operations, the reflection agent observes the outcomes of each operation and handles any mistakes accordingly. Experimental results indicate that Mobile-Agent-v2 achieves over a 30% improvement in task completion compared to the single-agent architecture of Mobile-Agent. The code is open-sourced at https://github.com/X-PLUG/MobileAgent., Comment: 22 pages, 11 figures, 10 Tables

In this paper, we study the rigidity of eigenvalues of shring Ricci solitons. It is known that the drifted Laplacian on shrinking Ricci solitons has discrete spectrum, its eigenvalues have a lower bound and a rigidity result holds. Firstly, we show that if the $n^\text{th}$ eigenvalue is close to this lower bound, then the $n$-soliton must be the trivial Gaussian soliton $\mathbb{R}^n$. Secondly, we show similar results for the $(n-1)^\text{th}$ and $(n-2)^\text{th}$ eigenvalue under a non-collapsing condition. Lastly, we give an alomost rigidity for the $k^\text{th}$ eigenvalue with general $k$. Part of our results could be viewed as an soliton (could be noncompact) analog of Theorem 1.1 (which only holds for compact manifolds) in Peterson (Invent. Math. 138 (1999): 1-21).

Graphical models have demonstrated their exceptional capabilities across numerous applications, such as social networks, citation networks, and online recommendation systems. Despite these successes, their performance, confidence, and trustworthiness are often limited by the inherent randomness of data in nature and the challenges of accurately capturing and modeling real-world complexities. This has increased interest in developing uncertainty quantification (UQ) techniques tailored to graphical models. In this survey, we comprehensively examine these existing works on UQ in graphical models, focusing on key aspects such as foundational knowledge, sources, representation, handling, and measurement of uncertainty. This survey distinguishes itself from most existing UQ surveys by specifically concentrating on UQ in graphical models, particularly probabilistic graphical models (PGMs) and graph neural networks (GNNs). We elaborately categorize recent work into two primary areas: uncertainty representation and uncertainty handling. By offering a comprehensive overview of the current landscape, including both established methodologies and emerging trends, we aim to bridge gaps in understanding and highlight key challenges and opportunities in the field. Through in-depth discussion of existing works and promising directions for future research, we believe this survey serves as a valuable resource for researchers, inspiring them to cope with uncertainty issues in both academic research and real-world applications.

Interlayer magnetic interactions play a pivotal role in determining the magnetic arrangement within van der Waals (vdW) magnets, and the remarkable tunability of these interactions through applied pressure further enhances their significance. Here, we investigate NiI2 flakes, a representative vdW magnet, under hydrostatic pressures up to 11 GPa. We reveal a notable increase in magnetic transition temperatures for both helimagnetic and antiferromagnetic states, and find that a reversible transition from helimagnetic to antiferromagnetic (AFM) phases at approximately 7 GPa challenges established theoretical and experimental expectations. While the increase in transition temperature aligns with pressure-enhanced overall exchange interaction strengths, we identify the significant role of the second-nearest neighbor interlayer interaction, which competes with intra-layer frustration and favors the AFM state as demonstrated in the Monte Carlo simulations. Experimental and simulated results converge on the existence of an intermediate helimagnetic ordered state in NiI2 before transitioning to the AFM state. These findings underscore the pivotal role of interlayer interactions in shaping the magnetic ground state, providing fresh perspectives for innovative applications in nanoscale magnetic device design.

We present a new two-dimensional, bin-scheme microphysical model of cloud formation in the atmospheres of hot Jupiters that includes the effects of longitudinal gas and cloud transport. We predict cloud particle size distributions as a function of planetary longitude and atmospheric height for a grid of hot Jupiters with equilibrium temperatures ranging from 1000-2100 K. The predicted 2D cloud distributions vary significantly from models that do not consider horizontal cloud transport and we discuss the microphysical and transport timescales that give rise to the differences in 2D versus 1D models. We find that the horizontal advection of cloud particles increases the cloud formation efficiency for nearly all cloud species and homogenizes cloud distributions across the planets in our model grid. In 2D models, certain cloud species are able to be transported and survive on the daysides of hot Jupiters in cases where 1D models would not predict the existence of clouds. We demonstrate that the depletion of condensible gas species varies as a function of longitude and atmospheric height across the planet, which impacts the resultant gas-phase chemistry. Finally, we discuss various model sensitivities including the sensitivity of cloud properties to microphysical parameters, which we find to be substantially less than the sensitivity to the atmospheric thermal structure and horizontal and vertical transport of condensible material., Comment: accepted to Ap

The valley degree of freedom in 2D materials can be manipulated for low-dissipation quantum electronics called valleytronics. At the boundary between two regions of bilayer graphene with different atomic or electrostatic configuration, valley-polarized current has been realized. However, the demanding fabrication and operation requirements limit device reproducibility and scalability toward more advanced valleytronics circuits. We demonstrate a new device architecture of a point junction where a valley-chiral 0D PN junction is easily configured, switchable, and capable of carrying valley current with an estimated polarization of ~80%. This work provides a new building block in manipulating valley quantum numbers and scalable valleytronics.

Electron collimation via a graphene pn-junction allows electrostatic control of ballistic electron trajectories akin to that of an optical circuit. Similar manipulation of novel correlated electronic phases in twisted-bilayer graphene (tBLG) can provide additional probes to the underlying physics and device components towards advanced quantum electronics. In this work, we demonstrate collimation of the electron flow via gate-defined moir\'e barriers in a tBLG device, utilizing the band-insulator gap of the moir\'e superlattice. A single junction can be tuned to host a chosen combination of conventional pseudo barrier and moir\'e tunnel barriers, from which we demonstrate improved collimation efficiency. By measuring transport through two consecutive moir\'e collimators separated by 1 um, we demonstrate evidence of electron collimation in tBLG in the presence of realistic twist-angle inhomogeneity.

Existing benchmarks for fake news detection have significantly contributed to the advancement of models in assessing the authenticity of news content. However, these benchmarks typically focus solely on news pertaining to a single semantic topic or originating from a single platform, thereby failing to capture the diversity of multi-domain news in real scenarios. In order to understand fake news across various domains, the external knowledge and fine-grained annotations are indispensable to provide precise evidence and uncover the diverse underlying strategies for fabrication, which are also ignored by existing benchmarks. To address this gap, we introduce a novel multi-domain knowledge-enhanced benchmark with fine-grained annotations, named \textbf{FineFake}. FineFake encompasses 16,909 data samples spanning six semantic topics and eight platforms. Each news item is enriched with multi-modal content, potential social context, semi-manually verified common knowledge, and fine-grained annotations that surpass conventional binary labels. Furthermore, we formulate three challenging tasks based on FineFake and propose a knowledge-enhanced domain adaptation network. Extensive experiments are conducted on FineFake under various scenarios, providing accurate and reliable benchmarks for future endeavors. The entire FineFake project is publicly accessible as an open-source repository at \url{https://github.com/Accuser907/FineFake}.

Multimodal pre-training demonstrates its potential in the medical domain, which learns medical visual representations from paired medical reports. However, many pre-training tasks require extra annotations from clinicians, and most of them fail to explicitly guide the model to learn the desired features of different pathologies. In this paper, we utilize Visual Question Answering (VQA) for multimodal pre-training to guide the framework focusing on targeted pathological features. We leverage descriptions in medical reports to design multi-granular question-answer pairs associated with different diseases, which assist the framework in pre-training without requiring extra annotations from experts. We also propose a novel pre-training framework with a quasi-textual feature transformer, a module designed to transform visual features into a quasi-textual space closer to the textual domain via a contrastive learning strategy. This narrows the vision-language gap and facilitates modality alignment. Our framework is applied to four downstream tasks: report generation, classification, segmentation, and detection across five datasets. Extensive experiments demonstrate the superiority of our framework compared to other state-of-the-art methods. Our code is available at https://github.com/MoramiSu/QFT-MICCAI2024., Comment: Accepted by MICCAI2024

Hierarchical massive quadruple systems are ideal laboratories for examining the theories of star formation, dynamical evolution, and stellar evolution. The successive mergers of hierarchical quadruple systems might explain the mass gap between neutron stars and black holes. Looking for light curves of O-type binaries identified by LAMOST, we find a (2+2) quadruple system: TYC 3340-2437-1, located in the stellar bow-shock nebula (SBN). It has a probability of over 99.99\% being a quadruple system derived from the surface density of the vicinity stars. Its inner orbital periods are 3.390602(89) days and 2.4378(16) days, respectively, and the total mass is about (11.47 + 5.79) + (5.2 + 2.02) = 24.48 $M_{\odot}$. The line-of-sight inclinations of the inner binaries, B$_1$ and B$_2$, are 55.94 and 78.2 degrees, respectively, indicating that they are not co-planar. Based on observations spanning 34 months and the significance of the astrometric excess noise ($D>2$) in Gaia DR3 data, we guess that its outer orbital period might be a few years. If it were true, the quadruple system might form through the disk fragmentation mechanism with outer eccentric greater than zero. This eccentricity could be the cause of both the arc-like feature of the SBN and the noncoplanarity of the inner orbit. The outer orbital period and outer eccentric could be determined with the release of future epoch astrometric data of Gaia.

Graphs are ubiquitous in social networks and biochemistry, where Graph Neural Networks (GNN) are the state-of-the-art models for prediction. Graphs can be evolving and it is vital to formally model and understand how a trained GNN responds to graph evolution. We propose a smooth parameterization of the GNN predicted distributions using axiomatic attribution, where the distributions are on a low-dimensional manifold within a high-dimensional embedding space. We exploit the differential geometric viewpoint to model distributional evolution as smooth curves on the manifold. We reparameterize families of curves on the manifold and design a convex optimization problem to find a unique curve that concisely approximates the distributional evolution for human interpretation. Extensive experiments on node classification, link prediction, and graph classification tasks with evolving graphs demonstrate the better sparsity, faithfulness, and intuitiveness of the proposed method over the state-of-the-art methods., Comment: Accepted into ICLR 2023