Search

All hyperK\"ahler ALE 4-manifolds with a given non-trivial finite group $\Gamma$ in $SU(2)$ at infinity are parameterized by an open dense subset of a real linear space of dimension $3$rank$\Phi$. Here, $\Phi$ denotes the root system associated with $\Gamma$ via the McKay correspondence. Such manifolds are diffeomorphic to the minimal resolution of a Kleinian singularity. By using the period map of the twistor space, we specify those points in the parameter space at which the hyperK\"ahlerian family of complex structures includes the complex structure of the minimal resolution. Furthermore, we count the rational curves lying on each hyperK\"ahler ALE 4-manifold. As an application, we prove that the twistor space of any hyperK\"ahler ALE cannot be K\"ahlerian. In particular, we strengthen some results of Kronheimer (J. Differential Geom., 29(3):665--683, 1989) and provide examples of non-compact and non-K\"ahlerian twistor spaces., Comment: 19 pages

The stochastic gravitational wave background (SGWB) consists of an incoherent collection of waves from both astrophysical and cosmological sources. To distinguish the SGWB from noise, it is essential to verify its quadrupolar nature, exemplified by the cross-correlations among pairs of pulsars within a pulsar timing array, commonly referred to as the Hellings-Downs curve. We extend the concept of quadrupolar correlations to pairs of general gravitational wave detectors, classified by their antenna responses. This study involves space-based missions such as the laser interferometers LISA, Taiji, and TianQin, along with atom interferometers like AEDGE/MAGIS. We calculate modulations in their correlations due to orbital motions and relative orientations, which are characteristic markers for identifying the quadrupolar nature of the SGWB. Our findings identify optimal configurations for these missions, offer forecasts for the time needed to identify the quadrupolar nature of the SGWB, and are applicable to both space-space and space-terrestrial correlations., Comment: 19 pages, 6 figures

This paper develops a general data-driven approach to stochastic elastoplastic modelling that leverages atomistic simulation data directly rather than by fitting parameters. The approach is developed in the context of metallic glasses, which present inherent complexities due to their disordered structure. By harvesting statistics from simulated metallic glass shear response histories, the material state is mapped onto a two-dimensional state space consisting of the shear stress and the inelastic contribution to the potential energy. The resulting elastoplastic model is intrinsically stochastic and represented as a non-deterministic dynamical map. The state space statistics provide insights into the deformation physics of metallic glasses, revealing that two state variables are sufficient to describe the main features of the elastoplastic response. In this two-dimensional state space, the gradually quenched metallic glass rejuvenates during the initial quasi-elastic shearing, ultimately reaching a steady state that fluctuates about a fixed point in the state space as rejuvenation and aging balance., Comment: 22 pages, 5 figures

Multi-modal large language models (MLLMs) have demonstrated promising capabilities across various tasks by integrating textual and visual information to achieve visual understanding in complex scenarios. Despite the availability of several benchmarks aims to evaluating MLLMs in tasks from visual question answering to complex problem-solving, most focus predominantly on mathematics or general visual understanding tasks. This reveals a critical gap in current benchmarks, which often overlook the inclusion of other key scientific disciplines such as physics and chemistry. To address this gap, we meticulously construct a comprehensive benchmark, named VisScience, which is utilized to assess the multi-modal scientific reasoning across the three disciplines of mathematics, physics, and chemistry. This benchmark comprises 3,000 questions drawn from K12 education - spanning elementary school through high school - equally distributed across three disciplines, with 1,000 questions per discipline. The questions within VisScience span 21 distinct subjects and are categorized into five difficulty levels, offering a broad spectrum of topics within each discipline. With VisScience, we present a detailed evaluation of the performance of 25 representative MLLMs in scientific reasoning. Experimental results demonstrate that closed-source MLLMs generally outperform open-source models. The best performance observed include a 53.4\% accuracy in mathematics by Claude3.5-Sonnet, 38.2\% in physics by GPT-4o, and 47.0\% in chemistry by Gemini-1.5-Pro. These results underscore the strengths and limitations of MLLMs, suggesting areas for future improvement and highlighting the importance of developing models that can effectively handle the diverse demands of multi-modal scientific reasoning., Comment: 89 pages, 70 figures

Large language models (LLMs) have demonstrated significant capabilities in mathematical reasoning, particularly with text-based mathematical problems. However, current multi-modal large language models (MLLMs), especially those specialized in mathematics, tend to focus predominantly on solving geometric problems but ignore the diversity of visual information available in other areas of mathematics. Moreover, the geometric information for these specialized mathematical MLLMs is derived from several public datasets, which are typically limited in diversity and complexity. To address these limitations, we aim to construct a fine-tuning dataset named MathVL, and develop a series of specialized mathematical MLLMs termed MathGLM-Vision by conducting Supervised Fine-Tuning (SFT) on MathVL with various parameter-scale backbones. To extensively evaluate the effectiveness of MathGLM-Vision, we conduct experiments on several public benchmarks and our curated MathVL-test consisting of 2,000 problems. Experimental results demonstrate that MathGLM-Vision achieves significant improvements compared with some existing models, including backbone models and open-source mathematical MLLMs. These findings indicate the importance of diversity dataset in enhancing the mathematical reasoning abilities of MLLMs., Comment: 30 pages,19 figures

Beginning with VisualGLM and CogVLM, we are continuously exploring VLMs in pursuit of enhanced vision-language fusion, efficient higher-resolution architecture, and broader modalities and applications. Here we propose the CogVLM2 family, a new generation of visual language models for image and video understanding including CogVLM2, CogVLM2-Video and GLM-4V. As an image understanding model, CogVLM2 inherits the visual expert architecture with improved training recipes in both pre-training and post-training stages, supporting input resolution up to $1344 \times 1344$ pixels. As a video understanding model, CogVLM2-Video integrates multi-frame input with timestamps and proposes automated temporal grounding data construction. Notably, CogVLM2 family has achieved state-of-the-art results on benchmarks like MMBench, MM-Vet, TextVQA, MVBench and VCGBench. All models are open-sourced in https://github.com/THUDM/CogVLM2 and https://github.com/THUDM/GLM-4, contributing to the advancement of the field.

We present CogVideoX, a large-scale text-to-video generation model based on diffusion transformer, which can generate 10-second continuous videos aligned with text prompt, with a frame rate of 16 fps and resolution of 768 * 1360 pixels. Previous video generation models often had limited movement and short durations, and is difficult to generate videos with coherent narratives based on text. We propose several designs to address these issues. First, we propose a 3D Variational Autoencoder (VAE) to compress videos along both spatial and temporal dimensions, to improve both compression rate and video fidelity. Second, to improve the text-video alignment, we propose an expert transformer with the expert adaptive LayerNorm to facilitate the deep fusion between the two modalities. Third, by employing a progressive training and multi-resolution frame pack technique, CogVideoX is adept at producing coherent, long-duration, different shape videos characterized by significant motions. In addition, we develop an effective text-video data processing pipeline that includes various data preprocessing strategies and a video captioning method, greatly contributing to the generation quality and semantic alignment. Results show that CogVideoX demonstrates state-of-the-art performance across both multiple machine metrics and human evaluations. The model weight of both 3D Causal VAE, Video caption model and CogVideoX are publicly available at https://github.com/THUDM/CogVideo.

Event Factuality Detection (EFD) task determines the factuality of textual events, i.e., classifying whether an event is a fact, possibility, or impossibility, which is essential for faithfully understanding and utilizing event knowledge. However, due to the lack of high-quality large-scale data, event factuality detection is under-explored in event understanding research, which limits the development of EFD community. To address these issues and provide faithful event understanding, we introduce MAVEN-Fact, a large-scale and high-quality EFD dataset based on the MAVEN dataset. MAVEN-Fact includes factuality annotations of 112,276 events, making it the largest EFD dataset. Extensive experiments demonstrate that MAVEN-Fact is challenging for both conventional fine-tuned models and large language models (LLMs). Thanks to the comprehensive annotations of event arguments and relations in MAVEN, MAVEN-Fact also supports some further analyses and we find that adopting event arguments and relations helps in event factuality detection for fine-tuned models but does not benefit LLMs. Furthermore, we preliminarily study an application case of event factuality detection and find it helps in mitigating event-related hallucination in LLMs. Our dataset and codes can be obtained from \url{https://github.com/lcy2723/MAVEN-FACT}, Comment: Under review

We present an autonomous exploration system for efficient coverage of unknown environments. First, a rapid environment preprocessing method is introduced to provide environmental information for subsequent exploration planning. Then, the whole exploration space is divided into multiple subregion cells, each with varying levels of detail. The subregion cells are capable of decomposition and updating online, effectively characterizing dynamic unknown regions with variable resolution. Finally, the hierarchical planning strategy treats subregions as basic planning units and computes an efficient global coverage path. Guided by the global path, the local path that sequentially visits the viewpoint set is refined to provide an executable path for the robot. This hierarchical planning from coarse to fine steps reduces the complexity of the planning scheme while improving exploration efficiency. The proposed method is compared with state-of-art methods in benchmark environments. Our approach demonstrates superior efficiency in completing exploration while using lower computational resources.

Rapid sampling from the environment to acquire available frontier points and timely incorporating them into subsequent planning to reduce fragmented regions are critical to improve the efficiency of autonomous exploration. We propose HPHS, a fast and effective method for the autonomous exploration of unknown environments. In this work, we efficiently sample frontier points directly from the LiDAR data and the local map around the robot, while exploiting a hierarchical planning strategy to provide the robot with a global perspective. The hierarchical planning framework divides the updated environment into multiple subregions and arranges the order of access to them by considering the overall revenue of the global path. The combination of the hybrid frontier sampling method and hierarchical planning strategy reduces the complexity of the planning problem and mitigates the issue of region remnants during the exploration process. Detailed simulation and real-world experiments demonstrate the effectiveness and efficiency of our approach in various aspects. The source code will be released to benefit the further research., Comment: Accepted by IROS 2024

SiC is a promising substrate for Si-on-insulator (SOI) wafers for efficient thermal management owing to its high thermal conductivity and large bandgap. However, fabricating a Si device layer on a SiC substrate with a high and uniform thermal-boundary conductance (TBC) at the wafer scale is challenging. In this study, a 4-inch Si-on-SiC wafer was fabricated using a room-temperature surface-activated bonding method, and the TBC was measured using the time-domain thermoreflectance (TDTR) method. The obtained TBC was 109 MW/m2K in the as-bonded sample, improving to 293 MW/m2K after annealing at 750 oC, representing a 78% increase compared to previously reported values for a Si-SiC interface formed by bonding methods. Such enhancement is attributed to the absence of an oxide layer at the interface. Furthermore, we assessed the actual spatial distribution of the TBC in the SOI system by combining the TDTR mapping with a mathematical model to remove the influence of random errors in the experiment. The spatial distributions before and after annealing were 7% and 17%, respectively. Such variation highlights the need to consider the TBC distribution when designing thermal management systems.

We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most capable models that are trained with all the insights and lessons gained from the preceding three generations of ChatGLM. To date, the GLM-4 models are pre-trained on ten trillions of tokens mostly in Chinese and English, along with a small set of corpus from 24 languages, and aligned primarily for Chinese and English usage. The high-quality alignment is achieved via a multi-stage post-training process, which involves supervised fine-tuning and learning from human feedback. Evaluations show that GLM-4 1) closely rivals or outperforms GPT-4 in terms of general metrics such as MMLU, GSM8K, MATH, BBH, GPQA, and HumanEval, 2) gets close to GPT-4-Turbo in instruction following as measured by IFEval, 3) matches GPT-4 Turbo (128K) and Claude 3 for long context tasks, and 4) outperforms GPT-4 in Chinese alignments as measured by AlignBench. The GLM-4 All Tools model is further aligned to understand user intent and autonomously decide when and which tool(s) touse -- including web browser, Python interpreter, text-to-image model, and user-defined functions -- to effectively complete complex tasks. In practical applications, it matches and even surpasses GPT-4 All Tools in tasks like accessing online information via web browsing and solving math problems using Python interpreter. Over the course, we have open-sourced a series of models, including ChatGLM-6B (three generations), GLM-4-9B (128K, 1M), GLM-4V-9B, WebGLM, and CodeGeeX, attracting over 10 million downloads on Hugging face in the year 2023 alone. The open models can be accessed through https://github.com/THUDM and https://huggingface.co/THUDM.

Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of meeting the demands of real-world applications such as embodied intelligence for long-term decision-making, in-depth movie reviews and discussions, and live sports commentary, all of which require comprehension of long videos spanning several hours. To address this gap, we introduce LVBench, a benchmark specifically designed for long video understanding. Our dataset comprises publicly sourced videos and encompasses a diverse set of tasks aimed at long video comprehension and information extraction. LVBench is designed to challenge multimodal models to demonstrate long-term memory and extended comprehension capabilities. Our extensive evaluations reveal that current multimodal models still underperform on these demanding long video understanding tasks. Through LVBench, we aim to spur the development of more advanced models capable of tackling the complexities of long video comprehension. Our data and code are publicly available at: https://lvbench.github.io.

We introduce a block encoding method for mapping discrete subgroups to qubits on a quantum computer. This method is applicable to general discrete groups, including crystal-like subgroups such as $\mathbb{BI}$ of $SU(2)$ and $\mathbb{V}$ of $SU(3)$. We detail the construction of primitive gates -- the inversion gate, the group multiplication gate, the trace gate, and the group Fourier gate -- utilizing this encoding method for $\mathbb{BT}$ and for the first time $\mathbb{BI}$ group. We also provide resource estimations to extract the gluon viscosity. The inversion gates for $\mathbb{BT}$ and $\mathbb{BI}$ are benchmarked on the $\texttt{Baiwang}$ quantum computer with estimated fidelities of $40^{+5}_{-4}\%$ and $4^{+5}_{-3}\%$ respectively., Comment: 12 pages, 10 figures

Cone spherical metrics, defined on compact Riemann surfaces, are conformal metrics with constant curvature one and finitely many cone singularities. Such a metric is termed \textit{reducible} if a developing map of the metric has monodromy in ${\rm U(1)}$, and \textit{irreducible} otherwise. Utilizing the polystable extensions of two line bundles on a compact Riemann surface $X$ with genus $g_X>0$, we establish the following three primary results concerning these metrics with cone angles in $2\pi{\mathbb Z}_{>1}$: \begin{itemize} \item[(1)] Given an effective divisor $D$ with an odd degree surpassing $2g_X$ on $X$, we find the existence of an effective divisor $D'$ in the complete linear system $|D|$ that can be represented by at least two distinct irreducible cone spherical metrics on $X$. \item[(2)] For a generic effective divisor $D$ with an even degree and $\deg D\geq 6g_X-2$ on $X$, we can identify an arcwise connected Borel subset in $|D|$ that demonstrates a Hausdorff dimension of no less than $\big(\deg D-4g_{X}+2\big)$. Within this subset, each divisor $D'$ can be distinctly represented by a family of reducible metrics, defined by a single real parameter. \item[(3)] For an effective divisor $D$ with $\deg D=2$ on an elliptic curve, we can identify a Borel subset in $|D|$ that is arcwise connected, showcasing a Hausdorff dimension of one. Within this subset, each divisor $D'$ can be distinctly represented by a family of reducible metrics, defined by a single real parameter.

Large language models (LLMs) usually fall short on information extraction (IE) tasks and struggle to follow the complex instructions of IE tasks. This primarily arises from LLMs not being aligned with humans, as mainstream alignment datasets typically do not include IE data. In this paper, we introduce ADELIE (Aligning large language moDELs on Information Extraction), an aligned LLM that effectively solves various IE tasks, including closed IE, open IE, and on-demand IE. We first collect and construct a high-quality alignment corpus IEInstruct for IE. Then we train ADELIE_SFT using instruction tuning on IEInstruct. We further train ADELIE_SFT with direct preference optimization (DPO) objective, resulting in ADELIE_DPO. Extensive experiments on various held-out IE datasets demonstrate that our models (ADELIE_SFT and ADELIE_DPO) achieve state-of-the-art (SoTA) performance among open-source models. We further explore the general capabilities of ADELIE, and experimental results reveal that their general capabilities do not exhibit a noticeable decline. We will release the code, data, and models to facilitate further research., Comment: Accepted at EMNLP 2024. Camera-ready version

On a compact Riemann surface (X) with finite punctures (P_1, \ldots, P_k), we define toric curves as multi-valued, totally unramified holomorphic maps to (\mathbb{P}^n) with monodromy in a maximal torus of ({\rm PSU}(n+1)). \textit{Toric solutions} for the ({\rm SU}(n+1)) system on $X\setminus\{P_1,\ldots, P_k\}$ are recognized by their associated {\it toric} curves in (\mathbb{P}^n). We introduce a character n-ensemble as an (n)-tuple of meromorphic one-forms with simple poles and purely imaginary periods, generating toric curves on (X) minus finitely many points. We establish on $X$ a correspondence between character $n$-ensembles and toric solutions to the ({\rm SU}(n+1)) system with finitely many cone singularities. Our approach not only broadens seminal solutions for up to two cone singularities on the Riemann sphere, as classified by Jost-Wang (Int. Math. Res. Not., (6):277-290, 2002) and Lin-Wei-Ye (Invent. Math., 190(1):169-207, 2012), but also advances beyond the limits of Lin-Yang-Zhong's existence theorems (J. Differential Geom., 114(2):337-391, 2020) by introducing a new solution class., Comment: 23 pages

We demonstrate that long-ranged terrestrial electric fields can be used to exclude or discover ultralight bosonic particles with extremely small charge, beyond that probed by astrophysics. Bound condensates of scalar millicharged particles can be rapidly produced near electrostatic generators or in the atmosphere. If such particles directly couple to the photon, they quickly short out such electrical activity. Instead, for interactions mediated by a kinetically-mixed dark photon, the effects of this condensate are suppressed depending on the size of the kinetic mixing, but may still be directly detected with precision electromagnetic sensors. Analogous condensates can also develop in other theories involving new long-ranged forces, such as those coupled to baryon and lepton number., Comment: 8 pages, 2 figures

Thermal boundary resistance (TBR) in semiconductor-on-diamond structure bottlenecks efficient heat dissipation in electronic devices. In this study, to reduce the TBR between GaN and diamond, surface-activated bonding with a hybrid SiOx-Ar ion source was applied to achieve an ultrathin interfacial layer. The simultaneous surface activation and slow deposition of the SiOx binder layer enabled precise control over layer thickness (2.5-5.3 nm) and formation of an amorphous heterogeneous nanostructure comprising a SiOx region between two inter-diffusion regions. Crucially, the 2.5-nm-thick interfacial layer achieved a TBR of 8.3 m2-W/GW, a record low for direct-bonded GaN/diamond interface. A remarkable feature is that the TBR is extremely sensitive to the interfacial thickness; rapidly increasing to 34 m2-K/GW on doubling the thickness to 5.3 nm. Theoretical analysis revealed the origin of this increase: a diamond/SiOx interdiffusion layer extend the vibrational frequency, far-exceeding that of crystalline diamond, which increases the lattice vibrational mismatch and suppresses phonon transmission.

Antiferromagnets have attracted significant attention in the field of magnonics, as promising candidates for ultralow-energy carriers for information transfer for future computing. The role of crystalline orientation distribution on magnon transport has received very little attention. In multiferroics such as BiFeO$_3$ the coupling between antiferromagnetic and polar order imposes yet another boundary condition on spin transport. Thus, understanding the fundamentals of spin transport in such systems requires a single domain, a single crystal. We show that through Lanthanum(La) substitution, a single ferroelectric domain can be engineered with a stable, single-variant spin cycloid, controllable by an electric field. The spin transport in such a single domain displays a strong anisotropy, arising from the underlying spin cycloid lattice. Our work shows a pathway to understand the fundamental origins of spin transport in such a single domain multiferroic., Comment: 15 pages, 9 figure

Thermal conductivity, a fundamental parameter characterizing thermal transport in solids, is typically determined by electron and phonon transport. Although other transport properties including electrical conductivity and thermoelectric conversion coefficients have material-specific values, it is known that thermal conductivity can be modulated artificially via phonon engineering techniques. Here, we demonstrate another way of artificially modulating the heat conduction in solids: magnonic thermal transport engineering. The time-domain thermoreflectance measurements using ferromagnetic metal/insulator junction systems reveal that the thermal conductivity of the ferromagnetic metals and interfacial thermal conductance vary significantly depending on the spatial distribution of nonequilibrium spin currents. Systematic measurements of the thermal transport properties with changing the boundary conditions for spin currents show that the observed thermal transport modulation stems from magnon origin. This observation unveils that magnons significantly contribute to the heat conduction even in ferromagnetic metals at room temperature, upsetting the conventional wisdom that the thermal conductivity mediated by magnons is very small in metals except at low temperatures. The magnonic thermal transport engineering offers a new principle and method for active thermal management.

Negative sampling has swiftly risen to prominence as a focal point of research, with wide-ranging applications spanning machine learning, computer vision, natural language processing, data mining, and recommender systems. This growing interest raises several critical questions: Does negative sampling really matter? Is there a general framework that can incorporate all existing negative sampling methods? In what fields is it applied? Addressing these questions, we propose a general framework that leverages negative sampling. Delving into the history of negative sampling, we trace the development of negative sampling through five evolutionary paths. We dissect and categorize the strategies used to select negative sample candidates, detailing global, local, mini-batch, hop, and memory-based approaches. Our review categorizes current negative sampling methods into five types: static, hard, GAN-based, Auxiliary-based, and In-batch methods, providing a clear structure for understanding negative sampling. Beyond detailed categorization, we highlight the application of negative sampling in various areas, offering insights into its practical benefits. Finally, we briefly discuss open problems and future directions for negative sampling., Comment: 20 pages, 11 figures

Interlayer stacking order has recently emerged as a unique degree of freedom to control crystal symmetry and physical properties in two-dimensional van der Waals (vdW) materials and heterostructures. By tuning the layer stacking pattern, symmetry-breaking and electric polarization can be created in otherwise non-polar crystals, whose polarization reversal depends on the interlayer sliding motion. Herein, we demonstrate that in a vdW layered ferroelectric, its existing polarization is closely coupled to the interlayer sliding driven by hydrostatic pressure. Through combined structural, electrical, vibrational characterizations, and theoretical calculations, we clearly map out the structural evolution of CuInP2S6 under pressure. A tendency towards a high polarization state is observed in the low-pressure region, followed by an interlayer-sliding-mediated phase transition from a monoclinic to a trigonal phase. Along the transformation pathway, the displacive-instable Cu ion serves as a pivot point that regulates the interlayer interaction in response to external pressure. The rich phase diagram of CuInP2S6, which is enabled by stacking orders, sheds light on the physics of vdW ferroelectricity and opens an alternative route to tailoring long-range order in vdW layered crystals., Comment: 22 pages, 4 figures