Search

Equivariant neural networks have shown great success in reinforcement learning, improving sample efficiency and generalization when there is symmetry in the task. However, in many problems, only approximate symmetry is present, which makes imposing exact symmetry inappropriate. Recently, approximately equivariant networks have been proposed for supervised classification and modeling physical systems. In this work, we develop approximately equivariant algorithms in reinforcement learning (RL). We define approximately equivariant MDPs and theoretically characterize the effect of approximate equivariance on the optimal Q function. We propose novel RL architectures using relaxed group convolutions and experiment on several continuous control domains and stock trading with real financial data. Our results demonstrate that approximate equivariance matches prior work when exact symmetries are present, and outperforms them when domains exhibit approximate symmetry. As an added byproduct of these techniques, we observe increased robustness to noise at test time., Comment: Preprint

GPT-4o is an autoregressive omni model that accepts as input any combination of text, audio, image, and video, and generates any combination of text, audio, and image outputs. It's trained end-to-end across text, vision, and audio, meaning all inputs and outputs are processed by the same neural network. GPT-4o can respond to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in conversation. It matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages, while also being much faster and 50\% cheaper in the API. GPT-4o is especially better at vision and audio understanding compared to existing models. In line with our commitment to building AI safely and consistent with our voluntary commitments to the White House, we are sharing the GPT-4o System Card, which includes our Preparedness Framework evaluations. In this System Card, we provide a detailed look at GPT-4o's capabilities, limitations, and safety evaluations across multiple categories, focusing on speech-to-speech while also evaluating text and image capabilities, and measures we've implemented to ensure the model is safe and aligned. We also include third-party assessments on dangerous capabilities, as well as discussion of potential societal impacts of GPT-4o's text and vision capabilities.

With the aim of studying subspaces in pointfree bitopology, we characterize extremal epimorphism in biframes and show that a smallest dense one always exists, providing an analogue of Isbell's Density Theorem. Further we study the functoriality of assigning to each biframe its lattice of subbilocales and its smallest dense subbilocale.

Many manipulation tasks require the robot to rearrange objects relative to one another. Such tasks can be described as a sequence of relative poses between parts of a set of rigid bodies. In this work, we propose MATCH POLICY, a simple but novel pipeline for solving high-precision pick and place tasks. Instead of predicting actions directly, our method registers the pick and place targets to the stored demonstrations. This transfers action inference into a point cloud registration task and enables us to realize nontrivial manipulation policies without any training. MATCH POLICY is designed to solve high-precision tasks with a key-frame setting. By leveraging the geometric interaction and the symmetries of the task, it achieves extremely high sample efficiency and generalizability to unseen configurations. We demonstrate its state-of-the-art performance across various tasks on RLBench benchmark compared with several strong baselines and test it on a real robot with six tasks., Comment: project url: https://haojhuang.github.io/match_page/

We utilize the Bruns-Lakser completion to introduce Bruns-Lakser towers of a meet-semilattice. This machinery enables us to develop various hierarchies inside the class of bounded distributive lattices, which measure $\kappa$-degrees of distributivity of bounded distributive lattices and their Dedekind-MacNeille completions. We also use Priestley duality to obtain a dual characterization of the resulting hierarchies. Among other things, this yields a natural generalization of Esakia's representation of Heyting lattices to proHeyting lattices.

We investigate a random geometric graph model introduced by Bonato and Janssen. The vertices are the points of a countable dense set $S$ in a (necessarily separable) normed vector space $X$, and each pair of points are joined independently with some fixed probability $p$ (with $0

Instabilities driven by pressure anisotropy play a critical role in modulating the energy transfer in space and astrophysical plasmas. For the first time, we simulate the evolution and saturation of the parallel proton firehose instability using a multi-fluid model without adding artificial viscosity. These simulations are performed using a 10-moment, multi-fluid model with local and gradient relaxation heat-flux closures in high-$\beta$ proton-electron plasmas. When these higher-order moments are included and pressure anisotropy is permitted to develop in all species, we find that the electrons have a significant impact on the saturation of the parallel proton firehose instability, modulating the proton pressure anisotropy as the instability saturates. Even for lower $\beta$s more relevant to heliospheric plasmas, we observe a pronounced electron energization in simulations using the gradient relaxation closure. Our results indicate that resolving the electron pressure anisotropy is important to correctly describe the behavior of multi-species plasma systems., Comment: 10 pages, 7 figures, under review in ApJ

3D Euclidean symmetry equivariant neural networks have demonstrated notable success in modeling complex physical systems. We introduce a framework for relaxed $E(3)$ graph equivariant neural networks that can learn and represent symmetry breaking within continuous groups. Building on the existing e3nn framework, we propose the use of relaxed weights to allow for controlled symmetry breaking. We show empirically that these relaxed weights learn the correct amount of symmetry breaking., Comment: Extended abstract presented at the Geometry-grounded Representation Learning and Generative Modeling Workshop (GRaM) at the 41st International Conference on Machine Learning, July 2024, Vienna, Austria

Estimating many-body effects that deviate from an independent particle approach, has long been a key research interest in condensed matter physics. Layered cuprates are prototypical systems, where electron-electron interactions are found to strongly affect the dynamics of single-particle excitations. It is however, still unclear how the electron correlations influence charge excitations, such as plasmons, which have been variously treated with either weak or strong correlation models. In this work, we demonstrate the hybridised nature of collective valence charge fluctuations leading to dispersing acoustic-like plasmons in hole-doped La$_{1.84}$Sr$_{0.16}$CuO$_{4}$ and electron-doped La$_{1.84}$Ce$_{0.16}$CuO$_{4}$ using the two-particle probe, resonant inelastic x-ray scattering. We then describe the plasmon dispersions in both systems, within both the weak mean-field Random Phase Approximation (RPA) and strong coupling $t$-$J$-$V$ models. The $t$-$J$-$V$ model, which includes the correlation effects implicitly, accurately describes the plasmon dispersions as resonant excitations outside the single-particle intra-band continuum. In comparison, a quantitative description of the plasmon dispersion in the RPA approach is obtained only upon explicit consideration of re-normalized electronic band parameters. Our comparative analysis shows that electron correlations significantly impact the low-energy plasmon excitations across the cuprate doping phase diagram, even at long wavelengths. Thus, complementary information on the evolution of electron correlations, influenced by the rich electronic phases in condensed matter systems, can be extracted through the study of two-particle charge response., Comment: 6 Figures

The QCD axion and axion-like particles are compelling candidates for galactic dark matter. Theoretically, axions can convert into photons in the presence of a strong external magnetic field, which means it is possible to search for them experimentally. One approach is to use radio telescopes with high-resolution spectrometers to look for axion-photon conversion in the magnetospheres of neutron stars. In this paper, we describe the results obtained using a novel approach where we used the Green Bank Telescope (GBT) to search for radio transients produced by collisions between neutron stars and dark matter clumps known as axion miniclusters. We used the VErsatile GBT Astronomical Spectrometer (VEGAS) and the X-band receiver (8 to 10 GHz) to observe the core of Andromeda. Our measurements are sensitive to axions with masses between 33 and 42 $\mu$eV with $\Delta$$m_a$ = 3.8$\times10^{-4}$ $\mu$eV. This paper gives a description of the search method we developed, including observation and analysis strategies. Given our analysis algorithm choices and the instrument sensitivity ($\sim$2 mJy in each spectral channel), we did not find any candidate signals greater than 5$\sigma$. We are currently implementing this search method in other spectral bands., Comment: 19 pages, 12 figures, accepted to PRD

While grasp detection is an important part of any robotic manipulation pipeline, reliable and accurate grasp detection in $SE(3)$ remains a research challenge. Many robotics applications in unstructured environments such as the home or warehouse would benefit a lot from better grasp performance. This paper proposes a novel framework for detecting $SE(3)$ grasp poses based on point cloud input. Our main contribution is to propose an $SE(3)$-equivariant model that maps each point in the cloud to a continuous grasp quality function over the 2-sphere $S^2$ using spherical harmonic basis functions. Compared with reasoning about a finite set of samples, this formulation improves the accuracy and efficiency of our model when a large number of samples would otherwise be needed. In order to accomplish this, we propose a novel variation on EquiFormerV2 that leverages a UNet-style encoder-decoder architecture to enlarge the number of points the model can handle. Our resulting method, which we name $\textit{OrbitGrasp}$, significantly outperforms baselines in both simulation and physical experiments., Comment: Conference on Robot Learning 2024

Recent work has shown diffusion models are an effective approach to learning the multimodal distributions arising from demonstration data in behavior cloning. However, a drawback of this approach is the need to learn a denoising function, which is significantly more complex than learning an explicit policy. In this work, we propose Equivariant Diffusion Policy, a novel diffusion policy learning method that leverages domain symmetries to obtain better sample efficiency and generalization in the denoising function. We theoretically analyze the $\mathrm{SO}(2)$ symmetry of full 6-DoF control and characterize when a diffusion model is $\mathrm{SO}(2)$-equivariant. We furthermore evaluate the method empirically on a set of 12 simulation tasks in MimicGen, and show that it obtains a success rate that is, on average, 21.9% higher than the baseline Diffusion Policy. We also evaluate the method on a real-world system to show that effective policies can be learned with relatively few training samples, whereas the baseline Diffusion Policy cannot., Comment: Conference on Robot Learning 2024, Oral Presentation

Controlling robots through natural language instructions in open-vocabulary scenarios is pivotal for enhancing human-robot collaboration and complex robot behavior synthesis. However, achieving this capability poses significant challenges due to the need for a system that can generalize from limited data to a wide range of tasks and environments. Existing methods rely on large, costly datasets and struggle with generalization. This paper introduces Grounded Equivariant Manipulation (GEM), a novel approach that leverages the generative capabilities of pre-trained vision-language models and geometric symmetries to facilitate few-shot and zero-shot learning for open-vocabulary robot manipulation tasks. Our experiments demonstrate GEM's high sample efficiency and superior generalization across diverse pick-and-place tasks in both simulation and real-world experiments, showcasing its ability to adapt to novel instructions and unseen objects with minimal data requirements. GEM advances a significant step forward in the domain of language-conditioned robot control, bridging the gap between semantic understanding and action generation in robotic systems.

Humans can imagine goal states during planning and perform actions to match those goals. In this work, we propose Imagination Policy, a novel multi-task key-frame policy network for solving high-precision pick and place tasks. Instead of learning actions directly, Imagination Policy generates point clouds to imagine desired states which are then translated to actions using rigid action estimation. This transforms action inference into a local generative task. We leverage pick and place symmetries underlying the tasks in the generation process and achieve extremely high sample efficiency and generalizability to unseen configurations. Finally, we demonstrate state-of-the-art performance across various tasks on the RLbench benchmark compared with several strong baselines.

A set $X$ is called Euclidean Ramsey if, for any $k$ and sufficiently large $n$, every $k$-colouring of $\mathbb{R}^n$ contains a monochromatic congruent copy of $X$. This notion was introduced by Erd\H{o}s, Graham, Montgomery, Rothschild, Spencer and Straus. They asked if a set is Ramsey if and only if it is spherical, meaning that it lies on the surface of a sphere. It is not too difficult to show that if a set is not spherical then it is not Euclidean Ramsey either, but the converse is very much open despite extensive research over the years. On the other hand, the block sets conjecture is a purely combinatorial, Hales-Jewett type of statement, concerning `blocks in large products', introduced by Leader, Russell and Walters. If true, the block sets conjecture would imply that every transitive set (a set whose symmetry group acts transitively) is Euclidean Ramsey. As for the question above, the block sets conjecture remains very elusive, being known only in a few cases. In this paper we show that the sizes of the blocks in the block sets conjecture cannot be bounded, even for templates over the alphabet of size $3$. We also show that for the first non-trivial template, namely $123$, the blocks may be taken to be of size $2$ (for any number of colours). This is best possible; all previous bounds were `tower-type' large., Comment: 10 pages

Many algorithms and observed phenomena in deep learning appear to be affected by parameter symmetries -- transformations of neural network parameters that do not change the underlying neural network function. These include linear mode connectivity, model merging, Bayesian neural network inference, metanetworks, and several other characteristics of optimization or loss-landscapes. However, theoretical analysis of the relationship between parameter space symmetries and these phenomena is difficult. In this work, we empirically investigate the impact of neural parameter symmetries by introducing new neural network architectures that have reduced parameter space symmetries. We develop two methods, with some provable guarantees, of modifying standard neural networks to reduce parameter space symmetries. With these new methods, we conduct a comprehensive experimental study consisting of multiple tasks aimed at assessing the effect of removing parameter symmetries. Our experiments reveal several interesting observations on the empirical impact of parameter symmetries; for instance, we observe linear mode connectivity between our networks without alignment of weight spaces, and we find that our networks allow for faster and more effective Bayesian neural network training. Our code is available at https://github.com/cptq/asymmetric-networks, Comment: NeurIPS 2024. v2: added / updated some citations. v3 added link to code, and some additional ablations

Completions play an important r\^ole for studying structure by supplying elements that in some sense ``ought to be." Among these, the Dedekind-MacNeille completion is of particular importance. In 1968 Janowitz provided necessary and sufficient conditions for it to be subfit or Boolean. Another natural separation axiom situated between the two is regularity. We explore similar characterizations of when closely related completions are subfit, regular, or Boolean. We are mainly interested in the Bruns-Lakser, ideal, and canonical completions, which are useful in pointfree topology since (unlike the Dedekind-MacNeille completion) they satisfy stronger forms of distributivity., Comment: 28 pages, 4 figures, 4 tables

Despite the advancements in learning governing differential equations from observations of dynamical systems, data-driven methods are often unaware of fundamental physical laws, such as frame invariance. As a result, these algorithms may search an unnecessarily large space and discover less accurate or overly complex equations. In this paper, we propose to leverage symmetry in automated equation discovery to compress the equation search space and improve the accuracy and simplicity of the learned equations. Specifically, we derive equivariance constraints from the time-independent symmetries of ODEs. Depending on the types of symmetries, we develop a pipeline for incorporating symmetry constraints into various equation discovery algorithms, including sparse regression and genetic programming. In experiments across diverse dynamical systems, our approach demonstrates better robustness against noise and recovers governing equations with significantly higher probability than baselines without symmetry. Our codebase is available at https://github.com/Rose-STL-Lab/symmetry-ode-discovery.

The recent advent of autonomous laboratories, coupled with algorithms for high-throughput screening and active learning, promises to accelerate materials discovery and innovation. As these autonomous systems grow in complexity, the demand for robust and efficient workflow management software becomes increasingly critical. In this paper, we introduce AlabOS, a general-purpose software framework for orchestrating experiments and managing resources, with an emphasis on automated laboratories for materials synthesis and characterization. AlabOS features a reconfigurable experiment workflow model and a resource reservation mechanism, enabling the simultaneous execution of varied workflows composed of modular tasks while eliminating conflicts between tasks. To showcase its capability, we demonstrate the implementation of AlabOS in a prototype autonomous materials laboratory, A-Lab, with around 3,500 samples synthesized over 1.5 years., Comment: 34 pages, 5 figures

The Simons Observatory (SO) is a cosmic microwave background (CMB) survey experiment that includes small-aperture telescopes (SATs) observing from an altitude of 5,200 m in the Atacama Desert in Chile. The SO SATs will cover six spectral bands between 27 and 280 GHz to search for primordial B-modes to a sensitivity of $\sigma(r)=0.002$, with quantified systematic errors well below this value. Each SAT is a self-contained cryogenic telescope with a 35$^\circ$ field of view, 42 cm diameter optical aperture, 40 K half-wave plate, 1 K refractive optics, and $<0.1$ K focal plane that holds $>12,000$ TES detectors. We describe the nominal design of the SATs and present details about the integration and testing for one operating at 93 and 145 GHz.

The intrinsic alignments (IA) of galaxies, regarded as a contaminant in weak lensing analyses, represents the correlation of galaxy shapes due to gravitational tidal interactions and galaxy formation processes. As such, understanding IA is paramount for accurate cosmological inferences from weak lensing surveys; however, one limitation to our understanding and mitigation of IA is expensive simulation-based modeling. In this work, we present a deep learning approach to emulate galaxy position-position ($\xi$), position-orientation ($\omega$), and orientation-orientation ($\eta$) correlation function measurements and uncertainties from halo occupation distribution-based mock galaxy catalogs. We find strong Pearson correlation values with the model across all three correlation functions and further predict aleatoric uncertainties through a mean-variance estimation training procedure. $\xi(r)$ predictions are generally accurate to $\leq10\%$. Our model also successfully captures the underlying signal of the noisier correlations $\omega(r)$ and $\eta(r)$, although with a lower average accuracy. We find that the model performance is inhibited by the stochasticity of the data, and will benefit from correlations averaged over multiple data realizations. Our code will be made open source upon journal publication., Comment: 15 pages, 6 figures, 1 table. Accepted at the Data-centric Machine Learning Research (DMLR) Workshop at ICLR 2024

We investigate whether the set of subfit elements of a distributive semilattice is an ideal. This question was raised by the second author at the BLAST conference in 2022. We show that in general it has a negative solution, however if the semilattice is a lattice, then the solution is positive. This is somewhat unexpected since, as we show, a semilattice is subfit if and only if so is its distributive lattice envelope., Comment: 14 pages, 1 figure

We describe the discrete Fourier transform (DFT) for a cyclic group when $p|N$ by factoring $x^N-1$ over finite fields and constructing the Fourier transform and its inverse using B\'{e}zout's identity for polynomials. For the symmetric group, in the modular case when $p|n!$ we construct the Peirce decomposition using central primitive orthogonal idempotents, yielding a change-of-basis matrix which generalizes the DFT. We compute the unitary DFT for the symmetric group over number fields containing sufficiently many square roots. For $n=3$, we compute the Galois group of the splitting field of the characteristic polynomial. All constructions are implemented in SageMath., Comment: 12 pages

Many physical and chemical processes in the condensed phase environment exhibit non-Markovian quantum dynamics. As such simulations are challenging on classical computers, we developed a variational quantum algorithm that is capable of simulating non-Markovian dynamics on NISQ devices. We used a quantum system linearly coupled to its harmonic bath as the model Hamiltonian. The non-Markovianity is captured by introducing auxiliary variables from the bath trajectories. With Monte Carlo sampling of the bath degrees of freedom, finite temperature dynamics is produced. We validated the algorithm on the simulator and demonstrated its performance on the IBM quantum device. The framework developed is naturally adapted to any anharmonic bath with non-linear coupling to the system, and is also well suited for simulating spin chain dynamics in a dissipative environment.

We introduce TopoX, a Python software suite that provides reliable and user-friendly building blocks for computing and machine learning on topological domains that extend graphs: hypergraphs, simplicial, cellular, path and combinatorial complexes. TopoX consists of three packages: TopoNetX facilitates constructing and computing on these domains, including working with nodes, edges and higher-order cells; TopoEmbedX provides methods to embed topological domains into vector spaces, akin to popular graph-based embedding algorithms such as node2vec; TopoModelx is built on top of PyTorch and offers a comprehensive toolbox of higher-order message passing functions for neural networks on topological domains. The extensively documented and unit-tested source code of TopoX is available under MIT license at https://pyt-team.github.io/.

We compare the performance of several popular spectrum fitting codes (Firefly, starlight, pyPipe3D and pPXF), and a deep-learning convolutional neural network (StarNet), in recovering known stellar population properties (mean stellar age, stellar metallicity, stellar mass-to-light ratio M*/L_r and the internal E(B-V)) of simulated galaxy spectra in optical wavelengths. Our mock spectra are constructed from star-formation histories from the IllustrisTNG100-1 simulation. These spectra mimic the Sloan Digital Sky Survey (SDSS) through a novel method of including the noise, sky residuals and emission lines taken directly from SDSS. We find that StarNet vastly outperforms all conventional codes in both speed and recovery of stellar population properties (error scatter < 0.08 dex, average biases < 0.02 dex for all tested quantities), but it requires an appropriate training set. Of the non-machine-learning codes, pPXF was a factor of 3-4 times faster than the other codes, and was the best in recovering stellar population properties (error scatter of < 0.11 dex, average biases < 0.08 dex). However, the errors and biases are strongly dependent on both true and predicted values of stellar age and metallicity, and signal-to-noise ratio. The biases of all codes can approach 0.15 dex in stellar ages, metallicities and log M*/L_r , but remain < 0.05 for E(B-V). Using unrealistic Gaussian noise in the construction of mock spectra will underestimate the errors in the metallicities by a factor of two or more, and mocks without emission lines will underestimate the errors in stellar age and M*/L_r by a factor of two., Comment: Accepted to MNRAS

Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions. Training a robotic agent to learn this sequence over many different starting conditions typically requires many iterations or demonstrations, especially in 3D environments. In this work, we propose Fourier Transporter (FourTran) which leverages the two-fold SE(d)xSE(d) symmetry in the pick-place problem to achieve much higher sample efficiency. FourTran is an open-loop behavior cloning method trained using expert demonstrations to predict pick-place actions on new environments. FourTran is constrained to incorporate symmetries of the pick and place actions independently. Our method utilizes a fiber space Fourier transformation that allows for memory-efficient construction. We test our proposed network on the RLbench benchmark and achieve state-of-the-art results across various tasks., Comment: ICLR 2024

We investigate whether general-domain large language models such as GPT-4 Turbo can perform risk stratification and predict post-operative outcome measures using a description of the procedure and a patient's clinical notes derived from the electronic health record. We examine predictive performance on 8 different tasks: prediction of ASA Physical Status Classification, hospital admission, ICU admission, unplanned admission, hospital mortality, PACU Phase 1 duration, hospital duration, and ICU duration. Few-shot and chain-of-thought prompting improves predictive performance for several of the tasks. We achieve F1 scores of 0.50 for ASA Physical Status Classification, 0.81 for ICU admission, and 0.86 for hospital mortality. Performance on duration prediction tasks were universally poor across all prompt strategies. Current generation large language models can assist clinicians in perioperative risk stratification on classification tasks and produce high-quality natural language summaries and explanations.

Incorporating geometric inductive biases into models can aid interpretability and generalization, but encoding to a specific geometric structure can be challenging due to the imposed topological constraints. In this paper, we theoretically and empirically characterize obstructions to training encoders with geometric latent spaces. We show that local optima can arise due to singularities (e.g. self-intersection) or due to an incorrect degree or winding number. We then discuss how normalizing flows can potentially circumvent these obstructions by defining multimodal variational distributions. Inspired by this observation, we propose a new flow-based model that maps data points to multimodal distributions over geometric spaces and empirically evaluate our model on 2 domains. We observe improved stability during training and a higher chance of converging to a homeomorphic encoder.

This letter reports the first detection of a periodic light curve whose modulation is unambiguously due to rotation in a polluted white dwarf. TESS observations of WD 2138-332, at a distance of 16.1 pc, reveal a 0.39 per cent amplitude modulation with a 6.19 h period. While this rotation is relatively rapid for isolated white dwarfs, it falls within the range of spin periods common to those with detectable magnetic fields, where WD 2138-332 is notably both metal-rich and weakly magnetic. Within the local 20 pc volume of white dwarfs, multi-sector TESS data find no significant periodicities among the remaining 16 polluted objects (five of which are also magnetic), whereas six of 23 magnetic and metal-free targets have light curves consistent with rotation periods between 0.7 and 35 h (three of which are new discoveries). This indicates the variable light curve of WD 2138-332 is primarily a result of magnetism, as opposed to an inhomogeneous distribution of metals. From 13 magnetic and metallic degenerates with acceptable TESS data, a single detection of periodicity suggests that polluted white dwarfs are not rotating as rapidly as their magnetic counterparts, and planet ingestion is thus unlikely to be a significant channel for rapid rotation., Comment: 5 pages, 4 figures, and 2 tables, accepted by MNRAS Letters

In this paper, we use Topological Data Analysis (TDA), a mathematical approach for studying data shape, to analyse Fast Radio Bursts (FRBs). Applying the Mapper algorithm, we visualise the topological structure of a large FRB sample. Our findings reveal three distinct FRB populations based on their inferred source properties, and show a robust structure indicating their morphology and energy. We also identify potential non-repeating FRBs that might become repeaters based on proximity in the Mapper graph. This work showcases TDA's promise in unraveling the origin and nature of FRBs., Comment: 8 pages, 3 figures, 2 tables

Data over non-Euclidean manifolds, often discretized as surface meshes, naturally arise in computer graphics and biological and physical systems. In particular, solutions to partial differential equations (PDEs) over manifolds depend critically on the underlying geometry. While graph neural networks have been successfully applied to PDEs, they do not incorporate surface geometry and do not consider local gauge symmetries of the manifold. Alternatively, recent works on gauge equivariant convolutional and attentional architectures on meshes leverage the underlying geometry but underperform in modeling surface PDEs with complex nonlinear dynamics. To address these issues, we introduce a new gauge equivariant architecture using nonlinear message passing. Our novel architecture achieves higher performance than either convolutional or attentional networks on domains with highly complex and nonlinear dynamics. However, similar to the non-mesh case, design trade-offs favor convolutional, attentional, or message passing networks for different tasks; we investigate in which circumstances our message passing method provides the most benefit., Comment: Accepted to NeurIPS 2023

Visual culture has long been deployed by actors across the political spectrum as tools of political mobilization, and have recently incorporated new communication tools, such as memes, GIFs, and emojis. In this study, we analyze the top-circulated Facebook memes relating to critical race theory (CRT) from May 2021 - May 2022 to investigate their visual and textual appeals. Using image clustering techniques and critical discourse analysis, we find that both pro- and anti-CRT memes deploy similar rhetorical tactics to make bifurcating arguments, most of which do not pertain to the academic formulations of CRT. Instead, these memes manipulate definitions of racism and antiracism to appeal to their respective audiences. We argue that labeling such discursive practices as simply a symptom of "post-truth" politics is a potentially unproductive stance. Instead, theorizing the knowledge-building practices of these memes through a lens of political epistemology allows us to understand how they produce meaning.

Modeling symmetry breaking is essential for understanding the fundamental changes in the behaviors and properties of physical systems, from microscopic particle interactions to macroscopic phenomena like fluid dynamics and cosmic structures. Thus, identifying sources of asymmetry is an important tool for understanding physical systems. In this paper, we focus on learning asymmetries of data using relaxed group convolutions. We provide both theoretical and empirical evidence that this flexible convolution technique allows the model to maintain the highest level of equivariance that is consistent with data and discover the subtle symmetry-breaking factors in various physical systems. We employ various relaxed group convolution architectures to uncover various symmetry-breaking factors that are interpretable and physically meaningful in different physical systems, including the phase transition of crystal structure, the isotropy and homogeneity breaking in turbulent flow, and the time-reversal symmetry breaking in pendulum systems.

Equivariant neural networks require explicit knowledge of the symmetry group. Automatic symmetry discovery methods aim to relax this constraint and learn invariance and equivariance from data. However, existing symmetry discovery methods are limited to simple linear symmetries and cannot handle the complexity of real-world data. We propose a novel generative model, Latent LieGAN (LaLiGAN), which can discover symmetries of nonlinear group actions. It learns a mapping from the data space to a latent space where the symmetries become linear and simultaneously discovers symmetries in the latent space. Theoretically, we show that our model can express nonlinear symmetries under some conditions about the group action. Experimentally, we demonstrate that our method can accurately discover the intrinsic symmetry in high-dimensional dynamical systems. LaLiGAN also results in a well-structured latent space that is useful for downstream tasks including equation discovery and long-term forecasting.

This paper presents the computational challenge on topological deep learning that was hosted within the ICML 2023 Workshop on Topology and Geometry in Machine Learning. The competition asked participants to provide open-source implementations of topological neural networks from the literature by contributing to the python packages TopoNetX (data processing) and TopoModelX (deep learning). The challenge attracted twenty-eight qualifying submissions in its two-month duration. This paper describes the design of the challenge and summarizes its main findings.

We consider correlators for the flux of energy and charge in the background of operators with large global $U(1)$ charge in conformal field theory (CFT). It has recently been shown that the corresponding Euclidean correlators generically admit a semiclassical description in terms of the effective field theory (EFT) for a conformal superfluid. We adapt the semiclassical description to Lorentzian observables and compute the leading large charge behavior of the flux correlators in general $U(1)$ symmetric CFTs. We discuss the regime of validity of the large charge EFT for these Lorentzian observables and the subtleties in extending the EFT approach to subleading corrections. We also consider the Wilson-Fisher fixed point in $d=4-\epsilon$ dimensions, which offers a specific weakly coupled realization of the general setup, where the subleading corrections can be systematically computed without relying on an EFT., Comment: 33 pages, 8 figures

In this work, we investigate how the complex structure found in solar wind proton velocity distribution functions (VDFs), rather than the commonly assumed two-component bi-Maxwellian structure, affects the onset and evolution of parallel-propagating microinstabilities. We use the Arbitrary Linear Plasma Solver (ALPS), a numerical dispersion solver, to find the real frequencies and growth/damping rates of the Alfv\'en modes calculated for proton VDFs extracted from Wind spacecraft observations of the solar wind. We compare this wave behavior to that obtained by applying the same procedure to core-and-beam bi-Maxwellian fits of the Wind proton VDFs. We find several significant differences in the plasma waves obtained for the extracted data and bi-Maxwellian fits, including a strong dependence of the growth/damping rate on the shape of the VDF. By application of the quasilinear diffusion operator to these VDFs, we pinpoint resonantly interacting regions in velocity space where differences in VDF structure significantly affect the wave growth and damping rates. This demonstration of the sensitive dependence of Alfv\'en mode behavior on VDF structure may explain why the Alfv\'en ion-cyclotron instability thresholds predicted by linear theory for bi-Maxwellian models of solar wind proton background VDFs do not entirely constrain spacecraft observations of solar wind proton VDFs, such as those made by the Wind spacecraft., Comment: 11 pages, 4 figures, 1 table. To be published in The Astrophysical Journal

Robotic pick and place tasks are symmetric under translations and rotations of both the object to be picked and the desired place pose. For example, if the pick object is rotated or translated, then the optimal pick action should also rotate or translate. The same is true for the place pose; if the desired place pose changes, then the place action should also transform accordingly. A recently proposed pick and place framework known as Transporter Net captures some of these symmetries, but not all. This paper analytically studies the symmetries present in planar robotic pick and place and proposes a method of incorporating equivariant neural models into Transporter Net in a way that captures all symmetries. The new model, which we call Equivariant Transporter Net, is equivariant to both pick and place symmetries and can immediately generalize pick and place knowledge to different pick and place poses. We evaluate the new model empirically and show that it is much more sample efficient than the non-symmetric version, resulting in a system that can imitate demonstrated pick and place behavior using very few human demonstrations on a variety of imitation learning tasks., Comment: International Journal of Robotics Research. arXiv admin note: substantial text overlap with arXiv:2202.09400

We develop a hierarchy of semilattice bases (S-bases) for frames. For a given (unbounded) meet-semilattice $A$, we analyze the interval in the coframe of sublocales of the frame of downsets of $A$ formed by all frames with the S-base $A$. We give an explicit description of the nuclei associated with these sublocales. We study various degrees of completeness of $A$, which generalize the concepts of extremally disconnected and basically disconnected frames. We also introduce the concepts of D-bases and L-bases, as well as their bounded counterparts, and show how our results specialize and sharpen in these cases. Classic examples that are covered by our approach include zero-dimensional, completely regular, and coherent frames, allowing us to provide a new perspective on these well-studied classes of frames, as well as their spatial counterparts.

The EU AI Act is the proposed EU legislation concerning AI systems. This paper identifies several categories of the AI Act. Based on this categorization, a questionnaire is developed that serves as a tool to offer insights by creating quantitative data. Analysis of the data shows various challenges for organizations in different compliance categories. The influence of organization characteristics, such as size and sector, is examined to determine the impact on compliance. The paper will also share qualitative data on which questions were prevalent among respondents, both on the content of the AI Act as the application. The paper concludes by stating that there is still room for improvement in terms of compliance with the AIA and refers to a related project that examines a solution to help these organizations.

Link prediction is a crucial task in graph machine learning with diverse applications. We explore the interplay between node attributes and graph topology and demonstrate that incorporating pre-trained node attributes improves the generalization power of link prediction models. Our proposed method, UPNA (Unsupervised Pre-training of Node Attributes), solves the inductive link prediction problem by learning a function that takes a pair of node attributes and predicts the probability of an edge, as opposed to Graph Neural Networks (GNN), which can be prone to topological shortcuts in graphs with power-law degree distribution. In this manner, UPNA learns a significant part of the latent graph generation mechanism since the learned function can be used to add incoming nodes to a growing graph. By leveraging pre-trained node attributes, we overcome observational bias and make meaningful predictions about unobserved nodes, surpassing state-of-the-art performance (3X to 34X improvement on benchmark datasets). UPNA can be applied to various pairwise learning tasks and integrated with existing link prediction models to enhance their generalizability and bolster graph generative models., Comment: 17 pages, 6 figures

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These changes, which preserve distance, encompass isometric transformations such as translations, rotations, and reflections, collectively known as the Euclidean group. In this work, we delve into the design of improved learning algorithms for reinforcement learning and planning tasks that possess Euclidean group symmetry. We put forth a theory on that unify prior work on discrete and continuous symmetry in reinforcement learning, planning, and optimal control. Algorithm side, we further extend the 2D path planning with value-based planning to continuous MDPs and propose a pipeline for constructing equivariant sampling-based planning algorithms. Our work is substantiated with empirical evidence and illustrated through examples that explain the benefits of equivariance to Euclidean symmetry in tackling natural control problems., Comment: Preprint. Website: http://lfzhao.com/SymCtrl

Learning about the three-dimensional world from two-dimensional images is a fundamental problem in computer vision. An ideal neural network architecture for such tasks would leverage the fact that objects can be rotated and translated in three dimensions to make predictions about novel images. However, imposing SO(3)-equivariance on two-dimensional inputs is difficult because the group of three-dimensional rotations does not have a natural action on the two-dimensional plane. Specifically, it is possible that an element of SO(3) will rotate an image out of plane. We show that an algorithm that learns a three-dimensional representation of the world from two dimensional images must satisfy certain geometric consistency properties which we formulate as SO(2)-equivariance constraints. We use the induced and restricted representations of SO(2) on SO(3) to construct and classify architectures which satisfy these geometric consistency constraints. We prove that any architecture which respects said consistency constraints can be realized as an instance of our construction. We show that three previously proposed neural architectures for 3D pose prediction are special cases of our construction. We propose a new algorithm that is a learnable generalization of previously considered methods. We test our architecture on three pose predictions task and achieve SOTA results on both the PASCAL3D+ and SYMSOL pose estimation tasks.

This paper reports the ULTRACAM discovery of dipolar surface spots in two cool magnetic white dwarfs with Balmer emission lines, while a third system exhibits a single spot, similar to the prototype GD 356. The light curves are modeled with simple, circular, isothermal dark spots, yielding relatively large regions with minimum angular radii of 20 deg. For those stars with two light curve minima, the dual spots are likely observed at high inclination (or colatitude), however, identical and antipodal spots cannot simultaneously reproduce both the distinct minima depths and the phases of the light curve maxima. The amplitudes of the multi-band photometric variability reported here are all several times larger than that observed in the prototype GD 356; nevertheless, all DAHe stars with available data appear to have light curve amplitudes that increase toward the blue in correlated ratios. This behavior is consistent with cool spots that produce higher contrasts at shorter wavelengths, with remarkably similar spectral properties given the diversity of magnetic field strengths and rotation rates. These findings support the interpretation that some magnetic white dwarfs generate intrinsic chromospheres as they cool, and that no external source is responsible for the observed temperature inversion. Spectroscopic time-series data for DAHe stars is paramount for further characterization, where it is important to obtain well-sampled data, and consider wavelength shifts, equivalent widths, and spectropolarimetry., Comment: 9 pages, 5 figures, 3 tables, accepted to MNRAS

We develop an Empirical Bayes grading scheme that balances the informativeness of the assigned grades against the expected frequency of ranking errors. Applying the method to a massive correspondence experiment, we grade the racial biases of 97 U.S. employers. A four-grade ranking limits the chances that a randomly selected pair of firms is mis-ranked to 5% while explaining nearly half of the variation in firms' racial contact gaps. The grades are presented alongside measures of uncertainty about each firm's contact gap in an accessible rubric that is easily adapted to other settings where ranks and levels are of simultaneous interest.

Imitation learning of robot policies from few demonstrations is crucial in open-ended applications. We propose a new method, Interaction Warping, for learning SE(3) robotic manipulation policies from a single demonstration. We infer the 3D mesh of each object in the environment using shape warping, a technique for aligning point clouds across object instances. Then, we represent manipulation actions as keypoints on objects, which can be warped with the shape of the object. We show successful one-shot imitation learning on three simulated and real-world object re-arrangement tasks. We also demonstrate the ability of our method to predict object meshes and robot grasps in the wild., Comment: CoRL 2023

White dwarfs stars are known to be polluted by their active planetary systems, but little attention has been paid to the accretion of wind from low-mass companions. The capture of stellar or substellar wind by white dwarfs is one of few methods available to astronomers which can assess mass-loss rates from unevolved stars and brown dwarfs, and the only known method to extract their chemical compositions. In this work, four white dwarfs with closely-orbiting, L-type brown dwarf companions are studied to place limits on the accretion of a substellar wind, with one case of a detection, and at an extremely non-solar abundance $m_{\rm Na}/m_{\rm Ca}>900$. The mass-loss rates and upper limits are tied to accretion in the white dwarfs, based on limiting cases for how the wind is captured, and compared with known cases of wind pollution from close M dwarf companions, which manifest in solar proportions between all elements detected. For wind captured in a Bondi-Hoyle flow, mass-loss limits $\dot M\lesssim 5\times10^{-17}$ M$_\odot$ yr$^{-1}$ are established for three L dwarfs, while for M dwarfs polluting their hosts, winds in the range $10^{-13} - 10^{-16}$ M$_\odot$ yr$^{-1}$ are found. The latter compares well with the $\dot M\sim 10^{-13} - 10^{-15}$ M$_\odot$ yr$^{-1}$ estimates obtained for nearby, isolated M dwarfs using Ly$\alpha$ to probe their astropsheres. These results demonstrate that white dwarfs are highly-sensitive stellar and substellar wind detectors, where further work on the actual captured wind flow is needed., Comment: 13 pages, 2 figures, 1 table, accepted to MNRAS

Real-world grasp detection is challenging due to the stochasticity in grasp dynamics and the noise in hardware. Ideally, the system would adapt to the real world by training directly on physical systems. However, this is generally difficult due to the large amount of training data required by most grasp learning models. In this paper, we note that the planar grasp function is $\SE(2)$-equivariant and demonstrate that this structure can be used to constrain the neural network used during learning. This creates an inductive bias that can significantly improve the sample efficiency of grasp learning and enable end-to-end training from scratch on a physical robot with as few as $600$ grasp attempts. We call this method Symmetric Grasp learning (SymGrasp) and show that it can learn to grasp ``from scratch'' in less that 1.5 hours of physical robot time., Comment: Accepted in Autonomous Robot. arXiv admin note: substantial text overlap with arXiv:2202.09468

The WARP Reactor Concept promises orders of magnitude increase of intense ion beam energies and respective radiation yields at a fraction of the size and cost over existing z-pinch class accelerators allowing the economically viable study of new Relativistic High Energy Density Physics regimes for probing the intersection between General Relativity and Quantum Field Theory along with game-changing direct applications from rep-rated Magnetized Liner Inertial Fusion devices for energy production and advanced propulsion to multi-pulse compact flash x-ray/neutron radiography sources for assessing nuclear weapons stockpile. An overview of the WARP Reactor Concept is presented., Comment: 12 pages, 26 figures, 9 tables. Submitting to Physical Review Accelerators and Beams