Search

We study the electronic band structure and optical response of a hybrid model, a $\alpha-\mathcal{T}_3$ model featuring a $\sqrt{3}\times\sqrt{3}$ Kekul\'e pattern modulation. Such a hybrid system may result from the depositing of adatoms in a hexagonal lattice, where the two sublattices are displaced in the perpendicular direction, like in germanene and silicene. We derive analytical expressions for the energy dispersion and the eigenfunctions using a tight-binding approximation of nearest-neighbor hopping electrons. The energy spectrum consists of a double-cone structure with Dirac points at zero momentum caused by Brillouin zone folding and a doubly degenerate flat band resulting from destructive quantum interference effects. Furthermore, we study the spectrum of intraband and interband transitions through the joint density of states, the optical conductivity, and the Drude spectral weight. We find new conductivity terms resulting from the opening of intervalley channels that are absent in the $\alpha-\mathcal{T}_3$ model and manifest themselves as van Hove singularities in the optical response. In particular, we identify an absorption window related to intervalley transport, which serves as a viable signature for detecting Kekul\'e periodicity in two-dimensional materials., Comment: 10 pages, 7 figures

The rapid development of Wi-Fi technologies in recent years has caused a significant increase in the traffic usage. Hence, knowledge obtained from Wi-Fi network measurements can be helpful for a more efficient network management. In this paper, we propose a methodology to predict future values of some specific network metrics (e.g. traffic load, transmission failures, etc.). These predictions may be useful for improving the network performance. After data collection and preprocessing, the correlation between each target access point (AP) and its neighbouring APs is estimated. According to these correlations, either an only-temporal or a spatio-temporal based prediction is done. To evaluate the proposed methodology, real measurements are collected from 100 APs deployed in different university buildings for 3 months. Deep Learning (DL) methods (i.e. Convolutional Neural Network (CNN), Simple Recurrent Neural Network (SRNN), Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), Transformer) are evaluated and compared for both temporal and spatio-temporal based predictions. Moreover, a hybrid prediction methodology is proposed using a spatial processing based on CNN and a temporal prediction based on RNN. The proposed hybrid methodology provides an improvement in the prediction accuracy at expenses of a slight increase in the Training Computational Time (TCT) and negligible in Prediction Computational Time (PCT)., Comment: 18 pages, 6 figures

The increase in the demand for eXtended Reality (XR)/Virtual Reality (VR) services in the recent years, poses a great challenge for Wi-Fi networks to maintain the strict latency requirements. In VR over Wi-Fi, latency is a significant issue. In fact, VR users expect instantaneous responses to their interactions, and any noticeable delay can disrupt user experience. Such disruptions can cause motion sickness, and users might end up quitting the service. Differentiating interactive VR traffic from Non-VR traffic within a Wi-Fi network can aim to decrease latency for VR users and improve Wi-Fi Quality of Service (QoS) with giving priority to VR users in the access point (AP) and efficiently handle VR traffic. In this paper, we propose a machine learning-based approach for identifying interactive VR traffic in a Cloud-Edge VR scenario. The correlation between downlink and uplink is crucial in our study. First, we extract features from single-user traffic characteristics and then, we compare six common classification techniques (i.e., Logistic Regression, Support Vector Machines, k-Nearest Neighbors, Decision Trees, Random Forest, and Naive Bayes). For each classifier, a process of hyperparameter tuning and feature selection, namely permutation importance is applied. The model created is evaluated using datasets generated by different VR applications, including both single and multi-user cases. Then, a Wi-Fi network simulator is used to analyze the VR traffic identification and prioritization QoS improvements. Our simulation results show that we successfully reduce VR traffic delays by a factor of 4.2x compared to scenarios without prioritization, while incurring only a 2.3x increase in delay for background (BG) traffic related to Non-VR services., Comment: 19 pages, 6 figures

The livestock industry faces several challenges, including labor-intensive management, the threat of predators and environmental sustainability concerns. Therefore, this paper explores the integration of quadruped robots in extensive livestock farming as a novel application of field robotics. The SELF-AIR project, an acronym for Supporting Extensive Livestock Farming with the use of Autonomous Intelligent Robots, exemplifies this innovative approach. Through advanced sensors, artificial intelligence, and autonomous navigation systems, these robots exhibit remarkable capabilities in navigating diverse terrains, monitoring large herds, and aiding in various farming tasks. This work provides insight into the SELF-AIR project, presenting the lessons learned., Comment: 5 pages, 3 figures

Weather forecasts are fundamentally uncertain, so predicting the range of probable weather scenarios is crucial for important decisions, from warning the public about hazardous weather, to planning renewable energy use. Here, we introduce GenCast, a probabilistic weather model with greater skill and speed than the top operational medium-range weather forecast in the world, the European Centre for Medium-Range Forecasts (ECMWF)'s ensemble forecast, ENS. Unlike traditional approaches, which are based on numerical weather prediction (NWP), GenCast is a machine learning weather prediction (MLWP) method, trained on decades of reanalysis data. GenCast generates an ensemble of stochastic 15-day global forecasts, at 12-hour steps and 0.25 degree latitude-longitude resolution, for over 80 surface and atmospheric variables, in 8 minutes. It has greater skill than ENS on 97.4% of 1320 targets we evaluated, and better predicts extreme weather, tropical cyclones, and wind power production. This work helps open the next chapter in operational weather forecasting, where critical weather-dependent decisions are made with greater accuracy and efficiency., Comment: Main text 11 pages, Appendices 76 pages

General circulation models (GCMs) are the foundation of weather and climate prediction. GCMs are physics-based simulators which combine a numerical solver for large-scale dynamics with tuned representations for small-scale processes such as cloud formation. Recently, machine learning (ML) models trained on reanalysis data achieved comparable or better skill than GCMs for deterministic weather forecasting. However, these models have not demonstrated improved ensemble forecasts, or shown sufficient stability for long-term weather and climate simulations. Here we present the first GCM that combines a differentiable solver for atmospheric dynamics with ML components, and show that it can generate forecasts of deterministic weather, ensemble weather and climate on par with the best ML and physics-based methods. NeuralGCM is competitive with ML models for 1-10 day forecasts, and with the European Centre for Medium-Range Weather Forecasts ensemble prediction for 1-15 day forecasts. With prescribed sea surface temperature, NeuralGCM can accurately track climate metrics such as global mean temperature for multiple decades, and climate forecasts with 140 km resolution exhibit emergent phenomena such as realistic frequency and trajectories of tropical cyclones. For both weather and climate, our approach offers orders of magnitude computational savings over conventional GCMs. Our results show that end-to-end deep learning is compatible with tasks performed by conventional GCMs, and can enhance the large-scale physical simulations that are essential for understanding and predicting the Earth system., Comment: 92 pages, 54 figures. Nature (2024)

WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting.

This work aims at constraining the size, shape, and geometric albedo of the dwarf planet candidate 2002 MS4 through the analysis of nine stellar occultation events. Using multichord detection, we also studied the object's topography by analyzing the obtained limb and the residuals between observed chords and the best-fitted ellipse. We predicted and organized the observational campaigns of nine stellar occultations by 2002 MS4 between 2019 and 2022, resulting in two single-chord events, four double-chord detections, and three events with three to up to sixty-one positive chords. Using 13 selected chords from the 8 August 2020 event, we determined the global elliptical limb of 2002 MS4. The best-fitted ellipse, combined with the object's rotational information from the literature, constrains the object's size, shape, and albedo. Additionally, we developed a new method to characterize topography features on the object's limb. The global limb has a semi-major axis of 412 $\pm$ 10 km, a semi-minor axis of 385 $\pm$ 17 km, and the position angle of the minor axis is 121 $^\circ$ $\pm$ 16$^\circ$. From this instantaneous limb, we obtained 2002 MS4's geometric albedo and the projected area-equivalent diameter. Significant deviations from the fitted ellipse in the northernmost limb are detected from multiple sites highlighting three distinct topographic features: one 11 km depth depression followed by a 25$^{+4}_{-5}$ km height elevation next to a crater-like depression with an extension of 322 $\pm$ 39 km and 45.1 $\pm$ 1.5 km deep. Our results present an object that is $\approx$138 km smaller in diameter than derived from thermal data, possibly indicating the presence of a so-far unknown satellite. However, within the error bars, the geometric albedo in the V-band agrees with the results published in the literature, even with the radiometric-derived albedo.

Symbolic anchoring is a crucial problem in the field of robotics, as it enables robots to obtain symbolic knowledge from the perceptual information acquired through their sensors. In cognitive-based robots, this process of processing sub-symbolic data from real-world sensors to obtain symbolic knowledge is still an open problem. To address this issue, this paper presents SAILOR, a framework for providing symbolic anchoring in the ROS 2 ecosystem. SAILOR aims to maintain the link between symbolic data and perceptual data in real robots over time, increasing the intelligent behavior of robots. It provides a semantic world modeling approach using two deep learning-based sub-symbolic robotic skills: object recognition and matching function. The object recognition skill allows the robot to recognize and identify objects in its environment, while the matching function enables the robot to decide if new perceptual data corresponds to existing symbolic data. This paper provides a description of the proposed method and the development of the framework, as well as its integration in MERLIN2 (a hybrid cognitive architecture fully functional in robots running ROS 2)., Comment: 16 pages, 5 figures, 7 tables, 3 algorithms, Submitted to Scientific Reports

Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but cannot directly use historical weather data to improve the underlying model. We introduce a machine learning-based method called "GraphCast", which can be trained directly from reanalysis data. It predicts hundreds of weather variables, over 10 days at 0.25 degree resolution globally, in under one minute. We show that GraphCast significantly outperforms the most accurate operational deterministic systems on 90% of 1380 verification targets, and its forecasts support better severe event prediction, including tropical cyclones, atmospheric rivers, and extreme temperatures. GraphCast is a key advance in accurate and efficient weather forecasting, and helps realize the promise of machine learning for modeling complex dynamical systems., Comment: GraphCast code and trained weights are available at: https://github.com/deepmind/graphcast

Simulating rigid collisions among arbitrary shapes is notoriously difficult due to complex geometry and the strong non-linearity of the interactions. While graph neural network (GNN)-based models are effective at learning to simulate complex physical dynamics, such as fluids, cloth and articulated bodies, they have been less effective and efficient on rigid-body physics, except with very simple shapes. Existing methods that model collisions through the meshes' nodes are often inaccurate because they struggle when collisions occur on faces far from nodes. Alternative approaches that represent the geometry densely with many particles are prohibitively expensive for complex shapes. Here we introduce the Face Interaction Graph Network (FIGNet) which extends beyond GNN-based methods, and computes interactions between mesh faces, rather than nodes. Compared to learned node- and particle-based methods, FIGNet is around 4x more accurate in simulating complex shape interactions, while also 8x more computationally efficient on sparse, rigid meshes. Moreover, FIGNet can learn frictional dynamics directly from real-world data, and can be more accurate than analytical solvers given modest amounts of training data. FIGNet represents a key step forward in one of the few remaining physical domains which have seen little competition from learned simulators, and offers allied fields such as robotics, graphics and mechanical design a new tool for simulation and model-based planning.

Noble metals break preferably exposing (111)-oriented surfaces, that host Shockley type surface states (SSs). Nevertheless, the relevance of SSs on the electrical properties of gold-based molecular junctions has not been explored in detail yet. Here, we present ab initio simulations that show how the gold (111) SS, that lies approximately 0.5 eV below the Fermi energy, is key to determining correctly the electrical and thermoelectric response of the above junctions. We show how the ability to shift in a controlled way the energy position of gold SS enables us to tune the electrical and thermoelectric response of gold molecular junctions. We also show that gold's SS appears in our simulations only if the 5d orbitals are included explicitly in the valence shell. To illustrate this behaviour, we discuss in detail Benzenediamine (BDA) and Benzenedicarbonitrile (BDCN) gold (111) junctions.

TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many production models at Google use TF-GNN, and it has been recently released as an open source project. In this paper we describe the TF-GNN data model, its Keras message passing API, and relevant capabilities such as graph sampling and distributed training.

Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks. In this paper, we describe a pre-training technique based on denoising that achieves a new state-of-the-art in molecular property prediction by utilizing large datasets of 3D molecular structures at equilibrium to learn meaningful representations for downstream tasks. Relying on the well-known link between denoising autoencoders and score-matching, we show that the denoising objective corresponds to learning a molecular force field -- arising from approximating the Boltzmann distribution with a mixture of Gaussians -- directly from equilibrium structures. Our experiments demonstrate that using this pre-training objective significantly improves performance on multiple benchmarks, achieving a new state-of-the-art on the majority of targets in the widely used QM9 dataset. Our analysis then provides practical insights into the effects of different factors -- dataset sizes, model size and architecture, and the choice of upstream and downstream datasets -- on pre-training.

Designing physical artifacts that serve a purpose - such as tools and other functional structures - is central to engineering as well as everyday human behavior. Though automating design has tremendous promise, general-purpose methods do not yet exist. Here we explore a simple, fast, and robust approach to inverse design which combines learned forward simulators based on graph neural networks with gradient-based design optimization. Our approach solves high-dimensional problems with complex physical dynamics, including designing surfaces and tools to manipulate fluid flows and optimizing the shape of an airfoil to minimize drag. This framework produces high-quality designs by propagating gradients through trajectories of hundreds of steps, even when using models that were pre-trained for single-step predictions on data substantially different from the design tasks. In our fluid manipulation tasks, the resulting designs outperformed those found by sampling-based optimization techniques. In airfoil design, they matched the quality of those obtained with a specialized solver. Our results suggest that despite some remaining challenges, machine learning-based simulators are maturing to the point where they can support general-purpose design optimization across a variety of domains., Comment: First three authors contributed equally

Turbulence simulation with classical numerical solvers requires high-resolution grids to accurately resolve dynamics. Here we train learned simulators at low spatial and temporal resolutions to capture turbulent dynamics generated at high resolution. We show that our proposed model can simulate turbulent dynamics more accurately than classical numerical solvers at the comparably low resolutions across various scientifically relevant metrics. Our model is trained end-to-end from data and is capable of learning a range of challenging chaotic and turbulent dynamics at low resolution, including trajectories generated by the state-of-the-art Athena++ engine. We show that our simpler, general-purpose architecture outperforms various more specialized, turbulence-specific architectures from the learned turbulence simulation literature. In general, we see that learned simulators yield unstable trajectories; however, we show that tuning training noise and temporal downsampling solves this problem. We also find that while generalization beyond the training distribution is a challenge for learned models, training noise, added loss constraints, and dataset augmentation can help. Broadly, we conclude that our learned simulator outperforms traditional solvers run on coarser grids, and emphasize that simple design choices can offer stability and robust generalization.

In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state which satisfies them. Here we present a framework for constraint-based learned simulation, where a scalar constraint function is implemented as a graph neural network, and future predictions are computed by solving the optimization problem defined by the learned constraint. Our model achieves comparable or better accuracy to top learned simulators on a variety of challenging physical domains, and offers several unique advantages. We can improve the simulation accuracy on a larger system by applying more solver iterations at test time. We also can incorporate novel hand-designed constraints at test time and simulate new dynamics which were not present in the training data. Our constraint-based framework shows how key techniques from traditional simulation and numerical methods can be leveraged as inductive biases in machine learning simulators.

Solving for the lowest energy eigenstate of the many-body Schrodinger equation is a cornerstone problem that hinders understanding of a variety of quantum phenomena. The difficulty arises from the exponential nature of the Hilbert space which casts the governing equations as an eigenvalue problem of exponentially large, structured matrices. Variational methods approach this problem by searching for the best approximation within a lower-dimensional variational manifold. In this work we use graph neural networks to define a structured variational manifold and optimize its parameters to find high quality approximations of the lowest energy solutions on a diverse set of Heisenberg Hamiltonians. Using graph networks we learn distributed representations that by construction respect underlying physical symmetries of the problem and generalize to problems of larger size. Our approach achieves state-of-the-art results on a set of quantum many-body benchmark problems and works well on problems whose solutions are not positive-definite. The discussed techniques hold promise of being a useful tool for studying quantum many-body systems and providing insights into optimization and implicit modeling of exponentially-sized objects., Comment: 19 pages, 9 figures

Travel-time prediction constitutes a task of high importance in transportation networks, with web mapping services like Google Maps regularly serving vast quantities of travel time queries from users and enterprises alike. Further, such a task requires accounting for complex spatiotemporal interactions (modelling both the topological properties of the road network and anticipating events -- such as rush hours -- that may occur in the future). Hence, it is an ideal target for graph representation learning at scale. Here we present a graph neural network estimator for estimated time of arrival (ETA) which we have deployed in production at Google Maps. While our main architecture consists of standard GNN building blocks, we further detail the usage of training schedule methods such as MetaGradients in order to make our model robust and production-ready. We also provide prescriptive studies: ablating on various architectural decisions and training regimes, and qualitative analyses on real-world situations where our model provides a competitive edge. Our GNN proved powerful when deployed, significantly reducing negative ETA outcomes in several regions compared to the previous production baseline (40+% in cities like Sydney)., Comment: To appear at CIKM 2021 (Applied Research Track). 10 pages, 4 figures

Effectively and efficiently deploying graph neural networks (GNNs) at scale remains one of the most challenging aspects of graph representation learning. Many powerful solutions have only ever been validated on comparatively small datasets, often with counter-intuitive outcomes -- a barrier which has been broken by the Open Graph Benchmark Large-Scale Challenge (OGB-LSC). We entered the OGB-LSC with two large-scale GNNs: a deep transductive node classifier powered by bootstrapping, and a very deep (up to 50-layer) inductive graph regressor regularised by denoising objectives. Our models achieved an award-level (top-3) performance on both the MAG240M and PCQM4M benchmarks. In doing so, we demonstrate evidence of scalable self-supervised graph representation learning, and utility of very deep GNNs -- both very important open issues. Our code is publicly available at: https://github.com/deepmind/deepmind-research/tree/master/ogb_lsc., Comment: To appear at KDD Cup 2021. 13 pages, 3 figures. All authors contributed equally

In this paper we show that simple noise regularisation can be an effective way to address GNN oversmoothing. First we argue that regularisers addressing oversmoothing should both penalise node latent similarity and encourage meaningful node representations. From this observation we derive "Noisy Nodes", a simple technique in which we corrupt the input graph with noise, and add a noise correcting node-level loss. The diverse node level loss encourages latent node diversity, and the denoising objective encourages graph manifold learning. Our regulariser applies well-studied methods in simple, straightforward ways which allow even generic architectures to overcome oversmoothing and achieve state of the art results on quantum chemistry tasks, and improve results significantly on Open Graph Benchmark (OGB) datasets. Our results suggest Noisy Nodes can serve as a complementary building block in the GNN toolkit., Comment: ICLR 2022 Camera Ready

The possibility of suddenly ionized molecules undergoing extremely fast electron hole dynamics prior to significant structural change was first recognized more than 20 years ago and termed charge migration. The accurate probing of ultrafast electron hole dynamics requires measurements that have both sufficient temporal resolution and can detect the localization of a specific hole within the molecule. We report an investigation of the dynamics of inner valence hole states in isopropanol where we use an x-ray pump/x-ray probe experiment, with site and state-specific probing of a transient hole state localized near the oxygen atom in the molecule, together with an ab initio theoretical treatment. We record the signature of transient hole dynamics and make the first observation of dynamics driven by frustrated Auger-Meitner transitions. We verify that the hole lifetime is consistent with our theoretical prediction. This state-specific measurement paves the way to widespread application for observations of transient hole dynamics localized in space and time in molecules and thus to charge transfer phenomena that are fundamental in chemical and material physics.

Mesh-based simulations are central to modeling complex physical systems in many disciplines across science and engineering. Mesh representations support powerful numerical integration methods and their resolution can be adapted to strike favorable trade-offs between accuracy and efficiency. However, high-dimensional scientific simulations are very expensive to run, and solvers and parameters must often be tuned individually to each system studied. Here we introduce MeshGraphNets, a framework for learning mesh-based simulations using graph neural networks. Our model can be trained to pass messages on a mesh graph and to adapt the mesh discretization during forward simulation. Our results show it can accurately predict the dynamics of a wide range of physical systems, including aerodynamics, structural mechanics, and cloth. The model's adaptivity supports learning resolution-independent dynamics and can scale to more complex state spaces at test time. Our method is also highly efficient, running 1-2 orders of magnitude faster than the simulation on which it is trained. Our approach broadens the range of problems on which neural network simulators can operate and promises to improve the efficiency of complex, scientific modeling tasks.

We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent representations when we train a GNN in a supervised setting, then we apply symbolic regression to components of the learned model to extract explicit physical relations. We find the correct known equations, including force laws and Hamiltonians, can be extracted from the neural network. We then apply our method to a non-trivial cosmology example-a detailed dark matter simulation-and discover a new analytic formula which can predict the concentration of dark matter from the mass distribution of nearby cosmic structures. The symbolic expressions extracted from the GNN using our technique also generalized to out-of-distribution data better than the GNN itself. Our approach offers alternative directions for interpreting neural networks and discovering novel physical principles from the representations they learn., Comment: Accepted to NeurIPS 2020. 9 pages content + 16 pages appendix/references. Supporting code found at https://github.com/MilesCranmer/symbolic_deep_learning

Here we present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and deformable materials interacting with one another. Our framework---which we term "Graph Network-based Simulators" (GNS)---represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time. Our model was robust to hyperparameter choices across various evaluation metrics: the main determinants of long-term performance were the number of message-passing steps, and mitigating the accumulation of error by corrupting the training data with noise. Our GNS framework advances the state-of-the-art in learned physical simulation, and holds promise for solving a wide range of complex forward and inverse problems., Comment: Accepted at ICML 2020

We introduce "Search with Amortized Value Estimates" (SAVE), an approach for combining model-free Q-learning with model-based Monte-Carlo Tree Search (MCTS). In SAVE, a learned prior over state-action values is used to guide MCTS, which estimates an improved set of state-action values. The new Q-estimates are then used in combination with real experience to update the prior. This effectively amortizes the value computation performed by MCTS, resulting in a cooperative relationship between model-free learning and model-based search. SAVE can be implemented on top of any Q-learning agent with access to a model, which we demonstrate by incorporating it into agents that perform challenging physical reasoning tasks and Atari. SAVE consistently achieves higher rewards with fewer training steps, and---in contrast to typical model-based search approaches---yields strong performance with very small search budgets. By combining real experience with information computed during search, SAVE demonstrates that it is possible to improve on both the performance of model-free learning and the computational cost of planning., Comment: Published as a conference paper at ICLR 2020

We introduce agents that use object-oriented reasoning to consider alternate states of the world in order to more quickly find solutions to problems. Specifically, a hierarchical controller directs a low-level agent to behave as if objects in the scene were added, deleted, or modified. The actions taken by the controller are defined over a graph-based representation of the scene, with actions corresponding to adding, deleting, or editing the nodes of a graph. We present preliminary results on three environments, demonstrating that our approach can achieve similar levels of reward as non-hierarchical agents, but with better data efficiency., Comment: 8 pages; accepted to the Perception as Generative Reasoning workshop of the 33rd Conference on Neural InformationProcessing Systems (NeurIPS 2019)

We introduce an approach for imposing physically informed inductive biases in learned simulation models. We combine graph networks with a differentiable ordinary differential equation integrator as a mechanism for predicting future states, and a Hamiltonian as an internal representation. We find that our approach outperforms baselines without these biases in terms of predictive accuracy, energy accuracy, and zero-shot generalization to time-step sizes and integrator orders not experienced during training. This advances the state-of-the-art of learned simulation, and in principle is applicable beyond physical domains.

Physical construction---the ability to compose objects, subject to physical dynamics, to serve some function---is fundamental to human intelligence. We introduce a suite of challenging physical construction tasks inspired by how children play with blocks, such as matching a target configuration, stacking blocks to connect objects together, and creating shelter-like structures over target objects. We examine how a range of deep reinforcement learning agents fare on these challenges, and introduce several new approaches which provide superior performance. Our results show that agents which use structured representations (e.g., objects and scene graphs) and structured policies (e.g., object-centric actions) outperform those which use less structured representations, and generalize better beyond their training when asked to reason about larger scenes. Model-based agents which use Monte-Carlo Tree Search also outperform strictly model-free agents in our most challenging construction problems. We conclude that approaches which combine structured representations and reasoning with powerful learning are a key path toward agents that possess rich intuitive physics, scene understanding, and planning., Comment: ICML 2019

We introduce Compositional Imitation Learning and Execution (CompILE): a framework for learning reusable, variable-length segments of hierarchically-structured behavior from demonstration data. CompILE uses a novel unsupervised, fully-differentiable sequence segmentation module to learn latent encodings of sequential data that can be re-composed and executed to perform new tasks. Once trained, our model generalizes to sequences of longer length and from environment instances not seen during training. We evaluate CompILE in a challenging 2D multi-task environment and a continuous control task, and show that it can find correct task boundaries and event encodings in an unsupervised manner. Latent codes and associated behavior policies discovered by CompILE can be used by a hierarchical agent, where the high-level policy selects actions in the latent code space, and the low-level, task-specific policies are simply the learned decoders. We found that our CompILE-based agent could learn given only sparse rewards, where agents without task-specific policies struggle., Comment: ICML (2019)

We present a comprehensive experimental and theoretical study on superfluorescence in the extreme ultraviolet wavelength regime. Focusing a high-intensity free-electron laser pulse in a cell filled with Xe or Kr gas, the medium is quasi instantaneously population-inverted by inner-shell ionization on the giant resonance followed by Auger decay. On the timescale of 100 ps a macroscopic polarization builds up in the medium, resulting in superfluorescent emission of several Xe and Kr lines in the forward direction. As the number of emitters in the system is increased by either raising the pressure or the pump-pulse energy, the emission shows an exponential growth of over 4 orders of magnitude and reaches saturation. With increasing yield, we observe line broadening, a manifestation of superfluorescence in the spectral domain. Our novel theoretical approach, based on a full quantum treatment of the atomic system and the irradiated field, shows quantitative agreement with the experiment and supports our interpretation.

Understanding and interacting with everyday physical scenes requires rich knowledge about the structure of the world, represented either implicitly in a value or policy function, or explicitly in a transition model. Here we introduce a new class of learnable models--based on graph networks--which implement an inductive bias for object- and relation-centric representations of complex, dynamical systems. Our results show that as a forward model, our approach supports accurate predictions from real and simulated data, and surprisingly strong and efficient generalization, across eight distinct physical systems which we varied parametrically and structurally. We also found that our inference model can perform system identification. Our models are also differentiable, and support online planning via gradient-based trajectory optimization, as well as offline policy optimization. Our framework offers new opportunities for harnessing and exploiting rich knowledge about the world, and takes a key step toward building machines with more human-like representations of the world., Comment: ICML 2018

Artificial intelligence (AI) has undergone a renaissance recently, making major progress in key domains such as vision, language, control, and decision-making. This has been due, in part, to cheap data and cheap compute resources, which have fit the natural strengths of deep learning. However, many defining characteristics of human intelligence, which developed under much different pressures, remain out of reach for current approaches. In particular, generalizing beyond one's experiences--a hallmark of human intelligence from infancy--remains a formidable challenge for modern AI. The following is part position paper, part review, and part unification. We argue that combinatorial generalization must be a top priority for AI to achieve human-like abilities, and that structured representations and computations are key to realizing this objective. Just as biology uses nature and nurture cooperatively, we reject the false choice between "hand-engineering" and "end-to-end" learning, and instead advocate for an approach which benefits from their complementary strengths. We explore how using relational inductive biases within deep learning architectures can facilitate learning about entities, relations, and rules for composing them. We present a new building block for the AI toolkit with a strong relational inductive bias--the graph network--which generalizes and extends various approaches for neural networks that operate on graphs, and provides a straightforward interface for manipulating structured knowledge and producing structured behaviors. We discuss how graph networks can support relational reasoning and combinatorial generalization, laying the foundation for more sophisticated, interpretable, and flexible patterns of reasoning. As a companion to this paper, we have released an open-source software library for building graph networks, with demonstrations of how to use them in practice.

X-ray free-electron lasers (XFELs) are the only sources currently able to produce bright few-fs pulses with tunable photon energies from 100 eV to more than 10 keV. Due to the stochastic SASE operating principles and other technical issues the output pulses are subject to large fluctuations, making it necessary to characterize the x-ray pulses on every shot for data sorting purposes. We present a technique that applies machine learning tools to predict x-ray pulse properties using simple electron beam and x-ray parameters as input. Using this technique at the Linac Coherent Light Source (LCLS), we report mean errors below 0.3 eV for the prediction of the photon energy at 530 eV and below 1.6 fs for the prediction of the delay between two x-ray pulses. We also demonstrate spectral shape prediction with a mean agreement of 97%. This approach could potentially be used at the next generation of high-repetition-rate XFELs to provide accurate knowledge of complex x-ray pulses at the full repetition rate., Comment: 12 pages, 8 figures

We present transient absorption spectra of an extreme ultraviolet attosecond pulse train in helium dressed by an 800 nm laser field with intensity ranging from $2\times10^{12}$ W/cm$^2$ to $2\times10^{14}$ W/cm$^2$. The energy range probed spans 16-42 eV, straddling the first ionisation energy of helium (24.59 eV). By changing the relative polarisation of the dressing field with respect to the attosecond pulse train polarisation we observe a large change in the modulation of the absorption reflecting the vectorial response to the dressing field. With parallel polarized dressing and probing fields, we observe significant modulations with periods of one half and one quarter of the dressing field period. With perpendicularly polarized dressing and probing fields, the modulations of the harmonics above the ionisation threshold are significantly suppressed. A full-dimensionality solution of the single-atom time-dependent Schr\"odinger equation obtained using the recently developed ab-initio time-dependent B-spline ADC method reproduce some of our observations., Comment: 9 pages, 5 figures

We show that, for each ordinal $\alpha<\omega_1$, the space $C([0,\omega^\alpha])$ does not embed into $C(K)$ with distortion strictly less than $2$ unless $K^{(\alpha)}\neq \emptyset$., Comment: 11 pages

The concept of subdifferentiability is studied in the context of $C^1$ Finsler manifolds (modeled on a Banach space with a Lipschitz $C^1$ bump function). A class of Hamilton-Jacobi equations defined on $C^1$ Finsler manifolds is studied and several results related to the existence and uniqueness of viscosity solutions are obtained., Comment: 24 pages

We give a simple example of a countable metric space $M$ that does not embed bi-Lipschitz with distortion strictly less than 2 into any Asplund space. Actually, if $M$ embeds with distortion strictly less than 2 to a Banach space $X$, then $X$ contains an isomorphic copy of $\ell_1$. We also show that the space $M$ does not embed with distortion strictly less than $2$ into $\ell_1$ itself but it does embed isometrically into a space that is isomorphic to $\ell_1$., Comment: 5 pages

We study the global inversion of a continuous nonsmooth mapping $f: \mathbb{R}^n \rightarrow \mathbb{R}^n$, which may be non-locally Lipschitz. To this end, we use the notion of pseudo-Jacobian map associated to f, introduced by Jeyakumar and Luc, and we consider a related index of regularity for f. We obtain a characterization of global inversion in terms of its index of regularity. Furthermore, we prove that the Hadamard integral condition has a natural counterpart in this setting, providing a sufficient condition for global invertibility., Comment: 12 pages

We consider the problem of finding sufficient conditions for a locally Lipschitz mapping between Finsler manifolds to be a global homeomorphism. For this purpose, we develop the notion of Clarke generalized differential in this context and, using this, we obtain a version of the Hadamard integral condition for invertibility. As consequences, we deduce some global inversion and global injectivity results for Lipschitz mappings on $\mathbb{R}^n$ in terms of spectral conditions of its Clarke generalized differential., Comment: 18 pages

Let $X$ and $Z$ be Banach spaces, $A$ a closed subset of $X$ and a mapping $f:A \to Z$. We give necessary and sufficient conditions to obtain a $C^1$ smooth mapping $F:X \to Z$ such that $F_{\mid_A}=f$, when either (i) $X$ and $Z$ are Hilbert spaces and $X$ is separable, or (ii) $X^*$ is separable and $Z$ is an absolute Lipschitz retract, or (iii) $X=L_2$ and $Z=L_p$ with $1

In this note we give sufficient conditions to ensure that the weak Finsler structure of a complete $C^k$ Finsler manifold $M$ is determined by the normed algebra $C_b^k(M)$ of all real-valued, bounded and $C^k$ smooth functions with bounded derivative defined on $M$. As a consequence, we obtain: (i) the Finsler structure of a finite-dimensional and complete $C^k$ Finsler manifold $M$ is determined by the algebra $C_b^k(M)$; (ii) the weak Finsler structure of a separable and complete $C^k$ Finsler manifold $M$ modeled on a Banach space with a Lipschitz and $C^k$ smooth bump function is determined by the algebra $C^k_b(M)$; (iii) the weak Finsler structure of a $C^k$ uniformly bumpable and complete $C^k$ Finsler manifold $M$ modeled on a Weakly Compactly Generated (WCG) Banach space with an (equivalent) $C^k$ smooth norm is determined by the algebra $C^k_b(M)$; and (iii) the isometric structure of a WCG Banach space $X$ with an $C^1$ smooth bump function is determined by the algebra $C_b^1(X)$., Comment: 13 pages

Let us consider a Riemannian manifold $M$ (either separable or non-separable). We prove that, for every $\epsilon>0$, every Lipschitz function $f:M\rightarrow\mathbb R$ can be uniformly approximated by a Lipschitz, $C^1$-smooth function $g$ with $\Lip(g)\le \Lip(f)+\epsilon$. As a consequence, every Riemannian manifold is uniformly bumpable. The results are presented in the context of $C^\ell$ Finsler manifolds modeled on Banach spaces. Sufficient conditions are given on the Finsler manifold $M$ (and the Banach space $X$ where $M$ is modeled), so that every Lipschitz function $f:M\rightarrow \mathbb R$ can be uniformly approximated by a Lipschitz, $C^k$-smooth function $g$ with $\Lip(g)\le C \Lip(f)$ (for some $C$ depending only on $X$). Some applications of these results are also given as well as a characterization, on the separable case, of the class of $C^\ell$ Finsler manifolds satisfying the above property of approximation. Finally, we give sufficient conditions on the $C^1$ Finsler manifold $M$ and $X$, to ensure the existence of Lipschitz and $C^1$-smooth extensions of every real-valued function $f$ defined on a submanifold $N$ of $M$ provided $f$ is $C^1$-smooth on $N$ and Lipschitz with the metric induced by $M$., Comment: 23 pages, 1 figure

Let us consider a Banach space $X$ with the property that every real-valued Lipschitz function $f$ can be uniformly approximated by a Lipschitz, $C^1$-smooth function $g$ with $\Lip(g)\le C \Lip(f)$ (with $C$ depending only on the space $X$). This is the case for a Banach space $X$ bi-Lipschitz homeomorphic to a subset of $c_0(\Gamma)$, for some set $\Gamma$, such that the coordinate functions of the homeomorphism are $C^1$-smooth. Then, we prove that for every closed subspace $Y\subset X$ and every $C^1$-smooth (Lipschitz) function $f:Y\to\Real$, there is a $C^1$-smooth (Lipschitz, respectively) extension of $f$ to $X$. We also study $C^1$-smooth extensions of real-valued functions defined on closed subsets of $X$., Comment: 16 pages