Search

Automating anomaly detection is an open problem in many scientific fields, particularly in time-domain astronomy, where modern telescopes generate millions of alerts per night. Currently, most anomaly detection algorithms for astronomical time-series rely either on hand-crafted features or on features generated through unsupervised representation learning, coupled with standard anomaly detection algorithms. In this work, we introduce a novel approach that leverages the latent space of a neural network classifier for anomaly detection. We then propose a new method called Multi-Class Isolation Forests (MCIF), which trains separate isolation forests for each class to derive an anomaly score for an object based on its latent space representation. This approach significantly outperforms a standard isolation forest when distinct clusters exist in the latent space. Using a simulated dataset emulating the Zwicky Transient Facility (54 anomalies and 12,040 common), our anomaly detection pipeline discovered $46\pm3$ anomalies ($\sim 85\%$ recall) after following up the top 2,000 ($\sim 15\%$) ranked objects. Furthermore, our classifier-based approach outperforms or approaches the performance of other state-of-the-art anomaly detection pipelines. Our novel method demonstrates that existing and new classifiers can be effectively repurposed for real-time anomaly detection. The code used in this work, including a Python package, is publicly available, https://github.com/Rithwik-G/AstroMCAD., Comment: Accepted in the ICML 2024 AI for Science Workshop. 15 pages, 10 figures. https://openreview.net/forum?id=jkCVGBhIqy. arXiv admin note: substantial text overlap with arXiv:2403.14742

Bees are among the master navigators of the insect world. Despite impressive advances in robot navigation research, the performance of these insects is still unrivaled by any artificial system in terms of training efficiency and generalization capabilities, particularly considering the limited computational capacity. On the other hand, computational principles underlying these extraordinary feats are still only partially understood. The theoretical framework of reinforcement learning (RL) provides an ideal focal point to bring the two fields together for mutual benefit. In particular, we analyze and compare representations of space in robot and insect navigation models through the lens of RL, as the efficiency of insect navigation is likely rooted in an efficient and robust internal representation, linking retinotopic (egocentric) visual input with the geometry of the environment. While RL has long been at the core of robot navigation research, current computational theories of insect navigation are not commonly formulated within this framework, but largely as an associative learning process implemented in the insect brain, especially in the mushroom body (MB). Here we propose specific hypothetical components of the MB circuit that would enable the implementation of a certain class of relatively simple RL algorithms, capable of integrating distinct components of a navigation task, reminiscent of hierarchical RL models used in robot navigation. We discuss how current models of insect and robot navigation are exploring representations beyond classical, complete map-like representations, with spatial information being embedded in the respective latent representations to varying degrees., Comment: 26 pages, 5 figures; submitted to Frontiers in Computational Neuroscience

We apply a state-of-the-art transformer algorithm to 221 deg$^2$ of the Kilo Degree Survey (KiDS) to search for new strong gravitational lenses (SGL). We test four transformer encoders trained on simulated data from the Strong Lens Finding Challenge on KiDS survey data. The best performing model is fine-tuned on real images of SGL candidates identified in previous searches. To expand the dataset for fine-tuning, data augmentation techniques are employed, including rotation, flipping, transposition, and white noise injection. The network fine-tuned with rotated, flipped, and transposed images exhibited the best performance and is used to hunt for SGL in the overlapping region of the Galaxy And Mass Assembly (GAMA) and KiDS surveys on galaxies up to $z$=0.8. Candidate SGLs are matched with those from other surveys and examined using GAMA data to identify blended spectra resulting from the signal from multiple objects in a fiber. We observe that fine-tuning the transformer encoder to the KiDS data reduces the number of false positives by 70%. Additionally, applying the fine-tuned model to a sample of $\sim$ 5,000,000 galaxies results in a list of $\sim$ 51,000 SGL candidates. Upon visual inspection, this list is narrowed down to 231 candidates. Combined with the SGL candidates identified in the model testing, our final sample includes 264 candidates, with 71 high-confidence SGLs of which 44 are new discoveries. We propose fine-tuning via real augmented images as a viable approach to mitigating false positives when transitioning from simulated lenses to real surveys. Additionally, we provide a list of 121 false positives that exhibit features similar to lensed objects, which can benefit the training of future machine learning models in this field., Comment: 28 pages, 21 figures, accepted in A&A on 16/05/2024

This report describes and synthesizes implementation determinants and strategies to promote uptake and sustained implementation of comprehensive school mental health and trauma-sensitive practices in schools. The present synthesis of studies and reports emphasizes use of relevant and efficient practices with empirical support at the state, district, and school levels to promote comprehensive school mental health and trauma-sensitive practices.

Youth mental health concerns are on the rise and can have serious implications for student well-being and success (Clayborne et al., 2019). Consequently, more educators and mental health professionals are identifying mental health as an important student need (American Academy of Pediatrics, 2021). This report summarizes the key principles underlying comprehensive school mental health and trauma sensitive schools. The present synthesis of studies and reports emphasizes core features, key principles, and associated core components. [This report was co-produced by the Wisconsin Evaluation Collaborative and originally prepared for the Wisconsin Department of Public Instruction (DPI).]

Automating real-time anomaly detection is essential for identifying rare transients in the era of large-scale astronomical surveys. Modern survey telescopes are generating tens of thousands of alerts per night, and future telescopes, such as the Vera C. Rubin Observatory, are projected to increase this number dramatically. Currently, most anomaly detection algorithms for astronomical transients rely either on hand-crafted features extracted from light curves or on features generated through unsupervised representation learning, which are then coupled with standard machine learning anomaly detection algorithms. In this work, we introduce an alternative approach to detecting anomalies: using the penultimate layer of a neural network classifier as the latent space for anomaly detection. We then propose a novel method, named Multi-Class Isolation Forests (MCIF), which trains separate isolation forests for each class to derive an anomaly score for a light curve from the latent space representation given by the classifier. This approach significantly outperforms a standard isolation forest. We also use a simpler input method for real-time transient classifiers which circumvents the need for interpolation in light curves and helps the neural network model inter-passband relationships and handle irregular sampling. Our anomaly detection pipeline identifies rare classes including kilonovae, pair-instability supernovae, and intermediate luminosity transients shortly after trigger on simulated Zwicky Transient Facility light curves. Using a sample of our simulations that matched the population of anomalies expected in nature (54 anomalies and 12,040 common transients), our method was able to discover $41\pm3$ anomalies (~75% recall) after following up the top 2000 (~15%) ranked transients. Our novel method shows that classifiers can be effectively repurposed for real-time anomaly detection., Comment: 16 pages, 14 figures, 1 table, submitted to MNRAS

Unsupervised learning, a branch of machine learning that can operate on unlabelled data, has proven to be a powerful tool for data exploration and discovery in astronomy. As large surveys and new telescopes drive a rapid increase in data size and richness, these techniques offer the promise of discovering new classes of objects and of efficient sorting of data into similar types. However, unsupervised learning techniques generally require feature extraction to derive simple but informative representations of images. In this paper, we explore the use of self-supervised deep learning as a method of automated representation learning. We apply the algorithm Bootstrap Your Own Latent (BYOL) to Galaxy Zoo DECaLS images to obtain a lower dimensional representation of each galaxy, known as features. We briefly validate these features using a small supervised classification problem. We then move on to apply an automated clustering algorithm, demonstrating that this fully unsupervised approach is able to successfully group together galaxies with similar morphology. The same features prove useful for anomaly detection, where we use the framework astronomaly to search for merger candidates. While the focus of this work is on optical images, we also explore the versatility of this technique by applying the exact same approach to a small radio galaxy dataset. This work aims to demonstrate that applying deep representation learning is key to unlocking the potential of unsupervised discovery in future datasets from telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array., Comment: 22 pages, 22 figures, comments welcome

Modern astronomical surveys are producing datasets of unprecedented size and richness, increasing the potential for high-impact scientific discovery. This possibility, coupled with the challenge of exploring a large number of sources, has led to the development of novel machine-learning-based anomaly detection approaches, such as Astronomaly. For the first time, we test the scalability of Astronomaly by applying it to almost 4 million images of galaxies from the Dark Energy Camera Legacy Survey. We use a trained deep learning algorithm to learn useful representations of the images and pass these to the anomaly detection algorithm isolation forest, coupled with Astronomaly's active learning method, to discover interesting sources. We find that data selection criteria have a significant impact on the trade-off between finding rare sources such as strong lenses and introducing artefacts into the dataset. We demonstrate that active learning is required to identify the most interesting sources and reduce artefacts, while anomaly detection methods alone are insufficient. Using Astronomaly, we find 1635 anomalies among the top 2000 sources in the dataset after applying active learning, including eight strong gravitational lens candidates, 1609 galaxy merger candidates, and 18 previously unidentified sources exhibiting highly unusual morphology. Our results show that by leveraging the human-machine interface, Astronomaly is able to rapidly identify sources of scientific interest even in large datasets., Comment: 15 pages, 9 figures. Comments welcome, especially suggestions about the anomalous sources

Forthcoming imaging surveys will potentially increase the number of known galaxy-scale strong lenses by several orders of magnitude. For this to happen, images of tens of millions of galaxies will have to be inspected to identify potential candidates. In this context, deep learning techniques are particularly suitable for the finding patterns in large data sets, and convolutional neural networks (CNNs) in particular can efficiently process large volumes of images. We assess and compare the performance of three network architectures in the classification of strong lensing systems on the basis of their morphological characteristics. We train and test our models on different subsamples of a data set of forty thousand mock images, having characteristics similar to those expected in the wide survey planned with the ESA mission \Euclid, gradually including larger fractions of faint lenses. We also evaluate the importance of adding information about the colour difference between the lens and source galaxies by repeating the same training on single-band and multi-band images. Our models find samples of clear lenses with $\gtrsim 90\%$ precision and completeness, without significant differences in the performance of the three architectures. Nevertheless, when including lenses with fainter arcs in the training set, the three models' performance deteriorates with accuracy values of $\sim 0.87$ to $\sim 0.75$ depending on the model. Our analysis confirms the potential of the application of CNNs to the identification of galaxy-scale strong lenses. We suggest that specific training with separate classes of lenses might be needed for detecting the faint lenses since the addition of the colour information does not yield a significant improvement in the current analysis, with the accuracy ranging from $\sim 0.89$ to $\sim 0.78$ for the different models., Comment: 23 pages,12 figures

Scholarly publications are key to the transfer of knowledge from scholars to others. However, research papers are information-dense, and as the volume of the scientific literature grows, the need for new technology to support the reading process grows. In contrast to the process of finding papers, which has been transformed by Internet technology, the experience of reading research papers has changed little in decades. The PDF format for sharing research papers is widely used due to its portability, but it has significant downsides including: static content, poor accessibility for low-vision readers, and difficulty reading on mobile devices. This paper explores the question "Can recent advances in AI and HCI power intelligent, interactive, and accessible reading interfaces -- even for legacy PDFs?" We describe the Semantic Reader Project, a collaborative effort across multiple institutions to explore automatic creation of dynamic reading interfaces for research papers. Through this project, we've developed ten research prototype interfaces and conducted usability studies with more than 300 participants and real-world users showing improved reading experiences for scholars. We've also released a production reading interface for research papers that will incorporate the best features as they mature. We structure this paper around challenges scholars and the public face when reading research papers -- Discovery, Efficiency, Comprehension, Synthesis, and Accessibility -- and present an overview of our progress and remaining open challenges.

The volume of scientific output is creating an urgent need for automated tools to help scientists keep up with developments in their field. Semantic Scholar (S2) is an open data platform and website aimed at accelerating science by helping scholars discover and understand scientific literature. We combine public and proprietary data sources using state-of-the-art techniques for scholarly PDF content extraction and automatic knowledge graph construction to build the Semantic Scholar Academic Graph, the largest open scientific literature graph to-date, with 200M+ papers, 80M+ authors, 550M+ paper-authorship edges, and 2.4B+ citation edges. The graph includes advanced semantic features such as structurally parsed text, natural language summaries, and vector embeddings. In this paper, we describe the components of the S2 data processing pipeline and the associated APIs offered by the platform. We will update this living document to reflect changes as we add new data offerings and improve existing services., Comment: 8 pages, 6 figures

We report the discovery of a unique object in the MeerKAT Galaxy Cluster Legacy Survey (MGCLS) using the machine learning anomaly detection framework Astronomaly. This strange, ring-like source is 30' from the MGCLS field centred on Abell 209, and is not readily explained by simple physical models. With an assumed host galaxy at redshift 0.55, the luminosity (10^25 W/Hz) is comparable to powerful radio galaxies. The source consists of a ring of emission 175 kpc across, quadrilateral enhanced brightness regions bearing resemblance to radio jets, two "ears" separated by 368 kpc, and a diffuse envelope. All of the structures appear spectrally steep, ranging from -1.0 to -1.5. The ring has high polarization (25%) except on the bright patches (<10%). We compare this source to the Odd Radio Circles recently discovered in ASKAP data and discuss several possible physical models, including a termination shock from starburst activity, an end-on radio galaxy, and a supermassive black hole merger event. No simple model can easily explain the observed structure of the source. This work, as well as other recent discoveries, demonstrates the power of unsupervised machine learning in mining large datasets for scientifically interesting sources., Comment: 8 pages, 7 figures, published in MNRAS

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will discover an unprecedented number of supernovae (SNe), making spectroscopic classification for all the events infeasible. LSST will thus rely on photometric classification, whose accuracy depends on the not-yet-finalized LSST observing strategy. In this work, we analyze the impact of cadence choices on classification performance using simulated multi-band light curves. First, we simulate SNe with an LSST baseline cadence, a non-rolling cadence, and a presto-color cadence which observes each sky location three times per night instead of twice. Each simulated dataset includes a spectroscopically-confirmed training set, which we augment to be representative of the test set as part of the classification pipeline. Then, we use the photometric transient classification library snmachine to build classifiers. We find that the active region of the rolling cadence used in the baseline observing strategy yields a 25% improvement in classification performance relative to the background region. This improvement in performance in the actively-rolling region is also associated with an increase of up to a factor of 2.7 in the number of cosmologically-useful Type Ia supernovae relative to the background region. However, adding a third visit per night as implemented in presto-color degrades classification performance due to more irregularly sampled light curves. Overall, our results establish desiderata on the observing cadence related to classification of full SNe light curves, which in turn impacts photometric SNe cosmology with LSST., Comment: 22 pages, 14 figures. Changed to match version accepted by the Astrophysical Journal Supplement Series (accepted 06/02/2023)

Chirality has been a property of central importance in chemistry and biology for more than a century, and is now taking on increasing relevance in condensed matter physics. Recently, electrons were found to become spin polarized after transmitting through chiral molecules, crystals, and their hybrids. This phenomenon, called chirality-induced spin selectivity (CISS), presents broad application potentials and far-reaching fundamental implications involving intricate interplays among structural chirality, topological states, and electronic spin and orbitals. However, the microscopic picture of how chiral geometry influences electronic spin remains elusive. In this work, via a direct comparison of magnetoconductance (MC) measurements on magnetic semiconductor-based chiral molecular spin valves with normal metal electrodes of contrasting strengths of spin-orbit coupling (SOC), we unambiguously identified the origin of the SOC, a necessity for the CISS effect, given the negligible SOC in organic molecules. The experiments revealed that a heavy-metal electrode provides SOC to convert the orbital polarization induced by the chiral molecular structure to spin polarization. Our results evidence the essential role of SOC in the metal electrode for engendering the CISS spin valve effect. A tunneling model with a magnetochiral modulation of the potential barrier is shown to quantitatively account for the unusual transport behavior. This work hence produces critical new insights on the microscopic mechanism of CISS, and more broadly, reveals a fundamental relation between structure chirality, electron spin, and orbital.

The Vera C. Rubin Observatory's Legacy Survey of Space and Time is forecast to collect a large sample of Type Ia supernovae (SNe Ia) that could be instrumental in unveiling the nature of Dark Energy. The feat, however, requires measuring the two components of the Hubble diagram - distance modulus and redshift - with a high degree of accuracy. Distance is estimated from SNe Ia parameters extracted from light curve fits, where the average quality of light curves is primarily driven by survey parameters such as the cadence and the number of visits per band. An optimal observing strategy is thus critical for measuring cosmological parameters with high accuracy. We present in this paper a three-stage analysis aiming at quantifying the impact of the Deep Drilling (DD) strategy parameters on three critical aspects of the survey: the redshift completeness (originating from the Malmquist cosmological bias), the number of well-measured SNe Ia, and the cosmological measurements. Analyzing the current LSST survey simulations, we demonstrate that the current DD survey plans are characterized by a low completeness ($z~\sim$ 0.55-0.65), and irregular and low cadences (few days) that dramatically decrease the size of the well-measured SNe Ia sample. We then propose a modus operandi that provides the number of visits (per band) required to reach higher redshifts. The results of this approach are used to design a set of optimized DD surveys for SNe Ia cosmology. We show that most accurate cosmological measurements are achieved with Deep Rolling surveys characterized by a high cadence (one day), a rolling strategy (each field observed at least two seasons), and two sets of fields: ultra-deep ($z \gtrsim 0.8$) and deep ($z \gtrsim 0.6$) fields. We also demonstrate that a deterministic scheduler including a gap recovery mechanism is critical to achieve a high quality DD survey required for SNe Ia cosmology., Comment: 26 pages, 16 figures

A new generation of powerful dark energy experiments will open new vistas for cosmology in the next decade. However, these projects cannot reach their utmost potential without data from other telescopes. This white paper focuses in particular on the compelling benefits of ground-based spectroscopic and photometric observations to complement the Vera C. Rubin Observatory, as well as smaller programs in aid of a DESI-2 experiment and CMB-S4. These additional data sets will both improve dark energy constraints from these flagship projects beyond what would possible on their own and open completely new windows into fundamental physics. For example, additional photometry and single-object spectroscopy will provide necessary follow-up information for supernova and strong lensing cosmology, while highly-multiplexed spectroscopy both from smaller facilities over wide fields and from larger facilities over narrower regions of sky will yield more accurate photometric redshift estimates for weak lensing and galaxy clustering measurements from the Rubin Observatory, provide critical spectroscopic host galaxy redshifts for supernova Hubble diagrams, provide improved understanding of limiting astrophysical systematic effects, and enable new measurements that probe the nature of gravity. A common thread is that access to complementary data from a range of telescopes/instruments would have a substantial impact on the rate of advance of dark energy science in the coming years., Comment: White paper submitted to the Proceedings of the US Community Study on the Future of Particle Physics (Snowmass 2021)

In the local Universe, OH megamasers (OHMs) are detected almost exclusively in infrared-luminous galaxies, with a prevalence that increases with IR luminosity, suggesting that they trace gas-rich galaxy mergers. Given the proximity of the rest frequencies of OH and the hyperfine transition of neutral atomic hydrogen (HI), radio surveys to probe the cosmic evolution of HI in galaxies also offer exciting prospects for exploiting OHMs to probe the cosmic history of gas-rich mergers. Using observations for the Looking At the Distant Universe with the MeerKAT Array (LADUMA) deep HI survey, we report the first untargeted detection of an OHM at $z > 0.5$, LADUMA J033046.20$-$275518.1 (nicknamed "Nkalakatha"). The host system, WISEA J033046.26$-$275518.3, is an infrared-luminous radio galaxy whose optical redshift $z \approx 0.52$ confirms the MeerKAT emission line detection as OH at a redshift $z_{\rm OH} = 0.5225 \pm 0.0001$ rather than HI at lower redshift. The detected spectral line has 18.4$\sigma$ peak significance, a width of $459 \pm 59\,{\rm km\,s^{-1}}$, and an integrated luminosity of $(6.31 \pm 0.18\,{\rm [statistical]}\,\pm 0.31\,{\rm [systematic]}) \times 10^3\,L_\odot$, placing it among the most luminous OHMs known. The galaxy's far-infrared luminosity $L_{\rm FIR} = (1.576 \pm 0.013) \times 10^{12}\,L_\odot$ marks it as an ultra-luminous infrared galaxy; its ratio of OH and infrared luminosities is similar to those for lower-redshift OHMs. A comparison between optical and OH redshifts offers a slight indication of an OH outflow. This detection represents the first step towards a systematic exploitation of OHMs as a tracer of galaxy growth at high redshifts., Comment: 10 pages, 4 figures. Accepted to ApJ Letters