Search

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective., Comment: Published in PASP Focus Issue on the Zwicky Transient Facility (doi: 10.1088/1538-3873/aaf3fa). 14 Pages, 8 Figures

The Zwicky Transient Facility (ZTF), a public-private enterprise, is a new time domain survey employing a dedicated camera on the Palomar 48-inch Schmidt telescope with a 47 deg$^2$ field of view and 8 second readout time. It is well positioned in the development of time domain astronomy, offering operations at 10% of the scale and style of the Large Synoptic Survey Telescope (LSST) with a single 1-m class survey telescope. The public surveys will cover the observable northern sky every three nights in g and r filters and the visible Galactic plane every night in g and r. Alerts generated by these surveys are sent in real time to brokers. A consortium of universities which provided funding ("partnership") are undertaking several boutique surveys. The combination of these surveys producing one million alerts per night allows for exploration of transient and variable astrophysical phenomena brighter than r $\sim$ 20.5 on timescales of minutes to years. We describe the primary science objectives driving ZTF including the physics of supernovae and relativistic explosions, multi-messenger astrophysics, supernova cosmology, active galactic nuclei and tidal disruption events, stellar variability, and Solar System objects., Comment: 26 pages, 7 figures, Published in PASP Focus Issue on the Zwicky Transient Facility

Astrophysical and cosmological observations currently provide the only robust, empirical measurements of dark matter. Future observations with Large Synoptic Survey Telescope (LSST) will provide necessary guidance for the experimental dark matter program. This white paper represents a community effort to summarize the science case for studying the fundamental physics of dark matter with LSST. We discuss how LSST will inform our understanding of the fundamental properties of dark matter, such as particle mass, self-interaction strength, non-gravitational couplings to the Standard Model, and compact object abundances. Additionally, we discuss the ways that LSST will complement other experiments to strengthen our understanding of the fundamental characteristics of dark matter. More information on the LSST dark matter effort can be found at https://lsstdarkmatter.github.io/ ., Comment: 96 pages, 22 figures, 1 table

This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrophysics, with a particular emphasis on real-time discovery campaigns. Acknowledging the transdisciplinary nature of Multi-Messenger Astrophysics, this document has been prepared by members of the physics, astronomy, computer science, data science, software and cyberinfrastructure communities who attended the NSF-, DOE- and NVIDIA-funded "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at the National Center for Supercomputing Applications, October 17-19, 2018. Highlights of this report include unanimous agreement that it is critical to accelerate the development and deployment of novel, signal-processing algorithms that use the synergy between artificial intelligence (AI) and high performance computing to maximize the potential for scientific discovery with Multi-Messenger Astrophysics. We discuss key aspects to realize this endeavor, namely (i) the design and exploitation of scalable and computationally efficient AI algorithms for Multi-Messenger Astrophysics; (ii) cyberinfrastructure requirements to numerically simulate astrophysical sources, and to process and interpret Multi-Messenger Astrophysics data; (iii) management of gravitational wave detections and triggers to enable electromagnetic and astro-particle follow-ups; (iv) a vision to harness future developments of machine and deep learning and cyberinfrastructure resources to cope with the scale of discovery in the Big Data Era; (v) and the need to build a community that brings domain experts together with data scientists on equal footing to maximize and accelerate discovery in the nascent field of Multi-Messenger Astrophysics., Comment: 15 pages, no figures. White paper based on the "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at NCSA, October 17-19, 2018 http://www.ncsa.illinois.edu/Conferences/DeepLearningLSST/

The presence of massive neutrinos affects the growth of large-scale structure in the universe, leaving a potentially observable imprint on the abundance and properties of massive dark matter-dominated halos. Cosmological surveys detect large numbers of these halos in the form of rich groups and clusters, using the information as an input to constraining the properties of dark energy. We use a suite of N-body simulations that include the effects of massive neutrinos as well as of dynamical dark energy to study the properties of the mass function. As in our previous work, we follow an approach valid at low neutrino mass, where the neutrino overdensities are assumed to be too small to act as a significant nonlinear source term for gravity. We study how well a universal form for the halo mass function describes our numerical results, finding that the use of an appropriate linear power spectrum within the formalism yields a good match to the simulation results, correctly accounting for the (neutrino mass-dependent) suppression of the mass function., Comment: 11 pages, 5 figures, to be submitted to PRD

We investigate the ability of the Large Synoptic Survey Telescope (LSST) to discover kilonovae (kNe) from binary neutron star (BNS) and neutron star-black hole (NSBH) mergers, focusing on serendipitous detections in the Wide-Fast-Deep (WFD) survey. We simulate observations of kNe with proposed LSST survey strategies, paying particular attention to cadence choices that are compatible with the broader LSST cosmology programme. We find that if all kNe are identical to GW170817, the baseline survey strategy will yield 58 kNe over the survey lifetime. If we instead assume a representative population model of BNS kNe, we expect to detect only 27 kNe. However, we find the choice of survey strategy significantly impacts these numbers and can increase them to 254 kNe and 82 kNe over the survey lifetime, respectively. This improvement arises from an increased cadence of observations between different filters with respect to the baseline. We then consider the ability of the Advanced LIGO/Virgo (ALV) detector network to detect these BNS mergers. If the optimal survey strategy is adopted, 202 of the GW170817-like kNe and 56 of the BNS population model kNe are detected with LSST but are below the threshold for detection by the ALV network. This represents, for both models, an increase by a factor greater than 4.5 in the number of detected sub-threshold events over the baseline survey strategy. Such a population of sub-threshold events would provide an opportunity to conduct electromagnetic-triggered searches for signals in gravitational-wave detector data and assess selection effects in measurements of the Hubble constant from standard sirens, e.g., related to viewing angle effects., Comment: 14 pages, 9 figures, 6 tables, to be submitted to MNRAS; v2: version accepted by MNRAS. Minor clarifications added

We identify minimal observing cadence requirements that enable photometric astronomical surveys to detect and recognize fast and explosive transients and fast transient features. Observations in two different filters within a short time window (e.g., g-and-i, or r-and-z, within < 0.5 hr) and a repeat of one of those filters with a longer time window (e.g., > 1.5 hr) are desirable for this purpose. Such an observing strategy delivers both the color and light curve evolution of transients on the same night. This allows the identification and initial characterization of fast transient -- or fast features of longer timescale transients -- such as rapidly declining supernovae, kilonovae, and the signatures of SN ejecta interacting with binary companion stars or circumstellar material. Some of these extragalactic transients are intrinsically rare and generally all hard to find, thus upcoming surveys like the Large Synoptic Survey Telescope (LSST) could dramatically improve our understanding of their origin and properties. We colloquially refer to such a strategy implementation for the LSST as the Presto-Color strategy (rapid-color). This cadence's minimal requirements allow for overall optimization of a survey for other science goals., Comment: The original version of this submission was a contribution in response to the Call for White Papers on LSST Cadence Optimization (https://www.lsst.org/submitted-whitepaper-2018). The current version is an extension and generalization of the previous work published in Publications of the Astronomical Society of the Pacific, 131:068002 (13pp), 2019 June (Special Issue)

We review the measurements of dark energy enabled by observations of the Deep Drilling Fields and the optimization of survey design for cosmological measurements. This white paper is the result of efforts by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy for the DDFs that will benefit all cosmological analyses with LSST. It is accompanied by the DESC-WFD white paper (Lochner et al.). We argue for altering the nominal deep drilling plan to have $>6$ month seasons, interweaving $gri$ and $zy$ observations every 3 days with 2, 4, 8, 25, 4 visits in $grizy$, respectively. These recommendations are guided by metrics optimizing constraints on dark energy and mitigation of systematic uncertainties, including specific requirements on total number of visits after Y1 and Y10 for photometric redshifts (photo-$z$) and weak lensing systematics. We specify the precise locations for the previously-chosen LSST deep fields (ELAIS-S1, XMM-LSS, CDF-S, and COSMOS) and recommend Akari Deep Field South as the planned fifth deep field in order to synergize with Euclid and WFIRST. Our recommended DDF strategy uses $6.2\%$ of the LSST survey time. We briefly discuss synergy with white papers from other collaborations, as well as additional mini-surveys and Target-of-Opportunity programs that lead to better measurements of dark energy., Comment: The LSST DESC response (DDF) to the Call for White Papers on LSST Cadence Optimization. Comments welcome

Cosmology is one of the four science pillars of LSST, which promises to be transformative for our understanding of dark energy and dark matter. The LSST Dark Energy Science Collaboration (DESC) has been tasked with deriving constraints on cosmological parameters from LSST data. Each of the cosmological probes for LSST is heavily impacted by the choice of observing strategy. This white paper is written by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy that will benefit all cosmological analyses with LSST. It is accompanied by the DESC DDF (Deep Drilling Fields) white paper (Scolnic et al.). We use a variety of metrics to understand the effects of the observing strategy on measurements of weak lensing, large-scale structure, clusters, photometric redshifts, supernovae, strong lensing and kilonovae. In order to reduce systematic uncertainties, we conclude that the current baseline observing strategy needs to be significantly modified to result in the best possible cosmological constraints. We provide some key recommendations: moving the WFD (Wide-Fast-Deep) footprint to avoid regions of high extinction, taking visit pairs in different filters, changing the 2x15s snaps to a single exposure to improve efficiency, focusing on strategies that reduce long gaps (>15 days) between observations, and prioritizing spatial uniformity at several intervals during the 10-year survey., Comment: The LSST DESC response (WFD) to the Call for White Papers on LSST Cadence Optimization. Comments welcome

The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering and measuring millions of time-varying objects. In this challenge, we pose the question: how well can we classify objects in the sky that vary in brightness from simulated LSST time-series data, with all its challenges of non-representativity? In this note we explain the need for a data challenge to help classify such astronomical sources and describe the PLAsTiCC data set and Kaggle data challenge, noting that while the references are provided for context, they are not needed to participate in the challenge., Comment: Research note to accompany the https://www.kaggle.com/c/PLAsTiCC-2018 challenge

The Large Synoptic Survey Telescope (LSST) Dark Energy Science Collaboration (DESC) will use five cosmological probes: galaxy clusters, large scale structure, supernovae, strong lensing, and weak lensing. This Science Requirements Document (SRD) quantifies the expected dark energy constraining power of these probes individually and together, with conservative assumptions about analysis methodology and follow-up observational resources based on our current understanding and the expected evolution within the field in the coming years. We then define requirements on analysis pipelines that will enable us to achieve our goal of carrying out a dark energy analysis consistent with the Dark Energy Task Force definition of a Stage IV dark energy experiment. This is achieved through a forecasting process that incorporates the flowdown to detailed requirements on multiple sources of systematic uncertainty. Future versions of this document will include evolution in our software capabilities and analysis plans along with updates to the LSST survey strategy., Comment: 32 pages + 60 pages of appendices. This is v1.0.2 of the DESC SRD, an internal collaboration document that is being made public and is not planned for submission to a journal. Data products for reproducing key plots are available on Zenodo, https://doi.org/10.5281/zenodo.1409815 ; see "Executive Summary and User Guide" for how to use and cite those products

Testing for the equality of two high-dimensional distributions is a challenging problem, and this becomes even more challenging when the sample size is small. Over the last few decades, several graph-based two-sample tests have been proposed in the literature, which can be used for data of arbitrary dimensions. Most of these test statistics are computed using pairwise Euclidean distances among the observations. But, due to concentration of pairwise Euclidean distances, these tests have poor performance in many high-dimensional problems. Some of them can have powers even below the nominal level when the scale-difference between two distributions dominates the location-difference. To overcome these limitations, we introduce a new class of dissimilarity indices and use it to modify some popular graph-based tests. These modified tests use the distance concentration phenomenon to their advantage, and as a result, they outperform the corresponding tests based on the Euclidean distance in a wide variety of examples. We establish the high-dimensional consistency of these modified tests under fairly general conditions. Analyzing several simulated as well as real data sets, we demonstrate their usefulness in high dimension, low sample size situations.

The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white paper, we explore how the detailed performance of the anticipated science investigations is expected to depend on small changes to the LSST observing strategy. Using realistic simulations of the LSST schedule and observation properties, we design and compute diagnostic metrics and Figures of Merit that provide quantitative evaluations of different observing strategies, analyzing their impact on a wide range of proposed science projects. This is work in progress: we are using this white paper to communicate to each other the relative merits of the observing strategy choices that could be made, in an effort to maximize the scientific value of the survey. The investigation of some science cases leads to suggestions for new strategies that could be simulated and potentially adopted. Notably, we find motivation for exploring departures from a spatially uniform annual tiling of the sky: focusing instead on different parts of the survey area in different years in a "rolling cadence" is likely to have significant benefits for a number of time domain and moving object astronomy projects. The communal assembly of a suite of quantified and homogeneously coded metrics is the vital first step towards an automated, systematic, science-based assessment of any given cadence simulation, that will enable the scheduling of the LSST to be as well-informed as possible., Comment: 312 pages, 90 figures. Browse the current version at https://github.com/LSSTScienceCollaborations/ObservingStrategy, new contributions welcome!

The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pach\'on in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline., Comment: 10 pages, 3 figures, to appear in the Proceedings of ADASS XXV

Ground and space-based sky surveys enable powerful cosmological probes based on measurements of galaxy properties and the distribution of galaxies in the Universe. These probes include weak lensing, baryon acoustic oscillations, abundance of galaxy clusters, and redshift space distortions; they are essential to improving our knowledge of the nature of dark energy. On the theory and modeling front, large-scale simulations of cosmic structure formation play an important role in interpreting the observations and in the challenging task of extracting cosmological physics at the needed precision. These simulations must cover a parameter range beyond the standard six cosmological parameters and need to be run at high mass and force resolution. One key simulation-based task is the generation of accurate theoretical predictions for observables, via the method of emulation. Using a new sampling technique, we explore an 8-dimensional parameter space including massive neutrinos and a variable dark energy equation of state. We construct trial emulators using two surrogate models (the linear power spectrum and an approximate halo mass function). The new sampling method allows us to build precision emulators from just 26 cosmological models and to increase the emulator accuracy by adding new sets of simulations in a prescribed way. This allows emulator fidelity to be systematically improved as new observational data becomes available and higher accuracy is required. Finally, using one LCDM cosmology as an example, we study the demands imposed on a simulation campaign to achieve the required statistics and accuracy when building emulators for dark energy investigations., Comment: 14 pages, 13 figures

We show that the number of observed voids in galaxy redshift surveys is a sensitive function of the equation of state of dark energy. Using the Fisher matrix formalism we find the error ellipses in the $w_0-w_a$ plane when the equation of state of dark energy is assumed to be of the form $w_{CPL}(z)=w_0 +w_a z/(1+z)$. We forecast the number of voids to be observed with the ESA Euclid satellite and the NASA WFIRST mission, taking into account updated details of the surveys to reach accurate estimates of their power. The theoretical model for the forecast of the number of voids is based on matches between abundances in simulations and the analytical prediction. To take into account the uncertainties within the model, we marginalize over its free parameters when calculating the Fisher matrices. The addition of the void abundance constraints to the data from Planck, HST and supernova survey data noticeably tighten the $w_0-w_a$ parameter space. We thus quantify the improvement in the constraints due to the use of voids and demonstrate that the void abundance is a sensitive new probe for the dark energy equation of state., Comment: 10 pages, 6 figures and 2 tables. Matches PRD published version after minor corrections

The Large Synoptic Survey Telescope (LSST) will explore the entire southern sky over 10 years starting in 2022 with unprecedented depth and time sampling in six filters, $ugrizy$. Artificial power on the scale of the 3.5 deg LSST field-of-view will contaminate measurements of baryonic acoustic oscillations (BAO), which fall at the same angular scale at redshift $z \sim 1$. Using the HEALPix framework, we demonstrate the impact of an "un-dithered" survey, in which $17\%$ of each LSST field-of-view is overlapped by neighboring observations, generating a honeycomb pattern of strongly varying survey depth and significant artificial power on BAO angular scales. We find that adopting large dithers (i.e., telescope pointing offsets) of amplitude close to the LSST field-of-view radius reduces artificial structure in the galaxy distribution by a factor of $\sim$10. We propose an observing strategy utilizing large dithers within the main survey and minimal dithers for the LSST Deep Drilling Fields. We show that applying various magnitude cutoffs can further increase survey uniformity. We find that a magnitude cut of $r < 27.3$ removes significant spurious power from the angular power spectrum with a minimal reduction in the total number of observed galaxies over the ten-year LSST run. We also determine the effectiveness of the observing strategy for Type Ia SNe and predict that the main survey will contribute $\sim$100,000 Type Ia SNe. We propose a concentrated survey where LSST observes one-third of its main survey area each year, increasing the number of main survey Type Ia SNe by a factor of $\sim$1.5, while still enabling the successful pursuit of other science drivers., Comment: 9 pages, 6 figures, published in SPIE proceedings; corrected typo in equation 2

Peaks signify important events in a signal. In a pair of signals how peaks are occurring with mutual correspondence may offer us significant insights into the mutual interdependence between the two signals based on important events. In this work we proposed a novel synchronization measure between two signals, called peak synchronization, which measures the simultaneity of occurrence of peaks in the signals. We subsequently generalized it to more than two signals. We showed that our measure of synchronization is largely independent of the underlying parameter values. A time complexity analysis of the algorithm has also been presented. We applied the measure on intracranial EEG signals of epileptic patients and found that the enhanced synchronization during an epileptic seizure can be modeled better by the new peak synchronization measure than the classical amplitude correlation method.