Search

We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical implications for low-frequency radio surveys aiming to characterize the 21cm signal from the Epoch of Reionization and Cosmic Dawn, as systematics can cause bright foreground emission to contaminate the EoR window and prohibit a robust detection. We also quantify the signal loss properties of the systematic modeling algorithms, and show that our techniques demonstrate resistance against EoR signal loss. In a companion paper, we demonstrate these methods on data from the Hydrogen Epoch of Reionization Array as a proof-of-concept., Comment: Accepted to ApJ

We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. The data show evidence for systematics that, without removal, would hinder a detection of the 21 cm power spectrum for the targeted EoR line-of-sight modes in the range 0.2 < k_parallel < 0.5\ h^-1 Mpc. After systematic removal, we find we can recover these modes in the power spectrum down to the integrated noise-floor of a nightly observation, achieving a dynamic range in the EoR window of 10^-6 in power (mK^2 units) with respect to the bright galactic foreground signal. In the absence of other systematics and assuming the systematic suppression demonstrated here continues to lower noise levels, our results suggest that fully-integrated HERA Phase I may have the capacity to set competitive upper limits on the 21 cm power spectrum. For future observing seasons, HERA will have upgraded analog and digital hardware to better control these systematics in the field., Comment: Submitted to ApJ

We present limits on the 21cm power spectrum from the Epoch of Reionization (EoR) using data from the 64 antenna configuration of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER) analyzed through a power spectrum pipeline independent from previous PAPER analyses. Previously reported results from PAPER have been found to contain significant signal loss (Cheng et al. 2018, arxiv:1810.05175). Several lossy steps from previous PAPER pipelines have not been included in this analysis, namely: delay-based foreground filtering, optimal fringe-rate filtering, and empirical covariance-based estimators. Steps which remain in common with previous analyses include redundant calibration and local sidereal time (LST) binning. The power spectra reported here are effectively the result of applying a linear Fourier transform analysis to the calibrated, LST binned data. This analysis also uses more data than previous publications, including the complete available redshift range of $z \sim 7.5$ to $11$. In previous PAPER analyses, many power spectrum measurements were found to be detections of noncosmological power at levels of significance ranging from two to hundreds of times the theoretical noise. Here, excess power is examined using redundancy between baselines and power spectrum jackknives. The upper limits we find on the 21cm power spectrum from reionization are ($1500$ mK)$^{2}$, ($1900$ mK)$^{2}$, ($280$ mK)$^{2}$, ($200$ mK)$^{2}$, ($380$ mK)$^{2}$, ($300$ mK)$^{2}$ at redshifts $z=10.87,\ 9.93,\ 8.68,\ 8.37,\ 8.13,$ and $7.48$, respectively. For reasons described in Cheng et al. 2018 (arxiv:1810.05175), these limits supersede all previous PAPER results (Ali et al. 2018, arxiv:1502.06016)., Comment: 28 Pages, 17 Pages, Accepted to APJ

The detection of the Epoch of Reionization (EoR) delay power spectrum using a "foreground avoidance method" highly depends on the instrument chromaticity. The systematic effects induced by the radio-telescope spread the foreground signal in the delay domain, which contaminates the EoR window theoretically observable. Applied to the Hydrogen Epoch of Reionization Array (HERA), this paper combines detailed electromagnetic and electrical simulations in order to model the chromatic effects of the instrument, and quantify its frequency and time responses. In particular, the effects of the analogue receiver, transmission cables, and mutual coupling are included. These simulations are able to accurately predict the intensity of the reflections occurring in the 150-m cable which links the antenna to the back-end. They also show that electromagnetic waves can propagate from one dish to another one through large sections of the array due to mutual coupling. The simulated system time response is attenuated by a factor $10^{4}$ after a characteristic delay which depends on the size of the array and on the antenna position. Ultimately, the system response is attenuated by a factor $10^{5}$ after 1400 ns because of the reflections in the cable, which corresponds to characterizable ${k_\parallel}$-modes above 0.7 $h\;\rm{Mpc}^{-1}$ at 150 MHz. Thus, this new study shows that the detection of the EoR signal with HERA Phase I will be more challenging than expected. On the other hand, it improves our understanding of the telescope, which is essential to mitigate the instrument chromaticity., Comment: 13 pages, 17 figures - Submitted to MNRAS - 2nd revision

Development of the hardware, data analysis, and simulation techniques for large compact radio arrays dedicated to mapping the 21 cm line of neutral hydrogen gas has proven to be more difficult than imagined twenty years ago when such telescopes were first proposed. Despite tremendous technical and methodological advances, there are several outstanding questions on how to optimally calibrate and analyze such data. On the positive side, it has become clear that the outstanding issues are purely technical in nature and can be solved with sufficient development activity. Such activity will enable science across redshifts, from early galaxy evolution in the pre-reionization era to dark energy evolution at low redshift., Comment: 10 pages + references, 2 figures, 1 table; APC white paper submitted to the Astro2020 decadal survey. arXiv admin note: text overlap with arXiv:1810.09572

In this white paper, we lay out a US roadmap for high-redshift 21 cm cosmology (30 < z < 6) in the 2020s. Beginning with the currently-funded HERA and MWA Phase II projects and advancing through the decade with a coordinated program of small-scale instrumentation, software, and analysis projects targeting technology development, this roadmap incorporates our current best understanding of the systematics confronting 21 cm cosmology into a plan for overcoming them, enabling next-generation, mid-scale 21 cm arrays to be proposed late in the decade. Submitted for consideration by the Astro2020 Decadal Survey Program Panel for Radio, Millimeter, and Submillimeter Observations from the Ground as a Medium-Sized Project., Comment: 10 pages (plus a cover page and references), 6 figures. Submitted as a APC White Paper for Astro2020

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be erroneous, but confidently so, limiting the safe deployment of classifiers in real-world applications. One such challenging application is bacteria identification based on genomic sequences, which holds the promise of early detection of diseases, but requires a model that can output low confidence predictions on OOD genomic sequences from new bacteria that were not present in the training data. We introduce a genomics dataset for OOD detection that allows other researchers to benchmark progress on this important problem. We investigate deep generative model based approaches for OOD detection and observe that the likelihood score is heavily affected by population level background statistics. We propose a likelihood ratio method for deep generative models which effectively corrects for these confounding background statistics. We benchmark the OOD detection performance of the proposed method against existing approaches on the genomics dataset and show that our method achieves state-of-the-art performance. We demonstrate the generality of the proposed method by showing that it significantly improves OOD detection when applied to deep generative models of images., Comment: Accepted to NeurIPS 2019

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying uncertainty is especially critical in real-world settings, which often involve input distributions that are shifted from the training distribution due to a variety of factors including sample bias and non-stationarity. In such settings, well calibrated uncertainty estimates convey information about when a model's output should (or should not) be trusted. Many probabilistic deep learning methods, including Bayesian-and non-Bayesian methods, have been proposed in the literature for quantifying predictive uncertainty, but to our knowledge there has not previously been a rigorous large-scale empirical comparison of these methods under dataset shift. We present a large-scale benchmark of existing state-of-the-art methods on classification problems and investigate the effect of dataset shift on accuracy and calibration. We find that traditional post-hoc calibration does indeed fall short, as do several other previous methods. However, some methods that marginalize over models give surprisingly strong results across a broad spectrum of tasks., Comment: Advances in Neural Information Processing Systems, 2019

In addition to being a probe of Cosmic Dawn and Epoch of Reionization astrophysics, the 21cm line at $z>6$ is also a powerful way to constrain cosmology. Its power derives from several unique capabilities. First, the 21cm line is sensitive to energy injections into the intergalactic medium at high redshifts. It also increases the number of measurable modes compared to existing cosmological probes by orders of magnitude. Many of these modes are on smaller scales than are accessible via the CMB, and moreover have the advantage of being firmly in the linear regime (making them easy to model theoretically). Finally, the 21cm line provides access to redshifts prior to the formation of luminous objects. Together, these features of 21cm cosmology at $z>6$ provide multiple pathways toward precise cosmological constraints. These include the "marginalizing out" of astrophysical effects, the utilization of redshift space distortions, the breaking of CMB degeneracies, the identification of signatures of relative velocities between baryons and dark matter, and the discovery of unexpected signs of physics beyond the $\Lambda$CDM paradigm at high redshifts., Comment: Science white paper submitted to Decadal 2020 survey

The Dark Ages are the period between the last scattering of the cosmic microwave background and the appearance of the first luminous sources, spanning approximately 1100 < z < 30. The only known way to measure fluctuations in this era is through the 21-cm line of neutral hydrogen. Such observations have enormous potential for cosmology, because they span a large volume while the fluctuations remain linear even on small scales. Observations of 21-cm fluctuations during this era can therefore constrain fundamental aspects of our Universe, including inflation and any exotic physics of dark matter. While the observational challenges to these low-frequency 21-cm observations are enormous, especially from the terrestrial environment, they represent an important goal for cosmology., Comment: 10 pages, 4 figures

The epoch of reionization, when photons from early galaxies ionized the intergalactic medium about a billion years after the Big Bang, is the last major phase transition in the Universe's history. Measuring the characteristics of the transition is important for understanding early galaxies and the cosmic web and for modeling dwarf galaxies in the later Universe. But such measurements require probes of the intergalactic medium itself. Here we describe how the 21-cm line of neutral hydrogen provides a powerful probe of the reionization process and therefore important constraints on both the galaxies and intergalactic absorbers at that time. While existing experiments will make precise statistical measurements over the next decade, we argue that improved 21-cm analysis techniques - allowing imaging of the neutral gas itself - as well as improved theoretical models, are crucial for testing our understanding of this important era., Comment: 8 pages, 4 figures

The early phases of galaxy formation constitute one of the most exciting frontiers in astrophysics. It is during this era that the first luminous sources reionize the intergalactic medium - the moment when structure formation affects every baryon in the Universe. Here we argue that we will obtain a complete picture of this era by combining observations of galaxies with direct measurements of the reionization process: the former will provide a detailed understanding of bright sources, while the latter will constrain the (substantial) faint source population. We further describe how optimizing the comparison of these two measurements requires near-infrared galaxy surveys covering large volumes and retaining redshift information and also improvements in 21-cm analysis, moving those experiments into the imaging regime., Comment: 9 pages, 3 figures

Cosmic dawn and the Epoch of Reionization (EoR) are among the least explored observational eras in cosmology: a time at which the first galaxies and supermassive black holes formed and reionized the cold, neutral Universe of the post-recombination era. With current instruments, only a handful of the brightest galaxies and quasars from that time are detectable as individual objects, due to their extreme distances. Fortunately, a multitude of multi-wavelength intensity mapping measurements, ranging from the redshifted 21 cm background in the radio to the unresolved X-ray background, contain a plethora of synergistic information about this elusive era. The coming decade will likely see direct detections of inhomogenous reionization with CMB and 21 cm observations, and a slew of other probes covering overlapping areas and complementary physical processes will provide crucial additional information and cross-validation. To maximize scientific discovery and return on investment, coordinated survey planning and joint data analysis should be a high priority, closely coupled to computational models and theoretical predictions., Comment: 5 pages, 1 figure, submitted to the Astro2020 Decadal Survey Science White Paper call

Hamiltonian Monte Carlo is a powerful algorithm for sampling from difficult-to-normalize posterior distributions. However, when the geometry of the posterior is unfavorable, it may take many expensive evaluations of the target distribution and its gradient to converge and mix. We propose neural transport (NeuTra) HMC, a technique for learning to correct this sort of unfavorable geometry using inverse autoregressive flows (IAF), a powerful neural variational inference technique. The IAF is trained to minimize the KL divergence from an isotropic Gaussian to the warped posterior, and then HMC sampling is performed in the warped space. We evaluate NeuTra HMC on a variety of synthetic and real problems, and find that it significantly outperforms vanilla HMC both in time to reach the stationary distribution and asymptotic effective-sample-size rates.

Radio Frequency Interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array grow larger in number of receivers. To address this, we present a Deep Fully Convolutional Neural Network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known "ground truth" dataset for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6$\times 10^{5}$ HERA time-ordered 1024 channeled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time-frequency context which increases discrimination between RFI and Non-RFI. The inclusion of phase when predicting achieves a Recall of 0.81, Precision of 0.58, and $F_{2}$ score of 0.75 as applied to our HERA-67 observations., Comment: 11 pages, 7 figures

The Epoch of Reionization (EoR) is an uncharted era in our Universe's history during which the birth of the first stars and galaxies led to the ionization of neutral hydrogen in the intergalactic medium. There are many experiments investigating the EoR by tracing the 21cm line of neutral hydrogen. Because this signal is very faint and difficult to isolate, it is crucial to develop analysis techniques that maximize sensitivity and suppress contaminants in data. It is also imperative to understand the trade-offs between different analysis methods and their effects on power spectrum estimates. Specifically, with a statistical power spectrum detection in HERA's foreseeable future, it has become increasingly important to understand how certain analysis choices can lead to the loss of the EoR signal. In this paper, we focus on signal loss associated with power spectrum estimation. We describe the origin of this loss using both toy models and data taken by the 64-element configuration of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER). In particular, we highlight how detailed investigations of signal loss have led to a revised, higher 21cm power spectrum upper limit from PAPER-64. Additionally, we summarize errors associated with power spectrum error estimation that were previously unaccounted for. We focus on a subset of PAPER-64 data in this paper; revised power spectrum limits from the PAPER experiment are presented in a forthcoming paper by Kolopanis et al. (in prep.) and supersede results from previously published PAPER analyses., Comment: 25 pages, 18 figures, Accepted by ApJ

The separation of cosmological signal from astrophysical foregrounds is a fundamental challenge for any effort to probe the evolution of neutral hydrogen during the Cosmic Dawn and epoch of reionization (EoR) using the 21 cm hyperfine transition. Foreground separation is made possible by their intrinsic spectral smoothness, making them distinguishable from spectrally complex cosmological signal even though they are ~5 orders of magnitude brighter. Precisely calibrated radio interferometers are essential to maintaining the smoothness and thus separability of the foregrounds. One powerful calibration strategy is to use redundant measurements between pairs of antennas with the same physical separation in order to solve for each antenna's spectral response without reference to a sky model. This strategy is being employed by the Hydrogen Epoch of Reionization Array (HERA), a large radio telescope in South Africa that is now observing while being built out to 350 14-m dishes. However, the deviations from perfect redundancy inherent in any real radio telescope complicate the calibration problem. Using simulations of HERA, we show how calibration with antenna-to-antenna variations in dish construction and placement generally lead to spectral structure in otherwise smooth foregrounds that significantly reduces the number of cosmological modes available to a 21 cm measurement. However, we also show that this effect can be largely eliminated by a modified redundant-baseline calibration strategy that relies predominantly on short baselines., Comment: 14 pages, 12 figures. Updated to match the accepted MNRAS version

We present a simple case study, demonstrating that Variational Information Bottleneck (VIB) can improve a network's classification calibration as well as its ability to detect out-of-distribution data. Without explicitly being designed to do so, VIB gives two natural metrics for handling and quantifying uncertainty., Comment: 10 pages, 7 figures. Accepted to UAI 2018 - Uncertainty in Deep Learning Workshop

New massively redundant low frequency arrays allow for a novel investigation of closure relations in interferometry. We employ commissioning data from the Hydrogen Epoch of Reionization Array to investigate closure quantities in this densely packed grid array of 14m antennas operating at 100 MHz to 200 MHz. We investigate techniques that utilize closure phase spectra for redundant triads to estimate departures from redundancy for redundant baseline visibilities. We find a median absolute deviation from redundancy in closure phase across the observed frequency range of about 4.5deg. This value translates into a non-redundancy per visibility phase of about 2.6deg, using prototype electronics. The median absolute deviations from redundancy decrease with longer baselines. We show that closure phase spectra can be used to identify ill-behaved antennas in the array, independent of calibration. We investigate the temporal behavior of closure spectra. The Allan variance increases after a one minute stride time, due to passage of the sky through the primary beam of the transit telescope. However, the closure spectra repeat to well within the noise per measurement at corresponding local sidereal times (LST) from day to day. In future papers in this series we will develop the technique of using closure phase spectra in the search for the HI 21cm signal from cosmic reionization., Comment: 32 pages. 11 figures. Accepted to Radio Science

Foreground power dominates the measurements of interferometers that seek a statistical detection of highly-redshifted HI emission from the Epoch of Reionization (EoR). The chromaticity of the instrument creates a boundary in the Fourier transform of frequency (proportional to $k_\parallel$) between spectrally smooth emission, characteristic of the strong synchrotron foreground (the "wedge"), and the spectrally structured emission from HI in the EoR (the "EoR window"). Faraday rotation can inject spectral structure into otherwise smooth polarized foreground emission, which through instrument effects or miscalibration could possibly pollute the EoR window. Using data from the HERA 19-element commissioning array, we investigate the polarization response of this new instrument in the power spectrum domain. We perform a simple image-based calibration based on the unpolarized diffuse emission of the Global Sky Model, and show that it achieves qualitative redundancy between the nominally-redundant baselines of the array and reasonable amplitude accuracy. We construct power spectra of all fully polarized coherencies in all pseudo-Stokes parameters. We compare to simulations based on an unpolarized diffuse sky model and detailed electromagnetic simulations of the dish and feed, confirming that in Stokes I, the calibration does not add significant spectral structure beyond the expected level. Further, this calibration is stable over the 8 days of observations considered. Excess power is seen in the power spectra of the linear polarization Stokes parameters which is not easily attributable to leakage via the primary beam, and results from some combination of residual calibration errors and actual polarized emission. Stokes V is found to be highly discrepant from the expectation of zero power, strongly pointing to the need for more accurate polarized calibration., Comment: 21 pages, 12 figures, submitted to ApJ

Observations of the 21cm Epoch of Reionization (EoR) signal are dominated by Galactic and extragalactic foregrounds. The need for foreground removal has led to the development of two main techniques, often referred to as "foreground avoidance" and "foreground subtraction." Avoidance is associated with filtering foregrounds in Fourier space, while subtraction uses an explicit foreground model that is removed. Using 1088 hours of data from the 64-element PAPER array, we demonstrate that subtraction of a foreground model prior to delay-space foreground filtering results in a modest but measurable improvement of the performance of the filter. This proof-of-concept result shows that improvement stems from the reduced dynamic range requirements needed for the foreground filter: subtraction of a foreground model reduces the total foreground power, so for a fixed dynamic range, the filter can push towards fainter limits. We also find that the choice of window function used in the foreground filter can have an appreciable affect on the performance near the edges of the observing band. We demonstrate these effects using a smaller 3 hour sampling of data from the MWA, and find that the hybrid filtering and subtraction removal approach provides similar improvements across the band as seen in the case with PAPER-64., Comment: 20 pages, 12 figures

21 cm cosmology is a promising new probe of the evolution of visible matter in our universe, especially during the poorly-constrained Cosmic Dawn and Epoch of Reionization. However, in order to separate the 21 cm signal from bright astrophysical foregrounds, we need an exquisite understanding of our telescopes so as to avoid adding spectral structure to spectrally-smooth foregrounds. One powerful calibration method relies on repeated simultaneous measurements of the same interferometric baseline to solve for the sky signal and for instrumental parameters simultaneously. However, certain degrees of freedom are not constrained by asserting internal consistency between redundant measurements. In this paper, we review the origin of these "degeneracies" of redundant-baseline calibration and demonstrate how they can source unwanted spectral structure in our measurement and show how to eliminate that additional, artificial structure. We also generalize redundant calibration to dual-polarization instruments, derive the degeneracy structure, and explore the unique challenges to calibration and preserving spectral smoothness presented by a polarized measurement., Comment: 12 pages, 3 figures, updated to match the published MNRAS version

The TensorFlow Distributions library implements a vision of probability theory adapted to the modern deep-learning paradigm of end-to-end differentiable computation. Building on two basic abstractions, it offers flexible building blocks for probabilistic computation. Distributions provide fast, numerically stable methods for generating samples and computing statistics, e.g., log density. Bijectors provide composable volume-tracking transformations with automatic caching. Together these enable modular construction of high dimensional distributions and transformations not possible with previous libraries (e.g., pixelCNNs, autoregressive flows, and reversible residual networks). They are the workhorse behind deep probabilistic programming systems like Edward and empower fast black-box inference in probabilistic models built on deep-network components. TensorFlow Distributions has proven an important part of the TensorFlow toolkit within Google and in the broader deep learning community.

Recent work in unsupervised representation learning has focused on learning deep directed latent-variable models. Fitting these models by maximizing the marginal likelihood or evidence is typically intractable, thus a common approximation is to maximize the evidence lower bound (ELBO) instead. However, maximum likelihood training (whether exact or approximate) does not necessarily result in a good latent representation, as we demonstrate both theoretically and empirically. In particular, we derive variational lower and upper bounds on the mutual information between the input and the latent variable, and use these bounds to derive a rate-distortion curve that characterizes the tradeoff between compression and reconstruction accuracy. Using this framework, we demonstrate that there is a family of models with identical ELBO, but different quantitative and qualitative characteristics. Our framework also suggests a simple new method to ensure that latent variable models with powerful stochastic decoders do not ignore their latent code., Comment: 21 pages, 9 figures

The experimental efforts to detect the redshifted 21 cm signal from the Epoch of Reionization (EoR) are limited predominantly by the chromatic instrumental systematic effect. The delay spectrum methodology for 21 cm power spectrum measurements brought new attention to the critical impact of an antenna's chromaticity on the viability of making this measurement. This methodology established a straightforward relationship between time-domain response of an instrument and the power spectrum modes accessible to a 21 cm EoR experiment. We examine the performance of a prototype of the Hydrogen Epoch of Reionization Array (HERA) array element that is currently observing in Karoo desert, South Africa. We present a mathematical framework to derive the beam integrated frequency response of a HERA prototype element in reception from the return loss measurements between 100-200 MHz and determined the extent of additional foreground contamination in the delay space. The measurement reveals excess spectral structures in comparison to the simulation studies of the HERA element. Combined with the HERA data analysis pipeline that incorporates inverse covariance weighting in optimal quadratic estimation of power spectrum, we find that in spite of its departure from the simulated response, HERA prototype element satisfies the necessary criteria posed by the foreground attenuation limits and potentially can measure the power spectrum at spatial modes as low as $k_{\parallel} > 0.1h$~Mpc$^{-1}$. The work highlights a straightforward method for directly measuring an instrument response and assessing its impact on 21 cm EoR power spectrum measurements for future experiments that will use reflector-type antenna., Comment: 13 pages, 10 figures, Submitted to APJ

We present a variational approximation to the information bottleneck of Tishby et al. (1999). This variational approach allows us to parameterize the information bottleneck model using a neural network and leverage the reparameterization trick for efficient training. We call this method "Deep Variational Information Bottleneck", or Deep VIB. We show that models trained with the VIB objective outperform those that are trained with other forms of regularization, in terms of generalization performance and robustness to adversarial attack., Comment: 19 pages, 8 figures, Accepted to ICLR17

The Detection of redshifted 21 cm emission from the epoch of reionization (EoR) is a challenging task owing to strong foregrounds that dominate the signal. In this paper, we propose a general method, based on the delay spectrum approach, to extract HI power spectra that is applicable to tracking observations using an imaging radio interferometer (Delay Spectrum with Imaging Arrays (DSIA)). Our method is based on modelling the HI signal taking into account the impact of wide field effects such as the $w$-term which are then used as appropriate weights in cross-correlating the measured visibilities. Our method is applicable to any radio interferometer that tracks a phase center and could be utilized for arrays such as MWA, LOFAR, GMRT, PAPER and HERA. In the literature the delay spectrum approach has been implemented for near-redundant baselines using drift scan observations. In this paper we explore the scheme for non-redundant tracking arrays, and this is the first application of delay spectrum methodology to such data to extract the HI signal. We analyze 3 hours of MWA tracking data on the EoR1 field. We present both 2-dimensional ($k_\parallel,k_\perp$) and 1-dimensional (k) power spectra from the analysis. Our results are in agreement with the findings of other pipelines developed to analyse the MWA EoR data., Comment: 17 pages, 10 figures, accepted for publication in The Astrophysical Journal

We study the impact of sky-based calibration errors from source mismodeling on 21\,cm power spectrum measurements with an interferometer and propose a method for suppressing their effects. While emission from faint sources that are not accounted for in calibration catalogs is believed to be spectrally smooth, deviations of true visibilities from model visibilities are not, due to the inherent chromaticity of the interferometer's sky-response (the "wedge"). Thus, unmodeled foregrounds, below the confusion limit of many instruments, introduce frequency structure into gain solutions on the same line-of-sight scales on which we hope to observe the cosmological signal. We derive analytic expressions describing these errors using linearized approximations of the calibration equations and estimate the impact of this bias on measurements of the 21\,cm power spectrum during the Epoch of Reionization (EoR). Given our current precision in primary beam and foreground modeling, this noise will significantly impact the sensitivity of existing experiments that rely on sky-based calibration. Our formalism describes the scaling of calibration with array and sky-model parameters and can be used to guide future instrument design and calibration strategy. We find that sky-based calibration that down-weights long baselines can eliminate contamination in most of the region outside of the wedge with only a modest increase in instrumental noise., Comment: 24 pages, 8 figures, 1 table, accepted for publication in MNRAS. Matches published version

The Murchison Widefield Array (MWA) has collected hundreds of hours of Epoch of Reionization (EoR) data and now faces the challenge of overcoming foreground and systematic contamination to reduce the data to a cosmological measurement. We introduce several novel analysis techniques such as cable reflection calibration, hyper-resolution gridding kernels, diffuse foreground model subtraction, and quality control methods. Each change to the analysis pipeline is tested against a two dimensional power spectrum figure of merit to demonstrate improvement. We incorporate the new techniques into a deep integration of 32 hours of MWA data. This data set is used to place a systematic-limited upper limit on the cosmological power spectrum of $\Delta^2 \leq 2.7 \times 10^4$ mK$^2$ at $k=0.27$ h~Mpc$^{-1}$ and $z=7.1$, consistent with other published limits, and a modest improvement (factor of 1.4) over previous MWA results. From this deep analysis we have identified a list of improvements to be made to our EoR data analysis strategies. These improvements will be implemented in the future and detailed in upcoming publications., Comment: 21 pages, 16 figures, accepted to ApJ

The Hydrogen Epoch of Reionization Array (HERA) is a staged experiment to measure 21 cm emission from the primordial intergalactic medium (IGM) throughout cosmic reionization ($z=6-12$), and to explore earlier epochs of our Cosmic Dawn ($z\sim30$). During these epochs, early stars and black holes heated and ionized the IGM, introducing fluctuations in 21 cm emission. HERA is designed to characterize the evolution of the 21 cm power spectrum to constrain the timing and morphology of reionization, the properties of the first galaxies, the evolution of large-scale structure, and the early sources of heating. The full HERA instrument will be a 350-element interferometer in South Africa consisting of 14-m parabolic dishes observing from 50 to 250 MHz. Currently, 19 dishes have been deployed on site and the next 18 are under construction. HERA has been designated as an SKA Precursor instrument. In this paper, we summarize HERA's scientific context and provide forecasts for its key science results. After reviewing the current state of the art in foreground mitigation, we use the delay-spectrum technique to motivate high-level performance requirements for the HERA instrument. Next, we present the HERA instrument design, along with the subsystem specifications that ensure that HERA meets its performance requirements. Finally, we summarize the schedule and status of the project. We conclude by suggesting that, given the realities of foreground contamination, current-generation 21 cm instruments are approaching their sensitivity limits. HERA is designed to bring both the sensitivity and the precision to deliver its primary science on the basis of proven foreground filtering techniques, while developing new subtraction techniques to unlock new capabilities. The result will be a major step toward realizing the widely recognized scientific potential of 21 cm cosmology., Comment: 26 pages, 24 figures, 2 tables

We present the 21 cm power spectrum analysis approach of the Murchison Widefield Array Epoch of Reionization project. In this paper, we compare the outputs of multiple pipelines for the purpose of validating statistical limits cosmological hydrogen at redshifts between 6 and 12. Multiple, independent, data calibration and reduction pipelines are used to make power spectrum limits on a fiducial night of data. Comparing the outputs of imaging and power spectrum stages highlights differences in calibration, foreground subtraction and power spectrum calculation. The power spectra found using these different methods span a space defined by the various tradeoffs between speed, accuracy, and systematic control. Lessons learned from comparing the pipelines range from the algorithmic to the prosaically mundane; all demonstrate the many pitfalls of neglecting reproducibility. We briefly discuss the way these different methods attempt to handle the question of evaluating a significant detection in the presence of foregrounds., Comment: accepted to ApJ

We present an improved Global Sky Model (GSM) of diffuse galactic radio emission from 10 MHz to 5 THz, whose uses include foreground modeling for CMB and 21 cm cosmology. Our model improves on past work both algorithmically and by adding new data sets such as the Planck maps and the enhanced Haslam map. Our method generalizes the Principal Component Analysis approach to handle non-overlapping regions, enabling the inclusion of 29 sky maps with no region of the sky common to all. We also perform a blind separation of our GSM into physical components with a method that makes no assumptions about physical emission mechanisms (synchrotron, free-free, dust, etc). Remarkably, this blind method automatically finds five components that have previously only been found "by hand", which we identify with synchrotron, free-free, cold dust, warm dust, and the CMB anisotropy, with maps and spectra agreeing with previous work but in many cases with smaller error bars. The improved GSM is available online at github.com/jeffzhen/gsm2016., Comment: 13 pages, 8 figures. Updated to match the MNRAS accepted version

We present first results from radio observations with the Murchison Widefield Array seeking to constrain the power spectrum of 21 cm brightness temperature fluctuations between the redshifts of 11.6 and 17.9 (113 and 75 MHz). Three hours of observations were conducted over two nights with significantly different levels of ionospheric activity. We use these data to assess the impact of systematic errors at low frequency, including the ionosphere and radio-frequency interference, on a power spectrum measurement. We find that after the 1-3 hours of integration presented here, our measurements at the Murchison Radio Observatory are not limited by RFI, even within the FM band, and that the ionosphere does not appear to affect the level of power in the modes that we expect to be sensitive to cosmology. Power spectrum detections, inconsistent with noise, due to fine spectral structure imprinted on the foregrounds by reflections in the signal-chain, occupy the spatial Fourier modes where we would otherwise be most sensitive to the cosmological signal. We are able to reduce this contamination using calibration solutions derived from autocorrelations so that we achieve an sensitivity of $10^4$ mK on comoving scales $k\lesssim 0.5 h$Mpc$^{-1}$. This represents the first upper limits on the $21$ cm power spectrum fluctuations at redshifts $12\lesssim z \lesssim 18$ but is still limited by calibration systematics. While calibration improvements may allow us to further remove this contamination, our results emphasize that future experiments should consider carefully the existence of and their ability to calibrate out any spectral structure within the EoR window., Comment: 31 pages, 23 figures, corrected spelling errors in metadata

We use time-domain electromagnetic simulations to determine the spectral characteristics of the Hydrogen Epoch of Reionization Arrays (HERA) antenna. These simulations are part of a multi-faceted campaign to determine the effectiveness of the dish's design for obtaining a detection of redshifted 21 cm emission from the epoch of reionization. Our simulations show the existence of reflections between HERA's suspended feed and its parabolic dish reflector that fall below -40 dB at 150 ns and, for reasonable impedance matches, have a negligible impact on HERA's ability to constrain EoR parameters. It follows that despite the reflections they introduce, dishes are effective for increasing the sensitivity of EoR experiments at relatively low cost. We find that electromagnetic resonances in the HERA feed's cylindrical skirt, which is intended to reduce cross coupling and beam ellipticity, introduces significant power at large delays ($-40$ dB at 200 ns) which can lead to some loss of measurable Fourier modes and a modest reduction in sensitivity. Even in the presence of this structure, we find that the spectral response of the antenna is sufficiently smooth for delay filtering to contain foreground emission at line-of-sight wave numbers below $k_\parallel \lesssim 0.2$ $h$Mpc$^{-1}$, in the region where the current PAPER experiment operates. Incorporating these results into a Fisher Matrix analysis, we find that the spectral structure observed in our simulations has only a small effect on the tight constraints HERA can achieve on parameters associated with the astrophysics of reionization., Comment: Accepted to ApJ, 18 pages, 17 Figures. Replacement matches accepted manuscript

Realizing the potential of 21 cm tomography to statistically probe the intergalactic medium before and during the Epoch of Reionization requires large telescopes and precise control of systematics. Next-generation telescopes are now being designed and built to meet these challenges, drawing lessons from first-generation experiments that showed the benefits of densely packed, highly redundant arrays--in which the same mode on the sky is sampled by many antenna pairs--for achieving high sensitivity, precise calibration, and robust foreground mitigation. In this work, we focus on the Hydrogen Epoch of Reionization Array (HERA) as an interferometer with a dense, redundant core designed following these lessons to be optimized for 21 cm cosmology. We show how modestly supplementing or modifying a compact design like HERA's can still deliver high sensitivity while enhancing strategies for calibration and foreground mitigation. In particular, we compare the imaging capability of several array configurations, both instantaneously (to address instrumental and ionospheric effects) and with rotation synthesis (for foreground removal). We also examine the effects that configuration has on calibratability using instantaneous redundancy. We find that improved imaging with sub-aperture sampling via "off-grid" antennas and increased angular resolution via far-flung "outrigger" antennas is possible with a redundantly calibratable array configuration., Comment: 19 pages, 11 figures. Revised to match the accepted ApJ version

The Hydrogen Epoch of Reionization Array (HERA) is a radio interferometer aiming to detect the power spectrum of 21 cm fluctuations from neutral hydrogen from the Epoch of Reionization (EOR). Drawing on lessons from the Murchison Widefield Array (MWA) and the Precision Array for Probing the Epoch of Reionization (PAPER), HERA is a hexagonal array of large (14 m diameter) dishes with suspended dipole feeds. Not only does the dish determine overall sensitivity, it affects the observed frequency structure of foregrounds in the interferometer. This is the first of a series of four papers characterizing the frequency and angular response of the dish with simulations and measurements. We focus in this paper on the angular response (i.e., power pattern), which sets the relative weighting between sky regions of high and low delay, and thus, apparent source frequency structure. We measure the angular response at 137 MHz using the ORBCOMM beam mapping system of Neben et al. We measure a collecting area of 93 m^2 in the optimal dish/feed configuration, implying HERA-320 should detect the EOR power spectrum at z~9 with a signal-to-noise ratio of 12.7 using a foreground avoidance approach with a single season of observations, and 74.3 using a foreground subtraction approach. Lastly we study the impact of these beam measurements on the distribution of foregrounds in Fourier space., Comment: 13 pages, 9 figures. Replaced to match accepted ApJ version

In this paper we present observations, simulations, and analysis demonstrating the direct connection between the location of foreground emission on the sky and its location in cosmological power spectra from interferometric redshifted 21 cm experiments. We begin with a heuristic formalism for understanding the mapping of sky coordinates into the cylindrically averaged power spectra measurements used by 21 cm experiments, with a focus on the effects of the instrument beam response and the associated sidelobes. We then demonstrate this mapping by analyzing power spectra with both simulated and observed data from the Murchison Widefield Array. We find that removing a foreground model which includes sources in both the main field-of-view and the first sidelobes reduces the contamination in high k_parallel modes by several percent relative to a model which only includes sources in the main field-of-view, with the completeness of the foreground model setting the principal limitation on the amount of power removed. While small, a percent-level amount of foreground power is in itself more than enough to prevent recovery of any EoR signal from these modes. This result demonstrates that foreground subtraction for redshifted 21 cm experiments is truly a wide-field problem, and algorithms and simulations must extend beyond the main instrument field-of-view to potentially recover the full 21 cm power spectrum., Comment: 13 pages, 9 figures, matches version accepted to ApJ

Detection of the cosmological neutral hydrogen signal from the Epoch of Reionization, and estimation of its basic physical parameters, is the principal scientific aim of many current low-frequency radio telescopes. Here we describe the Cosmological HI Power Spectrum Estimator (CHIPS), an algorithm developed and implemented with data from the Murchison Widefield Array (MWA), to compute the two-dimensional and spherically-averaged power spectrum of brightness temperature fluctuations. The principal motivations for CHIPS are the application of realistic instrumental and foreground models to form the optimal estimator, thereby maximising the likelihood of unbiased signal estimation, and allowing a full covariant understanding of the outputs. CHIPS employs an inverse-covariance weighting of the data through the maximum likelihood estimator, thereby allowing use of the full parameter space for signal estimation ("foreground suppression"). We describe the motivation for the algorithm, implementation, application to real and simulated data, and early outputs. Upon application to a set of 3 hours of data, we set a 2$\sigma$ upper limit on the EoR dimensionless power at $k=0.05$~h.Mpc$^{-1}$ of $\Delta_k^2<7.6\times{10^4}$~mK$^2$ in the redshift range $z=[6.2-6.6]$, consistent with previous estimates., Comment: 34 pages, accepted for publication in ApJ

We use the Fisher matrix formalism and semi-numerical simulations to derive quantitative predictions of the constraints that power spectrum measurements on next-generation interferometers, such as the Hydrogen Epoch of Reionization Array (HERA) and the Square Kilometre Array (SKA), will place on the characteristics of the X-ray sources that heated the high redshift intergalactic medium. Incorporating observations between $z=5$ and $z=25$, we find that the proposed 331 element HERA and SKA phase 1 will be capable of placing $\lesssim 10\%$ constraints on the spectral properties of these first X-ray sources, even if one is unable to perform measurements within the foreground contaminated "wedge" or the FM band. When accounting for the enhancement in power spectrum amplitude from spin temperature fluctuations, we find that the observable signatures of reionization extend well beyond the peak in the power spectrum usually associated with it. We also find that lower redshift degeneracies between the signatures of heating and reionization physics lead to errors on reionization parameters that are significantly greater than previously predicted. Observations over the heating epoch are able to break these degeneracies and improve our constraints considerably. For these two reasons, 21\,cm observations during the heating epoch significantly enhance our understanding of reionization as well., Comment: 15 pages, 10 figures, Accepted to MNRAS