Search

Observation of redshifted 21-cm signal from the Epoch of Reionization (EoR) is challenging due to contamination from the bright foreground sources that exceed the signal by several orders of magnitude. The removal of this very high foreground relies on accurate calibration to keep the intrinsic property of the foreground with frequency. Commonly employed calibration techniques for these experiments are the sky model-based and the redundant baseline-based calibration approaches. However, the sky model-based and redundant baseline-based calibration methods could suffer from sky-modeling error and array redundancy imperfection issues, respectively. In this work, we introduce the hybrid correlation calibration ("CorrCal") scheme, which aims to bridge the gap between redundant and sky-based calibration by relaxing redundancy of the array and including sky information into the calibration formalisms. We demonstrate the slight improvement of power spectra, about $-6\%$ deviation at the bin right on the horizon limit of the foreground wedge-like structure, relative to the power spectra before the implementation of "CorrCal" to the data from the Precision Array for Probing the Epoch of Reionization (PAPER) experiment, which was otherwise calibrated using redundant baseline calibration. This small improvement of the foreground power spectra around the wedge limit could be suggestive of reduced spectral structure in the data after "CorrCal" calibration, which lays the foundation for future improvement of the calibration algorithm and implementation method., Comment: 18 pages, 12 figures, MNRAS in press

This paper presents the design of a new dual-polarised Vivaldi feed for the Hydrogen Epoch of Reionization Array (HERA) radio-telescope. This wideband feed has been developed to replace the Phase I dipole feed, and is used to illuminate a 14-m diameter dish. It aims to improve the science capabilities of HERA, by allowing it to characterise the redshifted 21-cm hydrogen signal from the Cosmic Dawn as well as from the Epoch of Reionization. This is achieved by increasing the bandwidth from 100 -- 200 MHz to 50 -- 250 MHz, optimising the time response of the antenna - receiver system, and improving its sensitivity. This new Vivaldi feed is directly fed by a differential front-end module placed inside the circular cavity and connected to the back-end via cables which pass in the middle of the tapered slot. We show that this particular configuration has minimal effects on the radiation pattern and on the system response., Comment: 15 pages, 32 figures. This article has been accepted for publication in IEEE Transactions on Antennas and Propagation. This is the author's version which has not been fully edited and content may change prior to final publication. Citation information: DOI 10.1109/TAP.2021.3083788. Copyright 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission

We present a Bayesian jackknife test for assessing the probability that a data set contains biased subsets, and, if so, which of the subsets are likely to be biased. The test can be used to assess the presence and likely source of statistical tension between different measurements of the same quantities in an automated manner. Under certain broadly applicable assumptions, the test is analytically tractable. We also provide an open-source code, chiborg, that performs both analytic and numerical computations of the test on general Gaussian-distributed data. After exploring the information theoretical aspects of the test and its performance with an array of simulations, we apply it to data from the Hydrogen Epoch of Reionization Array (HERA) to assess whether different sub-seasons of observing can justifiably be combined to produce a deeper 21 cm power spectrum upper limit. We find that, with a handful of exceptions, the HERA data in question are statistically consistent and this decision is justified. We conclude by pointing out the wide applicability of this test, including to CMB experiments and the H0 tension.

Precision calibration poses challenges to experiments probing the redshifted 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization (z~30-6). In both interferometric and global signal experiments, systematic calibration is the leading source of error. Though many aspects of calibration have been studied, the overlap between the two types of instruments has received less attention. We investigate the sky based calibration of total power measurements with a HERA dish and an EDGES style antenna to understand the role of auto-correlations in the calibration of an interferometer and the role of sky in calibrating a total power instrument. Using simulations we study various scenarios such as time variable gain, incomplete sky calibration model, and primary beam model. We find that temporal gain drifts, sky model incompleteness, and beam inaccuracies cause biases in the receiver gain amplitude and the receiver temperature estimates. In some cases, these biases mix spectral structure between beam and sky resulting in spectrally variable gain errors. Applying the calibration method to the HERA and EDGES data, we find good agreement with calibration via the more standard methods. Although instrumental gains are consistent with beam and sky errors similar in scale to those simulated, the receiver temperatures show significant deviations from expected values. While we show that it is possible to partially mitigate biases due to model inaccuracies by incorporating a time-dependent gain model in calibration, the resulting errors on calibration products are larger and more correlated. Completely addressing these biases will require more accurate sky and primary beam models., Comment: 16 pages, 13 figures, 1 table; accepted for publication in MNRAS main journal

The key challenge in the observation of the redshifted 21-cm signal from cosmic reionization is its separation from the much brighter foreground emission. Such separation relies on the different spectral properties of the two components, although, in real life, the foreground intrinsic spectrum is often corrupted by the instrumental response, inducing systematic effects that can further jeopardize the measurement of the 21-cm signal. In this paper, we use Gaussian Process Regression to model both foreground emission and instrumental systematics in $\sim 2$ hours of data from the Hydrogen Epoch of Reionization Array. We find that a simple co-variance model with three components matches the data well, giving a residual power spectrum with white noise properties. These consist of an "intrinsic" and instrumentally corrupted component with a coherence-scale of 20 MHz and 2.4 MHz respectively (dominating the line of sight power spectrum over scales $k_{\parallel} \le 0.2$ h cMpc$^{-1}$) and a baseline dependent periodic signal with a period of $\sim 1$ MHz (dominating over $k_{\parallel} \sim 0.4 - 0.8$h cMpc$^{-1}$) which should be distinguishable from the 21-cm EoR signal whose typical coherence-scales is $\sim 0.8$ MHz., 15 pages, 15 figures, 1 table, Accepted to MNRAS

Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data., Comment: 21 pages, 13 figures

We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets., Comment: 31 pages, 17 figures

Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power spectrum approach, we have produced a critical examination of different ways that one can estimate error bars on the power spectrum. We do this through a synthesis of analytic work, simulations of toy models, and tests on small amounts of real data. We find that, although computed independently, the different error bar methodologies are in good agreement with each other in the noise-dominated regime of the power spectrum. For our preferred methodology, the predicted probability distribution function is consistent with the empirical noise power distributions from both simulated and real data. This diagnosis is mainly in support of the forthcoming HERA upper limit, and also is expected to be more generally applicable., Comment: 35 Pages, 9 Figures, 4 Tables. Replaced with accepted ApJ version; some clarifying text added in response to referee comments with no changes to results

As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data., Comment: 15 pages, 3 figures, published in Astronomy and Computing

In 21 cm cosmology, precision calibration is key to the separation of the neutral hydrogen signal from very bright but spectrally-smooth astrophysical foregrounds. The Hydrogen Epoch of Reionization Array (HERA), an interferometer specialized for 21 cm cosmology and now under construction in South Africa, was designed to be largely calibrated using the self-consistency of repeated measurements of the same interferometric modes. This technique, known as "redundant-baseline calibration" resolves most of the internal degrees of freedom in the calibration problem. It assumes, however, on antenna elements with identical primary beams placed precisely on a redundant grid. In this work, we review the detailed implementation of the algorithms enabling redundant-baseline calibration and report results with HERA data. We quantify the effects of real-world non-redundancy and how they compare to the idealized scenario in which redundant measurements differ only in their noise realizations. Finally, we study how non-redundancy can produce spurious temporal structure in our calibration solutions--both in data and in simulations--and present strategies for mitigating that structure., Comment: 24 Pages, 19 Figures. Updated to match the accepted MNRAS version

We introduce DAYENU, a linear, spectral filter for HI intensity mapping that achieves the desirable foreground mitigation and error minimization properties of inverse co-variance weighting with minimal modeling of the underlying data. Beyond 21 cm power-spectrum estimation, our filter is suitable for any analysis where high dynamic-range removal of spectrally smooth foregrounds in irregularly (or regularly) sampled data is required, something required by many other intensity mapping techniques. Our filtering matrix is diagonalized by Discrete Prolate Spheroidal Sequences which are an optimal basis to model band-limited foregrounds in 21 cm intensity mapping experiments in the sense that they maximally concentrate power within a finite region of Fourier space. We show that DAYENU enables the access of large-scale line-of-sight modes that are inaccessible to tapered DFT estimators. Since these modes have the largest SNRs, DAYENU significantly increases the sensitivity of 21 cm analyses over tapered Fourier transforms. Slight modifications allow us to use DAYENU as a linear replacement for iterative delay CLEANing (DAYENUREST). We refer readers to the Code section at the end of this paper for links to examples and code., Accepted to MNRAS, 19 pages, 17 figures. Replacement matches accepted version

Characterizing the epoch of reionization (EoR) at $z\gtrsim 6$ via the redshifted 21 cm line of neutral Hydrogen (HI) is critical to modern astrophysics and cosmology, and thus a key science goal of many current and planned low-frequency radio telescopes. The primary challenge to detecting this signal is the overwhelmingly bright foreground emission at these frequencies, placing stringent requirements on the knowledge of the instruments and inaccuracies in analyses. Results from these experiments have largely been limited not by thermal sensitivity but by systematics, particularly caused by the inability to calibrate the instrument to high accuracy. The interferometric bispectrum phase is immune to antenna-based calibration and errors therein, and presents an independent alternative to detect the EoR HI fluctuations while largely avoiding calibration systematics. Here, we provide a demonstration of this technique on a subset of data from the Hydrogen Epoch of Reionization Array (HERA) to place approximate constraints on the brightness temperature of the intergalactic medium (IGM). From this limited data, at $z=7.7$ we infer "$1\sigma$" upper limits on the IGM brightness temperature to be $\le 316$ "pseudo" mK at $\kappa_\parallel=0.33$ "pseudo" $h$ Mpc$^{-1}$ (data-limited) and $\le 1000$ "pseudo" mK at $\kappa_\parallel=0.875$ "pseudo" $h$ Mpc$^{-1}$ (noise-limited). The "pseudo" units denote only an approximate and not an exact correspondence to the actual distance scales and brightness temperatures. By propagating models in parallel to the data analysis, we confirm that the dynamic range required to separate the cosmic HI signal from the foregrounds is similar to that in standard approaches, and the power spectrum of the bispectrum phase is still data-limited (at $\gtrsim 10^6$ dynamic range) indicating scope for further improvement in sensitivity as the array build-out continues., Comment: 22 pages, 12 figures (including sub-figures). Published in PhRvD. Abstract may be slightly abridged compared to the actual manuscript due to length limitations on arXiv

We analyze data from the Hydrogen Epoch of Reionization Array. This is the third in a series of papers on the closure phase delay-spectrum technique designed to detect the HI 21cm emission from cosmic reionization. We present the details of the data and models employed in the power spectral analysis, and discuss limitations to the process. We compare images and visibility spectra made with HERA data, to parallel quantities generated from sky models based on the GLEAM survey, incorporating the HERA telescope model. We find reasonable agreement between images made from HERA data, with those generated from the models, down to the confusion level. For the visibility spectra, there is broad agreement between model and data across the full band of $\sim 80$MHz. However, models with only GLEAM sources do not reproduce a roughly sinusoidal spectral structure at the tens of percent level seen in the observed visibility spectra on scales $\sim 10$ MHz on 29 m baselines. We find that this structure is likely due to diffuse Galactic emission, predominantly the Galactic plane, filling the far sidelobes of the antenna primary beam. We show that our current knowledge of the frequency dependence of the diffuse sky radio emission, and the primary beam at large zenith angles, is inadequate to provide an accurate reproduction of the diffuse structure in the models. We discuss implications due to this missing structure in the models, including calibration, and in the search for the HI 21cm signal, as well as possible mitigation techniques., Comment: 17 pages, 10 figures, accepted for the ApJ Supplement

The experimental efforts to detect the redshifted 21 cm signal from the Epoch of Reionization (EoR) are limited predominantly by the chromatic instrumental systematic effect. The delay spectrum methodology for 21 cm power spectrum measurements brought new attention to the critical impact of an antenna's chromaticity on the viability of making this measurement. This methodology established a straightforward relationship between time-domain response of an instrument and the power spectrum modes accessible to a 21 cm EoR experiment. We examine the performance of a prototype of the Hydrogen Epoch of Reionization Array (HERA) array element that is currently observing in Karoo desert, South Africa. We present a mathematical framework to derive the beam integrated frequency response of a HERA prototype element in reception from the return loss measurements between 100-200 MHz and determined the extent of additional foreground contamination in the delay space. The measurement reveals excess spectral structures in comparison to the simulation studies of the HERA element. Combined with the HERA data analysis pipeline that incorporates inverse covariance weighting in optimal quadratic estimation of power spectrum, we find that in spite of its departure from the simulated response, HERA prototype element satisfies the necessary criteria posed by the foreground attenuation limits and potentially can measure the power spectrum at spatial modes as low as $k_{\parallel} > 0.1h$~Mpc$^{-1}$. The work highlights a straightforward method for directly measuring an instrument response and assessing its impact on 21 cm EoR power spectrum measurements for future experiments that will use reflector-type antenna., 13 pages, 10 figures, Submitted to APJ

Observations of the redshifted 21-cm line from the epoch of reionization have recently motivated the construction of low frequency radio arrays with highly redundant configurations. These configurations provide an alternative calibration strategy - "redundant calibration" - and boosts sensitivity on specific spatial scales. In this paper, we formulate calibration of redundant interferometric arrays as a complex optimization problem. We solve this optimization problem via the Levenberg-Marquardt algorithm. This calibration approach is more robust to initial conditions than current algorithms and, by leveraging an approximate matrix inversion, allows for further optimization and an efficient implementation ("redundant StEfCal"). We also investigated using the preconditioned conjugate gradient method as an alternative to the approximate matrix inverse, but found that its computational performance is not competitive with respect to "redundant StEfCal". The efficient implementation of this new algorithm is made publicly available., 11 pages, 7 figures, MNRAS accepted

Radio Frequency Interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array grow larger in number of receivers. To address this, we present a Deep Fully Convolutional Neural Network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known "ground truth" dataset for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6$\times 10^{5}$ HERA time-ordered 1024 channeled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time-frequency context which increases discrimination between RFI and Non-RFI. The inclusion of phase when predicting achieves a Recall of 0.81, Precision of 0.58, and $F_{2}$ score of 0.75 as applied to our HERA-67 observations., Comment: 11 pages, 7 figures

The detection of the Epoch of Reionization (EoR) delay power spectrum using a "foreground avoidance method" highly depends on the instrument chromaticity. The systematic effects induced by the radio-telescope spread the foreground signal in the delay domain, which contaminates the EoR window theoretically observable. Applied to the Hydrogen Epoch of Reionization Array (HERA), this paper combines detailed electromagnetic and electrical simulations in order to model the chromatic effects of the instrument, and quantify its frequency and time responses. In particular, the effects of the analogue receiver, transmission cables, and mutual coupling are included. These simulations are able to accurately predict the intensity of the reflections occurring in the 150-m cable which links the antenna to the back-end. They also show that electromagnetic waves can propagate from one dish to another one through large sections of the array due to mutual coupling. The simulated system time response is attenuated by a factor $10^{4}$ after a characteristic delay which depends on the size of the array and on the antenna position. Ultimately, the system response is attenuated by a factor $10^{5}$ after 1400 ns because of the reflections in the cable, which corresponds to characterizable ${k_\parallel}$-modes above 0.7 $h\;\rm{Mpc}^{-1}$ at 150 MHz. Thus, this new study shows that the detection of the EoR signal with HERA Phase I will be more challenging than expected. On the other hand, it improves our understanding of the telescope, which is essential to mitigate the instrument chromaticity., Comment: 13 pages, 17 figures - Submitted to MNRAS - 2nd revision

We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical implications for low-frequency radio surveys aiming to characterize the 21cm signal from the Epoch of Reionization and Cosmic Dawn, as systematics can cause bright foreground emission to contaminate the EoR window and prohibit a robust detection. We also quantify the signal loss properties of the systematic modeling algorithms, and show that our techniques demonstrate resistance against EoR signal loss. In a companion paper, we demonstrate these methods on data from the Hydrogen Epoch of Reionization Array as a proof-of-concept., Comment: Accepted to ApJ

We present limits on the 21cm power spectrum from the Epoch of Reionization (EoR) using data from the 64 antenna configuration of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER) analyzed through a power spectrum pipeline independent from previous PAPER analyses. Previously reported results from PAPER have been found to contain significant signal loss (Cheng et al. 2018, arxiv:1810.05175). Several lossy steps from previous PAPER pipelines have not been included in this analysis, namely: delay-based foreground filtering, optimal fringe-rate filtering, and empirical covariance-based estimators. Steps which remain in common with previous analyses include redundant calibration and local sidereal time (LST) binning. The power spectra reported here are effectively the result of applying a linear Fourier transform analysis to the calibrated, LST binned data. This analysis also uses more data than previous publications, including the complete available redshift range of $z \sim 7.5$ to $11$. In previous PAPER analyses, many power spectrum measurements were found to be detections of noncosmological power at levels of significance ranging from two to hundreds of times the theoretical noise. Here, excess power is examined using redundancy between baselines and power spectrum jackknives. The upper limits we find on the 21cm power spectrum from reionization are ($1500$ mK)$^{2}$, ($1900$ mK)$^{2}$, ($280$ mK)$^{2}$, ($200$ mK)$^{2}$, ($380$ mK)$^{2}$, ($300$ mK)$^{2}$ at redshifts $z=10.87,\ 9.93,\ 8.68,\ 8.37,\ 8.13,$ and $7.48$, respectively. For reasons described in Cheng et al. 2018 (arxiv:1810.05175), these limits supersede all previous PAPER results (Ali et al. 2018, arxiv:1502.06016)., Comment: 28 Pages, 17 Pages, Accepted to APJ

The central challenge in 21~cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes such as the Hydrogen Epoch of Reionization Array \citep[HERA, ][]{DeBoer2017} that do not move, primary beam characterization is particularly challenging because standard beam-calibration routines do not apply \citep{Cornwell2005} and current techniques require accurate source catalogs at the telescope resolution. We present an extension of the method from \citet{Pober2012} where they use beam symmetries to create a network of overlapping source tracks that break the degeneracy between source flux density and beam response and allow their simultaneous estimation. We fit the beam response of our instrument using early HERA observations and find that our results agree well with electromagnetic simulations down to a -20~dB level in power relative to peak gain for sources with high signal-to-noise ratio. In addition, we construct a source catalog with 90 sources down to a flux density of 1.4~Jy at 151~MHz., 22 pages, 22 figures, accepted for publication in ApJ

Foreground power dominates the measurements of interferometers that seek a statistical detection of highly-redshifted HI emission from the Epoch of Reionization (EoR). The chromaticity of the instrument creates a boundary in the Fourier transform of frequency (proportional to $k_\parallel$) between spectrally smooth emission, characteristic of the strong synchrotron foreground (the "wedge"), and the spectrally structured emission from HI in the EoR (the "EoR window"). Faraday rotation can inject spectral structure into otherwise smooth polarized foreground emission, which through instrument effects or miscalibration could possibly pollute the EoR window. Using data from the HERA 19-element commissioning array, we investigate the polarization response of this new instrument in the power spectrum domain. We perform a simple image-based calibration based on the unpolarized diffuse emission of the Global Sky Model, and show that it achieves qualitative redundancy between the nominally-redundant baselines of the array and reasonable amplitude accuracy. We construct power spectra of all fully polarized coherencies in all pseudo-Stokes parameters. We compare to simulations based on an unpolarized diffuse sky model and detailed electromagnetic simulations of the dish and feed, confirming that in Stokes I, the calibration does not add significant spectral structure beyond the expected level. Further, this calibration is stable over the 8 days of observations considered. Excess power is seen in the power spectra of the linear polarization Stokes parameters which is not easily attributable to leakage via the primary beam, and results from some combination of residual calibration errors and actual polarized emission. Stokes V is found to be highly discrepant from the expectation of zero power, strongly pointing to the need for more accurate polarized calibration., Comment: 21 pages, 12 figures, submitted to ApJ

Interferometric arrays seeking to measure the 21 cm signal from the Epoch of Reionization must contend with overwhelmingly bright emission from foreground sources. Accurate recovery of the 21 cm signal will require precise calibration of the array, and several new avenues for calibration have been pursued in recent years, including methods using redundancy in the antenna configuration. The newly upgraded Phase II of Murchison Widefield Array (MWA) is the first interferometer that has large numbers of redundant baselines while retaining good instantaneous UV-coverage. This array therefore provides a unique opportunity to compare redundant calibration with sky-model based algorithms. In this paper, we present the first results from comparing both calibration approaches with MWA Phase II observations. For redundant calibration, we use the package OMNICAL, and produce sky-based calibration solutions with the analysis package Fast Holographic Deconvolution (FHD). There are three principal results. (1) We report the success of OMNICAL on observations of ORBComm satellites, showing substantial agreement between redundant visibility measurements after calibration. (2) We directly compare OMNICAL calibration solutions with those from FHD, and demonstrate these two different calibration schemes give extremely similar results. (3) We explore improved calibration by combining OMNICAL and FHD. We evaluate these combined methods using power spectrum techniques developed for EoR analysis and find evidence for marginal improvements mitigating artifacts in the power spectrum. These results are likely limited by signal-to-noise in the six hours of data used, but suggest future directions for combining these two calibration schemes., 20 pages, 11 figures. Accepted to ApJ

The separation of cosmological signal from astrophysical foregrounds is a fundamental challenge for any effort to probe the evolution of neutral hydrogen during the Cosmic Dawn and epoch of reionization (EoR) using the 21 cm hyperfine transition. Foreground separation is made possible by their intrinsic spectral smoothness, making them distinguishable from spectrally complex cosmological signal even though they are ~5 orders of magnitude brighter. Precisely calibrated radio interferometers are essential to maintaining the smoothness and thus separability of the foregrounds. One powerful calibration strategy is to use redundant measurements between pairs of antennas with the same physical separation in order to solve for each antenna's spectral response without reference to a sky model. This strategy is being employed by the Hydrogen Epoch of Reionization Array (HERA), a large radio telescope in South Africa that is now observing while being built out to 350 14-m dishes. However, the deviations from perfect redundancy inherent in any real radio telescope complicate the calibration problem. Using simulations of HERA, we show how calibration with antenna-to-antenna variations in dish construction and placement generally lead to spectral structure in otherwise smooth foregrounds that significantly reduces the number of cosmological modes available to a 21 cm measurement. However, we also show that this effect can be largely eliminated by a modified redundant-baseline calibration strategy that relies predominantly on short baselines., Comment: 14 pages, 12 figures. Updated to match the accepted MNRAS version

Observations of the 21cm Epoch of Reionization (EoR) signal are dominated by Galactic and extragalactic foregrounds. The need for foreground removal has led to the development of two main techniques, often referred to as "foreground avoidance" and "foreground subtraction." Avoidance is associated with filtering foregrounds in Fourier space, while subtraction uses an explicit foreground model that is removed. Using 1088 hours of data from the 64-element PAPER array, we demonstrate that subtraction of a foreground model prior to delay-space foreground filtering results in a modest but measurable improvement of the performance of the filter. This proof-of-concept result shows that improvement stems from the reduced dynamic range requirements needed for the foreground filter: subtraction of a foreground model reduces the total foreground power, so for a fixed dynamic range, the filter can push towards fainter limits. We also find that the choice of window function used in the foreground filter can have an appreciable affect on the performance near the edges of the observing band. We demonstrate these effects using a smaller 3 hour sampling of data from the MWA, and find that the hybrid filtering and subtraction removal approach provides similar improvements across the band as seen in the case with PAPER-64., Comment: 20 pages, 12 figures

21 cm cosmology is a promising new probe of the evolution of visible matter in our universe, especially during the poorly-constrained Cosmic Dawn and Epoch of Reionization. However, in order to separate the 21 cm signal from bright astrophysical foregrounds, we need an exquisite understanding of our telescopes so as to avoid adding spectral structure to spectrally-smooth foregrounds. One powerful calibration method relies on repeated simultaneous measurements of the same interferometric baseline to solve for the sky signal and for instrumental parameters simultaneously. However, certain degrees of freedom are not constrained by asserting internal consistency between redundant measurements. In this paper, we review the origin of these "degeneracies" of redundant-baseline calibration and demonstrate how they can source unwanted spectral structure in our measurement and show how to eliminate that additional, artificial structure. We also generalize redundant calibration to dual-polarization instruments, derive the degeneracy structure, and explore the unique challenges to calibration and preserving spectral smoothness presented by a polarized measurement., Comment: 12 pages, 3 figures, updated to match the published MNRAS version

Current and upcoming radio interferometric experiments are aiming to make a statistical characterization of the high-redshift 21cm fluctuation signal spanning the hydrogen reionization and X-ray heating epochs of the universe. However, connecting 21cm statistics to underlying physical parameters is complicated by the theoretical challenge of modeling the relevant physics at computational speeds quick enough to enable exploration of the high dimensional and weakly constrained parameter space. In this work, we use machine learning algorithms to build a fast emulator that mimics expensive simulations of the 21cm signal across a wide parameter space to high precision. We embed our emulator within a Markov-Chain Monte Carlo framework, enabling it to explore the posterior distribution over a large number of model parameters, including those that govern the Epoch of Reionization, the Epoch of X-ray Heating, and cosmology. As a worked example, we use our emulator to present an updated parameter constraint forecast for the Hydrogen Epoch of Reionization Array experiment, showing that its characterization of a fiducial 21cm power spectrum will considerably narrow the allowed parameter space of reionization and heating parameters, and could help strengthen Planck's constraints on $\sigma_8$. We provide both our generalized emulator code and its implementation specifically for 21cm parameter constraints as publicly available software., Comment: 22 pages, 9 figures; accepted to ApJ

A critical challenge in the observation of the redshifted 21-cm line is its separation from bright Galactic and extragalactic foregrounds. In particular, the instrumental leakage of polarized foregrounds, which undergo significant Faraday rotation as they propagate through the interstellar medium, may harmfully contaminate the 21-cm power spectrum. We develop a formalism to describe the leakage due to instrumental widefield effects in visibility-based power spectra measured with redundant arrays, extending the delay-spectrum approach presented in Parsons et al. (2012). We construct polarized sky models and propagate them through the instrument model to simulate realistic full-sky observations with the Precision Array to Probe the Epoch of Reionization. We find that the leakage due to a population of polarized point sources is expected to be higher than diffuse Galactic polarization at any $k$ mode for a 30~m reference baseline. For the same reference baseline, a foreground-free window at $k > 0.3 \, h$~Mpc$^{-1}$ can be defined in terms of leakage from diffuse Galactic polarization even under the most pessimistic assumptions. If measurements of polarized foreground power spectra or a model of polarized foregrounds are given, our method is able to predict the polarization leakage in actual 21-cm observations, potentially enabling its statistical subtraction from the measured 21-cm power spectrum., 11 pages, 10 figures, ApJ accepted

Intensity mapping is a promising technique for surveying the large scale structure of our Universe from $z=0$ to $z \sim 150$, using the brightness temperature field of spectral lines to directly observe previously unexplored portions of out cosmic timeline. Examples of targeted lines include the $21\,\textrm{cm}$ hyperfine transition of neutral hydrogen, rotational lines of carbon monoxide, and fine structure lines of singly ionized carbon. Recent efforts have focused on detections of the power spectrum of spatial fluctuations, but have been hindered by systematics such as foreground contamination. This has motivated the decomposition of data into Fourier modes perpendicular and parallel to the line-of-sight, which has been shown to be a particularly powerful way to diagnose systematics. However, such a method is well-defined only in the limit of a narrow-field, flat-sky approximation. This limits the sensitivity of intensity mapping experiments, as it means that wide surveys must be separately analyzed as a patchwork of smaller fields. In this paper, we develop a framework for analyzing intensity mapping data in a spherical Fourier-Bessel basis, which incorporates curved sky effects without difficulty. We use our framework to generalize a number of techniques in intensity mapping data analysis from the flat sky to the curved sky. These include visibility-based estimators for the power spectrum, treatments of interloper lines, and the "foreground wedge" signature of spectrally smooth foregrounds., 25 pages, 4 figures. Replaced to match accepted ApJ version; added table of variable names and minor pedagogical improvements in text (no changes to results)

The Hydrogen Epoch of Reionization Array (HERA) is a radio interferometer aiming to detect the power spectrum of 21 cm fluctuations from neutral hydrogen from the Epoch of Reionization (EOR). Drawing on lessons from the Murchison Widefield Array (MWA) and the Precision Array for Probing the Epoch of Reionization (PAPER), HERA is a hexagonal array of large (14 m diameter) dishes with suspended dipole feeds. Not only does the dish determine overall sensitivity, it affects the observed frequency structure of foregrounds in the interferometer. This is the first of a series of four papers characterizing the frequency and angular response of the dish with simulations and measurements. We focus in this paper on the angular response (i.e., power pattern), which sets the relative weighting between sky regions of high and low delay, and thus, apparent source frequency structure. We measure the angular response at 137 MHz using the ORBCOMM beam mapping system of Neben et al. We measure a collecting area of 93 m^2 in the optimal dish/feed configuration, implying HERA-320 should detect the EOR power spectrum at z~9 with a signal-to-noise ratio of 12.7 using a foreground avoidance approach with a single season of observations, and 74.3 using a foreground subtraction approach. Lastly we study the impact of these beam measurements on the distribution of foregrounds in Fourier space., 13 pages, 9 figures. Replaced to match accepted ApJ version

Unaccounted for systematics from foregrounds and instruments can severely limit the sensitivity of current experiments from detecting redshifted 21~cm signals from the Epoch of Reionization (EoR). Upcoming experiments are faced with a challenge to deliver more collecting area per antenna element without degrading the data with systematics. This paper and its companions show that dishes are viable for achieving this balance using the Hydrogen Epoch of Reionization Array (HERA) as an example. Here, we specifically identify spectral systematics associated with the antenna power pattern as a significant detriment to all EoR experiments which causes the already bright foreground power to leak well beyond ideal limits and contaminate the otherwise clean EoR signal modes. A primary source of this chromaticity is reflections in the antenna-feed assembly and between structures in neighboring antennas. Using precise foreground simulations taking wide-field effects into account, we provide a framework to set cosmologically-motivated design specifications on these reflections to prevent further EoR signal degradation. We show HERA will not be impeded by such spectral systematics and demonstrate that even in a conservative scenario that does not perform removal of foregrounds, HERA will detect EoR signal in line-of-sight $k$-modes, $k_\parallel \gtrsim 0.2\,h$~Mpc$^{-1}$, with high significance. All baselines in a 19-element HERA layout are capable of detecting EoR over a substantial observing window on the sky., Comment: 11 pages, 6 figures (10 total including subfigures), submitted to ApJ

Realizing the potential of 21 cm tomography to statistically probe the intergalactic medium before and during the Epoch of Reionization requires large telescopes and precise control of systematics. Next-generation telescopes are now being designed and built to meet these challenges, drawing lessons from first-generation experiments that showed the benefits of densely packed, highly redundant arrays--in which the same mode on the sky is sampled by many antenna pairs--for achieving high sensitivity, precise calibration, and robust foreground mitigation. In this work, we focus on the Hydrogen Epoch of Reionization Array (HERA) as an interferometer with a dense, redundant core designed following these lessons to be optimized for 21 cm cosmology. We show how modestly supplementing or modifying a compact design like HERA's can still deliver high sensitivity while enhancing strategies for calibration and foreground mitigation. In particular, we compare the imaging capability of several array configurations, both instantaneously (to address instrumental and ionospheric effects) and with rotation synthesis (for foreground removal). We also examine the effects that configuration has on calibratability using instantaneous redundancy. We find that improved imaging with sub-aperture sampling via "off-grid" antennas and increased angular resolution via far-flung "outrigger" antennas is possible with a redundantly calibratable array configuration., 19 pages, 11 figures. Revised to match the accepted ApJ version

We use time-domain electromagnetic simulations to determine the spectral characteristics of the Hydrogen Epoch of Reionization Arrays (HERA) antenna. These simulations are part of a multi-faceted campaign to determine the effectiveness of the dish's design for obtaining a detection of redshifted 21 cm emission from the epoch of reionization. Our simulations show the existence of reflections between HERA's suspended feed and its parabolic dish reflector that fall below -40 dB at 150 ns and, for reasonable impedance matches, have a negligible impact on HERA's ability to constrain EoR parameters. It follows that despite the reflections they introduce, dishes are effective for increasing the sensitivity of EoR experiments at relatively low cost. We find that electromagnetic resonances in the HERA feed's cylindrical skirt, which is intended to reduce cross coupling and beam ellipticity, introduces significant power at large delays ($-40$ dB at 200 ns) which can lead to some loss of measurable Fourier modes and a modest reduction in sensitivity. Even in the presence of this structure, we find that the spectral response of the antenna is sufficiently smooth for delay filtering to contain foreground emission at line-of-sight wave numbers below $k_\parallel \lesssim 0.2$ $h$Mpc$^{-1}$, in the region where the current PAPER experiment operates. Incorporating these results into a Fisher Matrix analysis, we find that the spectral structure observed in our simulations has only a small effect on the tight constraints HERA can achieve on parameters associated with the astrophysics of reionization., Comment: Accepted to ApJ, 18 pages, 17 Figures. Replacement matches accepted manuscript

The Hydrogen Epoch of Reionization Array (HERA) is a staged experiment to measure 21 cm emission from the primordial intergalactic medium (IGM) throughout cosmic reionization ($z=6-12$), and to explore earlier epochs of our Cosmic Dawn ($z\sim30$). During these epochs, early stars and black holes heated and ionized the IGM, introducing fluctuations in 21 cm emission. HERA is designed to characterize the evolution of the 21 cm power spectrum to constrain the timing and morphology of reionization, the properties of the first galaxies, the evolution of large-scale structure, and the early sources of heating. The full HERA instrument will be a 350-element interferometer in South Africa consisting of 14-m parabolic dishes observing from 50 to 250 MHz. Currently, 19 dishes have been deployed on site and the next 18 are under construction. HERA has been designated as an SKA Precursor instrument. In this paper, we summarize HERA's scientific context and provide forecasts for its key science results. After reviewing the current state of the art in foreground mitigation, we use the delay-spectrum technique to motivate high-level performance requirements for the HERA instrument. Next, we present the HERA instrument design, along with the subsystem specifications that ensure that HERA meets its performance requirements. Finally, we summarize the schedule and status of the project. We conclude by suggesting that, given the realities of foreground contamination, current-generation 21 cm instruments are approaching their sensitivity limits. HERA is designed to bring both the sensitivity and the precision to deliver its primary science on the basis of proven foreground filtering techniques, while developing new subtraction techniques to unlock new capabilities. The result will be a major step toward realizing the widely recognized scientific potential of 21 cm cosmology., Comment: 26 pages, 24 figures, 2 tables

Current-generation low frequency interferometers constructed with the objective of detecting the high-redshift 21 cm background, aim to generate power spectra of the brightness-temperature contrast of neutral hydrogen in primordial intergalactic medium. Two-dimensional power spectra (power in Fourier modes parallel and perpendicular to the line of sight) formed from interferometric visibilities have been shown to delineate a boundary between spectrally-smooth foregrounds (known as the wedge) and spectrally-structured 21 cm background emission (the EoR-window). However, polarized foregrounds are known to possess spectral structure due to Faraday rotation, which can leak into the EoR window. In this work, we create and analyze 2D power spectra from the PAPER-32 imaging array in Stokes I, Q, U and V. These allow us to observe and diagnose systematic effects in our calibration at high signal-to-noise within the Fourier space most relevant to EoR experiments. We observe well-defined windows in the Stokes visibilities, with Stokes Q, U and V power spectra sharing a similar wedge shape to that seen in Stokes I. With modest polarization calibration, we see no evidence that polarization calibration errors move power outside the wedge in any Stokes visibility, to the noise levels attained. Deeper integrations will be required to confirm that this behavior persists to the depth required for EoR detection., 10 pages, 7 figures, accepted by ApJ

Amongst standard model parameters that are constrained by cosmic microwave background (CMB) observations, the optical depth $\tau$ stands out as a nuisance parameter. While $\tau$ provides some crude limits on reionization, it also degrades constraints on other cosmological parameters. Here we explore how 21 cm cosmology---as a direct probe of reionization---can be used to independently predict $\tau$ in an effort to improve CMB parameter constraints. We develop two complementary schemes for doing so. The first uses 21 cm power spectrum observations in conjunction with semi-analytic simulations to predict $\tau$. The other uses global 21 cm measurements to directly constrain low redshift (post-reheating) contributions to $\tau$ in a relatively model-independent way. Forecasting the performance of the upcoming Hydrogen Epoch of Reionization Array, we find that significant reductions in the errors on $\tau$ can be achieved. These results are particularly effective at breaking the CMB degeneracy between $\tau$ and the amplitude of the primordial fluctuation spectrum $A_s$, with errors on $\ln (10^{10} A_s)$ reduced by up to a factor of four. Stage 4 CMB constraints on the neutrino mass sum are also improved, with errors potentially reduced to $12\,\textrm{meV}$ regardless of whether CMB experiments can precisely measure the reionization bump in polarization power spectra. Observations of the 21 cm line are therefore capable of improving not only our understanding of reionization astrophysics, but also of cosmology in general., Comment: 23 pages, 11 figures; Replaced to match accepted PRD version. New version contains small editorial changes throughout, and an additional section (Section VI) to discuss model dependence. Additional caveats and assumptions are highlighted, but final results are unchanged

The Epoch of Reionization (EoR) is an uncharted era in our Universe's history during which the birth of the first stars and galaxies led to the ionization of neutral hydrogen in the intergalactic medium. There are many experiments investigating the EoR by tracing the 21cm line of neutral hydrogen. Because this signal is very faint and difficult to isolate, it is crucial to develop analysis techniques that maximize sensitivity and suppress contaminants in data. It is also imperative to understand the trade-offs between different analysis methods and their effects on power spectrum estimates. Specifically, with a statistical power spectrum detection in HERA's foreseeable future, it has become increasingly important to understand how certain analysis choices can lead to the loss of the EoR signal. In this paper, we focus on signal loss associated with power spectrum estimation. We describe the origin of this loss using both toy models and data taken by the 64-element configuration of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER). In particular, we highlight how detailed investigations of signal loss have led to a revised, higher 21cm power spectrum upper limit from PAPER-64. Additionally, we summarize errors associated with power spectrum error estimation that were previously unaccounted for. We focus on a subset of PAPER-64 data in this paper; revised power spectrum limits from the PAPER experiment are presented in a forthcoming paper by Kolopanis et al. (in prep.) and supersede results from previously published PAPER analyses., 25 pages, 18 figures, Accepted by ApJ

Radio interferometers designed to measure the cosmological 21 cm power spectrum require high sensitivity. Several modern low-frequency interferometers feature drift-scan antennas placed on a regular grid to maximize the number of instantaneously coherent (redundant) measurements. However, even for such maximum-redundancy arrays, significant sensitivity comes through partial coherence between baselines. Current visibility-based power-spectrum pipelines, though shown to ease control of systematics, lack the ability to make use of this partial redundancy. We introduce a method to leverage partial redundancy in such power-spectrum pipelines for drift-scan arrays. Our method cross-multiplies baseline pairs at a time lag and quantifies the sensitivity contributions of each pair of baselines. Using the configurations and beams of the 128-element Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER-128) and staged deployments of the Hydrogen Epoch of Reionization Array, we illustrate how our method applies to different arrays and predict the sensitivity improvements associated with pairing partially coherent baselines. As the number of antennas increases, we find partial redundancy to be of increasing importance in unlocking the full sensitivity of upcoming arrays., 15 pages, 10 figures; Replaced with accepted ApJ version (some clarifying comments; no changes to results)

In this paper, we report new limits on 21cm emission from cosmic reionization based on a 135-day observing campaign with a 64-element deployment of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER) in South Africa. This work extends the work presented in Parsons et al. (2014) with more collecting area, a longer observing period, improved redundancy-based calibration, optimal fringe-rate filtering, and improved power-spectral analysis using optimal quadratic estimators. The result is a new $2\sigma$ upper limit on $\Delta^{2}(k)$ of (22.4 mK)$^2$ in the range $0.15 < k < 0.5h\ {\rm Mpc}^{-1}$ at $z = 8.4$. This represents a three-fold improvement over the previous best upper limit. As we discuss in more depth in a forthcoming paper (Pober et al. 2015, in prep), this upper limit supports and extends previous evidence against extremely cold reionization scenarios. We conclude with a discussion of implications for future 21cm reionization experiments, including the newly funded Hydrogen Epoch of Reionization Array (HERA). $\textbf{The limits presented in this paper have been retracted: The erratum can be found in Appendix A.}$, Comment: Updated manuscript with an erratum in appendix A

A measurement of the cosmological 21 cm signal remains a promising but as-of-yet unattained ambition of radio astronomy. A positive detection would provide direct observations of key unexplored epochs of our cosmic history, including the cosmic dark ages and reionization. In this paper, we concentrate on measurements of the spatial monopole of the 21 cm brightness temperature as a function of redshift (the "global signal"). Most global experiments to date have been single-element experiments. In this paper, we show how an interferometer can be designed to be sensitive to the monopole mode of the sky, thus providing an alternate approach to accessing the global signature. We provide simple rules of thumb for designing a global signal interferometer and use numerical simulations to show that a modest array of tightly packed antenna elements with moderately sized primary beams (full-width-half-max of $\sim$40$^\circ$) can compete with typical single-element experiments in their ability to constrain phenomenological parameters pertaining to reionization and the pre-reionization era. We also provide a general data analysis framework for extracting the global signal from interferometric measurements (with analysis of single-element experiments arising as a special case) and discuss trade-offs with various data analysis choices. Given that interferometric measurements are able to avoid a number of systematics inherent in single-element experiments, our results suggest that interferometry ought to be explored as a complementary way to probe the global signal., 21 pages, 13 figures; Replaced to match accepted ApJ version: minor revisions throughout + expanded discussion in Section 2.1 to clarify the importance of curved and finite sky effects in making an interferometer sensitive to the monopole

In order to study the "Cosmic Dawn" and the Epoch of Reionization with 21 cm tomography, we need to statistically separate the cosmological signal from foregrounds known to be orders of magnitude brighter. Over the last few years, we have learned much about the role our telescopes play in creating a putatively foreground-free region called the "EoR window." In this work, we examine how an interferometer's effects can be taken into account in a way that allows for the rigorous estimation of 21 cm power spectra from interferometric maps while mitigating foreground contamination and thus increasing sensitivity. This requires a precise understanding of the statistical relationship between the maps we make and the underlying true sky. While some of these calculations would be computationally infeasible if performed exactly, we explore several well-controlled approximations that make mapmaking and the calculation of map statistics much faster, especially for compact and highly redundant interferometers designed specifically for 21 cm cosmology. We demonstrate the utility of these methods and the parametrized trade-offs between accuracy and speed using one such telescope, the upcoming Hydrogen Epoch of Reionization Array, as a case study., Comment: 28 pages, 14 figures. Slightly revised to match published Physical Review D version

We present constraints on both the kinetic temperature of the intergalactic medium (IGM) at z=8.4, and on models for heating the IGM at high-redshift with X-ray emission from the first collapsed objects. These constraints are derived using a semi-analytic method to explore the new measurements of the 21 cm power spectrum from the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER), which were presented in a companion paper, Ali et al. (2015). Twenty-one cm power spectra with amplitudes of hundreds of mK^2 can be generically produced if the kinetic temperature of the IGM is significantly below the temperature of the Cosmic Microwave Background (CMB); as such, the new results from PAPER place lower limits on the IGM temperature at z=8.4. Allowing for the unknown ionization state of the IGM, our measurements find the IGM temperature to be above ~5 K for neutral fractions between 10% and 85%, above ~7 K for neutral fractions between 15% and 80%, or above ~10 K for neutral fractions between 30% and 70%. We also calculate the heating of the IGM that would be provided by the observed high redshift galaxy population, and find that for most models, these galaxies are sufficient to bring the IGM temperature above our lower limits. However, there are significant ranges of parameter space that could produce a signal ruled out by the PAPER measurements; models with a steep drop-off in the star formation rate density at high redshifts or with relatively low values for the X-ray to star formation rate efficiency of high redshift galaxies are generally disfavored. The PAPER measurements are consistent with (but do not constrain) a hydrogen spin temperature above the CMB temperature, a situation which we find to be generally predicted if galaxies fainter than the current detection limits of optical/NIR surveys are included in calculations of X-ray heating., Comment: companion paper to Ali et al. (2015), ApJ 809, 61; matches version accepted to ApJ; 11 pages, 7 figures

For there to be a successful measurement of the 21 cm Epoch of Reionization (EoR) power spectrum, it is crucial that strong foreground contaminants be robustly suppressed. These foregrounds come from a variety of sources (such as Galactic synchrotron emission and extragalactic point sources), but almost all share the property of being spectrally smooth, and when viewed through the chromatic response of an interferometer, occupy a signature "wedge" region in cylindrical $k_\perp k_\parallel$ Fourier space. The complement of the foreground wedge is termed the "EoR window", and is expected to be mostly foreground-free, allowing clean measurements of the power spectrum. This paper is a sequel to a previous paper that established a rigorous mathematical framework for describing the foreground wedge and the EoR window. Here, we use our framework to explore statistical methods by which the EoR window can be enlarged, thereby increasing the sensitivity of a power spectrum measurement. We adapt the FKP approximation (commonly used in galaxy surveys) for 21 cm cosmology, and also compare the optimal quadratic estimator to simpler estimators that ignore covariances between different Fourier modes. The optimal quadratic estimator is found to suppress foregrounds by an extra factor of $\sim 10^5$ in power at the peripheries of the EoR window, boosting the detection of the cosmological signal from $12\sigma$ to $50\sigma$ at the midpoint of reionization in our fiducial models. If numerical issues can be finessed, decorrelation techniques allow the EoR window to be further enlarged, enabling measurements to be made deep within the foreground wedge. These techniques do not assume that foreground are Gaussian-distributed, and we additionally prove that a final round of foreground subtraction can be performed after decorrelation in a way that is guaranteed to have no cosmological signal loss., Comment: 19 pages, 8 figures. v2: Updated to match published PRD version. Fixed typos, added figure showing fiducial theoretical model, appendix about Fisher matrices, and detection significance figures in response to referee comments. Main conclusions unchanged

A number of experiments are currently working towards a measurement of the 21 cm signal from the Epoch of Reionization. Whether or not these experiments deliver a detection of cosmological emission, their limited sensitivity will prevent them from providing detailed information about the astrophysics of reionization. In this work, we consider what types of measurements will be enabled by a next-generation of larger 21 cm EoR telescopes. To calculate the type of constraints that will be possible with such arrays, we use simple models for the instrument, foreground emission, and the reionization history. We focus primarily on an instrument modeled after the $\sim 0.1~\rm{km}^2$ collecting area Hydrogen Epoch of Reionization Array (HERA) concept design, and parameterize the uncertainties with regard to foreground emission by considering different limits to the recently described "wedge" footprint in k-space. Uncertainties in the reionization history are accounted for using a series of simulations which vary the ionizing efficiency and minimum virial temperature of the galaxies responsible for reionization, as well as the mean free path of ionizing photons through the IGM. Given various combinations of models, we consider the significance of the possible power spectrum detections, the ability to trace the power spectrum evolution versus redshift, the detectability of salient power spectrum features, and the achievable level of quantitative constraints on astrophysical parameters. Ultimately, we find that $0.1~\rm{km}^2$ of collecting area is enough to ensure a very high significance ($\gtrsim30\sigma$) detection of the reionization power spectrum in even the most pessimistic scenarios. This sensitivity should allow for meaningful constraints on the reionization history and astrophysical parameters, especially if foreground subtraction techniques can be improved and successfully implemented., Comment: 27 pages, 18 figures, updated SKA numbers in appendix

When planet-hosting stars evolve off the main sequence and go through the red-giant branch, the stars become orders of magnitudes more luminous and, at the same time, lose mass at much higher rates than their main-sequence counterparts. Accordingly, if planetary companions exist around these stars at orbital distances of a few AU, they will be heated up to the level of canonical hot Jupiters and also be subjected to a dense stellar wind. Given that magnetized planets interacting with stellar winds emit radio waves, such "Red-Giant Hot Jupiters" (RGHJs) may also be candidate radio emitters. We estimate the spectral auroral radio intensity of RGHJs based on the empirical relation with the stellar wind as well as a proposed scaling for planetary magnetic fields. RGHJs might be intrinsically as bright as or brighter than canonical hot Jupiters and about 100 times brighter than equivalent objects around main-sequence stars. We examine the capabilities of low-frequency radio observatories to detect this emission and find that the signal from an RGHJ may be detectable at distances up to a few hundred parsecs with the Square Kilometer Array., Comment: published in ApJ, corrected typo in abstract

This work describes a new instrument optimized for a detection of the neutral hydrogen 21cm power spectrum between redshifts of 0.5-1.5: the Baryon Acoustic Oscillation Broadband and Broad-beam (BAOBAB) Array. BAOBAB will build on the efforts of a first generation of 21cm experiments which are targeting a detection of the signal from the Epoch of Reionization at z ~ 10. At z ~ 1, the emission from neutral hydrogen in self-shielded overdense halos also presents an accessible signal, since the dominant, synchrotron foreground emission is considerably fainter than at redshift 10. The principle science driver for these observations are Baryon Acoustic Oscillations in the matter power spectrum which have the potential to act as a standard ruler and constrain the nature of dark energy. BAOBAB will fully correlate dual-polarization antenna tiles over the 600-900MHz band with a frequency resolution of 300 kHz and a system temperature of 50K. The number of antennas will grow in staged deployments, and reconfigurations of the array will allow for both traditional imaging and high power spectrum sensitivity operations. We present calculations of the power spectrum sensitivity for various array sizes, with a 35-element array measuring the cosmic neutral hydrogen fraction as a function of redshift, and a 132-element system detecting the BAO features in the power spectrum, yielding a 1.8% error on the z ~ 1 distance scale, and, in turn, significant improvements to constraints on the dark energy equation of state over an unprecedented range of redshifts from ~0.5-1.5., 16 pages, 13 figures, 2 tables, matches version accepted by AJ

We present observations taken with the Precision Array for Probing the Epoch of Reionization (PAPER) of the Centaurus A field in the frequency range 114 to 188 MHz. The resulting image has a 25' resolution, a dynamic range of 3500 and an r.m.s. of 0.5 Jy\beam (for a beam size of 25' x 23'). A spectral index map of Cen A is produced across the full band. The spectral index distribution is qualitatively consistent with electron reacceleration in regions of excess turbulence in the radio lobes, as previously identified morphologically. Hence, there appears to be an association of 'severe weather' in radio lobes with energy input into the relativistic electron population. We compare the PAPER large scale radio image with the X-ray image from the ROSAT All Sky Survey. There is a tentative correlation between radio and X-ray features at the end of the southern lobe, some 200 kpc from the nucleus, as might be expected from inverse Compton scattering of the CMB by the relativistic electrons also responsible for the radio synchrotron emission. The magnetic fields derived from the (possible) IC and radio emission are of similar magnitude to fields derived under the minimum pressure assumptions, ~ 1 {\mu}G. However, the X-ray field is complex, with large scale gradients and features possibly unrelated to Cen A. If these X-ray features are unrelated to Cen A, then these fields are lower limits., Comment: 9 pages, 5 figures; Section 7 and Fig. 5 have been revised and minor corrections have been implemented throught the paper; submitted for publication to MNRAS

We present a new technique for calibrating the primary beam of a wide-field, drift-scanning antenna element. Drift-scan observing is not compatible with standard beam calibration routines, and the situation is further complicated by difficult-to-parametrize beam shapes and, at low frequencies, the sparsity of accurate source spectra to use as calibrators. We overcome these challenges by building up an interrelated network of source "crossing points" -- locations where the primary beam is sampled by multiple sources. Using the single assumption that a beam has 180 degree rotational symmetry, we can achieve significant beam coverage with only a few tens of sources. The resulting network of crossing points allows us to solve for both a beam model and source flux densities referenced to a single calibrator source, circumventing the need for a large sample of well-characterized calibrators. We illustrate the method with actual and simulated observations from the Precision Array for Probing the Epoch of Reionization (PAPER)., 10 pages, 9 figures, 1 table, revised to match version accepted by AJ

Telescopes aiming to measure 21cm emission from the Epoch of Reionization must toe a careful line, balancing the need for raw sensitivity against the stringent calibration requirements for removing bright foregrounds. It is unclear what the optimal design is for achieving both of these goals. Via a pedagogical derivation of an interferometer's response to the power spectrum of 21cm reionization fluctuations, we show that even under optimistic scenarios, first-generation arrays will yield low-SNR detections, and that different compact array configurations can substantially alter sensitivity. We explore the sensitivity gains of array configurations that yield high redundancy in the uv-plane -- configurations that have been largely ignored since the advent of self-calibration for high-dynamic-range imaging. We first introduce a mathematical framework to generate optimal minimum-redundancy configurations for imaging. We contrast the sensitivity of such configurations with high-redundancy configurations, finding that high-redundancy configurations can improve power-spectrum sensitivity by more than an order of magnitude. We explore how high-redundancy array configurations can be tuned to various angular scales, enabling array sensitivity to be directed away from regions of the uv-plane (such as the origin) where foregrounds are brighter and where instrumental systematics are more problematic. We demonstrate that a 132-antenna deployment of the Precision Array for Probing the Epoch of Reionization (PAPER) observing for 120 days in a high-redundancy configuration will, under ideal conditions, have the requisite sensitivity to detect the power spectrum of the 21cm signal from reionization at a 3\sigma level at k, Comment: 34 pages, 5 figures, 2 appendices. Version accepted to ApJ

We present observations from the Precision Array for Probing the Epoch of Reionization (PAPER) in South Africa, observed in May and September 2010. Using two nights of drift scanning with PAPER's 60\arcdeg\ FWHM beam we have made a map covering the entire sky below +10 degrees declination with an effective center frequency of 145 MHz, a 70-MHz bandwidth, and a resolution of 26\arcmin. A 4800 square-degree region of this large map with the lowest Galactic emission reaches an RMS of 0.7 Jy. We establish an absolute flux scale using sources from the 160-MHz Culgoora catalog. Using the 408-MHz Molonglo Reference Catalog (MRC) as a finding survey, we identify counterparts to 480 sources in our maps, and compare our fluxes to the MRC and to 332 sources in the Culgoora catalog. For both catalogs, the ratio of PAPER to catalog flux averages to 1, with a standard deviation of 50%. This measured variation is consistent with comparisons between independent catalogs observed at different bands. The PAPER data represent new 145-MHz flux measurements for a large number of sources in the band expected to encompass cosmic reionization, and represents a significant step toward establishing a model for removing foregrounds to the reionization signal., Comment: 3 figures, 2 tables, machine readable table. Accepted by ApJL

A new generation of radio telescopes is achieving unprecedented levels of sensitivity and resolution, as well as increased agility and field-of-view, by employing high-performance digital signal processing hardware to phase and correlate large numbers of antennas. The computational demands of these imaging systems scale in proportion to BMN^2, where B is the signal bandwidth, M is the number of independent beams, and N is the number of antennas. The specifications of many new arrays lead to demands in excess of tens of PetaOps per second. To meet this challenge, we have developed a general purpose correlator architecture using standard 10-Gbit Ethernet switches to pass data between flexible hardware modules containing Field Programmable Gate Array (FPGA) chips. These chips are programmed using open-source signal processing libraries we have developed to be flexible, scalable, and chip-independent. This work reduces the time and cost of implementing a wide range of signal processing systems, with correlators foremost among them,and facilitates upgrading to new generations of processing technology. We present several correlator deployments, including a 16-antenna, 200-MHz bandwidth, 4-bit, full Stokes parameter application deployed on the Precision Array for Probing the Epoch of Reionization., Accepted to Publications of the Astronomy Society of the Pacific. 31 pages. v2: corrected typo, v3: corrected Fig. 13