Search

End-to-end simulations play a key role in the analysis of any high-sensitivity CMB experiment, providing high-fidelity systematic error propagation capabilities unmatched by any other means. In this paper, we address an important issue regarding such simulations, namely how to define the inputs in terms of sky model and instrument parameters. These may either be taken as a constrained realization derived from the data, or as a random realization independent from the data. We refer to these as Bayesian and frequentist simulations, respectively. We show that the two options lead to significantly different correlation structures, as frequentist simulations, contrary to Bayesian simulations, effectively include cosmic variance, but exclude realization-specific correlations from non-linear degeneracies. Consequently, they quantify fundamentally different types of uncertainties, and we argue that they therefore also have different and complementary scientific uses, even if this dichotomy is not absolute. Before BeyondPlanck, most pipelines have used a mix of constrained and random inputs, and used the same hybrid simulations for all applications, even though the statistical justification for this is not always evident. BeyondPlanck represents the first end-to-end CMB simulation framework that is able to generate both types of simulations, and these new capabilities have brought this topic to the forefront. The Bayesian BeyondPlanck simulations and their uses are described extensively in a suite of companion papers. In this paper we consider one important applications of the corresponding frequentist simulations, namely code validation. That is, we generate a set of 1-year LFI 30 GHz frequentist simulations with known inputs, and use these to validate the core low-level BeyondPlanck algorithms; gain estimation, correlated noise estimation, and mapmaking.

We present Planck LFI frequency sky maps derived within the BeyondPlanck framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical and cosmological parameters, and the main product is an entire ensemble of frequency sky map samples. This ensemble allows for computationally convenient end-to-end propagation of low-level instrumental uncertainties into higher-level science products. We show that the two dominant sources of LFI instrumental systematic uncertainties are correlated noise and gain fluctuations, and the products presented here support - for the first time - full Bayesian error propagation for these effects at full angular resolution. We compare our posterior mean maps with traditional frequency maps delivered by the Planck collaboration, and find generally good agreement. The most important quality improvement is due to significantly lower calibration uncertainties in the new processing, as we find a fractional absolute calibration uncertainty at 70 GHz of $\delta g_{0}/g_{0} =5 \cdot 10^{-5}$, which is nominally 40 times smaller than that reported by Planck 2018. However, the original Planck 2018 estimate has a non-trivial statistical interpretation, and this further illustrates the advantage of the new framework in terms of producing self-consistent and well-defined error estimates of all involved quantities without the need of ad hoc uncertainty contributions. We describe how low-resolution data products, including dense pixel-pixel covariance matrices, may be produced directly from the posterior samples without the need for computationally expensive analytic calculations or simulations. We conclude that posterior-based frequency map sampling provides unique capabilities in terms of low-level systematics modelling and error propagation, and may play an important role for future CMB B-mode experiments. (Abridged.), Comment: 32 pages, 23 figures, data available from https://www.cosmoglobe.uio.no/

We present posterior sample-based cosmic microwave background (CMB) constraints from Planck LFI and WMAP observations derived through global end-to-end Bayesian processing. We use these samples to study correlations between CMB, foreground, and instrumental parameters, and we identify a particularly strong degeneracy between CMB temperature fluctuations and free-free emission on intermediate angular scales, which is mitigated through model reduction, masking, and resampling. We compare our posterior-based CMB results with previous Planck products, and find generally good agreement, but with higher noise due to exclusion of HFI data. We find a best-fit CMB dipole amplitude of $3362.7\pm1.4{\mu}K$, in excellent agreement with previous Planck results. The quoted uncertainty is derived directly from the sampled posterior distribution, and does not involve any ad hoc contribution for systematic effects. Similarly, we find a temperature quadrupole amplitude of $\sigma^{TT}_2=229\pm97{\mu}K^2$, in good agreement with previous results in terms of the amplitude, but the uncertainty is an order of magnitude larger than the diagonal Fisher uncertainty. Relatedly, we find lower evidence for a possible alignment between $\ell = 2$ and $\ell = 3$ than previously reported due to a much larger scatter in the individual quadrupole coefficients, caused both by marginalizing over a more complete set of systematic effects, and by our more conservative analysis mask. For higher multipoles, we find that the angular temperature power spectrum is generally in good agreement with both Planck and WMAP. This is the first time the sample-based asymptotically exact Blackwell-Rao estimator has been successfully established for multipoles up to $\ell\le600$, and it now accounts for the majority of the cosmologically important information. Cosmological parameter constraints are presented in a companion paper. (Abriged), Comment: 26 pages, 24 figures. Submitted to A&A. Part of the BeyondPlanck paper suite

The BeyondPlanck and Cosmoglobe collaborations have implemented the first integrated Bayesian end-to-end analysis pipeline for CMB experiments. The primary long-term motivation for this work is to develop a common analysis platform that supports efficient global joint analysis of complementary radio, microwave, and sub-millimeter experiments. A strict prerequisite for this to succeed is broad participation from the CMB community, and two foundational aspects of the program are therefore reproducibility and Open Science. In this paper, we discuss our efforts toward this aim. We also discuss measures toward facilitating easy code and data distribution, community-based code documentation, user-friendly compilation procedures, etc. This work represents the first publicly released end-to-end CMB analysis pipeline that includes raw data, source code, parameter files, and documentation. We argue that such a complete pipeline release should be a requirement for all major future and publicly-funded CMB experiments, noting that a full public release significantly increases data longevity by ensuring that the data quality can be improved whenever better processing techniques, complementary datasets, or more computing power become available, and thereby also taxpayers' value for money; providing only raw data and final products is not sufficient to guarantee full reproducibility in the future.

We present cosmological parameter constraints as estimated using the Bayesian BeyondPlanck (BP) analysis framework. This method supports seamless end-to-end error propagation from raw time-ordered data to final cosmological parameters. As a first demonstration of the method, we analyze time-ordered Planck LFI observations, combined with selected external data (WMAP 33-61GHz, Planck HFI DR4 353 and 857GHz, and Haslam 408MHz) in the form of pixelized maps which are used to break critical astrophysical degeneracies. Overall, all results are generally in good agreement with previously reported values from Planck 2018 and WMAP, with the largest relative difference for any parameter of about 1 sigma when considering only temperature multipoles between 29

We describe the correction procedure for Analog-to-Digital Converter (ADC) differential non-linearities (DNL) adopted in the Bayesian end-to-end BeyondPlanck analysis framework. This method is nearly identical to that developed for the official LFI Data Processing Center (DPC) analysis, and relies on the binned rms noise profile of each detector data stream. However, rather than building the correction profile directly from the raw rms profile, we first fit a Gaussian to each significant ADC-induced rms decrement, and then derive the corresponding correction model from this smooth model. The main advange of this approach is that only samples which are significantly affected by ADC DNLs are corrected. The new corrections are only applied to data for which there is a clear detection of the non-linearities, and for which they perform at least comparably with the DPC corrections. Out of a total of 88 LFI data streams (sky and reference load for each of the 44 detectors) we apply the new minimal ADC corrections in 25 cases, and maintain the DPC corrections in 8 cases. All these correctsion are applited to 44 or 70 GHz channels, while, as in previous analyses, none of the 30 GHz ADCs show significant evidence of non-linearity. By comparing the BeyondPlanck and DPC ADC correction methods, we estimate that the residual ADC uncertainty is about two orders of magnitude below the total noise of both the 44 and 70 GHz channels, and their impact on current cosmological parameter estimation is small. However, we also show that non-idealities in the ADC corrections can generate sharp stripes in the final frequency maps, and these could be important for future joint analyses with HFI, WMAP, or other datasets. We therefore conclude that, although the existing corrections are adequate for LFI-based cosmological parameter analysis, further work on LFI ADC corrections is still warranted., Comment: 9 pages, 8 figures, mild language edits

We present the first application of the Cosmoglobe analysis framework by analyzing 9-year $\mathit{WMAP}$ time-ordered observations using similar machinery as BeyondPlanck utilizes for $\mathit{Planck}$ LFI. We analyze only the $\mathit Q$-band (41 GHz) data and report on the low-level analysis process from uncalibrated time-ordered data to calibrated maps. Most of the existing BeyondPlanck pipeline may be reused for $\mathit{WMAP}$ analysis with minimal changes to the existing codebase. The main modification is the implementation of the same preconditioned biconjugate gradient mapmaker used by the $\mathit{WMAP}$ team. Producing a single $\mathit{WMAP}$ $\mathit Q$1-band sample requires 22 CPU-hrs, which is slightly more than the cost of a $\mathit{Planck}$ 44 GHz sample of 17 CPU-hrs; this demonstrates that full end-to-end Bayesian processing of the $\mathit{WMAP}$ data is computationally feasible. In general, our recovered maps are very similar to the maps released by the $\mathit{WMAP}$ team, although with two notable differences. In temperature we find a $\sim2\,\mathrm{\mu K}$ quadrupole difference that most likely is caused by different gain modeling, while in polarization we find a distinct $2.5\,\mathrm{\mu K}$ signal that has been previously called poorly-measured modes by the $\mathit{WMAP}$ team. In the Cosmoglobe processing, this pattern arises from temperature-to-polarization leakage from the coupling between the CMB Solar dipole, transmission imbalance, and sidelobes. No traces of this pattern are found in either the frequency map or TOD residual map, suggesting that the current processing has succeeded in modelling these poorly measured modes within the assumed parametric model by using $\mathit{Planck}$ information to break the sky-synchronous degeneracies inherent in the $\mathit{WMAP}$ scanning strategy., Comment: 11 figures, submitted to A&A. Includes updated instrument model and changes addressing referee comments

We present the intensity foreground algorithms and model employed within the BeyondPlanck analysis framework. The BeyondPlanck analysis is aimed at integrating component separation and instrumental parameter sampling within a global framework, leading to complete end-to-end error propagation in the $Planck$ Low Frequency Instrument (LFI) data analysis. Given the scope of the BeyondPlanck analysis, a limited set of data is included in the component separation process, leading to foreground parameter degeneracies. In order to properly constrain the Galactic foreground parameters, we improve upon the previous $\texttt{Commander}$ component separation implementation by adding a suite of algorithmic techniques. These algorithms are designed to improve the stability and computational efficiency for weakly constrained posterior distributions. These are: 1) joint foreground spectral parameter and amplitude sampling, building on ideas from Miramare; 2) component-based monopole determination; 3) joint spectral parameter and monopole sampling; and 4) application of informative spatial priors for component amplitude maps. We find that the only spectral parameter with a significant signal-to-noise ratio using the current BeyondPlanck data set is the peak frequency of the anomalous microwave emission component, for which we find $\nu_{\mathrm{p}}=25.3\pm0.5$ GHz; all others must be constrained through external priors. Future works will be aimed at integrating many more data sets into this analysis, both map and time-ordered based, thereby gradually eliminating the currently observed degeneracies in a controlled manner with respect to both instrumental systematic effects and astrophysical degeneracies. When this happens, the simple LFI-oriented data model employed in the current work will need to be generalized to account for both a richer astrophysical model and additional instrumental effects., Comment: 27 pages, 23 figures, 3 tables, part 13 of the BeyondPlanck release. All BeyondPlanck products and software will be released publicly at http://beyondplanck.science. Paper version as accepted by A&A

We constrain the level of polarized anomalous microwave emission (AME) on large angular scales using $\textit{Planck}$ LFI and $\textit{WMAP}$ polarization data within a Bayesian CMB analysis framework. We model synchrotron emission with a power-law spectral energy distribution, and the sum of AME and thermal dust emission through linear regression with the $\textit{Planck}$ HFI 353 GHz data. This template-based dust emission model allows us to constrain the level of polarized AME while making minimal assumptions on its frequency dependence. We neglect cosmic microwave background fluctuations, but show through simulations that these have a minor impact on the results. We find that the resulting AME polarization fraction confidence limit is sensitive to the polarized synchrotron spectral index prior, and for priors steeper than $\beta_{\mathrm{s}} = -3.1\pm0.1$ we find an upper limit of $p_{\mathrm{AME}}^{\rm max}\lesssim 0.6\,\%$ ($95\,\%$ confidence). In contrast, for $\beta_{\mathrm{s}}=-3.0\pm0.1$, we find a nominal detection of $p_{\mathrm{AME}}=2.5\pm1.0\,\%$ ($95\,\%$ confidence). These data are thus not strong enough to simultaneously and robustly constrain both polarized synchrotron emission and AME, and our main result is therefore a constraint on the AME polarization fraction explicitly as a function of $\beta_\mathrm{s}$. Combining the current $\textit{Planck}$ and $\textit{WMAP}$ observations with measurements from high-sensitivity low-frequency experiments such as C-BASS and QUIJOTE will be critical to improve these limits further., Comment: 10 pages, 9 figures, part 15 of the BeyondPlanck release. All BeyondPlanck products and software will be released publicly at http://beyondplanck.science. Refereed, edited, and accepted by A&A. Added references, added arxiv IDs to BeyondPlanck papers. Figure update. Expanded discussion on AME models. Moved title from BeyondPlanck XV to BeyondPlanck XVI due to internal reordering

We describe the computational infrastructure for end-to-end Bayesian CMB analysis implemented by the BeyondPlanck collaboration. This code is called commander3, and provides a statistically consistent framework for global analysis of CMB and microwave observations, and may be useful for a wide range of legacy, current, and future experiments. The paper has three main goals. Firstly, we provide a high-level overview of the existing code base, aiming to guide readers who wish to extend and adapt the code according to their own needs, or to reimplement it from scratch in a different programming language. Secondly, we discuss some critical computational challenges that arise within any global CMB analysis framework, for instance in-memory compression of time-ordered data, FFT optimization, and parallelization and load-balancing. Thirdly, we quantify the CPU and RAM requirements for the current BeyondPlanck analysis, and find that a total of 1.5 TB of RAM is required for efficient analysis, and the total cost of a full Gibbs sample is 170 CPU-hrs, including both low-level processing and high-level component separation, which is well within the capabilities of current low-cost computing facilities. The existing code base is made publicly available under a GNU General Public Library (GPL) license., Comment: 16 Pages, 7 Figures. Part of the BeyondPlanck paper suite

We introduce a new formulation of the Conviqt convolution algorithm in terms of spin harmonics, and apply this to the problem of sidelobe correction for BeyondPlanck, the first end-to-end Bayesian Gibbs sampling framework for CMB analysis. We compare our implementation to the previous Planck LevelS implementation, and find good agreement between the two codes in terms of accuracy, but with a speed-up reaching a factor of 3--10, depending on the frequency bandlimits, $l_{\textrm{max}}$ and $m_{\textrm{max}}$. The new algorithm is significantly simpler to implement and maintain, since all low-level calculations are handled through an external spherical harmonic transform library. We find that our mean sidelobe estimates for Planck LFI agree well with previous efforts. Additionally, we present novel sidelobe rms maps that quantify the uncertainty in the sidelobe corrections due to variations in the sky model., Comment: 9 pages, 8 figures. Part of the BeyondPlanck paper suite

We discuss the treatment of bandpass and beam leakage corrections in the Bayesian BeyondPlanck CMB analysis pipeline as applied to the Planck LFI measurements. As a preparatory step, we first apply three corrections to the nominal LFI bandpass profiles including removal of a known systematic effect in the ground measuring equipment at 61 GHz; smoothing of standing wave ripples; and edge regularization. The main net impact of these modifications is an overall shift in the 70 GHz bandpass of +0.6 GHz; we argue that any analysis of LFI data products, either from Planck or BeyondPlanck, should use these new bandpasses. In addition, we fit a single free bandpass parameter for each radiometer of the form $\Delta_i = \Delta_0 + \delta_i$, where $\Delta_0$ represents an absolute frequency shift per frequency band and $\delta_i$ is a relative shift per detector. The absolute correction is only fitted at 30 GHz with a full $\chi^2$-based likelihood, resulting in a correction of $\Delta_{30}=0.24\pm0.03\,$GHz. The relative corrections are fitted using a spurious map approach, fundamentally similar to the method pioneered by the WMAP team, but without introducing many additional degrees of freedom. All bandpass parameters are sampled using a standard Metropolis sampler within the main BeyondPlanck Gibbs chain, and bandpass uncertainties are thus propagated to all other data products in the analysis. In total, we find that our bandpass model significantly reduces leakage effects. For beam leakage corrections, we adopt the official Planck LFI beam estimates without additional degrees of freedom, and only marginalize over the underlying sky model. We note that this is the first time leakage from beam mismatch has been included for Planck LFI maps., Comment: 14 pages, 11 figures, this is part 10 in the BeyondPlanck release. All BeyondPlanck products and software will be released publicly at http://beyondplanck.science. Submitted to A&A

We constrain polarized foreground emission between 30 and 70 GHz with the Planck Low Frequency Instrument (LFI) and WMAP data within the global Bayesian BeyondPlanck framework. We combine for the first time full-resolution Planck LFI time-ordered data with low-resolution WMAP sky maps at 33, 40 and 61 GHz. Spectral parameters are fit with a likelihood defined at the native resolution of each frequency channel. This analysis represents the first implementation of true multi-resolution component separation applied to CMB observations for both amplitude and spectral energy distribution (SED) parameters. For synchrotron emission, we approximate the SED as a power-law in frequency and find that the low signal-to-noise ratio of the current data strongly limits the number of free parameters that may be robustly constrained. We partition the sky into four large disjoint regions (High Latitude; Galactic Spur; Galactic Plane; and Galactic Center), each associated with its own power-law index. We find that the High Latitude region is prior-dominated, while the Galactic Center region is contaminated by residual instrumental systematics. The two remaining regions appear to be signal-dominated, and for these we derive spectral indices of $\beta_{\mathrm s}^{\mathrm{Spur}}=-3.17\pm0.06$ and $\beta_{\mathrm s}^{\mathrm{Plane}}=-3.03\pm0.07$, in good agreement with previous results. For thermal dust emission we assume a modified blackbody model and we fit a single power-law index across the full sky. We find $\beta_{\mathrm{d}}=1.64\pm0.03$, which is slightly steeper than reported from Planck HFI data, but still statistically consistent at the 2$\sigma$ confidence level., Comment: 18 pages, 15 figures. All BeyondPlanck products and software will be released publicly at http://beyondplanck.science. This paper has been submitted to A&A. Major revision, matches submitted version

We present a Bayesian calibration algorithm for CMB observations as implemented within the global end-to-end BeyondPlanck (BP) framework, and apply this to the Planck Low Frequency Instrument (LFI) data. Following the most recent Planck analysis, we decompose the full time-dependent gain into a sum of three orthogonal components: One absolute calibration term, common to all detectors; one time-independent term that can vary between detectors; and one time-dependent component that is allowed to vary between one-hour pointing periods. Each term is then sampled conditionally on all other parameters in the global signal model through Gibbs sampling. The absolute calibration is sampled using only the orbital dipole as a reference source, while the two relative gain components are sampled using the full sky signal, including the orbital and Solar CMB dipoles, CMB fluctuations, and foreground contributions. We discuss various aspects of the data that influence gain estimation, including the dipole/polarization quadrupole degeneracy and anomalous jumps in the instrumental gain. Comparing our solution to previous pipelines, we find good agreement in general, with relative deviations of -0.67% (-0.84%) for 30 GHz, 0.12% (-0.04%) for 44 GHz and -0.03% (-0.64%) for 70 GHz, compared to Planck DR4 (Planck 2018). The deviations we find are within expected error bounds, and we attribute them to differences in data usage and general approach between the pipelines. In particular, the BP calibration is performed globally, resulting in better inter-frequency consistency. Additionally, WMAP observations are used actively in the BP analysis, which breaks degeneracies in the Planck data set and results in better agreement with WMAP. Although our presentation and algorithm are currently oriented toward LFI processing, the procedure is fully generalizable to other experiments., Comment: 19 pages, 18 figures. All BeyondPlanck products and software will be released publicly at http://beyondplanck.science

We present a Bayesian method for estimating instrumental noise parameters and propagating noise uncertainties within the global BeyondPlanck Gibbs sampling framework, and apply this to Planck Low Frequency Instrument (LFI) time-ordered data. Following previous literature, we initially adopt a $1/f$ model for the noise power spectral density (PSD), but find the need for an additional lognormal component in the noise model for the 30 and 44\,GHz bands. We implement an optimal Wiener-filter (or constrained realization) gap-filling procedure to account for masked data. We then use this procedure to both estimate the gapless correlated noise in the time-domain, $n_\mathrm{corr}$, and to sample the noise PSD parameters, $\xi^n = \{\sigma_0, f_\mathrm{knee}, \alpha, A_\mathrm{p}\}$. In contrast to previous \textit{Planck} analyses, we assume piecewise stationary noise only within each pointing period (PID), not throughout the full mission, but we adopt the LFI Data Processing Center (DPC) results as priors on $\alpha$ and $f_\mathrm{knee}$. On average, we find best-fit correlated noise parameters that are mostly consistent with previous results, with a few notable exceptions. However, a detailed inspection of the time-dependent results reveals many important findings. First and foremost, we find strong evidence for statistically significant temporal variations in all noise PSD parameters, many of which are directly correlated with satellite housekeeping data. Second, while the simple $1/f$ model appears to be an excellent fit for the LFI 70 GHz channel, there is evidence for additional correlated noise not described by a $1/f$ model in the 30 and 44 GHz channels, including within the primary science frequency range of 0.1--1 Hz. (Abridged), Comment: 26 pages, 29 figures, as accepted in A&A

We present a Gibbs sampling solution to the map-making problem for CMB measurements, building on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps; noise filtering and map binning. Considered as two separate steps, both are computationally much cheaper than solving the combined problem. This provides a huge performance benefit as compared to traditional methods, and allows us for the first time to bring the destriping baseline length to a single sample. We apply the Gibbs procedure to simulated Planck 30 GHz data. We find that gaps in the time-ordered data are handled efficiently by filling them with simulated noise as part of the Gibbs process. The Gibbs procedure yields a chain of map samples, from which we may compute the posterior mean as a best-estimate map. The variation in the chain provides information on the correlated residual noise, without need to construct a full noise covariance matrix. However, if only a single maximum-likelihood frequency map estimate is required, we find that traditional conjugate gradient solvers converge much faster than a Gibbs sampler in terms of total number of iterations. The conceptual advantages of the Gibbs sampling approach lies in statistically well-defined error propagation and systematic error correction, and this methodology forms the conceptual basis for the map-making algorithm employed in the BeyondPlanck framework, which implements the first end-to-end Bayesian analysis pipeline for CMB observations., Comment: 11 pages, 10 figures. All BeyondPlanck products and software will be released publicly at http://beyondplanck.science during the online release conference (November 18-20, 2020). Connection details will be made available at the same website. Registration is mandatory for the online tutorial, but optional for the conference

We describe the BeyondPlanck project in terms of motivation, methodology and main products, and provide a guide to a set of companion papers that describe each result in fuller detail. We implement a complete end-to-end Bayesian analysis framework for the Planck LFI observations. The primary product is a full joint posterior distribution $P(\omega|d)$, where $\omega$ represents the set of all free instrumental, astrophysical, and cosmological parameters. Notable advantages of this approach are seamless end-to-end propagation of uncertainties; accurate modeling of both astrophysical and instrumental effects in the most natural basis for each uncertain quantity; optimized computational costs with little or no need for intermediate human interaction between various analysis steps; and a complete overview of the entire analysis process within one single framework. We focus in particular on low-$\ell$ CMB polarization reconstruction with Planck LFI. We identify several important new effects that have not been accounted for in previous pipelines, including gain over-smoothing and time-variable and non-$1/f$ correlated noise in the 30 and 44 GHz channels. We find that all results are consistent with the $\Lambda$CDM model, and we constrain the reionization optical depth to $\tau=0.066\pm0.013$, with a low-resolution $\chi^2$ probability-to-exceed of 32%. This uncertainty is about 30% larger than the official pipelines, arising from taking into account a more complete instrumental model. The marginal CMB Solar dipole amplitude is $3362.7\pm1.4\mu\mathrm{K}$, where the error bar is derived directly from the posterior distribution without the need of any ad-hoc instrumental corrections. We are currently not aware of any significant unmodelled systematic effects remaining in the Planck LFI data, and, for the first time, the 44 GHz channel is fully exploited. (Abridged.), Comment: 61 pages, 31 figures, submitted to A&A. Major revision: Previously reported unresolved effects are now understood and mitigated. This paper version concludes the BeyondPlanck project. All BeyondPlanck products and software are available at https://cosmoglobe.uio.no

We describe an extension of the most recent version of the Planck Catalogue of Compact Sources (PCCS2), produced using a new multi-band Bayesian Extraction and Estimation Package (BeeP). BeeP assumes that the compact sources present in PCCS2 at 857 GHz have a dust-like spectral energy distribution, which leads to emission at both lower and higher frequencies, and adjusts the parameters of the source and its SED to fit the emission observed in Planck's three highest frequency channels at 353, 545, and 857 GHz, as well as the IRIS map at 3000 GHz. In order to reduce confusion regarding diffuse cirrus emission, BeeP's data model includes a description of the background emission surrounding each source, and it adjusts the confidence in the source parameter extraction based on the statistical properties of the spatial distribution of the background emission. BeeP produces the following three new sets of parameters for each source: (a) fits to a modified blackbody (MBB) thermal emission model of the source; (b) SED-independent source flux densities at each frequency considered; and (c) fits to an MBB model of the background in which the source is embedded. BeeP also calculates, for each source, a reliability parameter, which takes into account confusion due to the surrounding cirrus. We define a high-reliability subset (BeeP/base), containing 26 083 sources (54.1 per cent of the total PCCS2 catalogue), the majority of which have no information on reliability in the PCCS2. The results of the BeeP extension of PCCS2, which are made publicly available via the PLA, will enable the study of the thermal properties of well-defined samples of compact Galactic and extra-galactic dusty sources., Comment: 55 pages. Accepted for publication in A&A. The BeeP catalogue will be published in the Planck Legacy Archive (https://pla.esac.esa.int/pla)

We present the NPIPE processing pipeline, which produces calibrated frequency maps in temperature and polarization from data from the Planck Low Frequency Instrument (LFI) and High Frequency Instrument (HFI) using high-performance computers. NPIPE represents a natural evolution of previous Planck analysis efforts, and combines some of the most powerful features of the separate LFI and HFI analysis pipelines. The net effect of the improvements is lower levels of noise and systematics in both frequency and component maps at essentially all angular scales, as well as notably improved internal consistency between the various frequency channels. Based on the NPIPE maps, we present the first estimate of the Solar dipole determined through component separation across all nine Planck frequencies. The amplitude is ($3366.6 \pm 2.7$)$\mu$K, consistent with, albeit slightly higher than, earlier estimates. From the large-scale polarization data, we derive an updated estimate of the optical depth of reionization of $\tau = 0.051 \pm 0.006$, which appears robust with respect to data and sky cuts. There are 600 complete signal, noise and systematics simulations of the full-frequency and detector-set maps. As a Planck first, these simulations include full time-domain processing of the beam-convolved CMB anisotropies. The release of NPIPE maps and simulations is accompanied with a complete suite of raw and processed time-ordered data and the software, scripts, auxiliary data, and parameter files needed to improve further on the analysis and to run matching simulations., Comment: 97 pages, 93 figures and 16 tables, abstract abridged for arXiv submission, accepted for publication in A&A

The largest temperature anisotropy in the cosmic microwave background (CMB) is the dipole, which has been measured with increasing accuracy for more than three decades, particularly with the Planck satellite. The simplest interpretation of the dipole is that it is due to our motion with respect to the rest frame of the CMB. Since current CMB experiments infer temperature anisotropies from angular intensity variations, the dipole modulates the temperature anisotropies with the same frequency dependence as the thermal Sunyaev-Zeldovich (tSZ) effect. We present the first, and significant, detection of this signal in the tSZ maps and find that it is consistent with direct measurements of the CMB dipole, as expected. The signal contributes power in the tSZ maps, which is modulated in a quadrupolar pattern, and we estimate its contribution to the tSZ bispectrum, noting that it contributes negligible noise to the bispectrum at relevant scales., Comment: 15 pages, 8 figures. Added references, small clarifying and language edits. All results remain the same

This paper describes the 2018 Planck CMB likelihoods, following a hybrid approach similar to the 2015 one, with different approximations at low and high multipoles, and implementing several methodological and analysis refinements. With more realistic simulations, and better correction and modelling of systematics, we can now make full use of the High Frequency Instrument polarization data. The low-multipole 100x143 GHz EE cross-spectrum constrains the reionization optical-depth parameter $\tau$ to better than 15% (in combination with with the other low- and high-$\ell$ likelihoods). We also update the 2015 baseline low-$\ell$ joint TEB likelihood based on the Low Frequency Instrument data, which provides a weaker $\tau$ constraint. At high multipoles, a better model of the temperature-to-polarization leakage and corrections for the effective calibrations of the polarization channels (polarization efficiency or PE) allow us to fully use the polarization spectra, improving the constraints on the $\Lambda$CDM parameters by 20 to 30% compared to TT-only constraints. Tests on the modelling of the polarization demonstrate good consistency, with some residual modelling uncertainties, the accuracy of the PE modelling being the main limitation. Using our various tests, simulations, and comparison between different high-$\ell$ implementations, we estimate the consistency of the results to be better than the 0.5$\sigma$ level. Minor curiosities already present before (differences between $\ell$<800 and $\ell$>800 parameters or the preference for more smoothing of the $C_\ell$ peaks) are shown to be driven by the TT power spectrum and are not significantly modified by the inclusion of polarization. Overall, the legacy Planck CMB likelihoods provide a robust tool for constraining the cosmological model and represent a reference for future CMB observations. (Abridged), Comment: Revised to match version published in Astronomy & Astrophysics

Analysis of the Planck 2018 data set indicates that the statistical properties of the cosmic microwave background (CMB) temperature anisotropies are in excellent agreement with previous studies using the 2013 and 2015 data releases. In particular, they are consistent with the Gaussian predictions of the $\Lambda$CDM cosmological model, yet also confirm the presence of several so-called "anomalies" on large angular scales. The novelty of the current study, however, lies in being a first attempt at a comprehensive analysis of the statistics of the polarization signal over all angular scales, using either maps of the Stokes parameters, $Q$ and $U$, or the $E$-mode signal derived from these using a new methodology (which we describe in an appendix). Although remarkable progress has been made in reducing the systematic effects that contaminated the 2015 polarization maps on large angular scales, it is still the case that residual systematics (and our ability to simulate them) can limit some tests of non-Gaussianity and isotropy. However, a detailed set of null tests applied to the maps indicates that these issues do not dominate the analysis on intermediate and large angular scales (i.e., $\ell \lesssim 400$). In this regime, no unambiguous detections of cosmological non-Gaussianity, or of anomalies corresponding to those seen in temperature, are claimed. Notably, the stacking of CMB polarization signals centred on the positions of temperature hot and cold spots exhibits excellent agreement with the $\Lambda$CDM cosmological model, and also gives a clear indication of how Planck provides state-of-the-art measurements of CMB temperature and polarization on degree scales., Comment: Paper VII of the Planck 2018 release, revised to closely match version published in Astronomy and Astrophysics

We analyse the Planck full-mission cosmic microwave background (CMB) temperature and E-mode polarization maps to obtain constraints on primordial non-Gaussianity (NG). We compare estimates obtained from separable template-fitting, binned, and modal bispectrum estimators, finding consistent values for the local, equilateral, and orthogonal bispectrum amplitudes. Our combined temperature and polarization analysis produces the following results: f_NL^local = -0.9 +\- 5.1; f_NL^equil = -26 +\- 47; and f_NL^ortho = - 38 +\- 24 (68%CL, statistical). These results include the low-multipole (4 <= l < 40) polarization data, not included in our previous analysis, pass an extensive battery of tests, and are stable with respect to our 2015 measurements. Polarization bispectra display a significant improvement in robustness; they can now be used independently to set NG constraints. We consider a large number of additional cases, e.g. scale-dependent feature and resonance bispectra, isocurvature primordial NG, and parity-breaking models, where we also place tight constraints but do not detect any signal. The non-primordial lensing bispectrum is detected with an improved significance compared to 2015, excluding the null hypothesis at 3.5 sigma. We present model-independent reconstructions and analyses of the CMB bispectrum. Our final constraint on the local trispectrum shape is g_NLl^local = (-5.8 +\-6.5) x 10^4 (68%CL, statistical), while constraints for other trispectra are also determined. We constrain the parameter space of different early-Universe scenarios, including general single-field models of inflation, multi-field and axion field parity-breaking models. Our results provide a high-precision test for structure-formation scenarios, in complete agreement with the basic picture of the LambdaCDM cosmology regarding the statistics of the initial conditions (abridged)., Comment: 50 pages, 20 figures

The Planck Collaboration made its final data release in 2018. In this paper we describe beam-deconvolution map products made from Planck LFI data using the artDeco deconvolution code to symmetrize the effective beam. The deconvolution results are auxiliary data products, available through the Planck Legacy Archive. Analysis of these deconvolved survey difference maps reveals signs of residual signal in the 30-GHz and 44-GHz frequency channels. We produce low-resolution maps and corresponding noise covariance matrices (NCVMs). The NCVMs agree reasonably well with the half-ring noise estimates except for 44 GHz, where we observe an asymmetry between $EE$ and $BB$ noise spectra, possibly a sign of further unresolved systematics., Comment: 12 pages, 7 figures

The two-point correlation function of the galaxy distribution is a key cosmological observable that allows us to constrain the dynamical and geometrical state of our Universe. To measure the correlation function we need to know both the galaxy positions and the expected galaxy density field. The expected field is commonly specified using a Monte-Carlo sampling of the volume covered by the survey and, to minimize additional sampling errors, this random catalog has to be much larger than the data catalog. Correlation function estimators compare data-data pair counts to data-random and random-random pair counts, where random-random pairs usually dominate the computational cost. Future redshift surveys will deliver spectroscopic catalogs of tens of millions of galaxies. Given the large number of random objects required to guarantee sub-percent accuracy, it is of paramount importance to improve the efficiency of the algorithm without degrading its precision. We show both analytically and numerically that splitting the random catalog into a number of subcatalogs of the same size as the data catalog when calculating random-random pairs, and excluding pairs across different subcatalogs provides the optimal error at fixed computational cost. For a random catalog fifty times larger than the data catalog, this reduces the computation time by a factor of more than ten without affecting estimator variance or bias., Comment: 11 pages, 6 figures

We present full-sky maps of the cosmic microwave background (CMB) and polarized synchrotron and thermal dust emission, derived from the third set of Planck frequency maps. These products have significantly lower contamination from instrumental systematic effects than previous versions. The methodologies used to derive these maps follow those described in earlier papers, adopting four methods (Commander, NILC, SEVEM, and SMICA) to extract the CMB component, as well as three methods (Commander, GNILC, and SMICA) to extract astrophysical components. Our revised CMB temperature maps agree with corresponding products in the Planck 2015 delivery, whereas the polarization maps exhibit significantly lower large-scale power, reflecting the improved data processing described in companion papers; however, the noise properties of the resulting data products are complicated, and the best available end-to-end simulations exhibit relative biases with respect to the data at the few percent level. Using these maps, we are for the first time able to fit the spectral index of thermal dust independently over 3 degree regions. We derive a conservative estimate of the mean spectral index of polarized thermal dust emission of beta_d = 1.55 +/- 0.05, where the uncertainty marginalizes both over all known systematic uncertainties and different estimation techniques. For polarized synchrotron emission, we find a mean spectral index of beta_s = -3.1 +/- 0.1, consistent with previously reported measurements. We note that the current data processing does not allow for construction of unbiased single-bolometer maps, and this limits our ability to extract CO emission and correlated components. The foreground results for intensity derived in this paper therefore do not supersede corresponding Planck 2015 products. For polarization the new results supersede the corresponding 2015 products in all respects., Comment: 74 pages, A&A, 641, A4

This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous 2015 release. They enabled the first significant measurement of the reionization optical depth parameter using HFI data. This paper presents an extensive analysis of systematic effects, including the use of simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved. Calibration, based on the CMB dipole, is now extremely accurate and in the frequency range 100 to 353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than $0.35\mu$K, an accuracy of order $10^{-4}$. This is a major legacy from the HFI for future CMB experiments. The removal of bandpass leakage has been improved by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. Simulations reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect. Using these simulations, we measure and correct the small frequency calibration bias induced by this systematic effect at the $10^{-4}$ level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the $10^{-3}$ level., Comment: Accepted for publication on A&A (AA/2018/32909)

We present 353 GHz full-sky maps of the polarization fraction $p$, angle $\psi$, and dispersion of angles $S$ of Galactic dust thermal emission produced from the 2018 release of Planck data. We confirm that the mean and maximum of $p$ decrease with increasing $N_H$. The uncertainty on the maximum polarization fraction, $p_\mathrm{max}=22.0$% at 80 arcmin resolution, is dominated by the uncertainty on the zero level in total intensity. The observed inverse behaviour between $p$ and $S$ is interpreted with models of the polarized sky that include effects from only the topology of the turbulent Galactic magnetic field. Thus, the statistical properties of $p$, $\psi$, and $S$ mostly reflect the structure of the magnetic field. Nevertheless, we search for potential signatures of varying grain alignment and dust properties. First, we analyse the product map $S \times p$, looking for residual trends. While $p$ decreases by a factor of 3--4 between $N_H=10^{20}$ cm$^{-2}$ and $N_H=2\times 10^{22}$ cm$^{-2}$, $S \times p$ decreases by only about 25%, a systematic trend observed in both the diffuse ISM and molecular clouds. Second, we find no systematic trend of $S \times p$ with the dust temperature, even though in the diffuse ISM lines of sight with high $p$ and low $S$ tend to have colder dust. We also compare Planck data with starlight polarization in the visible at high latitudes. The agreement in polarization angles is remarkable. Two polarization emission-to-extinction ratios that characterize dust optical properties depend only weakly on $N_H$ and converge towards the values previously determined for translucent lines of sight. We determine an upper limit for the polarization fraction in extinction of 13%, compatible with the $p_\mathrm{max}$ observed in emission. These results provide strong constraints for models of Galactic dust in diffuse gas., Comment: Accepted for publication in Astronomy & Astrophysics

The European Space Agency's Planck satellite, which was dedicated to studying the early Universe and its subsequent evolution, was launched on 14 May 2009. It scanned the microwave and submillimetre sky continuously between 12 August 2009 and 23 October 2013, producing deep, high-resolution, all-sky maps in nine frequency bands from 30 to 857GHz. This paper presents the cosmological legacy of Planck, which currently provides our strongest constraints on the parameters of the standard cosmological model and some of the tightest limits available on deviations from that model. The 6-parameter LCDM model continues to provide an excellent fit to the cosmic microwave background data at high and low redshift, describing the cosmological information in over a billion map pixels with just six parameters. With 18 peaks in the temperature and polarization angular power spectra constrained well, Planck measures five of the six parameters to better than 1% (simultaneously), with the best-determined parameter (theta_*) now known to 0.03%. We describe the multi-component sky as seen by Planck, the success of the LCDM model, and the connection to lower-redshift probes of structure formation. We also give a comprehensive summary of the major changes introduced in this 2018 release. The Planck data, alone and in combination with other probes, provide stringent constraints on our models of the early Universe and the large-scale structure within which all astrophysical objects form and evolve. We discuss some lessons learned from the Planck mission, and highlight areas ripe for further experimental advances., Comment: 61 pages, 40 figures, matches version accepted by A&A

We present a final description of the data-processing pipeline for the Planck, Low Frequency Instrument (LFI), implemented for the 2018 data release. Several improvements have been made with respect to the previous release, especially in the calibration process and in the correction of instrumental features such as the effects of nonlinearity in the response of the analogue-to-digital converters. We provide a brief pedagogical introduction to the complete pipeline, as well as a detailed description of the important changes implemented. Self-consistency of the pipeline is demonstrated using dedicated simulations and null tests. We present the final version of the LFI full sky maps at 30, 44, and 70 GHz, both in temperature and polarization, together with a refined estimate of the Solar dipole and a final assessment of the main LFI instrumental parameters.

We present measurements of the cosmic microwave background (CMB) lensing potential using the final $\textit{Planck}$ 2018 temperature and polarization data. We increase the significance of the detection of lensing in the polarization maps from $5\,\sigma$ to $9\,\sigma$. Combined with temperature, lensing is detected at $40\,\sigma$. We present an extensive set of tests of the robustness of the lensing-potential power spectrum, and construct a minimum-variance estimator likelihood over lensing multipoles $8 \le L \le 400$. We find good consistency between lensing constraints and the results from the $\textit{Planck}$ CMB power spectra within the $\rm{\Lambda CDM}$ model. Combined with baryon density and other weak priors, the lensing analysis alone constrains $\sigma_8 \Omega_{\rm m}^{0.25}=0.589\pm 0.020$ ($1\,\sigma$ errors). Also combining with baryon acoustic oscillation (BAO) data, we find tight individual parameter constraints, $\sigma_8=0.811\pm0.019$, $H_0=67.9_{-1.3}^{+1.2}\,\text{km}\,\text{s}^{-1}\,\rm{Mpc}^{-1}$, and $\Omega_{\rm m}=0.303^{+0.016}_{-0.018}$. Combining with $\textit{Planck}$ CMB power spectrum data, we measure $\sigma_8$ to better than $1\,\%$ precision, finding $\sigma_8=0.811\pm 0.006$. We find consistency with the lensing results from the Dark Energy Survey, and give combined lensing-only parameter constraints that are tighter than joint results using galaxy clustering. Using $\textit{Planck}$ cosmic infrared background (CIB) maps we make a combined estimate of the lensing potential over $60\,\%$ of the sky with considerably more small-scale signal. We demonstrate delensing of the $\textit{Planck}$ power spectra, detecting a maximum removal of $40\,\%$ of the lensing-induced power in all spectra. The improvement in the sharpening of the acoustic peaks by including both CIB and the quadratic lensing reconstruction is detected at high significance (abridged)., Comment: Abstract abridged for arxiv submission. Lensing data products available at https://wiki.cosmos.esa.int/planck-legacy-archive/index.php/Lensing. Matches version accepted by A&A, with minor updates from v1

We report on the implications for cosmic inflation of the 2018 Release of the Planck CMB anisotropy measurements. The results are fully consistent with the two previous Planck cosmological releases, but have smaller uncertainties thanks to improvements in the characterization of polarization at low and high multipoles. Planck temperature, polarization, and lensing data determine the spectral index of scalar perturbations to be $n_\mathrm{s}=0.9649\pm 0.0042$ at 68% CL and show no evidence for a scale dependence of $n_\mathrm{s}.$ Spatial flatness is confirmed at a precision of 0.4% at 95% CL with the combination with BAO data. The Planck 95% CL upper limit on the tensor-to-scalar ratio, $r_{0.002}<0.10$, is further tightened by combining with the BICEP2/Keck Array BK15 data to obtain $r_{0.002}<0.056$. In the framework of single-field inflationary models with Einstein gravity, these results imply that: (a) slow-roll models with a concave potential, $V" (\phi) < 0,$ are increasingly favoured by the data; and (b) two different methods for reconstructing the inflaton potential find no evidence for dynamics beyond slow roll. Non-parametric reconstructions of the primordial power spectrum consistently confirm a pure power law. A complementary analysis also finds no evidence for theoretically motivated parameterized features in the Planck power spectrum, a result further strengthened for certain oscillatory models by a new combined analysis that includes Planck bispectrum data. The new Planck polarization data provide a stringent test of the adiabaticity of the initial conditions. The polarization data also provide improved constraints on inflationary models that predict a small statistically anisotropic quadrupolar modulation of the primordial fluctuations. However, the polarization data do not confirm physical models for a scale-dependent dipolar modulation., Comment: References added and minor improvements. BICEP2/Keck Array BK15 is used in the place of BICEP2/Keck Array BK14

We present cosmological parameter results from the final full-mission Planck measurements of the CMB anisotropies. We find good consistency with the standard spatially-flat 6-parameter $\Lambda$CDM cosmology having a power-law spectrum of adiabatic scalar perturbations (denoted "base $\Lambda$CDM" in this paper), from polarization, temperature, and lensing, separately and in combination. A combined analysis gives dark matter density $\Omega_c h^2 = 0.120\pm 0.001$, baryon density $\Omega_b h^2 = 0.0224\pm 0.0001$, scalar spectral index $n_s = 0.965\pm 0.004$, and optical depth $\tau = 0.054\pm 0.007$ (in this abstract we quote $68\,\%$ confidence regions on measured parameters and $95\,\%$ on upper limits). The angular acoustic scale is measured to $0.03\,\%$ precision, with $100\theta_*=1.0411\pm 0.0003$. These results are only weakly dependent on the cosmological model and remain stable, with somewhat increased errors, in many commonly considered extensions. Assuming the base-$\Lambda$CDM cosmology, the inferred late-Universe parameters are: Hubble constant $H_0 = (67.4\pm 0.5)$km/s/Mpc; matter density parameter $\Omega_m = 0.315\pm 0.007$; and matter fluctuation amplitude $\sigma_8 = 0.811\pm 0.006$. We find no compelling evidence for extensions to the base-$\Lambda$CDM model. Combining with BAO we constrain the effective extra relativistic degrees of freedom to be $N_{\rm eff} = 2.99\pm 0.17$, and the neutrino mass is tightly constrained to $\sum m_\nu< 0.12$eV. The CMB spectra continue to prefer higher lensing amplitudes than predicted in base -$\Lambda$CDM at over $2\,\sigma$, which pulls some parameters that affect the lensing amplitude away from the base-$\Lambda$CDM model; however, this is not supported by the lensing reconstruction or (in models that also change the background geometry) BAO data. (Abridged), Comment: 73 pages; Updated with published reionization result corrigendum on p59. Parameter tables and chains available at https://wiki.cosmos.esa.int/planck-legacy-archive/index.php/Cosmological_Parameters

This paper presents the Planck Multi-frequency Catalogue of Non-thermal (i.e. synchrotron-dominated) Sources (PCNT) observed between 30 and 857 GHz by the ESA Planck mission. This catalogue was constructed by selecting objects detected in the full mission all-sky temperature maps at 30 and 143 GHz, with a signal-to-noise ratio (S/N)>3 in at least one of the two channels after filtering with a particular Mexican hat wavelet. As a result, 29400 source candidates were selected. Then, a multi-frequency analysis was performed using the Matrix Filters methodology at the position of these objects, and flux densities and errors were calculated for all of them in the nine Planck channels. The present catalogue is the first unbiased, full-sky catalogue of synchrotron-dominated sources published at millimetre and submillimetre wavelengths and constitutes a powerful database for statistical studies of non-thermal extragalactic sources, whose emission is dominated by the central active galactic nucleus. Together with the full multi-frequency catalogue, we also define the Bright Planck Multi-frequency Catalogue of Non-thermal Sources PCNTb, where only those objects with a S/N>4 at both 30 and 143 GHz were selected. In this catalogue 1146 compact sources are detected outside the adopted Planck GAL070 mask; thus, these sources constitute a highly reliable sample of extragalactic radio sources. We also flag the high-significance subsample PCNThs, a subset of 151 sources that are detected with S/N>4 in all nine Planck channels, 75 of which are found outside the Planck mask adopted here. The remaining 76 sources inside the Galactic mask are very likely Galactic objects., Comment: 24 pages, 15 figures. Accepted for publication in Astronomy & Astrophysics