Search

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to instabilities that can lead to feature collapse. Different techniques have been devised to circumvent this issue, including the use of negative pairs with different contrastive losses, the use of external memory banks, and breaking of symmetry by using separate encoding networks with possibly different structures. Our method, termed BAM, rather than directly matching features of different views (augmentations) of input images, is based on matching their self-attention vectors, which are the distributions of similarities to the entire set of augmented images of a batch. We obtain rich representations and avoid feature collapse by minimizing a loss that matches these distributions to their globally balanced and entropy regularized version, which is obtained through a simple self-optimal-transport computation. We ablate and verify our method through a wide set of experiments that show competitive performance with leading methods on both semi-supervised and transfer-learning benchmarks. Our implementation and pre-trained models are available at github.com/DanielShalam/BAM .

We present the detection and characterization of fluctuations in linearly polarized emission from the atmosphere above the South Pole. These measurements make use of Austral winter survey data from the SPT-3G receiver on the South Pole Telescope in three frequency bands centered at 95, 150, and 220 GHz. We use the cross-correlation between detectors to produce an unbiased estimate of the power in Stokes I, Q, and U parameters on large angular scales. Our results are consistent with the polarized signal being produced by the combination of Rayleigh scattering of thermal radiation from the ground and thermal emission from a population of horizontally aligned ice crystals with an anisotropic distribution described by Kolmogorov turbulence. The signal is most significant at large angular scales, high observing frequency, and low elevation angle. Polarized atmospheric emission has the potential to significantly impact observations on the large angular scales being targeted by searches for inflationary B-mode CMB polarization. We present the distribution of measured angular power spectrum amplitudes in Stokes Q and I for 4 years of winter observations, which can be used to simulate the impact of atmospheric polarization and intensity fluctuations at the South Pole on a specified experiment and observation strategy. For the SPT-3G data, downweighting the small fraction of significantly contaminated observations is an effective mitigation strategy. In addition, we present a strategy for further improving sensitivity on large angular scales where maps made in the 220 GHz band are used to measure and subtract the polarized atmosphere signal from the 150 GHz band maps. In observations with the SPT-3G instrument at the South Pole, the polarized atmospheric signal is a well-understood and sub-dominant contribution to the measured noise after implementing the mitigation strategies described here., Comment: 32 pages, 28 figures

The Balanced-Pairwise-Affinities (BPA) feature transform is designed to upgrade the features of a set of input items to facilitate downstream matching or grouping related tasks. The transformed set encodes a rich representation of high order relations between the input features. A particular min-cost-max-flow fractional matching problem, whose entropy regularized version can be approximated by an optimal transport (OT) optimization, leads to a transform which is efficient, differentiable, equivariant, parameterless and probabilistically interpretable. While the Sinkhorn OT solver has been adapted extensively in many contexts, we use it differently by minimizing the cost between a set of features to $itself$ and using the transport plan's $rows$ as the new representation. Empirically, the transform is highly effective and flexible in its use and consistently improves networks it is inserted into, in a variety of tasks and training schemes. We demonstrate state-of-the-art results in few-shot classification, unsupervised image clustering and person re-identification. Code is available at \url{github.com/DanielShalam/BPA}., Comment: arXiv admin note: substantial text overlap with arXiv:2204.03065

We prove PSPACE-hardness for fifteen games in the Super Mario Bros. 2D platforming video game series. Previously, only the original Super Mario Bros. was known to be PSPACE-hard (FUN 2016), though several of the games we study were known to be NP-hard (FUN 2014). Our reductions build door gadgets with open, close, and traverse traversals, in each case using mechanics unique to the game. While some of our door constructions are similar to those from FUN 2016, those for Super Mario Bros. 2, Super Mario Land 2, Super Mario World 2, and the New Super Mario Bros. series are quite different; notably, the Super Mario Bros. 2 door is extremely difficult. Doors remain elusive for just two 2D Mario games (Super Mario Land and Super Mario Run); we prove that these games are at least NP-hard.

We measure the stacked lensing signal in the direction of galaxy clusters in the Dark Energy Survey Year 3 (DES Y3) redMaPPer sample, using cosmic microwave background (CMB) temperature data from SPT-3G, the third-generation CMB camera on the South Pole Telescope (SPT). We estimate the lensing signal using temperature maps constructed from the initial 2 years of data from the SPT-3G 'Main' survey, covering 1500 deg$^2$ of the Southern sky. We then use this signal as a proxy for the mean cluster mass of the DES sample. In this work, we employ three versions of the redMaPPer catalogue: a Flux-Limited sample containing 8865 clusters, a Volume-Limited sample with 5391 clusters, and a Volume&Redshift-Limited sample with 4450 clusters. For the three samples, we find the mean cluster masses to be ${M}_{200{\rm{m}}}=1.66\pm0.13$ [stat.]$\pm0.03$ [sys.], $1.97\pm0.18$ [stat.]$\pm0.05$ [sys.], and $2.11\pm0.20$ [stat.]$\pm0.05$ [sys.]$\times{10}^{14}\ {\rm{M}}_{\odot }$, respectively. This is a factor of $\sim2$ improvement relative to the precision of measurements with previous generations of SPT surveys and the most constraining cluster mass measurements using CMB cluster lensing to date. Overall, we find no significant tensions between our results and masses given by redMaPPer mass-richness scaling relations of previous works, which were calibrated using CMB cluster lensing, optical weak lensing, and velocity dispersion measurements from various combinations of DES, SDSS and Planck data. We then divide our sample into 3 redshift and 3 richness bins, finding no significant tensions with optical weak-lensing calibrated masses in these bins. We forecast a $5.7\%$ constraint on the mean cluster mass of the DES Y3 sample with the complete SPT-3G surveys when using both temperature and polarization data and including an additional $\sim1400$ deg$^2$ of observations from the 'Extended' SPT-3G survey., Comment: 23 pages, 9 figures, accepted for publication in JCAP. Minor changes and corrections have been made relative to v1

We forecast constraints on cosmological parameters enabled by three surveys conducted with SPT-3G, the third-generation camera on the South Pole Telescope. The surveys cover separate regions of 1500, 2650, and 6000 ${\rm deg}^{2}$ to different depths, in total observing 25% of the sky. These regions will be measured to white noise levels of roughly 2.5, 9, and 12 $\mu{\rm K-arcmin}$, respectively, in CMB temperature units at 150 GHz by the end of 2024. The survey also includes measurements at 95 and 220 GHz, which have noise levels a factor of ~1.2 and 3.5 times higher than 150 GHz, respectively, with each band having a polarization noise level ~$\sqrt{\text{2}}$ times higher than the temperature noise. We use a novel approach to obtain the covariance matrices for jointly and optimally estimated gravitational lensing potential bandpowers and unlensed CMB temperature and polarization bandpowers. We demonstrate the ability to test the $\Lambda{\rm CDM}$ model via the consistency of cosmological parameters constrained independently from SPT-3G and Planck data, and consider the improvement in constraints on $\Lambda{\rm CDM}$ extension parameters from a joint analysis of SPT-3G and Planck data. The $\Lambda{\rm CDM}$ cosmological parameters are typically constrained with uncertainties up to ~2 times smaller with SPT-3G data, compared to Planck, with the two data sets measuring significantly different angular scales and polarization levels, providing additional tests of the standard cosmological model., Comment: 26 pages; 13 figures; Accepted for publication in ApJ; Minor edits have been made

We report results from an analysis aimed at detecting the trispectrum of the kinematic Sunyaev-Zel{'}dovich (kSZ) effect by combining data from the South Pole Telescope (SPT) and {\it Herschel}-SPIRE experiments over a 100 ${\rm deg}^{2}$ field. The SPT observations combine data from the previous and current surveys, namely SPTpol and SPT-3G, to achieve depths of 4.5, 3, and 16 $\mu {\rm K-arcmin}$ in bands centered at 95, 150, and 220 GHz. For SPIRE, we include data from the 600 and 857 GHz bands. We reconstruct the velocity-induced large-scale correlation of the small-scale kSZ signal with a quadratic estimator that uses two cosmic microwave background (CMB) temperature maps, constructed by optimally combining data from all the frequency bands. We reject the null hypothesis of a zero trispectrum at $10.3\sigma$ level. However, the measured trispectrum contains contributions from both the kSZ and other undesired components, such as CMB lensing and astrophysical foregrounds, with kSZ being sub-dominant. We use the \textsc{Agora} simulations to estimate the expected signal from CMB lensing and astrophysical foregrounds. After accounting for the contributions from CMB lensing and foreground signals, we do not detect an excess kSZ-only trispectrum and use this non-detection to set constraints on reionization. By applying a prior based on observations of the Gunn-Peterson trough, we obtain an upper limit on the duration of reionization of $\Delta z_{\rm re, 50} < 4.5$ (95\% C.L). We find these constraints are fairly robust to foregrounds assumptions. This trispectrum measurement is independent of, but consistent with, {\it Planck}'s optical depth measurement. This result is the first constraint on the epoch of reionization using the non-Gaussian nature of the kSZ signal., Comment: 15 pages, 5 figures (3 in main text and 2 in Appendix); Accepted for publication in PRL; Some texts have been moved to Appendix; Minor change in Fig. 2 to include nomalization; Data products and plotting scripts can be downloaded from https://github.com/sriniraghunathan/kSZ_4pt_SPT_SPIRE

We present a flare star catalog from four years of non-targeted millimeter-wave survey data from the South Pole Telescope (SPT). The data were taken with the SPT-3G camera and cover a 1500-square-degree region of the sky from $20^{h}40^{m}0^{s}$ to $3^{h}20^{m}0^{s}$ in right ascension and $-42^{\circ}$ to $-70^{\circ}$ in declination. This region was observed on a nearly daily cadence from 2019-2022 and chosen to avoid the plane of the galaxy. A short-duration transient search of this survey yields 111 flaring events from 66 stars, increasing the number of both flaring events and detected flare stars by an order of magnitude from the previous SPT-3G data release. We provide cross-matching to Gaia DR3, as well as matches to X-ray point sources found in the second ROSAT all-sky survey. We have detected flaring stars across the main sequence, from early-type A stars to M dwarfs, as well as a large population of evolved stars. These stars are mostly nearby, spanning 10 to 1000 parsecs in distance. Most of the flare spectral indices are constant or gently rising as a function of frequency at 95/150/220 GHz. The timescale of these events can range from minutes to hours, and the peak $\nu L_{\nu}$ luminosities range from $10^{27}$ to $10^{31}$ erg s$^{-1}$ in the SPT-3G frequency bands.

We present a measurement of gravitational lensing over 1500 deg$^2$ of the Southern sky using SPT-3G temperature data at 95 and 150 GHz taken in 2018. The lensing amplitude relative to a fiducial Planck 2018 $\Lambda$CDM cosmology is found to be $1.020\pm0.060$, excluding instrumental and astrophysical systematic uncertainties. We conduct extensive systematic and null tests to check the robustness of the lensing measurements, and report a minimum-variance combined lensing power spectrum over angular multipoles of $50

In group foraging situations, the conventional expectation is that increased food availability would enhance consumption, especially when animals prioritize maximizing their food intake. This paper challenges this conventional wisdom by conducting an in-depth game-theoretic analysis of a basic producer-scrounger model, in which animals must choose between intensive food searching as producers or moderate searching while relying on group members as scroungers. Surprisingly, our study reveals that, under certain circumstances, increasing food availability can amplify the inclination to scrounge to such an extent that it paradoxically leads to a reduction in animals' food consumption compared to scenarios with limited food availability. We further illustrate a similar phenomenon in a model capturing free-riding dynamics among workers in a company. We demonstrate that, under certain reward mechanisms, enhancing workers' production capacities can inadvertently trigger a surge in free-riding behavior, leading to both diminished group productivity and reduced individual payoffs. Our findings underscore the significance of contextual factors when comprehending and predicting the impact of resource availability on individual and collective outcomes.

Research on neural radiance fields (NeRFs) for novel view generation is exploding with new models and extensions. However, a question that remains unanswered is what happens in underwater or foggy scenes where the medium strongly influences the appearance of objects. Thus far, NeRF and its variants have ignored these cases. However, since the NeRF framework is based on volumetric rendering, it has inherent capability to account for the medium's effects, once modeled appropriately. We develop a new rendering model for NeRFs in scattering media, which is based on the SeaThru image formation model, and suggest a suitable architecture for learning both scene information and medium parameters. We demonstrate the strength of our method using simulated and real-world scenes, correctly rendering novel photorealistic views underwater. Even more excitingly, we can render clear views of these scenes, removing the medium between the camera and the scene and reconstructing the appearance and depth of far objects, which are severely occluded by the medium. Our code and unique datasets are available on the project's website.

The ILAN-ES (Imaging of Lightning And Nocturnal Emissions from Space) experiment was conducted by Israeli astronaut Eytan Stibbe in April 2022 as part of the Axiom Space company AX-1 private mission to the International Space Station, in the framework of Rakia, a set of experiments selected for flight by the Ramon Foundation and the Israeli Space Agency. The mission objective was to manually record lightning and transient luminous events from the Cupola window in the ISS, based on preliminary thunderstorm forecasts uploaded to the crew 24-36 hours in advance. A Nikon D6 camera with a 50 mm lens was used, in a video mode of 60 frames per second. During the 15-day mission, 82 different targets were uploaded to the ISS of which 20 were imaged by the astronauts, yielding a total harvest of 45 TLEs: sprites, Elves and Blue Corona Discharges. The methodology and execution by the ISS astronauts are described and recommendation for future observations by on-board human-operated instruments on the ISS are given, Comment: 16 pages, 5 figures

Today, and on any given day in the U.S., tens of thousands of students are attending school behind bars. Juvenile justice education fails many of these students, resulting in a double punishment for youth: the punitive experience of incarceration for their alleged offense and the potentially catastrophic disruptions of their educational pathway. This report reviews juvenile justice education policies in all 50 states, Washington, D.C., and Puerto Rico. The authors focused their review on three related sets of policy tools that are crucial for improving outcomes for youth who are incarcerated: governance, accountability, and finance. While each of these policy tools creates opportunities for reform, designing all three to be mutually reinforcing has broader impact at the system level. However, the review of current state policies shows that there is much to improve. State policymakers are responsible for designing policies that allow high-quality education to flourish in juvenile facilities. To that end, the authors conclude the report by offering recommendations to state and local policymakers for leveraging governance, accountability, and finance to improve the quality of juvenile justice education. [This project received financial support from the Margulf Foundation.]

This paper deals with various cases of resonance, which is a fundamental concept of science and engineering. Specifically, we study the connections between periodic and unbounded solutions for several classes of equations and systems. In particular, we extend the classical Massera's theorem, dealing with periodic systems of the type \[ x'=A(t)x+f(t) \,, \] and clarify that this theorem deals with a case of resonance. Then we provide instability results for the corresponding semilinear systems, with the linear part at resonance. We also use the solution curves developed in [8], [9] to establish the instability results for pendulum-like equations, and for first-order periodic equations., Comment: 20 pages, 1 figure

We investigate opinion dynamics in a fully-connected system, consisting of $n$ identical and anonymous agents, where one of the opinions (which is called correct) represents a piece of information to disseminate. In more detail, one source agent initially holds the correct opinion and remains with this opinion throughout the execution. The goal for non-source agents is to quickly agree on this correct opinion, and do that robustly, i.e., from any initial configuration. The system evolves in rounds. In each round, one agent chosen uniformly at random is activated: unless it is the source, the agent pulls the opinions of $\ell$ random agents and then updates its opinion according to some rule. We consider a restricted setting, in which agents have no memory and they only revise their opinions on the basis of those of the agents they currently sample. As restricted as it is, this setting encompasses very popular opinion dynamics, such as the voter model and best-of-$k$ majority rules. Qualitatively speaking, we show that lack of memory prevents efficient convergence. Specifically, we prove that no dynamics can achieve correct convergence in an expected number of steps that is sub-quadratic in $n$, even under a strong version of the model in which activated agents have complete access to the current configuration of the entire system, i.e., the case $\ell=n$. Conversely, we prove that the simple voter model (in which $\ell=1$) correctly solves the problem, while almost matching the aforementioned lower bound. These results suggest that, in contrast to symmetric consensus problems (that do not involve a notion of correct opinion), fast convergence on the correct opinion using stochastic opinion dynamics may indeed require the use of memory. This insight may reflect on natural information dissemination processes that rely on a few knowledgeable individuals.

The United States' child population is becoming increasingly racially diverse, and the proportion of children identified with disabilities is on an upward trajectory, but persistent disparities in outcomes based on race and disability status across education systems endure. At the intersection of these populations are children of color with disabilities, who experience greater obstacles along their education pathways and poorer academic outcomes than their nondisabled and/or white peers. For this report, the authors interviewed families of children of color with disabilities to understand their experiences with education, recognizing these families as experts in their own lives. While every interview was unique, the stories of these families illustrate the challenges many families of color with children with disabilities face in accessing high-quality services. Despite differences in geography, family structure, and the types of disabilities that their children have, the problems these families face -- and their ideas for how to make things better -- were consistent. [Funding for this report was provided by Easterseals.]

We present a sample-variance-limited measurement of the temperature power spectrum ($TT$) of the cosmic microwave background (CMB) using observations of a $\sim\! 1500 \,\mathrm{deg}^2$ field made by SPT-3G in 2018. We report multifrequency power spectrum measurements at 95, 150, and 220GHz covering the angular multipole range $750 \leq \ell < 3000$. We combine this $TT$ measurement with the published polarization power spectrum measurements from the 2018 observing season and update their associated covariance matrix to complete the SPT-3G 2018 $TT/TE/EE$ data set. This is the first analysis to present cosmological constraints from SPT $TT$, $TE$, and $EE$ power spectrum measurements jointly. We blind the cosmological results and subject the data set to a series of consistency tests at the power spectrum and parameter level. We find excellent agreement between frequencies and spectrum types and our results are robust to the modeling of astrophysical foregrounds. We report results for $\Lambda$CDM and a series of extensions, drawing on the following parameters: the amplitude of the gravitational lensing effect on primary power spectra $A_\mathrm{L}$, the effective number of neutrino species $N_{\mathrm{eff}}$, the primordial helium abundance $Y_{\mathrm{P}}$, and the baryon clumping factor due to primordial magnetic fields $b$. We find that the SPT-3G 2018 $T/TE/EE$ data are well fit by $\Lambda$CDM with a probability-to-exceed of $15\%$. For $\Lambda$CDM, we constrain the expansion rate today to $H_0 = 68.3 \pm 1.5\,\mathrm{km\,s^{-1}\,Mpc^{-1}}$ and the combined structure growth parameter to $S_8 = 0.797 \pm 0.042$. The SPT-based results are effectively independent of Planck, and the cosmological parameter constraints from either data set are within $<1\,\sigma$ of each other. (abridged), Comment: 35 Pages, 17 Figures, 11 Tables

We infer the mean optical depth of a sample of optically-selected galaxy clusters from the Dark Energy Survey (DES) via the pairwise kinematic Sunyaev-Zel'dovich (kSZ) effect. The pairwise kSZ signal between pairs of clusters drawn from the DES Year-3 cluster catalog is detected at $4.1 \sigma$ in cosmic microwave background (CMB) temperature maps from two years of observations with the SPT-3G camera on the South Pole Telescope. After cuts, there are 24,580 clusters in the $\sim 1,400$ deg$^2$ of the southern sky observed by both experiments. We infer the mean optical depth of the cluster sample with two techniques. The optical depth inferred from the pairwise kSZ signal is $\bar{\tau}_e = (2.97 \pm 0.73) \times 10^{-3}$, while that inferred from the thermal SZ signal is $\bar{\tau}_e = (2.51 \pm 0.55^{\text{stat}} \pm 0.15^{\rm syst}) \times 10^{-3}$. The two measures agree at $0.6 \sigma$. We perform a suite of systematic checks to test the robustness of the analysis.