Search

The Atacama Cosmology Telescope Data Release 6 (ACT DR6) power spectrum is expected to provide state-of-the-art cosmological constraints, with an associated need for precise error modeling. In this paper we design, and evaluate the performance of, an analytic covariance matrix prescription for the DR6 power spectrum that sufficiently accounts for the complicated ACT map properties. We use recent advances in the literature to handle sharp features in the signal and noise power spectra, and account for the effect of map-level anisotropies on the covariance matrix. In including inhomogeneous survey depth information, the resulting covariance matrix prescription is structurally similar to that used in the $\textit{Planck}$ Cosmic Microwave Background (CMB) analysis. We quantify the performance of our prescription using comparisons to Monte Carlo simulations, finding better than $3\%$ agreement. This represents an improvement from a simpler, pre-existing prescription, which differs from simulations by $\sim16\%$. We develop a new method to correct the analytic covariance matrix using simulations, after which both prescriptions achieve better than $1\%$ agreement. This correction method outperforms a commonly used alternative, where the analytic correlation matrix is assumed to be accurate when correcting the covariance. Beyond its use for ACT, this framework should be applicable for future high resolution CMB experiments including the Simons Observatory (SO)., Comment: 22 pages (+11 appendix), 10 figures (+5 appendix), submitted to JCAP

In this report, we introduce INTELLECT-1, the first 10 billion parameter language model collaboratively trained across the globe, demonstrating that large-scale model training is no longer confined to large corporations but can be achieved through a distributed, community-driven approach. INTELLECT-1 was trained on 1 trillion tokens using up to 14 concurrent nodes distributed across 3 continents, with contributions from 30 independent compute providers dynamically joining and leaving the training process, while maintaining 83-96% compute utilization and 36.2-41.4% model FLOPS utilization. We leverage PRIME, our scalable distributed training framework designed for fault-tolerant, high-performance training on unreliable, globally distributed nodes. Key innovations in PRIME include the ElasticDeviceMesh, which manages dynamic global process groups for fault-tolerant communication across the internet and local process groups for communication within a node, live checkpoint recovery kernels, and a hybrid DiLoCo-FSDP2 implementation. Using PRIME with DiLoCo and our custom int8 all-reduce, we achieve a 400x reduction in communication bandwidth compared to traditional data-parallel training settings while delivering comparable performance. These results demonstrate the feasibility and promise of training frontier foundation models in a decentralized network of global GPU resources., Comment: 19 pages, 6 figures

Advanced Air Mobility aircraft require energy efficient flight plans to be economically viable. This paper defines minimum energy direct trajectories between waypoints for Lift+Cruise electric Vertical Take-Off and Landing (eVTOL) aircraft. Energy consumption is optimized over accelerated and cruise flight profiles with consideration of mode transitions. Because eVTOL operations start and end in hover for vertical take-off and landing, hover waypoints are utilized. Energy consumption is modeled as a function of airspeed for each flight mode, providing the basis to prove energy optimality for multi-mode traversal. Wind magnitude and direction dictate feasibility of straight-line traversal because Lift+Cruise aircraft point into the relative wind direction while hovering but also have a maximum heading rate constraint. Energy and power use for an experimentally validated QuadPlane small eVTOL aircraft are characterized with respect to airspeed and acceleration in all flight modes. Optimal QuadPlane traversals are presented. Constraints on acceleration and wind are derived for straight-line QuadPlane traversal. Results show an optimal QuadPlane $500m$ traversal between hover waypoints saves $71\%$ energy compared to pure vertical flight traversal for a representative case study with a direct $4m/s$ crosswind. Energy optimal eVTOL direct trajectory definition with transitions to and from hover is novel to this work. Future work should model three-dimensional flight and wind as well as optimize maneuver primitives when required., Comment: 34 pages, 17 figures and 5 tables

The high electron temperature in galaxy clusters ($>1\,$keV or $>10^7\,$K) leads to corrections at the level of a few percent in their thermal Sunyaev-Zeldovich effect signatures. Both the size and frequency dependence of these corrections, which are known as relativistic temperature corrections, depend upon the temperature of the objects. In this work we exploit this effect to measure the average temperature of a stack of Compton-$y$ selected clusters. Specifically, we apply the "spectroscopic method" and search for the temperature that best fits the clusters' signal measured at frequencies from 30 to 545 GHz by the Atacama Cosmology Telescope and Planck satellite. We measure the average temperature of clusters detected in the ACT maps to be $8.5\pm 2.4\,$keV, with an additional systematic error of comparable amplitude dominated by passband uncertainty. Upcoming surveys, such as the Simons Observatory and CMB-S4, have the potential to dramatically improve upon these measurements and thereby enable precision studies of cluster temperatures with millimeter observations. The key challenge for future observations will be mitigating instrumental systematic effects, which already limit this analysis., Comment: 21 pages with 17 figures

We introduce ImmerseDiffusion, an end-to-end generative audio model that produces 3D immersive soundscapes conditioned on the spatial, temporal, and environmental conditions of sound objects. ImmerseDiffusion is trained to generate first-order ambisonics (FOA) audio, which is a conventional spatial audio format comprising four channels that can be rendered to multichannel spatial output. The proposed generative system is composed of a spatial audio codec that maps FOA audio to latent components, a latent diffusion model trained based on various user input types, namely, text prompts, spatial, temporal and environmental acoustic parameters, and optionally a spatial audio and text encoder trained in a Contrastive Language and Audio Pretraining (CLAP) style. We propose metrics to evaluate the quality and spatial adherence of the generated spatial audio. Finally, we assess the model performance in terms of generation quality and spatial conformance, comparing the two proposed modes: ``descriptive", which uses spatial text prompts) and ``parametric", which uses non-spatial text prompts and spatial parameters. Our evaluations demonstrate promising results that are consistent with the user conditions and reflect reliable spatial fidelity., Comment: This work pioneers a Latent Diffusion Model for generating text-prompted ambisonic spatial audio

We generalise Phinney's 'practical theorem' to account for modified graviton dispersion relations motivated by certain cosmological scenarios. Focusing on specific examples, we show how such modifications can induce characteristic localised distortions, bumps, in the frequency profile of the stochastic gravitational wave background emitted from distant binary sources. We concentrate on gravitational waves at nano-Hertz frequencies probed by pulsar timing arrays, and we forecast the capabilities of future experiments to accurately probe parameters controlling modified dispersion relations. Our predictions are based on properties of gravitational waves emitted in the first inspiral phase of the binary process, and do not rely on assumptions of non-linear effects occurring during the binary merging phase, Comment: 19 pages, 5 figures, 2 tables

Additive manufacture (AM) involves creating a part layer by layer and is a rapidly evolving manufacturing process. It has multiple strengths that apply to space-based optics, such as the ability to consolidate multiple parts into one, reducing the number of interfaces. The process also allows for greater mass reduction, making parts more cost-effective to launch, achieved by optimising the shape for intended use or creating intricate geometries like lattices. However, previous studies have highlighted issues associated with the AM process. For example, when trying to achieve high-precision optical surfaces on AM parts, the latticing on the underside of mirrors can provide insufficient support during machining, resulting in the quilting effect. This paper builds on previous work and explores such challenges further. This will be implemented by investigating ways to apply AM to a deployable mirror from a CubeSat project called A-DOT. The reflective surface has a spherical radius of curvature of 682 mm and approximate external dimensions of 106 mm x 83 mm. The aim is to produce two mirrors that will take full advantage of AM design benefits and account for the challenges in printing and machining a near-net shape. The designs will have reduced mass by using selected internal lattice designs and topology-optimised connection points, resulting in two mirrors with mass reduction targets of 50% and 70%. Once printed in aluminium using laser powder bed fusion, the reflective surface will be created using single point diamond turning. Finally, an evaluation of the dimensional accuracy will be conducted, using interferometry, to quantify the performance of the reflective surface., Comment: 30 pages, 38 figures, submitted to SPIE Astronomical Telescopes & Instrumentation, Advances in Optical and Mechanical Technologies for Telescopes and Instrumentation VI (Conference 13100, Paper 140)

Despite the established role of additive manufacturing (AM) in aerospace and medical fields, its adoption in astronomy remains low. Encouraging AM integration in a risk-averse community necessitates documentation and dissemination of previous case studies. The objective of this study is to create the first review of AM in astronomy hardware, answering: where is AM currently being used in astronomy, what is the status of its adoption, and what challenges are preventing its widespread use? The review starts with an introduction to astronomical instruments size/cost challenges, alongside the role of manufacturing innovation. This is followed by highlighting the benefits/challenges of AM and used materials/processes in both space-based and ground-based applications. The review case studies include mirrors, optomechanical structures, compliant mechanisms, brackets and tooling applications that are either in research phase or are implemented., Comment: 27 pages, 17 figures, submitted to SPIE Astronomical Telescopes & Instrumentation, Advances in Optical and Mechanical Technologies for Telescopes and Instrumentation VI (Conference 13100, Paper 57)

Spaced-based mirrors are a developing use-case for Additive Manufacturing (AM), the process that builds a part layer-by-layer. The increased geometric freedom results in novel and advantageous designs previously unachievable. Conventionally, mirror fabrication uses subtractive (milling & turning), formative (casting) and fabricative (bonding) manufacturing methods; however, an additive method can simplify an assembly by consolidating individual components into one, and incorporating lattice structures and function optimised geometries to reduce the mass of components, which are beneficial to space-based instrumentation as mass and volume are constrained. Attention must be given to the printability of the design - build orientation and powder/resin removal from lattices and internal cavities are challenges when designing for AM. This paper will describe the design, manufacture and metrology of mirror prototypes from the Active Deployable Optical Telescope (ADOT) 6U CubeSat project. The AM mirror is 52mm in diameter, 10mm deep, with a convex 100mm radius of curvature reflective surface and deploys telescopically on three booms. The objectives of the designs were to combine the boom mounting features into the mirror and to lightweight both prototypes by 50% and 70% using internal, thin-walled lattices. Four final lattice designs were downselected through simulation and prototype validation. Prototypes were printed in the aluminium alloy AlSi10Mg using powder bed fusion and fused silica using stereolithography. Aluminium mirrors were single point diamond turned and had surface roughness measurements taken. Fused silica designs were adapted from the aluminium designs and have completed printing., Comment: 36 pages, 38 figures, submitted to SPIE Astronomical Telescopes & Instrumentation, Advances in Optical and Mechanical Technologies for Telescopes and Instrumentation VI (Conference 13100, Paper 6)

The relationship between measures of stenosis and microvascular resistance is of importance due to medical decisions being based on these values. This research investigates the impact of varying microvascular resistance on fractional flow reserve (FFR) and hyperaemic stenosis resistance (hSR). Microvascular resistance is classified using hyperaemic microvascular resistance (hMR). Additionally, hMR using the upstream pressure value (hMRPa) has also been calculated and is compared to hMR measured conventionally. Tests were conducted at three different degrees of stenosis (quantified by percent area) in a coronary flow circuit with varying downstream resistance to simulate the microvasculature. Pressure and flow values are recorded across the stenosed section, allowing for calculation of the diagnostic indexes. Results indicate that for a constant degree of stenosis, FFR would increase with increasing microvascular resistance while hSR would remain almost constant. hMRPa was found to approach hMR as the stenosis severity decreased, and the pressure gradient decreased. In the results shown here, with sufficiently high downstream resistance, an 84% stenosis could produce an FFR value over 0.8. This result suggests that there is the potential for misdiagnosis of the severity of stenosis when combined with elevated microvascular resistance. Consequently, decisions on the clinical significance of a stenosis, classified by FFR, need to consider the effect of the microvascular resistance., Comment: 25 pages including cover page. 9 figures in body and 2 in Appendix

Additive manufacturing (AM; 3D printing) in aluminium using laser powder bed fusion provides a new design space for lightweight mirror production. Printing layer-by-layer enables the use of intricate lattices for mass reduction, as well as organic shapes generated by topology optimisation, resulting in mirrors optimised for function as opposed to subtractive machining. However, porosity, a common AM defect, is present in printed aluminium and it is a result of the printing environment being either too hot or too cold, or gas entrapped bubbles within the aluminium powder. When present in an AM mirror substrates, porosity manifests as pits on the reflective surface, which increases micro-roughness and therefore scattered light. There are different strategies to reduce the impact of porosity: elimination during printing, coating the aluminium print in nickel phosphorous, or to apply a heat and pressure treatment to close the pores, commonly known as a hot isostatic press (HIP). This paper explores the application of HIP on printed aluminium substrates intended for mirror production using single point diamond turning (SPDT). The objective of the HIP is to reduce porosity whilst targeting a small grain growth within the aluminium, which is important in allowing the SPDT to generate surfaces with low micro-roughness. For this study, three disks, 50 mm diameter by 5 mm, were printed in AlSi10Mg at 0 deg, 45 deg, and 90 deg with respect to the build plate. X-ray computed tomography (XCT) was conducted before and after the HIP cycle to confirm the effectiveness of HIP to close porosity. The disks were SPDT and the micro-roughness evaluated. Mechanical testing and electron backscatter diffraction (EBSD) was used to quantify the mechanical strength and the grain size after HIP., Comment: 14 pages, 8 figures, submitted to SPIE Astronomical Telescopes & Instrumentation, Advances in Optical and Mechanical Technologies for Telescopes and Instrumentation VI (Conference 13100, Paper 141)

Additive manufacturing (AM; 3D printing) has clear benefits in the production of lightweight mirrors for astronomy: it can create optimised lightweight structures and combine multiple components into one. New capabilities in AM ceramics, silicon carbide infiltrated with silicon and fused silica, offer the possibility to combine the design benefits of AM with a material suitable for visible, ultraviolet and X-ray applications. This paper will introduce the printing methods and post-processing steps to convert AM ceramic samples into reflective mirrors. Surface roughness measurements after abrasive polishing of the AM ceramics will be presented., Comment: 15 pages, 15 figures, submitted to SPIE Astronomical Telescopes & Instrumentation, Advances in Optical and Mechanical Technologies for Telescopes and Instrumentation VI (Conference 13100, Paper 123)

Aims: The presence of coronary tandem lesions poses a significant challenge for the accurate diagnosis and management of coronary artery diseases. This study set out to provide a deeper understanding of the haemodynamic interactions between tandem obstructive coronary lesions and their impact on different haemodynamic diagnostic parameters. Methods and Results: Using a computational fluid dynamic model, validated against in vitro laboratory experiments, we investigated the various combinations of moderate and severe stenoses interchangeably located in the proximal and distal segments of the artery. The investigation was conducted using two diagnostic parameters: one hyperaemic-based, i.e., FFR, and one rest-based, i.e., iFR, technique, both of which are commonly used to assess the physiological significance of coronary stenoses. The three main findings of this work are: (a) the recovery distance (the immediate local distance affected by the presence of stenosis) is much shorter for the rest-measured diagnostic parameter compared with the hyperaemic-measured diagnostic parameter; (b) pressure drop measurements immediately downstream of the stenotic sections overestimate the significance of stenoses, and (c) the presence of a moderate stenosis downstream of a severe stenosis increases FFR value (faster FFR recovery). Conclusion: These findings enhance our understanding of the diagnostic accuracy of hyperaemic-based and rest-based physiological diagnostic coronary assessments and the nuances of using these different techniques when assessing tandem coronary stenoses. This understanding can help inform tailored therapeutic approaches for the management of coronary artery disease.

Eigenmaps are important in analysis, geometry, and machine learning, especially in nonlinear dimension reduction. Approximation of the eigenmaps of a Laplace operator depends crucially on the scaling parameter $\epsilon$. If $\epsilon$ is too small or too large, then the approximation is inaccurate or completely breaks down. However, an analytic expression for the optimal $\epsilon$ is out of reach. In our work, we use some explicitly solvable models and Monte Carlo simulations to find the approximately optimal range of $\epsilon$ that gives, on average, relatively accurate approximation of the eigenmaps. Numerically we can consider several model situations where eigen-coordinates can be computed analytically, including intervals with uniform and weighted measures, squares, tori, spheres, and the Sierpinski gasket. In broader terms, we intend to study eigen-coordinates on weighted Riemannian manifolds, possibly with boundary, and on some metric measure spaces, such as fractals.

We present ConvoCache, a conversational caching system that solves the problem of slow and expensive generative AI models in spoken chatbots. ConvoCache finds a semantically similar prompt in the past and reuses the response. In this paper we evaluate ConvoCache on the DailyDialog dataset. We find that ConvoCache can apply a UniEval coherence threshold of 90% and respond to 89% of prompts using the cache with an average latency of 214ms, replacing LLM and voice synthesis that can take over 1s. To further reduce latency we test prefetching and find limited usefulness. Prefetching with 80% of a request leads to a 63% hit rate, and a drop in overall coherence. ConvoCache can be used with any chatbot to reduce costs by reducing usage of generative AI by up to 89%., Comment: Accepted to appear at Interspeech 2024

We conducted extensive experiments on domain adaptation of the Meta-Llama-3-70B-Instruct model on SEC data, exploring its performance on both general and domain-specific benchmarks. Our focus included continual pre-training (CPT) and model merging, aiming to enhance the model's domain-specific capabilities while mitigating catastrophic forgetting. Through this study, we evaluated the impact of integrating financial regulatory data into a robust language model and examined the effectiveness of our model merging techniques in preserving and improving the model's instructive abilities. The model is accessible at hugging face: https://huggingface.co/arcee-ai/Llama-3-SEC-Base, arcee-ai/Llama-3-SEC-Base. This is an intermediate checkpoint of our final model, which has seen 20B tokens so far. The full model is still in the process of training. This is a preprint technical report with thorough evaluations to understand the entire process., Comment: 8 pages, 6 figures

A corporate bond trader in a typical sell side institution such as a bank provides liquidity to the market participants by buying/selling securities and maintaining an inventory. Upon receiving a request for a buy/sell price quote (RFQ), the trader provides a quote by adding a spread over a \textit{prevalent market price}. For illiquid bonds, the market price is harder to observe, and traders often resort to available benchmark bond prices (such as MarketAxess, Bloomberg, etc.). In \cite{Bergault2023ModelingLI}, the concept of \textit{Fair Transfer Price} for an illiquid corporate bond was introduced which is derived from an infinite horizon stochastic optimal control problem (for maximizing the trader's expected P\&L, regularized by the quadratic variation). In this paper, we consider the same optimization objective, however, we approach the estimation of an optimal bid-ask spread quoting strategy in a data driven manner and show that it can be learned using Reinforcement Learning. Furthermore, we perform extensive outcome analysis to examine the reasonableness of the trained agent's behavior., Comment: Working Paper

Efficiently post-training large language models remains a challenging task due to the vast computational resources required. We present Spectrum, a method that accelerates LLM training by selectively targeting layer modules based on their signal-to-noise ratio (SNR), and freezing the remaining modules. Our approach, which utilizes an algorithm to compute module SNRs prior to training, has shown to effectively match the performance of full fine-tuning while reducing GPU memory usage. Experiments comparing Spectrum to existing methods such as QLoRA demonstrate its effectiveness in terms of model quality and VRAM efficiency in distributed environments.

Given the central importance of positive parent and infant-early childhood mental health to children's long-term mental health and development, it is important to examine a wide range of approaches that show promise for strengthening supports for parent and infant-early childhood mental health in home visiting programs, especially programs serving diverse families. This report provides a view of promising strategies from the perspective of staff in home visiting programs that span multiple types and models and serve families from different cultural, racial/ ethnic, and linguistic backgrounds. Following a brief discussion of the project's methods for identifying and learning from a sample of home visiting programs, the report examines key strategies for promoting parent and child mental health as described by home visiting staff and expert respondents. The report concludes with recommendations for policy, program implementation supports, and research that could help advance the field's understanding and use of the most effective strategies. [Funding for this report was provided by the Perigee Foundation.]

In 2019, more than 5 million providers cared for one or more children either in their own home or in a child's home. Home-based child care (HBCC) providers are a varied group that includes listed providers and unlisted providers who do and do not receive payment. HBCC is especially prevalent in communities of color, communities with high concentrations of people from immigrant backgrounds, areas of concentrated poverty, and rural communities. Yet, research on HBCC lags behind research on center-based child care and early education (CCEE), and the least is known about unlisted providers who do not appear on state or national provider lists and work outside the formal systems supporting CCEE programs. This brief focuses on describing the characteristics of the communities in which unlisted HBCC providers live and, for many, where they typically care for children. It uses the 2019 National Survey of Early Care and Education (NSECE), the American Community Survey (ACS), and the Child Opportunity Index (COI) 2.0.

It is generally accepted that the Moon accreted from the disk formed by an impact between the proto-Earth and impactor, but its details are highly debated. Some models suggest that a Mars-sized impactor formed a silicate melt-rich (vapor-poor) disk around Earth, whereas other models suggest that a highly energetic impact produced a silicate vapor-rich disk. Such a vapor-rich disk, however, may not be suitable for the Moon formation, because moonlets, building blocks of the Moon, of 100 m-100 km may experience strong gas drag and fall onto Earth on a short timescale, failing to grow further. This problem may be avoided if large moonlets ($\gg 100$ km) form very quickly by streaming instability, which is a process to concentrate particles enough to cause gravitational collapse and rapid formation of planetesimals or moonlets. Here, we investigate the effect of the streaming instability in the Moon-forming disk for the first time and find that this instability can quickly form $\sim 100$ km-sized moonlets. However, these moonlets are not large enough to avoid strong drag and they still fall onto Earth quickly. This suggests that the vapor-rich disks may not form the large Moon, and therefore the models that produce vapor-poor disks are supported. This result is applicable to general impact-induced moon-forming disks, supporting the previous suggestion that small planets ($<1.6 R_\oplus$) are good candidates to host large moons because their impact-induced disks would be likely vapor-poor. We find a limited role of streaming instability in a satellite formation in an impact-induced disk, whereas it plays a key role during planet formation., Comment: Accepted for Publication in PSJ

Spatial variations in the cosmic electron density after reionization generate cosmic microwave background anisotropies via Thomson scattering, a process known as the ``patchy screening" effect. In this paper, we propose a new estimator for the patchy screening effect that is designed to mitigate biases from the dominant foreground signals. We use it to measure the cross-correlation between \textit{unWISE} galaxies and patchy screening, the latter measured by the Atacama Cosmology Telescope and \textit{Planck} satellite. We report the first detection of the patchy screening effect, with the statistical significance of the cross-correlation exceeding $7\sigma$. This measurement directly probes the distribution of electrons around these galaxies and provides strong evidence that gas is more extended than the underlying dark matter. By comparing our measurements to electron profiles extracted from simulations, we demonstrate the power of these observations to constrain galaxy evolution models. Requiring only the 2D positions of objects and no individual redshifts or velocity estimates, this approach is complementary to existing gas probes, such as those based on the kinetic Sunyaev-Zeldovich effect., Comment: See Schutt et al for a detailed comparison of patchy screening estimators. 17 pages with 8 figures

We determine hidden conformal symmetries behind the evolution equations of black hole perturbations in a vector-tensor theory of gravity. Such hidden symmetries are valid everywhere in the exterior region of a spherically symmetric, asymptotically flat black hole geometry. They allow us to factorize second order operators controlling the black hole perturbations into a product of two commuting first order operators. As a consequence, we are able to analytically determine the most general time-dependent solutions for the black hole perturbation equations. We focus on solutions belonging to a highest weight representation of a conformal symmetry, showing that they correspond to quasi-bound states with an ingoing behaviour into the black hole horizon, and exponential decay at spatial infinity. Their time-dependence is characterized by purely imaginary frequencies, with imaginary parts separated by integer numbers, as the overtones of quasi-normal modes in General Relativity., Comment: 22 pages, no figures