Search

One of the main obstacles for the signal extraction of the three point correlation function using photometric surveys, such as the Rubin Observatory Legacy Survey of Space and Time (LSST), will be the prohibitive computation time required for dealing with a vast quantity of sources. Brute force algorithms, which naively scales as $\mathcal{O}(N^3)$ with the number of objects, can be further improved with tree methods but not enough to deal with large scale correlations of Rubin's data. However, a harmonic basis decomposition of these higher order statistics reduces the time dramatically, to scale as a two-point correlation function with the number of objects, so that the signal can be extracted in a reasonable amount of time. In this work, we aim to develop the framework to use these expansions within the Limber approximation for scalar (or spin-0) fields, such as galaxy counts, weak lensing convergence or aperture masses. We develop an estimator to extract the signal from catalogs and different phenomenological and theoretical models for its description. The latter includes halo model and standard perturbation theory, to which we add a simple effective field theory prescription based on the short range of non-locality of cosmic fields, significantly improving the agreement with simulated data. In parallel to the modeling of the signal, we develop a code that can efficiently calculate three points correlations of more than 200 million data points (a full sky simulation with Nside=4096) in $\sim$40 minutes on a single high-performance computing node, enabling a feasible analysis for the upcoming LSST data., Comment: 31 pages, 10 figures

Finding the optimal learning rate for language model pretraining is a challenging task. This is not only because there is a complicated correlation between learning rate, batch size, number of training tokens, model size, and other hyperparameters but also because it is prohibitively expensive to perform a hyperparameter search for large language models with Billions or Trillions of parameters. Recent studies propose using small proxy models and small corpus to perform hyperparameter searches and transposing the optimal parameters to large models and large corpus. While the zero-shot transferability is theoretically and empirically proven for model size related hyperparameters, like depth and width, the zero-shot transfer from small corpus to large corpus is underexplored. In this paper, we study the correlation between optimal learning rate, batch size, and number of training tokens for the recently proposed WSD scheduler. After thousands of small experiments, we found a power-law relationship between variables and demonstrated its transferability across model sizes. Based on the observation, we propose a new learning rate scheduler, Power scheduler, that is agnostic about the number of training tokens and batch size. The experiment shows that combining the Power scheduler with Maximum Update Parameterization (muP) can consistently achieve impressive performance with one set of hyperparameters regardless of the number of training tokens, batch size, model size, and even model architecture. Our 3B dense and MoE models trained with the Power scheduler achieve comparable performance as state-of-the-art small language models. We open-source these pretrained models at https://ibm.biz/BdKhLa.

SN 2023ixf was discovered in M101 within a day of explosion and rapidly classified as a Type II supernova with flash features. Here we present ultraviolet (UV) spectra obtained with the Hubble Space Telescope 14, 19, 24, and 66 days after explosion. Interaction between the supernova ejecta and circumstellar material (CSM) is seen in the UV throughout our observations in the flux of the first three epochs and asymmetric MgII emission at day 66. We compare our observations to CMFGEN supernova models which include CSM interaction ($\dot{M}<10^{-3}$ $M_{\odot}$/yr) and find that the power from CSM interaction is decreasing with time, from $L_{\rm sh}\approx5\times10^{42}$ erg/s at day 14 to $L_{sh}\approx1\times10^{40}$ erg/s at day 66. We examine the contribution of individual atomic species to the spectra at day 14 and 19, showing that the majority of the features are dominated by iron, nickel, magnesium, and chromium absorption in the ejecta. The UV spectral energy distribution of SN 2023ixf sits between that of supernovae which show no definitive signs of CSM interaction and those with persistent signatures assuming the same progenitor radius and metallicity. Finally, we show that the evolution and asymmetric shape of the MgII emission are not unique to SN 2023ixf. These observations add to the early measurements of dense, confined CSM interaction, tracing the mass-loss history of SN 2023ixf to $\sim33$ yr prior to explosion and the density profile to a radius of $\sim5.7\times10^{15}$ cm. They show the relatively short evolution from quiescent red supergiant wind to high mass loss., Comment: Submitted to ApJ, comments welcome

This paper introduces long-context Granite code models that support effective context windows of up to 128K tokens. Our solution for scaling context length of Granite 3B/8B code models from 2K/4K to 128K consists of a light-weight continual pretraining by gradually increasing its RoPE base frequency with repository-level file packing and length-upsampled long-context data. Additionally, we also release instruction-tuned models with long-context support which are derived by further finetuning the long context base models on a mix of permissively licensed short and long-context instruction-response pairs. While comparing to the original short-context Granite code models, our long-context models achieve significant improvements on long-context tasks without any noticeable performance degradation on regular code completion benchmarks (e.g., HumanEval). We release all our long-context Granite code models under an Apache 2.0 license for both research and commercial use.

High entropy alloys (HEAs) represent a novel frontier in metallurgical advancements, offering exceptional mechanical properties owing to their unique multicomponent nature. This study explores a novel strategy utilising commodity powders - Ni625, Invar36, and CoCrF75 - to tailor HEAs via metal injection moulding (MIM). The objective is to achieve cost-effective manufacturing while maintaining desired properties. The research involves mixing these powders in a specific proportion, integrating them with a sustainable polyethylene glycol-cellulose acetate butyrate binder system, and characterising the resulting feedstocks for MIM processing. Subsequent debinding and sintering steps were executed to densify and form a single face-centered cubic (FCC) phase HEA, followed by comprehensive analyses to evaluate the suitability of the developed HEA compositions. In addition, all MIM stages were thoroughly characterised to control the porosity of the final parts and to ensure a single FCC solid solution with promising mechanical properties in the developed non-equiatomic CoCrFeNiMox-type HEAs.

Large language models (LLMs) have recently shown tremendous promise in serving as the backbone to agentic systems, as demonstrated by their performance in multi-faceted, challenging benchmarks like SWE-Bench and Agent-Bench. However, to realize the true potential of LLMs as autonomous agents, they must learn to identify, call, and interact with external tools and application program interfaces (APIs) to complete complex tasks. These tasks together are termed function calling. Endowing LLMs with function calling abilities leads to a myriad of advantages, such as access to current and domain-specific information in databases and knowledge sources, and the ability to outsource tasks that can be reliably performed by tools, e.g., a Python interpreter or calculator. While there has been significant progress in function calling with LLMs, there is still a dearth of open models that perform on par with proprietary LLMs like GPT, Claude, and Gemini. Therefore, in this work, we introduce the GRANITE-20B-FUNCTIONCALLING model under an Apache 2.0 license. The model is trained using a multi-task training approach on seven fundamental tasks encompassed in function calling, those being Nested Function Calling, Function Chaining, Parallel Functions, Function Name Detection, Parameter-Value Pair Detection, Next-Best Function, and Response Generation. We present a comprehensive evaluation on multiple out-of-domain datasets comparing GRANITE-20B-FUNCTIONCALLING to more than 15 other best proprietary and open models. GRANITE-20B-FUNCTIONCALLING provides the best performance among all open models on the Berkeley Function Calling Leaderboard and fourth overall. As a result of the diverse tasks and datasets used for training our model, we show that GRANITE-20B-FUNCTIONCALLING has better generalizability on multiple tasks in seven different evaluation datasets.

Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to developing and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for developing robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of developing autonomous scientific experimentation methods for accelerated scientific discovery., Comment: IEEE VLSI Test Symposium 2024 (VTS)

We present high-cadence photometric and spectroscopic observations of supernova (SN) 2024ggi, a Type II SN with flash spectroscopy features which exploded in the nearby galaxy NGC 3621 at $\sim$7 Mpc. The light-curve evolution over the first 30 hours can be fit by two power law indices with a break after 22 hours, rising from $M_V \approx -12.95$ mag at +0.66 days to $M_V \approx -17.91$ mag after 7 days. In addition, the densely sampled color curve shows a strong blueward evolution over the first few days and then behaves as a normal SN II with a redward evolution as the ejecta cool. Such deviations could be due to interaction with circumstellar material (CSM). Early high- and low-resolution spectra clearly show high-ionization flash features from the first spectrum to +3.42 days after the explosion. From the high-resolution spectra, we calculate the CSM velocity to be 37 $\pm~4~\mathrm{km\,s^{-1}} $. We also see the line strength evolve rapidly from 1.22 to 1.49 days in the earliest high-resolution spectra. Comparison of the low-resolution spectra with CMFGEN models suggests that the pre-explosion mass-loss rate of SN 2024ggi falls in a range of $10^{-3}$ to $10^{-2}$ M$_{\odot}$ yr$^{-1}$, which is similar to that derived for SN 2023ixf. However, the rapid temporal evolution of the narrow lines in the spectra of SN 2024ggi ($R_\mathrm{CSM} \sim 2.7 \times 10^{14} \mathrm{cm}$) could indicate a smaller spatial extent of the CSM than in SN 2023ixf ($R_\mathrm{CSM} \sim 5.4 \times 10^{14} \mathrm{cm}$) which in turn implies lower total CSM mass for SN 2024ggi., Comment: 23 pages, 15 figures, 4 tables, accepted for publication in ApJL

In this work, we compute the universe temperature for the cosmological horizon for the FLRW metric. For this purpose, we consider a scalar field on the cosmological horizon. This scalar field satisfies the Klein-Gordon equation in a curved space-time. Recently, some authors like Barrow, Bekenstein and others have proposed that the fundamental constants might vary with time. Along these lines of thought, we derive the electromagnetic momentum and electromagnetic field for the FLRW universe. This enables us to obtain a temporal dependence of the Hubble parameter which, in turn, induces a time dependence of the fundamental constants. In order to validate this model, the theoretical predictions are then compared with observational data as a function of the redshift, $z$, for the universe expansion. As a consequence, this time dependence on the fundamental constants makes it possible to predict a change in time of the informational content for the entropy of the universe surface area, this is expressed as the bit number by using the holographic principle., Comment: 27 pages, 2 figures. arXiv admin note: text overlap with arXiv:1007.4044 by other authors

We present photometric and spectroscopic observations of SN 2023fyq, a type Ibn supernova in the nearby galaxy NGC 4388 (D$\simeq$18~Mpc). In addition, we trace long-standing precursor emission at the position of SN 2023fyq using data from DLT40, ATLAS, ZTF, ASAS-SN, Swift, and amateur astronomer Koichi Itagaki. Precursor activity is observed up to nearly three years before the supernova explosion, with a relatively rapid rise in the final 100 days. The double-peaked post-explosion light curve reaches a luminosity of $\sim10^{43}~\rm erg\,s^{-1}$. The strong intermediate-width He lines observed in the nebular spectrum of SN 2023fyq imply the interaction is still active at late phases. We found that the precursor activity in SN 2023fyq is best explained by the mass transfer in a binary system involving a low-mass He star and a compact companion. An equatorial disk is likely formed in this process ($\sim$0.6$\rm M_{\odot}$), and the interaction of SN ejecta with this disk powers the main peak of the supernova. The early SN light curve reveals the presence of dense extended material ($\sim$0.3$\rm M_{\odot}$) at $\sim$3000$\rm R_{\odot}$ ejected weeks before the SN explosion, likely due to final-stage core silicon burning or runaway mass transfer resulting from binary orbital shrinking, leading to rapid rising precursor emission within $\sim$30 days prior to explosion. The final explosion could be triggered either by the core-collapse of the He star or by the merger of the He star with a compact object. SN 2023fyq, along with SN 2018gjx and SN 2015G, forms a unique class of Type Ibn SNe which originate in binary systems and are likely to exhibit detectable long-lasting pre-explosion outbursts with magnitudes ranging from $-$10 to $-$13., Comment: submitted to ApJ

Large Language Models (LLMs) trained on code are revolutionizing the software development process. Increasingly, code LLMs are being integrated into software development environments to improve the productivity of human programmers, and LLM-based agents are beginning to show promise for handling complex tasks autonomously. Realizing the full potential of code LLMs requires a wide range of capabilities, including code generation, fixing bugs, explaining and documenting code, maintaining repositories, and more. In this work, we introduce the Granite series of decoder-only code models for code generative tasks, trained with code written in 116 programming languages. The Granite Code models family consists of models ranging in size from 3 to 34 billion parameters, suitable for applications ranging from complex application modernization tasks to on-device memory-constrained use cases. Evaluation on a comprehensive set of tasks demonstrates that Granite Code models consistently reaches state-of-the-art performance among available open-source code LLMs. The Granite Code model family was optimized for enterprise software development workflows and performs well across a range of coding tasks (e.g. code generation, fixing and explanation), making it a versatile all around code model. We release all our Granite Code models under an Apache 2.0 license for both research and commercial use., Comment: Corresponding Authors: Rameswar Panda, Ruchir Puri; Equal Contributors: Mayank Mishra, Matt Stallone, Gaoyuan Zhang

The ionosphere affects radio signals by altering their speed, direction, and trajectory, causing a temporary delay known as ionospheric delay, which is directly related to the total electron content (TEC). Although research in other equatorial locations has explored TEC implications, qualitative research is required to predict its behavior in the ionosphere. This study aims to depict TEC intensity evolution through color maps using data from 14 GPS receivers placed across Ecuador. For this purpose, pseudorange observables collected from the stations were used to present a calculation method for the TEC and its evolution during January 2022. The results revealed an oscillatory behavior in the evolution of the TEC, with intensity peaks that, on some occasions, approach and even exceed 100 T ECU (TEC units), while its local minimums never reach zero values.

This paper explores the integration of causal pathway diagrams (CPD) into human-centered design (HCD), investigating how these diagrams can enhance the early stages of the design process. A dedicated CPD plugin for the online collaborative whiteboard platform Miro was developed to streamline diagram creation and offer real-time AI-driven guidance. Through a user study with designers (N=20), we found that CPD's branching and its emphasis on causal connections supported both divergent and convergent processes during design. CPD can also facilitate communication among stakeholders. Additionally, we found our plugin significantly reduces designers' cognitive workload and increases their creativity during brainstorming, highlighting the implications of AI-assisted tools in supporting creative work and evidence-based designs.

Nuclear facilities must routinely survey their infrastructure for radiation contamination. Generally, this is done by trained professionals, wearing personal protective equipment (PPE) that swipe potentially contaminated surfaces and test the wipes under detectors. This approach leaves personnel vulnerable to radiation exposure and is not comprehensive. Robots address these inadequacies, offering a cost-effective solution with negligible downtime. We present a Robot Radiation Survey System (RRSS): a heterogeneous robot team to perform comprehensive alpha/beta/gamma radiation surveys. The RRSS system members, core capabilities, and comprehensive survey plan are addresses in this paper., Comment: 6 pages, 16 figures

We introduce API Pack, a massive multi-programming language dataset containing more than 1 million instruction-API call pairs to improve the API call generation capabilities of large language models. By fine-tuning CodeLlama-13B on 20,000 Python instances from API Pack, we enable it to outperform GPT-3.5 and GPT-4 in generating unseen API calls. Fine-tuning on API Pack also facilitates cross-programming language generalization by leveraging a large amount of data in one language and small amounts of data from other languages. Scaling the training data to 1 million instances further improves the model's ability to generalize to new APIs not used in training. To facilitate further research, we open-source the API Pack dataset, trained model, and associated source code at https://github.com/zguo0525/API-Pack.

We present comprehensive optical observations of SN~2021gmj, a Type II supernova (SN~II) discovered within a day of explosion by the Distance Less Than 40~Mpc (DLT40) survey. Follow-up observations show that SN~2021gmj is a low-luminosity SN~II (LL~SN~II), with a peak magnitude $M_V = -15.45$ and Fe~II velocity of $\sim 1800 \ \mathrm{km} \ \mathrm{s}^{-1}$ at 50 days past explosion. Using the expanding photosphere method, we derive a distance of $17.8^{+0.6}_{-0.4}$~Mpc. From the tail of the light curve we obtain a radioactive nickel mass of $0.014 \pm 0.001$ M$_{\odot}$. The presence of circumstellar material (CSM) is suggested by the early-time light curve, early spectra, and high-velocity H$\alpha$ in absorption. Analytical shock-cooling models of the light curve cannot reproduce the fast rise, supporting the idea that the early-time emission is partially powered by the interaction of the SN ejecta and CSM. The inferred low CSM mass of 0.025 M$_{\odot}$ in our hydrodynamic-modeling light curve analysis is also consistent with our spectroscopy. We observe a broad feature near 4600 \AA, which may be high-ionization lines of C, N, or/and He~II. This feature is reproduced by radiation-hydrodynamic simulations of red supergiants with extended atmospheres. Several LL~SNe~II show similar spectral features, implying that high-density material around the progenitor may be common among them., Comment: Accepted version at ApJ

Community college bachelor's (CCB) programs have only existed for a few decades, yet now reach 25 states. Since 1989, both state policies allowing these programs and the number of CCB programs itself has grown steadily. A body of research on CCBs is growing in the wake of changing state policy and the growth of new programs. This literature review synthesizes research that addresses student access and outcomes in community college bachelor's programs. Key themes include graduates' racial and ethnic diversity, strong employment rates and wages for CCB graduates, and continued discussion regarding the place and purpose of CCBs in improving students' access to bachelor's degree programs and in facilitating bachelor's degree attainment.

While charter schools offer families additional choices for their children's educational experiences, they are not exempt from the racial and economic disparities deeply embedded in the American education system. Community leaders and educators often point to policies regarding curriculum, access, and instruction as areas of opportunity to rectify persistent inequities, but far less attention has been paid to the role of charter school authorizers, those entities who determine not only who can open a new charter school but also provide expectations and oversight for schools' academic and administrative operations. This study is one of the first to analyze the role of authorizers in advancing equity-focused charter schools. In this study, the authors assess authorizers' goals around equity and accessibility and how they signal these goals to organizations interested in opening charter schools. The findings highlight an overlooked point of leverage for policymakers and provide insight into how authorizers may play a significant but underestimated role in the mission, values, and planning of operating charter schools. [For the technical report, see ED625862.]

Charter school authorizers shape which charter schools open, where they open, and who they serve. We draw on principal agent theory to investigate how the priorities and practices of nine authorizers intersected with charter school applications' attention to the needs of historically marginalized students. Using data from interviews and applications, we find authorizers vary in orientations towards equity and the ways in which they signal that orientation to charter applicants. Our analysis suggests a robust relationship between authorizer mission and the content found in charter applications, demonstrating the influence of authorizing practices on the contents of charter school applications. [For the policy brief, see ED625865.]

Modified gravity models with scale-dependent linear growth typically exhibit an enhancement in the power spectrum beyond a certain scale. The conventional methods for extracting cosmological information usually involve inferring modified gravity effects via Redshift Space Distortions (RSD), particularly through the time evolution of $f\sigma_8$. However, classical galaxy RSD clustering analyses encounter difficulties in accurately capturing the spectrum's enhanced power, which is better obtained from the broad-band power spectrum. In this sense, full-shape analyses aim to consider survey data using comprehensive and precise models of the whole power spectrum. Yet, a major challenge in this approach is the slow computation of non-linear loop integrals for scale-dependent modified gravity, precluding the estimation of cosmological parameters using Markov Chain Monte Carlo methods. Based on recent studies, in this work we develop a perturbation theory tailored for Modified Gravity, or analogous scenarios introducing additional scales, such as in the presence of massive neutrinos. Our approach only needs the calculation of the scale-dependent growth rate $f(k,t)$ and the limit of the perturbative kernels at large scales. We called this approximate technique as fk-Perturbation Theory and implemented it into the code fkpt, capable of computing the redshift space galaxy power spectrum in a fraction of a second. We validate our modeling and code with the $f(R)$ theory MG-GLAM and General Relativity NSeries sets of simulations. The code is available at https://github.com/alejandroaviles/fkpt, Comment: 34 pages, 9 figures. v2

The amount of electronic waste (e-waste) recycled worldwide is less than 20% of the total amount produced. In a world where the need for critical and strategic metals is increasing almost exponentially, it is unacceptable that tons of these elements remain unrecycled. One of the causes of this low level of recycling is that recycling is based on an expensive and complex selective sorting of metals. Extracting all metals simultaneously is much simpler and if this were done, it would significantly increase the recycling rate. Meanwhile, it was demonstrated that high entropy alloys (HEAs), which are in great demand in applications where very high performance is required, can be made from mixtures of complex alloys, hence reducing their dependence on pure critical metals. Here, we show that it is possible to obtain competitive HEAs from complex alloy mixtures corresponding to typical electronic waste compositions, combining two needs of high interest in our society, namely: to increase the level of recycling of electronic waste and the possibility of developing high-performance HEAs without the need of using critical and/or strategic metals. To validate our hypothesis that e-waste can be used to produce competitive HEAs, we propose an alloy design strategy combining computational thermodynamics (CalPhaD) exploration of phase diagrams and phenomenological criteria for HEA design based on thermodynamic and structural parameters. A shortlist of selected compositions are then fabricated by arc melting ensuring compositional homogeneity of such complex alloys and, finally, characterised microstructurally, using electron microscopy and diffraction analysis, and mechanically, using hardness testing.

Understanding the behavior of non-human primates is crucial for improving animal welfare, modeling social behavior, and gaining insights into distinctively human and phylogenetically shared behaviors. However, the lack of datasets on non-human primate behavior hinders in-depth exploration of primate social interactions, posing challenges to research on our closest living relatives. To address these limitations, we present ChimpACT, a comprehensive dataset for quantifying the longitudinal behavior and social relations of chimpanzees within a social group. Spanning from 2015 to 2018, ChimpACT features videos of a group of over 20 chimpanzees residing at the Leipzig Zoo, Germany, with a particular focus on documenting the developmental trajectory of one young male, Azibo. ChimpACT is both comprehensive and challenging, consisting of 163 videos with a cumulative 160,500 frames, each richly annotated with detection, identification, pose estimation, and fine-grained spatiotemporal behavior labels. We benchmark representative methods of three tracks on ChimpACT: (i) tracking and identification, (ii) pose estimation, and (iii) spatiotemporal action detection of the chimpanzees. Our experiments reveal that ChimpACT offers ample opportunities for both devising new methods and adapting existing ones to solve fundamental computer vision tasks applied to chimpanzee groups, such as detection, pose estimation, and behavior analysis, ultimately deepening our comprehension of communication and sociality in non-human primates., Comment: NeurIPS 2023