Search

This paper presents a detailed study of the physical properties of seven C IV absorbers identified at z_abs = 0.68-1.28 along the line of sight toward QSO PG 1522+101 (z_QSO = 1.330). The study leverages high-quality QSO spectra from HST COS and STIS, and Keck HIRES to resolve component structures and to constrain the gas density and elemental abundances of individual components. Under the assumption of photoionization equilibrium (PIE), five of the 12 C IV components require a mixture of high- and low-density phases to fully explain the observed relative abundances between low-, intermediate-, and high-ionization species. In addition, galaxy surveys carried out using VLT MUSE and Magellan LDSS3c are utilized to characterize the galaxy environments. The results of this analysis are summarized as follows: (1) no luminous galaxies (> 0.1 L*) are found within 100 kpc in projected distance from the C IV absorbers; (2) the C IV selection preferentially targets high-metallicity (near solar) and chemically-evolved gas (~ solar [C/O] elemental abundances) in galaxy halos; (3) the observed narrow line widths of individual C IV components, places a stringent limit on the gas temperature (< 5e4 K) and supports a photoionization origin; (4) additional local ionizing sources beyond the UV ionizing background may be necessary for at least one absorber based on the observed deficit of He I relative to H I; and (5) a PIE assumption may not apply when the gas metallicity exceeds the solar value and the component line width implies a warmer temperature than expected from PIE models., Comment: 30 pages, 16 figures, submitted to The Open Journal of Astrophysics

Instruction-based speech processing is becoming popular. Studies show that training with multiple tasks boosts performance, but collecting diverse, large-scale tasks and datasets is expensive. Thus, it is highly desirable to design a fundamental task that benefits other downstream tasks. This paper introduces a multi-talker speaking style captioning task to enhance the understanding of speaker and prosodic information. We used large language models to generate descriptions for multi-talker speech. Then, we trained our model with pre-training on this captioning task followed by instruction tuning. Evaluation on Dynamic-SUPERB shows our model outperforming the baseline pre-trained only on single-talker tasks, particularly in speaker and emotion recognition. Additionally, tests on a multi-talker QA task reveal that current models struggle with attributes such as gender, pitch, and speaking rate. The code and dataset are available at https://github.com/cyhuang-tw/speechcaps., Comment: SynData4GenAI 2024

The shallow potential wells of star-forming dwarf galaxies make their surrounding circumgalactic and intergalactic medium (CGM/IGM) sensitive laboratories for studying the inflows and outflows thought to regulate galaxy evolution. We present new absorption-line measurements in quasar sightlines probing within projected distances of $<300$ kpc from 91 star-forming field dwarf galaxies with a median stellar mass of $\log{M_\star/\rm{M_\odot}} \approx 8.3$ at $0.077 < z < 0.73$ from the Cosmic Ultraviolet Baryon Survey (CUBS). In this redshift range, the CUBS quasar spectra cover a suite of transitions including H I, low and intermediate metal ions (e.g., C II, Si II, C III, and Si III), and highly ionized O VI. This CUBS-Dwarfs survey enables constraints with samples 9$\times$ larger than past dwarf CGM/IGM studies with similar ionic coverage. We find that low and intermediate ionization metal absorption is rare around dwarf galaxies, consistent with previous surveys of local dwarfs. In contrast, highly ionized O VI is commonly observed in sightlines that pass within the virial radius of a dwarf, and O VI detection rates are non-negligible at projected distances of 1$-$2$\times$ the virial radius. Based on these measurements, we estimate that the O VI-bearing phase of the CGM/IGM accounts for a dominant share of the metal budget of dwarf galaxies. The absorption kinematics suggest that a relatively modest fraction of the O VI-bearing gas is formally unbound. Together, these results imply that low-mass systems at $z\lesssim 1$ effectively retain a substantial fraction of their metals within the nearby CGM and IGM., Comment: Submitted to ApJ. 18 pages, 6 figures, 2 tables

We introduce Imagen 3, a latent diffusion model that generates high quality images from text prompts. We describe our quality and responsibility evaluations. Imagen 3 is preferred over other state-of-the-art (SOTA) models at the time of evaluation. In addition, we discuss issues around safety and representation, as well as methods we used to minimize the potential harm of our models.

We propose a novel in-context learning algorithm for building autonomous decision-making language agents. The language agent continuously attempts to solve the same task by self-correcting each time the task fails. Our selected language agent demonstrates the ability to solve tasks in a text-based game environment. Our results show that the gemma-2-9b-it language model, using our proposed method, can successfully complete two of six tasks that failed in the first attempt. This highlights the effectiveness of our approach in enhancing the problem-solving capabilities of a single language model through self-correction, paving the way for more advanced autonomous agents. The code is publicly available at https://github.com/YenCheHsiao/AutonomousLLMAgentwithAdaptingPlanning.

We present PyNeuralFx, an open-source Python toolkit designed for research on neural audio effect modeling. The toolkit provides an intuitive framework and offers a comprehensive suite of features, including standardized implementation of well-established model architectures, loss functions, and easy-to-use visualization tools. As such, it helps promote reproducibility for research on neural audio effect modeling, and enable in-depth performance comparison of different models, offering insight into the behavior and operational characteristics of models through DSP methodology. The toolkit can be found at https://github.com/ytsrt66589/pyneuralfx., Comment: toolkit paper

Recurrent neural networks (RNNs) have demonstrated impressive results for virtual analog modeling of audio effects. These networks process time-domain audio signals using a series of matrix multiplication and nonlinear activation functions to emulate the behavior of the target device accurately. To additionally model the effect of the knobs for an RNN-based model, existing approaches integrate control parameters by concatenating them channel-wisely with some intermediate representation of the input signal. While this method is parameter-efficient, there is room to further improve the quality of generated audio because the concatenation-based conditioning method has limited capacity in modulating signals. In this paper, we propose three novel conditioning mechanisms for RNNs, tailored for black-box virtual analog modeling. These advanced conditioning mechanisms modulate the model based on control parameters, yielding superior results to existing RNN- and CNN-based architectures across various evaluation metrics., Comment: Accepted to DAFx24

This paper provides a comprehensive and detailed derivation of the backpropagation algorithm for graph convolutional neural networks using matrix calculus. The derivation is extended to include arbitrary element-wise activation functions and an arbitrary number of layers. The study addresses two fundamental problems, namely node classification and link prediction. To validate our method, we compare it with reverse-mode automatic differentiation. The experimental results demonstrate that the median sum of squared errors of the updated weight matrices, when comparing our method to the approach using reverse-mode automatic differentiation, falls within the range of $10^{-18}$ to $10^{-14}$. These outcomes are obtained from conducting experiments on a five-layer graph convolutional network, applied to a node classification problem on Zachary's karate club social network and a link prediction problem on a drug-drug interaction network. Finally, we show how the derived closed-form solution can facilitate the development of explainable AI and sensitivity analysis.

This paper presents a novel coordinate descent algorithm leveraging a combination of one-directional line search and gradient information for parameter updates for a squared error loss function. Each parameter undergoes updates determined by either the line search or gradient method, contingent upon whether the modulus of the gradient of the loss with respect to that parameter surpasses a predefined threshold. Notably, a larger threshold value enhances algorithmic efficiency. Despite the potentially slower nature of the line search method relative to gradient descent, its parallelizability facilitates computational time reduction. Experimental validation conducted on a 2-layer Rectified Linear Unit network with synthetic data elucidates the impact of hyperparameters on convergence rates and computational efficiency.

We investigate the spectroscopic characteristics of Intermediate Luminosity Red Transients (ILRTs), a class of elusive objects with peak luminosity between that of classical novae and standard supernovae. We present the extensive optical and near-infrared (NIR) spectroscopic monitoring of four ILRTs, namely NGC 300 2008OT-1, AT 2019abn, AT 2019ahd and AT 2019udc. First we focus on the evolution of the most prominent spectral features observed in the low resolution spectra, then we discuss more in detail the high resolution spectrum collected for NGC 300 2008OT-1 with the Very Large Telescope equipped with UVES. Finally we analyse late time spectra of NGC 300 2008OT-1 and AT 2019ahd through comparisons with both synthetic and observed spectra. Balmer and Ca lines dominate the optical spectra, revealing the presence of slowly moving circumstellar medium (CSM) around the objects. The line luminosity of H$\alpha$, H$\beta$ and Ca II NIR triplet presents a double peaked evolution with time, possibly indicative of interaction between fast ejecta and the slow CSM. The high resolution spectrum of NGC 300 2008OT-1 reveals a complex circumstellar environment, with the transient being surrounded by a slow ($\sim$30 km s$^{-1}$) progenitor wind. At late epochs, optical spectra of NGC 300 2008OT-1 and AT 2019ahd show broad ($\sim$2500 km s$^{-1}$) emission features at $\sim$6170 A and $\sim$7000 A which are unprecedented for ILRTs. We find that these lines originate most likely from the blending of several narrow lines, possibly of iron-peak elements., Comment: 28 pages, 19 figures. Submitted to A&A

We investigate the photometric characteristics of a sample of Intermediate Luminosity Red Transients (ILRTs), a class of elusive objects with peak luminosity between that of classical novae and standard supernovae. We present the multi-wavelength photometric follow-up of four ILRTs, namely NGC 300 2008OT-1, AT 2019abn, AT 2019ahd and AT 2019udc. Through the analysis and modelling of their spectral energy distribution and bolometric light curves we infer the physical parameters associated with these transients. All four objects display a single peaked light curve which ends in a linear decline in magnitudes at late phases. A flux excess with respect to a single black body emission is detected in the infrared domain for three objects in our sample, a few months after maximum. This feature, commonly found in ILRTs, is interpreted as a sign of dust formation. Mid infrared monitoring of NGC 300 2008OT-1 761 days after maximum allows us to infer the presence of $\sim$10$^{-3}$-10$^{-5}$ M$_{\odot}$ of dust, depending on the chemical composition and the grain size adopted. The late time decline of the bolometric light curves of the considered ILRTs is shallower than expected for $^{56}$Ni decay, hence requiring an additional powering mechanism. James Webb Space Telescope observations of AT 2019abn prove that the object has faded below its progenitor luminosity in the mid-infrared domain, five years after its peak. Together with the disappearance of NGC 300 2008OT-1 in Spitzer images seven years after its discovery, this supports the terminal explosion scenario for ILRTs. With a simple semi-analytical model we try to reproduce the observed bolometric light curves in the context of few M$_{\odot}$ of material ejected at few 10$^{3}$ km s$^{-1}$ and enshrouded in an optically thick circumstellar medium., Comment: 21 pages, 15 figures plus 20 additional pages of data in appendix. Submitted to A&A

This paper presents the first-ever study of adapting compressed image latents to suit the needs of downstream vision tasks that adopt Multimodal Large Language Models (MLLMs). MLLMs have extended the success of large language models to modalities (e.g. images) beyond text, but their billion scale hinders deployment on resource-constrained end devices. While cloud-hosted MLLMs could be available, transmitting raw, uncompressed images captured by end devices to the cloud requires an efficient image compression system. To address this, we focus on emerging neural image compression and propose a novel framework with a lightweight transform-neck and a surrogate loss to adapt compressed image latents for MLLM-based vision tasks. The proposed framework is generic and applicable to multiple application scenarios, where the neural image codec can be (1) pre-trained for human perception without updating, (2) fully updated for joint human and machine perception, or (3) fully updated for only machine perception. The transform-neck trained with the surrogate loss is universal, for it can serve various downstream vision tasks enabled by a variety of MLLMs that share the same visual encoder. Our framework has the striking feature of excluding the downstream MLLMs from training the transform-neck, and potentially the neural image codec as well. This stands out from most existing coding for machine approaches that involve downstream networks in training and thus could be impractical when the networks are MLLMs. Extensive experiments on different neural image codecs and various MLLM-based vision tasks show that our method achieves great rate-accuracy performance with much less complexity, demonstrating its effectiveness.

Existing text-to-music models can produce high-quality audio with great diversity. However, textual prompts alone cannot precisely control temporal musical features such as chords and rhythm of the generated music. To address this challenge, we introduce MusiConGen, a temporally-conditioned Transformer-based text-to-music model that builds upon the pretrained MusicGen framework. Our innovation lies in an efficient finetuning mechanism, tailored for consumer-grade GPUs, that integrates automatically-extracted rhythm and chords as the condition signal. During inference, the condition can either be musical features extracted from a reference audio signal, or be user-defined symbolic chord sequence, BPM, and textual prompts. Our performance evaluation on two datasets -- one derived from extracted features and the other from user-created inputs -- demonstrates that MusiConGen can generate realistic backing track music that aligns well with the specified conditions. We open-source the code and model checkpoints, and provide audio examples online, https://musicongen.github.io/musicongen_demo/., Comment: Accepted by the 25th International Society for Music Information Retrieval (ISMIR)

Using large language models, this paper presents techniques to improve extremely low-resourced indigenous language translations. Our approaches are grounded in the use of (1) the presence of a datastore consisting of a limited number of parallel translation examples, (2) the inherent capabilities of LLMs like GPT-3.5, and (3) a word-level translation dictionary. We harness the potential of LLMs and in-context learning techniques in such a setting for using LLMs as universal translators for extremely low-resourced languages. Our methodology hinges on utilizing LLMs as language compilers for selected language pairs, hypothesizing that they could internalize syntactic structures to facilitate accurate translation. We introduce three techniques: KNNPrompting with Retrieved Prompting Context, Chain-of-Thought Prompting and Learningfrom-Mistakes Prompting, with the last method addressing past errors. The evaluation results suggest that, even with limited corpora, LLMs can effectively translate extremely low-resource languages when paired with proper prompting.

Solitons, the distinct balance between nonlinearity and dispersion, provide a route toward ultrafast electromagnetic pulse shaping, high-harmonic generation, real-time image processing, and RF photonic communications. Here we newly explore and observe the spatio-temporal breather dynamics of optical soliton crystals in frequency microcombs, examining spatial breathers, chaos transitions, and dynamical deterministic switching in nonlinear measurements and theory. To understand the breather solitons, we describe their dynamical routes and two example transitional maps of the ensemble spatial breathers, with and without chaos initiation. We elucidate the physical mechanisms of the breather dynamics in the soliton crystal microcombs, in the interaction plane limit cycles and in the domain-wall understanding with parity symmetry breaking from third order dispersion. We present maps of the accessible nonlinear regions, the breather frequency dependences on third order dispersion and avoided mode crossing strengths, and the transition between the collective breather spatiotemporal states. Our range of measurements matches well with our first-principles theory and nonlinear modeling. To image these soliton ensembles and their breathers, we further constructed panoramic temporal imaging for simultaneous fast and slow axis two dimensional mapping of the breathers. In the phase differential sampling, we present two dimensional evolution maps of soliton crystal breathers, including with defects, in both stable breathers and breathers with drift. Our fundamental studies contribute to the understanding of nonlinear dynamics in soliton crystal complexes, their spatiotemporal dependences, and their stability-existence zones.

Eye gaze that reveals human observational patterns has increasingly been incorporated into solutions for vision tasks. Despite recent explorations on leveraging gaze to aid deep networks, few studies exploit gaze as an efficient annotation approach for medical image segmentation which typically entails heavy annotating costs. In this paper, we propose to collect dense weak supervision for medical image segmentation with a gaze annotation scheme. To train with gaze, we propose a multi-level framework that trains multiple networks from discriminative human attention, simulated with a set of pseudo-masks derived by applying hierarchical thresholds on gaze heatmaps. Furthermore, to mitigate gaze noise, a cross-level consistency is exploited to regularize overfitting noisy labels, steering models toward clean patterns learned by peer networks. The proposed method is validated on two public medical datasets of polyp and prostate segmentation tasks. We contribute a high-quality gaze dataset entitled GazeMedSeg as an extension to the popular medical segmentation datasets. To the best of our knowledge, this is the first gaze dataset for medical image segmentation. Our experiments demonstrate that gaze annotation outperforms previous label-efficient annotation schemes in terms of both performance and annotation time. Our collected gaze data and code are available at: https://github.com/med-air/GazeMedSeg., Comment: MICCAI 2024

We formulate a first-principles approach for calculating the topological Hall effect (THE) in magnets with noncollinear nanoscale spin textures. We employ a modeling method to determine the effective magnetic field induced by the spin texture, thereby circumventing the computational challenges associated with superlattice calculations. Based on these results, we construct a Wannier tight-binding Hamiltonian to characterize the electronic states and calculate the Hall conductivity. Applying this approach to the skyrmion material $\rm Gd_2PdSi_3$ shows good agreement with experimental data. Our analysis in momentum space further reveals that the dominant contribution to the THE arises from the crossing points between the folded bands along high-symmetry lines in the Brillouin zone. This work advances numerical techniques for simulating general magnetic system, examplified by but not restricted to skyrmion lattice, and its result offering insights into the complex interplay between spin textures and electronic transport., Comment: 13 pages, 9 figures

We establish a precise formal correspondence between a spinless p-wave chiral fermionic superfluid and a spinless bosonic superfluid in a strong magnetic field by accounting for the correct superfluid vorticity in the effective theory of the former. In literature, the vorticity manifests itself incompletely as the magnetic field. This paper demonstrates this substitution can be understood as a truncation in the relevant expansion scheme, together with field redefinitions. Those discarded components are critical to restoring the Berry phase term in the effective theory, and the restoration incapsulates these two systems in the same master Lagrangian. In addition to clarifying the structure of the Berry phase, this formalism permits solving the bosonic system on the lowest Landau level (LLL) based on the method of analogue. In particular, we show that in the linear regime, the Maxwell equations governing these systems are identical by reformulating the vortex crystal with an auxiliary electromagnetic field. This approach offers a unified view for these systems and yields solutions that are rotationally covariant, gauge invariants, and physically interpretable., Comment: 10 pages

In this paper, we construct the phase space of a constantly curved tetrahedron with fixed triangle areas in terms of a pair of Darboux coordinates called the length and twist coordinates, which are in analogy to the Fenchel-Nielsen coordinates for flat connections, and their quantization. The curvature is identified to the value of the cosmological constant, either positive or negative. The physical Hilbert space is given by the $\mathcal{U}_q(\mathfrak{su}(2))$ intertwiner space. We show that the quantum trace of quantum monodromies, defining the quantum length operators, form a fusion algebra and describe their representation theory. We also construct the coherent states in the physical Hilbert space labeled by the length and twist coordinates. These coherent states describe quantum curved tetrahedra and peak at points of the tetrahedron phase space. This works is closely related to 3+1 dimensional Loop Quantum Gravity with a non-vanishing cosmological constant. The coherent states constructed herein serve as good candidates for the application to the spinfoam model with a cosmological constant., Comment: 23+10 pages, 8 figures

This paper introduces a method for zero-shot video restoration using pre-trained image restoration diffusion models. Traditional video restoration methods often need retraining for different settings and struggle with limited generalization across various degradation types and datasets. Our approach uses a hierarchical token merging strategy for keyframes and local frames, combined with a hybrid correspondence mechanism that blends optical flow and feature-based nearest neighbor matching (latent merging). We show that our method not only achieves top performance in zero-shot video restoration but also significantly surpasses trained models in generalization across diverse datasets and extreme degradations (8$\times$ super-resolution and high-standard deviation video denoising). We present evidence through quantitative metrics and visual comparisons on various challenging datasets. Additionally, our technique works with any 2D restoration diffusion model, offering a versatile and powerful tool for video enhancement tasks without extensive retraining. This research leads to more efficient and widely applicable video restoration technologies, supporting advancements in fields that require high-quality video output. See our project page for video results at https://jimmycv07.github.io/DiffIR2VR_web/., Comment: Project page: https://jimmycv07.github.io/DiffIR2VR_web/

Expressive music synthesis (EMS) for violin performance is a challenging task due to the disagreement among music performers in the interpretation of expressive musical terms (EMTs), scarcity of labeled recordings, and limited generalization ability of the synthesis model. These challenges create trade-offs between model effectiveness, diversity of generated results, and controllability of the synthesis system, making it essential to conduct a comparative study on EMS model design. This paper explores two violin EMS approaches. The end-to-end approach is a modification of a state-of-the-art text-to-speech generator. The parameter-controlled approach is based on a simple parameter sampling process that can render note lengths and other parameters compatible with MIDI-DDSP. We study these two approaches (in total, three model variants) through objective and subjective experiments and discuss several key issues of EMS based on the results., Comment: 15 pages, 2 figures, 3 tables

We propose a novel approach to optimizing a byte-level representation for end-to-end automatic speech recognition (ASR). Byte-level representation is often used by large scale multilingual ASR systems when the character set of the supported languages is large. The compactness and universality of byte-level representation allow the ASR models to use smaller output vocabularies and therefore, provide more flexibility. UTF-8 is a commonly used byte-level representation for multilingual ASR, but it is not designed to optimize machine learning tasks directly. By using auto-encoder and vector quantization, we show that we can optimize a byte-level representation for ASR and achieve better accuracy. Our proposed framework can incorporate information from different modalities, and provides an error correction mechanism. In an English/Mandarin dictation task, we show that a bilingual ASR model built with this approach can outperform UTF-8 representation by 5% relative in error rate., Comment: 5 pages, 1 figure, IEEE SLT 2024

We present the discovery and early observations of the nearby Type II supernova (SN) 2024ggi in NGC 3621 at 6.64 +/- 0.3 Mpc. The SN was caught 5.8 (+1.9 -2.9) hours after its explosion by the ATLAS survey. Early-phase, high-cadence, and multi-band photometric follow-up was performed by the Kinder (Kilonova Finder) project, collecting over 1000 photometric data points within a week. The combined o- and r-band light curves show a rapid rise of 3.3 magnitudes in 13.7 hours, much faster than SN 2023ixf (another recent, nearby, and well-observed SN II). Between 13.8 and 18.8 hours after explosion SN 2024ggi became bluer, with u-g colour dropping from 0.53 to 0.15 mag. The rapid blueward evolution indicates a wind shock breakout (SBO) scenario. No hour-long brightening expected for the SBO from a bare stellar surface was detected during our observations. The classification spectrum, taken 17 hours after the SN explosion, shows flash features of high-ionization species such as Balmer lines, He I, C III, and N III. Detailed light curve modeling reveals critical insights into the properties of the circumstellar material (CSM). Our favoured model has an explosion energy of 2 x 10^51 erg, a mass-loss rate of 10^-3 solar_mass/yr (with an assumed 10 km/s wind), and a confined CSM radius of 6 x 10^14 cm. The corresponding CSM mass is 0.4 solar_mass. Comparisons with SN 2023ixf highlight that SN 2024ggi has a smaller CSM density, resulting in a faster rise and fainter UV flux. The extensive dataset and the involvement of citizen astronomers underscore that a collaborative network is essential for SBO searches, leading to more precise and comprehensive SN characterizations., Comment: 11 pages, 5 figures in manuscript, 6 pages in appendix, submitted to ApJL

This study investigates the privacy risks associated with text embeddings, focusing on the scenario where attackers cannot access the original embedding model. Contrary to previous research requiring direct model access, we explore a more realistic threat model by developing a transfer attack method. This approach uses a surrogate model to mimic the victim model's behavior, allowing the attacker to infer sensitive information from text embeddings without direct access. Our experiments across various embedding models and a clinical dataset demonstrate that our transfer attack significantly outperforms traditional methods, revealing the potential privacy vulnerabilities in embedding technologies and emphasizing the need for enhanced security measures., Comment: Accepted at ACL 2024 Main Conference

We examine the transient scattered and transmitted fields generated when an incident electromagnetic wave impinges on a dielectric scatterer or a coated conductor embedded in an infinite space. By applying a boundary-field equation method, we reformulate the problem in the Laplace domain using the electric field equation inside the scatterer and a system of boundary integral equations for the scattered electric field in free space. To analyze this nonlocal boundary problem, we replace it by an equivalent boundary value problem. Existence, uniqueness and stability of the weak solution to the equivalent BVP are established in appropriate function spaces in terms of the Laplace transformed variable. The stability bounds are translated into time-domain estimates which determine the regularity of the solution in terms of the regularity of the problem data. These estimates can be easily converted into error estimates for a numerical discretization on the convolution quadrature for time evolution.

New JWST/NIRCam wide-field slitless spectroscopy provides redshifts for four z>8 galaxies located behind the lensing cluster MACS J0416.1-2403. Two of them, "Y1" and "JD", have previously reported spectroscopic redshifts based on ALMA measurements of [OIII] 88 $\mu$m and/or [CII] 157.7 $\mu$m lines. Y1 is a merging system of three components, and the existing redshift z=8.31 is confirmed. However, JD is at z=8.34 instead of the previously claimed z=9.28. JD's close companion, "JD-N", which was a previously discovered z>8 candidate, is now identified at the same redshift as JD. JD and JD-N form an interacting pair. A new candidate at z>8, "f090d_018", is also confirmed and is at z=8.49. These four objects are likely part of an overdensity that signposts a large structure extending ~165 kpc in projected distance and ~48.7 Mpc in radial distance. They are magnified by less than one magnitude and have intrinsic $M_{UV}$ ranging from -19.57 to -20.83 mag. Their spectral energy distributions show that the galaxies are all very young with ages ~ 4-18 Myr and stellar masses about $10^{7-8}$ ${\rm M_\odot}$. These infant galaxies have very different star formation rates ranging from a few to over a hundred $\rm{M_\odot}$ yr$^{-1}$, but only two of them (JD and f090d_018) have blue rest-frame UV slopes $\beta<-2.0$ indicative of a high Lyman-continuum photon escape fraction that could contribute significantly to the cosmic hydrogen-reionizing background. Interestingly, these two galaxies are the least massive and least active ones among the four. The other two systems have much flatter UV slopes largely because of their high dust extinction ($A_{\rm V}$=0.9-1.0 mag). Their much lower indicated escape fractions show that even very young, actively star-forming galaxies can have negligible contribution to reionization when they quickly form dust throughout their bodies., Comment: 18 pages, 6 figures, after addressing the referee report

Graph Neural Networks (GNNs) have proven highly effective in various machine learning (ML) tasks involving graphs, such as node/graph classification and link prediction. However, explaining the decisions made by GNNs poses challenges because of the aggregated relational information based on graph structure, leading to complex data transformations. Existing methods for explaining GNNs often face limitations in systematically exploring diverse substructures and evaluating results in the absence of ground truths. To address this gap, we introduce GNNAnatomy, a model- and dataset-agnostic visual analytics system designed to facilitate the generation and evaluation of multi-level explanations for GNNs. In GNNAnatomy, we employ graphlets to elucidate GNN behavior in graph-level classification tasks. By analyzing the associations between GNN classifications and graphlet frequencies, we formulate hypothesized factual and counterfactual explanations. To validate a hypothesized graphlet explanation, we introduce two metrics: (1) the correlation between its frequency and the classification confidence, and (2) the change in classification confidence after removing this substructure from the original graph. To demonstrate the effectiveness of GNNAnatomy, we conduct case studies on both real-world and synthetic graph datasets from various domains. Additionally, we qualitatively compare GNNAnatomy with a state-of-the-art GNN explainer, demonstrating the utility and versatility of our design.

Diffusion models have shown tremendous results in image generation. However, due to the iterative nature of the diffusion process and its reliance on classifier-free guidance, inference times are slow. In this paper, we propose a new distillation approach for guided diffusion models in which an external lightweight guide model is trained while the original text-to-image model remains frozen. We show that our method reduces the inference computation of classifier-free guided latent-space diffusion models by almost half, and only requires 1\% trainable parameters of the base model. Furthermore, once trained, our guide model can be applied to various fine-tuned, domain-specific versions of the base diffusion model without the need for additional training: this "plug-and-play" functionality drastically improves inference computation while maintaining the visual fidelity of generated images. Empirically, we show that our approach is able to produce visually appealing results and achieve a comparable FID score to the teacher with as few as 8 to 16 steps., Comment: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 project page: https://5410tiffany.github.io/plug-and-play-diffusion-distillation.github.io/

The concept of persona, originally adopted in dialogue literature, has re-surged as a promising framework for tailoring large language models (LLMs) to specific context (e.g., personalized search, LLM-as-a-judge). However, the growing research on leveraging persona in LLMs is relatively disorganized and lacks a systematic taxonomy. To close the gap, we present a comprehensive survey to categorize the current state of the field. We identify two lines of research, namely (1) LLM Role-Playing, where personas are assigned to LLMs, and (2) LLM Personalization, where LLMs take care of user personas. Additionally, we introduce existing methods for LLM personality evaluation. To the best of our knowledge, we present the first survey for role-playing and personalization in LLMs under the unified view of persona. We continuously maintain a paper collection to foster future endeavors: https://github.com/MiuLab/PersonaLLM-Survey, Comment: 8-page version

Well-fitted clothing is essential for both real and virtual garments to enable self-expression and accurate representation for a large variety of body types. Common practice in the industry is to provide a pre-made selection of distinct garment sizes such as small, medium and large. While these may cater to certain groups of individuals that fall within this distribution, they often exclude large sections of the population. In contrast, individually tailored clothing offers a solution to obtain custom-fit garments that are tailored to each individual. However, manual tailoring is time-consuming and requires specialized knowledge, prohibiting the approach from being applied to produce fitted clothing at scale. To address this challenge, we propose a novel method leveraging differentiable simulation for refitting and draping 3D garments and their corresponding 2D pattern panels onto a new body shape, enabling a workflow where garments only need to be designed once, in a single size, and they can be automatically refitted to support numerous body size and shape variations. Our method enables downstream applications, where our optimized 3D drape can be directly ingested into game engines or other applications. Our 2D sewing patterns allow for accurate physics-based simulations and enables manufacturing clothing for the real world.

Paired single-cell sequencing technologies enable the simultaneous measurement of complementary modalities of molecular data at single-cell resolution. Along with the advances in these technologies, many methods based on variational autoencoders have been developed to integrate these data. However, these methods do not explicitly incorporate prior biological relationships between the data modalities, which could significantly enhance modeling and interpretation. We propose a novel probabilistic learning framework that explicitly incorporates conditional independence relationships between multi-modal data as a directed acyclic graph using a generalized hierarchical variational autoencoder. We demonstrate the versatility of our framework across various applications pertinent to single-cell multi-omics data integration. These include the isolation of common and distinct information from different modalities, modality-specific differential analysis, and integrated cell clustering. We anticipate that the proposed framework can facilitate the construction of highly flexible graphical models that can capture the complexities of biological hypotheses and unravel the connections between different biological data types, such as different modalities of paired single-cell multi-omics data. The implementation of the proposed framework can be found in the repository https://github.com/kuijjerlab/CAVACHON.

Understanding the nature of the luminous 1991T-like supernovae is of great importance to supernova cosmology as they are likely to have been more common in the early universe. In this paper we explore the observational properties of 1991T-like supernovae to study their relationship to other luminous, slow-declining Type~Ia supernovae (SNe Ia). From the spectroscopic and photometric criteria defined in Phillips et al. (1992), we identify 17 1991T-like supernovae from the literature. Combining these objects with ten 1991T-like supernovae from the Carnegie Supernova Project-II, the spectra, light curves, and colors of these events, along with their host galaxy properties, are examined in detail. We conclude that 1991T-like supernovae are closely related in essentially all of their UV, optical, and near-infrared properties -- as well as their host galaxy parameters -- to the slow-declining subset of Branch core-normal supernovae and to the intermediate 1999aa-like events, forming a continuum of luminous SNe Ia. The overriding difference between these three subgroups appears to be the extent to which $^{56}$Ni mixes into the ejecta, producing the pre-maximum spectra dominated by Fe III absorption, the broader UV light curves, and the higher luminosities that characterize the 1991T-like events. Nevertheless, the association of 1991T-like SNe with the rare Type Ia CSM supernovae would seem to run counter to this hypothesis, in which case 1991T-like events may form a separate subclass of SNe Ia, possibly arising from single-degenerate progenitor systems., Comment: Accepted for publication in ApJS

Extrapolation in Large language models (LLMs) for open-ended inquiry encounters two pivotal issues: (1) hallucination and (2) expensive training costs. These issues present challenges for LLMs in specialized domains and personalized data, requiring truthful responses and low fine-tuning costs. Existing works attempt to tackle the problem by augmenting the input of a smaller language model with information from a knowledge graph (KG). However, they have two limitations: (1) failing to extract relevant information from a large one-hop neighborhood in KG and (2) applying the same augmentation strategy for KGs with different characteristics that may result in low performance. Moreover, open-ended inquiry typically yields multiple responses, further complicating extrapolation. We propose a new task, the extreme multi-label KG link prediction task, to enable a model to perform extrapolation with multiple responses using structured real-world knowledge. Our retriever identifies relevant one-hop neighbors by considering entity, relation, and textual data together. Our experiments demonstrate that (1) KGs with different characteristics require different augmenting strategies, and (2) augmenting the language model's input with textual data improves task performance significantly. By incorporating the retrieval-augmented framework with KG, our framework, with a small parameter size, is able to extrapolate based on a given KG. The code can be obtained on GitHub: https://github.com/exiled1143/Retrieval-Augmented-Language-Model-for-Multi-Label-Knowledge-Graph-Link-Prediction.git

We provide the first extensive, numerical study of the non-trivial problem of mixing between flavor-singlet composite states emerging in strongly coupled lattice field theories with matter field content consisting of fermions transforming in different representations of the gauge group. The theory of interest is the minimal candidate for a composite Higgs model that also accommodates a mechanism for top partial compositeness: the $Sp(4)$ gauge theory coupled to two (Dirac) fermions transforming as the fundamental and three as the two-index antisymmetric representation of the gauge group, respectively. We apply an admixture of APE and Wuppertal smearings, as well as the generalized eigenvalue problem approach, to two-point functions involving flavor-singlet mesons, for ensembles having time extent longer than the space extent. We demonstrate that, in the region of lattice parameter space accessible to this study, both masses and mixing angles can be measured effectively, despite the presence of (numerically noisy) contributions from disconnected diagrams., Comment: 18 pages, 3 figures, 4 tables

The COVID-19 pandemic led to a large global effort to sequence SARS-CoV-2 genomes from patient samples to track viral evolution and inform public health response. Millions of SARS-CoV-2 genome sequences have been deposited in global public repositories. The Canadian COVID-19 Genomics Network (CanCOGeN - VirusSeq), a consortium tasked with coordinating expanded sequencing of SARS-CoV-2 genomes across Canada early in the pandemic, created the Canadian VirusSeq Data Portal, with associated data pipelines and procedures, to support these efforts. The goal of VirusSeq was to allow open access to Canadian SARS-CoV-2 genomic sequences and enhanced, standardized contextual data that were unavailable in other repositories and that meet FAIR standards (Findable, Accessible, Interoperable and Reusable). The Portal data submission pipeline contains data quality checking procedures and appropriate acknowledgement of data generators that encourages collaboration. Here we also highlight Duotang, a web platform that presents genomic epidemiology and modeling analyses on circulating and emerging SARS-CoV-2 variants in Canada. Duotang presents dynamic changes in variant composition of SARS-CoV-2 in Canada and by province, estimates variant growth, and displays complementary interactive visualizations, with a text overview of the current situation. The VirusSeq Data Portal and Duotang resources, alongside additional analyses and resources computed from the Portal (COVID-MVP, CoVizu), are all open-source and freely available. Together, they provide an updated picture of SARS-CoV-2 evolution to spur scientific discussions, inform public discourse, and support communication with and within public health authorities. They also serve as a framework for other jurisdictions interested in open, collaborative sequence data sharing and analyses.

Spectral densities encode non-perturbative information that enters the calculation of a plethora of physical observables in strongly coupled field theories. Phenomenological applications encompass aspects of standard-model hadronic physics, observable at current colliders, as well as correlation functions characterizing new physics proposals, testable in future experiments. By making use of numerical data produced with lattice gauge theories, we perform a systematic study to demonstrate the effectiveness of recent technological progress in the reconstruction of spectral densities. To this purpose, we write and test new software packages that use energy-smeared spectral densities to analyze the mass spectrum of mesons. We assess the effectiveness of different smearing kernels and optimize the smearing parameters to the characteristics of available lattice ensembles. For concreteness, we analyze the Sp(4) lattice gauge theory with matter transforming in an admixture of fundamental and 2-index antisymmetric representations of the gauge group. We generate new ensembles for this theory, with lattices that have a longer extent in the time direction with respect to the spatial ones. We run our tests on these ensembles, obtaining new results about the spectrum of light mesons and their excitations. We make available our algorithm and software for the extraction of spectral densities, that can be applied to theories with other gauge groups, including the theory of strong interactions (QCD) governing hadronic physics in the standard model., Comment: 44 pages, 20 figures

We present the second and final release of optical spectroscopy of Type Ia Supernovae (SNe Ia) obtained during the first and second phases of the Carnegie Supernova Project (CSP-I and CSP-II). The newly released data consist of 148 spectra of 30 SNe Ia observed in the course of the CSP-I, and 234 spectra of 127 SNe Ia obtained during the CSP-II. We also present 216 optical spectra of 46 historical SNe Ia, including 53 spectra of 30 SNe Ia observed by the Cal\'an/Tololo Supernova Survey. We combine these observations with previously published CSP data and publicly-available spectra to compile a large sample of measurements of spectroscopic parameters at maximum light, consisting of pseudo-equivalent widths and expansion velocities of selected features, for 232 CSP and historical SNe Ia (including more than 1000 spectra). Finally, we review some of the strongest correlations between spectroscopic and photometric properties of SNe Ia. Specifically, we define two samples: one consisting of SNe Ia discovered by targeted searches (most of them CSP-I objects) and the other composed of SNe Ia discovered by untargeted searches, which includes most of the CSP-II objects. The analysed correlations are similar for both samples. We find a larger incidence of SNe Ia belonging to the Cool (CL)and Broad Line (BL) Branch subtypes among the events discovered by targeted searches, Shallow Silicon (SS) SNe Ia are present with similar frequencies in both samples, while Core Normal (CN) SNe Ia are more frequent in untargeted searches., Comment: 59 pages, 16 figures, accepted for publication in The Astrophysical Journal. May 7, 2024: LaTex file updated: corrected one missing comma and an extraneous space in Table 2

We present a JWST MIRI/MRS spectrum (5-27 $\mathrm{\mu}$m) of the Type Ia supernova (SN Ia), SN 2021aefx at $+415$ days past $B$-band maximum. The spectrum, which was obtained during the iron-dominated nebular phase, has been analyzed in combination with previous JWST observations of SN 2021aefx, to provide the first JWST time series analysis of an SN Ia. We find the temporal evolution of the [Co III] 11.888 $\mathrm{\mu}$m feature directly traces the decay of $^{56}$Co. The spectra, line profiles, and their evolution are analyzed with off-center delayed-detonation models. Best fits were obtained with White Dwarf (WD) central densities of $\rho_c=0.9-1.1\times 10^9$g cm$^{-3}$, a WD mass of M$_{\mathrm{WD}}$=1.33-1.35M$_\odot$, a WD magnetic field of $\approx10^6$G, and an off-center deflagration-to-detonation transition at $\approx$ 0.5 $M_\odot$ seen opposite to the line of sight of the observer (-30). The inner electron capture core is dominated by energy deposition from $\gamma$-rays whereas a broader region is dominated by positron deposition, placing SN 2021aefx at +415 d in the transitional phase of the evolution to the positron-dominated regime. The formerly `flat-tilted' profile at 9 $\mathrm{\mu}$m now has significant contribution from [Ni IV], [Fe II], and [Fe III] and less from [Ar III], which alters the shape of the feature as positrons excite mostly the low-velocity Ar. Overall, the strength of the stable Ni features in the spectrum is dominated by positron transport rather than the Ni mass. Based on multi-dimensional models, our analysis is consistent with a single-spot, close-to-central ignition with an indication for a pre-existing turbulent velocity field, and excludes a multiple-spot, off-center ignition., Comment: Accepted for publication in ApJ

We present JWST/NIRSpec high-resolution spectroscopy G395H/F290LP of MACS0647-JD, a gravitationally lensed galaxy merger at $z=10.167$. The new spectroscopy, which is acquired for the two lensed images (JD1 and JD2), detects and resolves emission lines in the rest-frame ultraviolet (UV) and blue optical, including the resolved [OII]3726,3729 doublet, [NeIII]3870, [HeI]3890, H$\delta$, H$\gamma$, and [OIII]4363. This is the first observation of the resolved [OII]3726,3729 doublet for a galaxy at $z>8$. We measure a line flux ratio [OII]3729/3726 $= 0.9 \pm 0.3$, which corresponds to an estimated electron density of $\log(n_{e} / \rm{cm}^{-3}) = 2.9 \pm 0.5$. This is significantly higher than the electron densities of local galaxies reported in the literature. We compile the measurements from the literature and further analyze the redshift evolution of $n_{e}$. We find that the redshift evolution follows the power-law form of $n_{e} = A\times (1+z)^{p}$ with $A=54^{+31}_{-23}$ cm$^{-3}$ and $p=1.2^{+0.4}_{-0.4}$. This power-law form may be explained by a combination of metallicity and morphological evolution of galaxies, which become, on average, more metal-poor and more compact with increasing redshift., Comment: 20 pages, 11 figures. Accepted for publication in ApJ

JWST spectroscopy has revolutionized our understanding of galaxies in the early universe. Covering wavelengths up to $5.3\,{\rm \mu m}$, NIRSpec can detect rest-frame optical emission lines H$\alpha$ out to $z = 7$ and [O III] to $z = 9.5$. Observing these lines in more distant galaxies requires longer wavelength spectroscopy with MIRI. Here we present MIRI MRS IFU observations of the lensed galaxy merger MACS0647$-$JD at $z = 10.165$. With exposure times of 4.2 hours in each of two bands, we detect H$\alpha$ at $9\sigma$, [O III]$\,\lambda5008$ at $11\sigma$, and [O III]$\,\lambda4960$ at $3\sigma$. Combined with previously reported NIRSpec spectroscopy that yields seven emission lines including the auroral line [O III]$\,\lambda4363$, we present the first direct metallicity measurement of a $z > 10$ galaxy: $12+{\rm log(O/H)}= 7.79\pm0.09$, or $0.13^{+0.02}_{-0.03}\,Z_{\odot}$. This is similar to galaxies at $z \sim 4 - 9$ with direct metallicity measurements, though higher than expected given the high specific star formation rate ${\rm log(sSFR / yr^{-1})} = -7.4 \pm 0.3$. We further constrain the ionization parameter ${\rm log}(U)$ = $-1.9 \pm 0.1$, ionizing photon production efficiency ${\rm log}(\xi_{\rm ion})$ = $25.3\pm0.1$, and star formation rate $5.0\pm0.6\,M_{\odot}/{\rm yr}$ within the past $10\,{\rm Myr}$. These observations demonstrate the combined power of JWST NIRSpec and MIRI for studying galaxies in the first $500$ million years., Comment: 16 pages, 8 figures, accepted for publication in ApJ

Earthquake-induced liquefaction can cause substantial lateral spreading, posing threats to infrastructure. Machine learning (ML) can improve lateral spreading prediction models by capturing complex soil characteristics and site conditions. However, the "black box" nature of ML models can hinder their adoption in critical decision-making. This study addresses this limitation by using SHapley Additive exPlanations (SHAP) to interpret an eXtreme Gradient Boosting (XGB) model for lateral spreading prediction, trained on data from the 2011 Christchurch Earthquake. SHAP analysis reveals the factors driving the model's predictions, enhancing transparency and allowing for comparison with established engineering knowledge. The results demonstrate that the XGB model successfully identifies the importance of soil characteristics derived from Cone Penetration Test (CPT) data in predicting lateral spreading, validating its alignment with domain understanding. This work highlights the value of explainable machine learning for reliable and informed decision-making in geotechnical engineering and hazard assessment., Comment: to be published in "Frontiers in Built Environment"

In this paper, we present a framework for convolutional coded Poisson receivers (CCPRs) that incorporates spatially coupled methods into the architecture of coded Poisson receivers (CPRs). We use density evolution equations to track the packet decoding process with the successive interference cancellation (SIC) technique. We derive outer bounds for the stability region of CPRs when the underlying channel can be modeled by a $\phi$-ALOHA receiver. The stability region is the set of loads that every packet can be successfully received with a probability of 1. Our outer bounds extend those of the spatially-coupled Irregular Repetition Slotted ALOHA (IRSA) protocol and apply to channel models with multiple traffic classes. For CCPRs with a single class of users, the stability region is reduced to an interval. Therefore, it can be characterized by a percolation threshold. We study the potential threshold by the potential function of the base CPR used for constructing a CCPR. In addition, we prove that the CCPR is stable under a technical condition for the window size. For the multiclass scenario, we recursively evaluate the density evolution equations to determine the boundaries of the stability region. Numerical results demonstrate that the stability region of CCPRs can be enlarged compared to that of CPRs by leveraging the spatially-coupled method. Moreover, the stability region of CCPRs is close to our outer bounds when the window size is large., Comment: Part of this work was presented in 2023 IEEE International Symposium on Information Theory (ISIT) [1] and 2024 IEEE International Symposium on Information Theory (ISIT) [2]

Painterly Image Harmonization aims at seamlessly blending disparate visual elements within a single coherent image. However, previous approaches often encounter significant limitations due to training data constraints, the need for time-consuming fine-tuning, or reliance on additional prompts. To surmount these hurdles, we design a Training-and-prompt-Free General Painterly Harmonization method using image-wise attention sharing (TF-GPH), which integrates a novel "share-attention module". This module redefines the traditional self-attention mechanism by allowing for comprehensive image-wise attention, facilitating the use of a state-of-the-art pretrained latent diffusion model without the typical training data limitations. Additionally, we further introduce "similarity reweighting" mechanism enhances performance by effectively harnessing cross-image information, surpassing the capabilities of fine-tuning or prompt-based approaches. At last, we recognize the deficiencies in existing benchmarks and propose the "General Painterly Harmonization Benchmark", which employs range-based evaluation metrics to more accurately reflect real-world application. Extensive experiments demonstrate the superior efficacy of our method across various benchmarks. The code and web demo are available at https://github.com/BlueDyee/TF-GPH.

Our aim in this article is to compute the mixed volume of a matroid. We give two computations. The first one is based on the integration formula for complete fans given by Brion. The second computation is a step-by-step method using deletion of elements in the matroid as in Braden-Huh-Matherne-Proudfoot-Wang., Comment: 29 pages, 1 figure