Search

The goal of this paper is to accelerate codec-based speech synthesis systems with minimum sacrifice to speech quality. We propose an enhanced inference method that allows for flexible trade-offs between speed and quality during inference without requiring additional training. Our core idea is to predict multiple tokens per inference step of the AR module using multiple prediction heads, resulting in a linear reduction in synthesis time as the number of heads increases. Furthermore, we introduce a novel speculative decoding technique that utilises a Viterbi-based algorithm to select the optimal sequence of generated tokens at each decoding step. In our experiments, we demonstrate that the time required to predict each token is reduced by a factor of 4 to 5 compared to baseline models, with minimal quality trade-off or even improvement in terms of speech intelligibility. Audio samples are available at: multpletokensprediction.github.io/multipletokensprediction.github.io/., Comment: Submitted to IEEE ICASSP 2025

This paper introduces SpoofCeleb, a dataset designed for Speech Deepfake Detection (SDD) and Spoofing-robust Automatic Speaker Verification (SASV), utilizing source data from real-world conditions and spoofing attacks generated by Text-To-Speech (TTS) systems also trained on the same real-world data. Robust recognition systems require speech data recorded in varied acoustic environments with different levels of noise to be trained. However, existing datasets typically include clean, high-quality recordings (bona fide data) due to the requirements for TTS training; studio-quality or well-recorded read speech is typically necessary to train TTS models. Existing SDD datasets also have limited usefulness for training SASV models due to insufficient speaker diversity. We present SpoofCeleb, which leverages a fully automated pipeline that processes the VoxCeleb1 dataset, transforming it into a suitable form for TTS training. We subsequently train 23 contemporary TTS systems. The resulting SpoofCeleb dataset comprises over 2.5 million utterances from 1,251 unique speakers, collected under natural, real-world conditions. The dataset includes carefully partitioned training, validation, and evaluation sets with well-controlled experimental protocols. We provide baseline results for both SDD and SASV tasks. All data, protocols, and baselines are publicly available at https://jungjee.github.io/spoofceleb., Comment: 9 pages, 2 figures, 8 tables

Text-to-speech (TTS) systems are traditionally trained using modest databases of studio-quality, prompted or read speech collected in benign acoustic environments such as anechoic rooms. The recent literature nonetheless shows efforts to train TTS systems using data collected in the wild. While this approach allows for the use of massive quantities of natural speech, until now, there are no common datasets. We introduce the TTS In the Wild (TITW) dataset, the result of a fully automated pipeline, in this case, applied to the VoxCeleb1 dataset commonly used for speaker recognition. We further propose two training sets. TITW-Hard is derived from the transcription, segmentation, and selection of VoxCeleb1 source data. TITW-Easy is derived from the additional application of enhancement and additional data selection based on DNSMOS. We show that a number of recent TTS models can be trained successfully using TITW-Easy, but that it remains extremely challenging to produce similar results using TITW-Hard. Both the dataset and protocols are publicly available and support the benchmarking of TTS systems trained using TITW data., Comment: 5 pages, submitted to ICASSP 2025 as a conference paper

We present a proof-of-concept simulation-based inference on $\Omega_{\rm m}$ and $\sigma_{8}$ from the SDSS BOSS LOWZ NGC catalog using neural networks and domain generalization techniques without the need of summary statistics. Using rapid lightcone simulations, ${\rm L{\scriptsize -PICOLA}}$, mock galaxy catalogs are produced that fully incorporate the observational effects. The collection of galaxies is fed as input to a point cloud-based network, ${\texttt{Minkowski-PointNet}}$. We also add relatively more accurate ${\rm G{\scriptsize ADGET}}$ mocks to obtain robust and generalizable neural networks. By explicitly learning the representations which reduces the discrepancies between the two different datasets via the semantic alignment loss term, we show that the latent space configuration aligns into a single plane in which the two cosmological parameters form clear axes. Consequently, during inference, the SDSS BOSS LOWZ NGC catalog maps onto the plane, demonstrating effective generalization and improving prediction accuracy compared to non-generalized models. Results from the ensemble of 25 independently trained machines find $\Omega_{\rm m}=0.339 \pm 0.056$ and $\sigma_{8}=0.801 \pm 0.061$, inferred only from the distribution of galaxies in the lightcone slices without relying on any indirect summary statistics. A single machine that best adapts to the ${\rm G{\scriptsize ADGET}}$ mocks yields a tighter prediction of $\Omega_{\rm m}=0.282 \pm 0.014$ and $\sigma_{8}=0.786 \pm 0.036$. We emphasize that adaptation across multiple domains can enhance the robustness of the neural networks in observational data., Comment: 28 pages, 14 figures; Accepted for publication in ApJ

We introduce a GPU-accelerated hybrid hydro/N-body code (Enzo-N) designed to address the challenges of concurrently simulating star clusters and their parent galaxies. This task has been exceedingly challenging, primarily due to the considerable computational time required, which stems from the substantial scale difference between galaxies (~ 0.1 Mpc) and star clusters (~ pc). Yet, this significant scale separation means that particles within star clusters perceive those outside the star cluster in a semi-stationary state. By leveraging this aspect, we integrate the direct N-body code (Nbody6++GPU) into the cosmological (magneto-)hydrodynamic code (Enzo) through the utilization of the semi-stationary background acceleration approximation. We solve the dynamics of particles within star clusters using the direct N-body solver with regularization for few-body interactions, while evolving particles outside -- dark matter, gas, and stars -- using the particle-mesh gravity solver and hydrodynamic methods. We demonstrate that Enzo-N successfully simulates the co-evolution of star clusters and their parent galaxies, capturing phenomena such as core collapse of the star cluster and tidal stripping due to galactic tides. This comprehensive framework opens up new possibilities for studying the evolution of star clusters within galaxies, offering insights that were previously inaccessible., Comment: 15 pages, 13 figures, Accepted for publication in ApJ

The AGORA Cosmorun (arXiv:2106.09738) is a set of hydrodynamical cosmological zoom-in simulations carried out within the AGORA High-resolution Galaxy Simulations Comparison Project (arXiv:1308.2669,arXiv:1610.03066). These simulations show the formation and evolution of a Milky Way-sized galaxy using eight of the most widely used numerical codes in the community (Art-I, Enzo, Ramses, Changa, Gadget-3, Gear, Gizmo, and Arepo). In this short report, we describe the public release of the raw output data from all of these simulations at z = 8, 7, 6, 5, 4, 3, 2 (plus at z=1, 0 when available), and several metadata files containing the halo centers, virial quantities, and merger trees. The data from even thinner timesteps will be released as soon as the upcoming collaboration papers (VII-IX) are submitted and accepted., Comment: ArXiv Data Release from the AGORA Collaboration. arXiv admin note: text overlap with arXiv:2001.04354

This paper introduces VoxSim, a dataset of perceptual voice similarity ratings. Recent efforts to automate the assessment of speech synthesis technologies have primarily focused on predicting mean opinion score of naturalness, leaving speaker voice similarity relatively unexplored due to a lack of extensive training data. To address this, we generate about 41k utterance pairs from the VoxCeleb dataset, a widely utilised speech dataset for speaker recognition, and collect nearly 70k speaker similarity scores through a listening test. VoxSim offers a valuable resource for the development and benchmarking of speaker similarity prediction models. We provide baseline results of speaker similarity prediction models on the VoxSim test set and further demonstrate that the model trained on our dataset generalises to the out-of-domain VCC2018 dataset., Comment: INTERSPEECH 2024. The dataset is available from https://mm.kaist.ac.kr/projects/voxsim/

We introduce a novel software called TCSpy which is designed to efficiently control a multi-telescope array through network-based protocols. The primary objectives of TCSpy include centralized control of the array, support for diverse observation modes, and swift responses to the follow-up observations of astronomical transients. To achieve these objectives, TCSpy utilizes the ASCOM Alpaca protocol in conjunction with Alpyca, establishing robust communication among multiple telescope units. For the practical application of TCSpy, we implement TCSpy within the 7-Dimensional Telescope (7DT). 7DT is a telescope array consisting of 20, 0.5-m telescopes, equipped with 40 different medium-band filters. The main scientific goals of 7DT include detecting the optical counterparts of gravitational-wave sources, identifying kilonovae, and the spectral mapping of the southern sky. Through the integration of TCSpy, 7DT can achieve these scientific objectives with its unique observation modes and rapid follow-up capabilities., Comment: 8 pages, 5 figures, SPIE Astronomical Telescopes + Instrumentation 2024

Center for the Gravitational-Wave Universe at Seoul National University has been operating its main observational facility, the 7-Dimensional Telescope (7DT) since October 2023. Located at El Sauce Observatory in Chilean Rio Hurtado Valley, 7DT consists of 20 50-cm telescopes equipped with 40 medium-band filters of 25 nm full width at half maximum along with a CMOS camera of 61 megapixels. 7DT produces about 1 TB per night of spectral mapping image data including calibration, and the byproduct of the data reduction pipeline once our planned three layered surveys (Reference Imaging Survey, Wide Field Survey, and Intensive Monitoring Survey) start in 2024. We are expecting to generate 1 PB per year by combining raw data, reduced data, and data products (e.g. calibrated stacked images, spectral cubes, and object catalogs). To incorporate this huge amount of data, we now have a data storage for 1 PB which we will increment by 1 PB per year. We also have a high-performance computation facility that is equipped with 2 NVIDIA A100 GPU cards since we plan to carry out real-time data reduction and analysis for follow-up observation data of gravitational wave events. To incorporate this, we established a 400 Mbps network connection between the facilities in Korea and Chile. Taking advantage of the high-performance network, we have been carrying out fully remote operations since October 2023. In this talk, we present details of designing, planning, and executing the ground-based telescope facility project, especially within low-budget academic environments. While we cover as much ground as possible, we will emphasize human resource management, project risk management, and financial contingency management., Comment: 7 pages, 1 figures, Proceedings of the SPIE conference "Modeling, Systems Engineering, and Project Management for Astronomy XI" SPIE Astronomical Telescopes + Instrumentation 2024 (Paper No. 13099-77)

The 7-Dimensional Telescope (7DT) is a multi-telescope system designed to identify electromagnetic (EM) counterparts of gravitational-wave (GW) sources. Consisting of 20 50-cm telescopes along with 40 medium-band filters of 25 nm width, 7DT can obtain spectral mapping images for a large field of view (~1.25 square degrees). Along with flexible operation, real-time data reduction, and analysis, the 7DT's spectral mapping capability enables 7DT to follow up GW events quickly and discover EM counterparts. Among 20 planned telescopes, 12 units are deployed at the El Sauce Observatory located at Rio Hurtado Valley in Chile. Since we obtained the first light of 7DT in October 2023, we started its commissioning procedures including examination of bias levels, master flat production, and spectrophotometric standardization. In this talk, we present 7DT instruments and their set-up, commissioning procedures, and data characteristics of 7DT along with our three-layered surveys which are assumed to be initiated in early 2024., Comment: 11 pages, 3 figures, Proceedings of the SPIE conference 13094 Ground-based and Airborne Telescope X, SPIE Astronomical Telescopes + Instrumentations 2024 (Paper No. 13094-034)

This work proposes an efficient method to enhance the quality of corrupted speech signals by leveraging both acoustic and visual cues. While existing diffusion-based approaches have demonstrated remarkable quality, their applicability is limited by slow inference speeds and computational complexity. To address this issue, we present FlowAVSE which enhances the inference speed and reduces the number of learnable parameters without degrading the output quality. In particular, we employ a conditional flow matching algorithm that enables the generation of high-quality speech in a single sampling step. Moreover, we increase efficiency by optimizing the underlying U-net architecture of diffusion-based systems. Our experiments demonstrate that FlowAVSE achieves 22 times faster inference speed and reduces the model size by half while maintaining the output quality. The demo page is available at: https://cyongong.github.io/FlowAVSE.github.io/, Comment: INTERSPEECH 2024

The goal of this work is to simultaneously generate natural talking faces and speech outputs from text. We achieve this by integrating Talking Face Generation (TFG) and Text-to-Speech (TTS) systems into a unified framework. We address the main challenges of each task: (1) generating a range of head poses representative of real-world scenarios, and (2) ensuring voice consistency despite variations in facial motion for the same identity. To tackle these issues, we introduce a motion sampler based on conditional flow matching, which is capable of high-quality motion code generation in an efficient way. Moreover, we introduce a novel conditioning method for the TTS system, which utilises motion-removed features from the TFG model to yield uniform speech outputs. Our extensive experiments demonstrate that our method effectively creates natural-looking talking faces and speech that accurately match the input text. To our knowledge, this is the first effort to build a multimodal synthesis system that can generalise to unseen identities., Comment: CVPR 2024

In this fourth paper from the AGORA Collaboration, we study the evolution down to redshift $z=2$ and below of a set of cosmological zoom-in simulations of a Milky Way mass galaxy by eight of the leading hydrodynamic simulation codes. We also compare this CosmoRun suite of simulations with dark matter-only simulations by the same eight codes. We analyze general properties of the halo and galaxy at $z=4$ and 3, and before the last major merger, focusing on the formation of well-defined rotationally-supported disks, the mass-metallicity relation, the specific star formation rate, the gas metallicity gradients, and the non-axisymmetric structures in the stellar disks. Codes generally converge well to the stellar-to-halo mass ratios predicted by semi-analytic models at $z\sim$2. We see that almost all the hydro codes develop rotationally-supported structures at low redshifts. Most agree within 0.5 dex with the observed MZR at high and intermediate redshifts, and reproduce the gas metallicity gradients obtained from analytical models and low-redshift observations. We confirm that the inter-code differences in the halo assembly history reported in the first paper of the collaboration also exist in CosmoRun, making the code-to-code comparison more difficult. We show that such differences are mainly due to variations in code-dependent parameters that control the time-stepping strategy of the gravity solver. We find that variations in the early stellar feedback can also result in differences in the timing of the low-redshift mergers. All the simulation data down to $z=2$ and the auxiliary data will be made publicly available., Comment: Submitted to ApJ. Visit the AGORA Collaboration website (www.agorasimulations.org ) for more information

We analyze and compare the satellite halo populations at $z\sim2$ in the high-resolution cosmological zoom-in simulations of a $10^{12}\,{\rm M}_{\odot}$ target halo ($z=0$ mass) carried out on eight widely-used astrophysical simulation codes ({\sc Art-I}, {\sc Enzo}, {\sc Ramses}, {\sc Changa}, {\sc Gadget-3}, {\sc Gear}, {\sc Arepo-t}, and {\sc Gizmo}) for the {\it AGORA} High-resolution Galaxy Simulations Comparison Project. We use slightly different redshift epochs near $z=2$ for each code (hereafter ``$z\sim2$') at which the eight simulations are in the same stage in the target halo's merger history. After identifying the matched pairs of halos between the {\it CosmoRun} simulations and the DMO simulations, we discover that each {\it CosmoRun} halo tends to be less massive than its DMO counterpart. When we consider only the halos containing stellar particles at $z\sim2$, the number of satellite {\it galaxies} is significantly fewer than that of dark matter halos in all participating {\it AGORA} simulations, and is comparable to the number of present-day satellites near the Milky Way or M31. The so-called ``missing satellite problem' is fully resolved across all participating codes simply by implementing the common baryonic physics adopted in {\it AGORA} and the stellar feedback prescription commonly used in each code, with sufficient numerical resolution ($\lesssim100$ proper pc at $z=2$). We also compare other properties such as the stellar mass$-$halo mass relation and the mass$-$metallicity relation. Our work highlights the value of comparison studies such as {\it AGORA}, where outstanding problems in galaxy formation theory are studied simultaneously on multiple numerical platforms., Comment: Accepted for publication to the ApJ, 19 pages, 10 figures. Visit the AGORA Collaboration website (www.agorasimulations.org) for more information. For summary video, please see https://www.youtube.com/watch?v=HShRJYvPe1k

We analyze the circumgalactic medium (CGM) for eight commonly-used cosmological codes in the AGORA collaboration. The codes are calibrated to use identical initial conditions, cosmology, heating and cooling, and star formation thresholds, but each evolves with its own unique code architecture and stellar feedback implementation. Here, we analyze the results of these simulations in terms of the structure, composition, and phase dynamics of the CGM. We show properties such as metal distribution, ionization levels, and kinematics are effective tracers of the effects of the different code feedback and implementation methods, and as such they can be highly divergent between simulations. This is merely a fiducial set of models, against which we will in the future compare multiple feedback recipes for each code. Nevertheless, we find that the large parameter space these simulations establish can help disentangle the different variables that affect observable quantities in the CGM, e.g., showing that abundances for ions with higher ionization energy are more strongly determined by the simulation's metallicity, while abundances for ions with lower ionization energy are more strongly determined by the gas density and temperature., Comment: 32 pages, 17 figures. Published in ApJ

Dark matter-deficient galaxies (DMDGs) discovered in the survey of ultra-diffuse galaxies (UDGs), in apparent conflict with standard CDM, may be produced by high-velocity galaxy-galaxy collisions, the $\textit{Mini-bullet}$ scenario. Recent observations of an aligned trail of $7-11$ UDGs near NGC1052, including DMDGs DF2 and DF4, suggesting a common formation event, $\sim8.9\pm1.5$ Gyr ago, provide a test. Hydro/N-body simulations, supplemented by galaxy orbit integrations, demonstrate that satellite-satellite collisions outside the host-galaxy virial radius can reproduce the observed UDGs in the NGC1052 group. A trail of $\sim10$ DMDGs is shown to form, including two massive ones that replicate the observed motions of DF2 and DF4. The linear relation, $v=Ax+v_{0}$, conjectured previously to relate positions ($x$) and velocities ($v$) of the aligned DMDGs as a signature of the collision event, is approximately obeyed, but individual DMDGs can deviate significantly from it. The progenitors whose collision spawned the trail of DMDGs survive the collision without, themselves, becoming DMDGs. We predict one progenitor is located at the end of the trail, testable by observing the difference between its stars, formed pre-collision, from those of the DMDGs, formed post-collision. By contrast, stellar ages and metallicities of the DMDGs are nearly identical. We further offer a hint that the tidal field of host NGC1052 may contribute to making DMDGs diffuse. $\Lambda$CDM simulation in a 100 cMpc box finds our required initial conditions $\sim10$ times at $z<3$. These results indicate current observations are consistent with the $\textit{Mini-bullet}$ scenario., Comment: 27 pages, 14 figures, minor revisions for clarification only in response to referee report, + 2 new figures. For associated movies and information, see https://joohyun-lee.github.io/research/DMDG3/

We introduce a novel halo/galaxy matching technique between two cosmological simulations with different resolutions, which utilizes the positions and masses of halos along their subhalo merger tree. With this tool, we conduct a study of resolution biases through the {\it galaxy-by-galaxy} inspection of a pair of simulations that have the same simulation configuration but different mass resolutions, utilizing a suite of {\sc IllustrisTNG} simulations to assess the impact on galaxy properties. We find that, with the subgrid physics model calibrated for TNG100-1, subhalos in TNG100-1 (high resolution) have $\lesssim0.5$ dex higher stellar masses than their counterparts in the TNG100-2 (low-resolution). It is also discovered that the subhalos with $M_{\mathrm{gas}}\sim10^{8.5}\,{\rm M}_\odot$ in TNG100-1 have $\sim0.5$ dex higher gas mass than those in TNG100-2. The mass profiles of the subhalos reveal that the dark matter masses of subhalos in TNG100-2 converge well with those from TNG100-1, except within 4 kpc of the resolution limit. The differences in stellar mass and hot gas mass are most pronounced in the central region. We exploit machine learning to build a correction mapping for the physical quantities of subhalos from low- to high-resolution simulations (TNG300-1 and TNG100-1), which enables us to find an efficient way to compile a high-resolution galaxy catalog even from a low-resolution simulation. Our tools can easily be applied to other large cosmological simulations, testing and mitigating the resolution biases of their numerical codes and subgrid physics models., Comment: 24 pages, 14 figures; Accepted for publication in to ApJ

The goal of this work is to reconstruct high quality speech from lip motions alone, a task also known as lip-to-speech. A key challenge of lip-to-speech systems is the one-to-many mapping caused by (1) the existence of homophenes and (2) multiple speech variations, resulting in a mispronounced and over-smoothed speech. In this paper, we propose a novel lip-to-speech system that significantly improves the generation quality by alleviating the one-to-many mapping problem from multiple perspectives. Specifically, we incorporate (1) self-supervised speech representations to disambiguate homophenes, and (2) acoustic variance information to model diverse speech styles. Additionally, to better solve the aforementioned problem, we employ a flow based post-net which captures and refines the details of the generated speech. We perform extensive experiments on two datasets, and demonstrate that our method achieves the generation quality close to that of real human utterance, outperforming existing methods in terms of speech naturalness and intelligibility by a large margin. Synthesised samples are available at our demo page: https://mm.kaist.ac.kr/projects/LTBS., Comment: Accepted to AAAI 2024

Recent abrupt changes of CW Leonis may indicate that we are witnessing the moment that the central carbon star is evolving off the Asymptotic Giant Branch (AGB) and entering into the pre-planetary nebula (PPN) phase. The recent appearance of a red compact peak at the predicted stellar position is possibly an unveiling event of the star, and the radial beams emerging from the stellar position resemble the feature of the PPN Egg Nebula. The increase of light curve over two decades is also extraordinary, and it is possibly related to the phase transition. Decadal-period variations are further found in the residuals of light curves, in the relative brightness of radial beams, and in the extended halo brightness distribution. Further monitoring of the recent dramatic and decadal-scale changes of this most well-known carbon star CW Leonis at the tip of AGB is still highly essential, and will help us gain a more concrete understanding on the conditions for transition between the late stellar evolutionary phases., Comment: 6 pages, 4 figures, Winds of Stars and Exoplanets. Proceedings of the International Astronomical Union, Volume 370, pp. 78-83

For the first time in the world, we succeeded in synthesizing the room-temperature superconductor ($T_c \ge 400$ K, 127$^\circ$C) working at ambient pressure with a modified lead-apatite (LK-99) structure. The superconductivity of LK-99 is proved with the Critical temperature ($T_c$), Zero-resistivity, Critical current ($I_c$), Critical magnetic field ($H_c$), and the Meissner effect. The superconductivity of LK-99 originates from minute structural distortion by a slight volume shrinkage (0.48 %), not by external factors such as temperature and pressure. The shrinkage is caused by Cu$^{2+}$ substitution of Pb$^{2+}$(2) ions in the insulating network of Pb(2)-phosphate and it generates the stress. It concurrently transfers to Pb(1) of the cylindrical column resulting in distortion of the cylindrical column interface, which creates superconducting quantum wells (SQWs) in the interface. The heat capacity results indicated that the new model is suitable for explaining the superconductivity of LK-99. The unique structure of LK-99 that allows the minute distorted structure to be maintained in the interfaces is the most important factor that LK-99 maintains and exhibits superconductivity at room temperatures and ambient pressure.

We present demography of the dynamics and gas-mass fraction of 33 extremely metal-poor galaxies (EMPGs) with metallicities of $0.015-0.195~Z_\odot$ and low stellar masses of $10^4-10^8~M_\odot$ in the local universe. We conduct deep optical integral-field spectroscopy (IFS) for the low-mass EMPGs with the medium high resolution ($R=7500$) grism of the 8m-Subaru FOCAS IFU instrument by the EMPRESS 3D survey, and investigate H$\alpha$ emission of the EMPGs. Exploiting the resolution high enough for the low-mass galaxies, we derive gas dynamics with the H$\alpha$ lines by the fitting of 3-dimensional disk models. We obtain an average maximum rotation velocity ($v_\mathrm{rot}$) of $15\pm3~\mathrm{km~s^{-1}}$ and an average intrinsic velocity dispersion ($\sigma_0$) of $27\pm10~\mathrm{km~s^{-1}}$ for 15 spatially resolved EMPGs out of the 33 EMPGs, and find that all of the 15 EMPGs have $v_\mathrm{rot}/\sigma_0<1$ suggesting dispersion dominated systems. There is a clear decreasing trend of $v_\mathrm{rot}/\sigma_0$ with the decreasing stellar mass and metallicity. We derive the gas mass fraction ($f_\mathrm{gas}$) for all of the 33 EMPGs, and find no clear dependence on stellar mass and metallicity. These $v_\mathrm{rot}/\sigma_0$ and $f_\mathrm{gas}$ trends should be compared with young high-$z$ galaxies observed by the forthcoming JWST IFS programs to understand the physical origins of the EMPGs in the local universe., Comment: 18 pages, 9 figures, accepted for publication in ApJ

While recent text-to-speech (TTS) systems have made remarkable strides toward human-level quality, the performance of cross-lingual TTS lags behind that of intra-lingual TTS. This gap is mainly rooted from the speaker-language entanglement problem in cross-lingual TTS. In this paper, we propose CrossSpeech which improves the quality of cross-lingual speech by effectively disentangling speaker and language information in the level of acoustic feature space. Specifically, CrossSpeech decomposes the speech generation pipeline into the speaker-independent generator (SIG) and speaker-dependent generator (SDG). The SIG produces the speaker-independent acoustic representation which is not biased to specific speaker distributions. On the other hand, the SDG models speaker-dependent speech variation that characterizes speaker attributes. By handling each information separately, CrossSpeech can obtain disentangled speaker and language representations. From the experiments, we verify that CrossSpeech achieves significant improvements in cross-lingual TTS, especially in terms of speaker similarity to the target speaker., Comment: Accepted to ICASSP 2023

We search for local extremely metal-poor galaxies (EMPGs), selecting photometric candidates by broadband color excess and machine-learning techniques with the SDSS photometric data. After removing stellar contaminants by shallow spectroscopy with Seimei and Nayuta telescopes, we confirm that three candidates are EMPGs with 0.05--0.1 $Z_\odot$ by deep Magellan/MagE spectroscopy for faint {\sc[Oiii]}$\lambda$4363 lines. Using a statistical sample consisting of 105 spectroscopically-confirmed EMPGs taken from our study and the literature, we calculate cross-correlation function (CCF) of the EMPGs and all SDSS galaxies to quantify environments of EMPGs. Comparing another CCF of all SDSS galaxies and comparison SDSS galaxies in the same stellar mass range ($10^{7.0}-10^{8.4} M_\odot$), we find no significant ($>1\sigma$) difference between these two CCFs. We also compare mass-metallicity relations (MZRs) of the EMPGs and those of galaxies at $z\sim$ 0--4 with a steady chemical evolution model and find that the EMPG MZR is comparable with the model prediction on average. These clustering and chemical properties of EMPGs are explained by a scenario of stochastic metal-poor gas accretion on metal-rich galaxies showing metal-poor star formation. Extending the broadband color-excess technique to a high-$z$ EMPG search, we select 17 candidates of $z\sim$ 4--5 EMPGs with the deep ($\simeq30$ mag) near-infrared JWST/NIRCam images obtained by ERO and ERS programs. We find galaxy candidates with negligible {\sc[Oiii]}$\lambda\lambda$4959,5007 emission weaker than the local EMPGs and known high-$z$ galaxies, suggesting that some of these candidates may fall in 0--0.01 $Z_\odot$, which potentially break the lowest metallicity limit known to date.

Question Answering (QA) is a task that entails reasoning over natural language contexts, and many relevant works augment language models (LMs) with graph neural networks (GNNs) to encode the Knowledge Graph (KG) information. However, most existing GNN-based modules for QA do not take advantage of rich relational information of KGs and depend on limited information interaction between the LM and the KG. To address these issues, we propose Question Answering Transformer (QAT), which is designed to jointly reason over language and graphs with respect to entity relations in a unified manner. Specifically, QAT constructs Meta-Path tokens, which learn relation-centric embeddings based on diverse structural and semantic relations. Then, our Relation-Aware Self-Attention module comprehensively integrates different modalities via the Cross-Modal Relative Position Bias, which guides information exchange between relevant entites of different modalities. We validate the effectiveness of QAT on commonsense question answering datasets like CommonsenseQA and OpenBookQA, and on a medical question answering dataset, MedQA-USMLE. On all the datasets, our method achieves state-of-the-art performance. Our code is available at http://github.com/mlvlab/QAT., Comment: AAAI2023 (accepted)

In a novel approach employing implicit likelihood inference (ILI), also known as likelihood-free inference, we calibrate the parameters of cosmological hydrodynamic simulations against observations, which has previously been unfeasible due to the high computational cost of these simulations. For computational efficiency, we train neural networks as emulators on ~1000 cosmological simulations from the CAMELS project to estimate simulated observables, taking as input the cosmological and astrophysical parameters, and use these emulators as surrogates to the cosmological simulations. Using the cosmic star formation rate density (SFRD) and, separately, stellar mass functions (SMFs) at different redshifts, we perform ILI on selected cosmological and astrophysical parameters (Omega_m, sigma_8, stellar wind feedback, and kinetic black hole feedback) and obtain full 6-dimensional posterior distributions. In the performance test, the ILI from the emulated SFRD (SMFs) can recover the target observables with a relative error of 0.17% (0.4%). We find that degeneracies exist between the parameters inferred from the emulated SFRD, confirmed with new full cosmological simulations. We also find that the SMFs can break the degeneracy in the SFRD, which indicates that the SMFs provide complementary constraints for the parameters. Further, we find that the parameter combination inferred from an observationally-inferred SFRD reproduces the target observed SFRD very well, whereas, in the case of the SMFs, the inferred and observed SMFs show significant discrepancies that indicate potential limitations of the current galaxy formation modeling and calibration framework, and/or systematic differences and inconsistencies between observations of the stellar mass function., Comment: This is the revised version from the reviewer's report (submitted to ApJ)

Stars that are tidally disrupted by the massive black hole (MBH) may contribute significantly to the growth of the MBH, especially in dense nuclear star clusters (NSCs). Yet, this tidal disruption accretion (TDA) of stars onto the MBH has largely been overlooked compared to the gas accretion (GA) channel in most numerical experiments until now. In this work, we implement a black hole growth channel via TDA in the high-resolution adaptive mesh refinement code Enzo to investigate its influence on a MBH seed's early evolution. We find that a MBH seed grows rapidly from $10^3\,\mathrm{M}_\odot$ to $\gtrsim 10^6\,\mathrm{M}_\odot$ in 200\,Myrs in some of the tested simulations. Compared to a MBH seed that grows only via GA, TDA can enhance the MBH's growth rate by up to more than an order of magnitude. However, as predicted, TDA mainly helps the early growth of the MBH (from $10^{3-4}\,\mathrm{M}_\odot$ to $\lesssim10^{5}\,\mathrm{M}_\odot$) while the later evolution is generally dominated by GA. We also observe that the star formation near the MBH is suppressed when TDA is most active, sometimes with a visible cavity in gas (of size $\sim$ a few pc) created in the vicinity of the MBH. It is because the MBH may grow expeditiously with both GA and TDA, and the massive MBH could consume its neighboring gas faster than being replenished by gas inflows. Our study demonstrates the need to consider different channels of black hole accretion that may provide clues for the existence of supermassive black holes at high redshifts., Comment: 17 pages, and 10 figures

We investigate the connection of the regulation of star formation and the cycling of baryons within and in and out of galaxies. We use idealized numerical simulations of Milky Way-mass galaxies, in which we systemically vary the galaxy morphology (bulge-to-total mass ratio) and stellar feedback strength (total eight setups with 80 simulations). By following individual gas parcels through the disk, spiral arms, and massive star-forming clumps, we quantify how gas moves and oscillates through the different phases of the interstellar medium (ISM) and forms stars. We show that the residence time of gas in the dense ISM phase ($\tau_{\rm SF}$), the nature of spiral arms (strength, number), and the clump properties (number, mass function, and young star fraction) depend on both the galaxy morphology and stellar feedback. Based on these results, we quantify signatures of the baryon cycle within galaxies using the temporal and spatial power spectrum density (PSD) of the star formation history (SFH). Stronger stellar feedback leads to more bursty star formation while the correlation timescale of the SFH is longer, because stronger feedback dissolves the dense, star-forming ISM phase, leading to a more homogeneous ISM and a decrease in $\tau_{\rm SF}$. The bulge strength has a similar effect: the deep gravitational potential in a bulge-dominant galaxy imposes a strong shear force that effectively breaks apart gas clumps in the ISM; this subsequently inhibits the fragmentation of cool gas and therefore the star formation in the disk, leading to a decrease in the spatial power on scales of $\sim$ 1 kpc. We conclude that measurements of the temporal and spatial PSD of the SFH can provide constraints on the baryon cycle and the star formation process., Comment: 22 pages including 17 figures. Submitted to ApJ

Large diffuse galaxies are hard to find, but understanding the environments where they live, their numbers, and ultimately their origins, is of intense interest and importance for galaxy formation and evolution. Using Subaru's Hyper Suprime-Cam Strategic Survey Program, we perform a systematic search for low surface brightness galaxies and present novel and effective methods for detecting and modeling them. As a case study, we surveyed 922 Milky Way analogs in the nearby Universe ($0.01 < z < 0.04$) and build a large sample of satellite galaxies that are outliers in the mass-size relation. These ``ultra-puffy'' galaxies (UPGs), defined to be $1.5\sigma$ above the average mass-size relation, represent the tail of the satellite size distribution. We find that each MW analog hosts $N_{\rm UPG} = 0.31\pm 0.05$ ultra-puffy galaxies on average, which is consistent with but slightly lower than the observed abundance at this halo mass in the Local Volume. We also construct a sample of ultra-diffuse galaxies (UDGs) in MW analogs and find an abundance of $N_{\rm UDG} = 0.44\pm0.05$ per host. With literature results, we confirm that the UDG abundance scales with the host halo mass following a sublinear power law. We argue that our definition for ultra-puffy galaxies, which is based on the mass-size relation, is more physically-motivated than the common definition of ultra-diffuse galaxies, which depends on surface brightness and size cuts and thus yields different surface mass density cuts for quenched and star-forming galaxies., Comment: 19 pages, 7 figures, ApJ accepted. Also see the companion paper arXiv:2302.14108

We present the result of the Infrared Medium-deep Survey (IMS) $z\sim6$ quasar survey, using the combination of the IMS near-infrared images and the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS) optical images. The traditional color-selection method results in 25 quasar candidates over $86$ deg$^{2}$. We introduce the corrected Akaike Information Criterion (AICc) with the high-redshift quasar and late-type star models to prioritize the candidates efficiently. Among the color-selected candidates, seven plausible candidates finally passed the AICc selection of which three are known quasars at $z\sim6$. The follow-up spectroscopic observations for the remaining four candidates were carried out, and we confirmed that two out of four are $z\sim6$ quasars. With this complete sample, we revisited the quasar space density at $z\sim6$ down to $M_{1450}\sim-23.5$ mag. Our result supports the low quasar space density at the luminosity where the quasar's ultraviolet ionizing emissivity peaks, favoring a minor contribution of quasars to the cosmic reionization., Comment: 21 pages, 13 figures, 4 tables. Accepted for publication in AJ

K-nearest neighbor search is one of the fundamental tasks in various applications and the hierarchical navigable small world (HNSW) has recently drawn attention in large-scale cloud services, as it easily scales up the database while offering fast search. On the other hand, a computational storage device (CSD) that combines programmable logic and storage modules on a single board becomes popular to address the data bandwidth bottleneck of modern computing systems. In this paper, we propose a computational storage platform that can accelerate a large-scale graph-based nearest neighbor search algorithm based on SmartSSD CSD. To this end, we modify the algorithm more amenable on the hardware and implement two types of accelerators using HLS- and RTL-based methodology with various optimization methods. In addition, we scale up the proposed platform to have 4 SmartSSDs and apply graph parallelism to boost the system performance further. As a result, the proposed computational storage platform achieves 75.59 query per second throughput for the SIFT1B dataset at 258.66W power dissipation, which is 12.83x and 17.91x faster and 10.43x and 24.33x more energy efficient than the conventional CPU-based and GPU-based server platform, respectively. With multi-terabyte storage and custom acceleration capability, we believe that the proposed computational storage platform is a promising solution for cost-sensitive cloud datacenters., Comment: Extension of FCCM 20201 and Accepted in Transaction on Computers

We present kinematics of 6 local extremely metal-poor galaxies (EMPGs) with low metallicities ($0.016-0.098\ Z_{\odot}$) and low stellar masses ($10^{4.7}-10^{7.6} M_{\odot}$). Taking deep medium-high resolution ($R\sim7500$) integral-field spectra with 8.2-m Subaru, we resolve the small inner velocity gradients and dispersions of the EMPGs with H$\alpha$ emission. Carefully masking out sub-structures originated by inflow and/or outflow, we fit 3-dimensional disk models to the observed H$\alpha$ flux, velocity, and velocity-dispersion maps. All the EMPGs show rotational velocities ($v_{\rm rot}$) of 5--23 km s$^{-1}$ smaller than the velocity dispersions ($\sigma_{0}$) of 17--31 km s$^{-1}$, indicating dispersion-dominated ($v_{\rm rot}/\sigma_{0}=0.29-0.80<1$) systems affected by inflow and/or outflow. Except for two EMPGs with large uncertainties, we find that the EMPGs have very large gas-mass fractions of $f_{\rm gas}\simeq 0.9-1.0$. Comparing our results with other H$\alpha$ kinematics studies, we find that $v_{\rm rot}/\sigma_{0}$ decreases and $f_{\rm gas}$ increases with decreasing metallicity, decreasing stellar mass, and increasing specific star-formation rate. We also find that simulated high-$z$ ($z\sim 7$) forming galaxies have gas fractions and dynamics similar to the observed EMPGs. Our EMPG observations and the simulations suggest that primordial galaxies are gas-rich dispersion-dominated systems, which would be identified by the forthcoming James Webb Space Telescope (JWST) observations at $z\sim 7$., Comment: ApJ in Press

We present optical-line gas metallicity diagnostics established by the combination of local SDSS galaxies and the largest compilation of extremely metal-poor galaxies (EMPGs) including new EMPGs identified by the Subaru EMPRESS survey. A total of 103 EMPGs are included that cover a large parameter space of magnitude (Mi=-19 to -7) and H-beta equivalent width (10-600 Ang), i.e., wide ranges of stellar mass and star-formation rate. Using reliable metallicity measurements of the direct method for these galaxies, we derive the relationships between strong optical-line ratios and gas-phase metallicity over the range of 12+log(O/H)=~6.9-8.9 corresponding to 0.02-2 solar metallicity Zsun. We confirm that R23-index, ([OIII]+[OII])/H-beta, is the most accurate metallicity indicator with the metallicity uncertainty of 0.14 dex over the range among various popular metallicity indicators. The other metallicity indicators show large scatters in the metal-poor range (<0.1 Zsun). It is explained by our CLOUDY photoionization modeling that, unlike R23-index, the other metallicity indicators do not use a sum of singly and doubly ionized lines and cannot trace both low and high ionization gas. We find that the accuracy of the metallicity indicators is significantly improved, if one uses H-beta equivalent width measurements that tightly correlate with ionization states. In this work, we also present the relation of physical properties with UV-continuum slope beta and ionization production rate xi_ion derived with GALEX data for the EMPGs, and provide local anchors of galaxy properties together with the optical-line metallicity indicators that are available in the form of ASCII table and useful for forthcoming JWST spectroscopic studies., Comment: 33 pages, 14 figures. Accepted for publication in ApJ Supplement Series. Visit https://sci.nao.ac.jp/MEMBER/ouchi/members/nakajima.html for the publicly available table of EMPGs (Table 6)