Search

Student service member/veteran (SSM/V) university enrollment has grown exponentially in recent years. In response, many U.S. universities have developed military-focused student services to address navigational and social challenges SSM/Vs face on campus. While research suggests these services are beneficial, few studies have empirically examined how often contemporary SSM/Vs engage with them across universities, how engagement connects to predictors of university success, or how SSM/Vs describe such connections. Using social capital theory, surveys (n=531), and interviews (n=59) of SSM/Vs across four universities, we analyze SSM/V military-focused service engagement levels, correlations between engagement and campus belonging and institutional satisfaction, and SSM/V perspectives on engagement. Findings suggest SSM/Vs very rarely engage in these services. Higher engagement, however, is significantly associated with more campus belonging and institutional satisfaction. Interviewees describe how the moral support military-focused service staff offer while providing reliable administrative assistance, as well as SSM/V-dedicated spaces and community building, foster belonging and satisfaction.

Asian Americans as a group are overrepresented among STEM college graduates and have the highest average college enrollment rate of any racial or ethnic category. Thus, Asian Americans are typically excluded from educational interventions directed at improving STEM education for Students of Color because they are not considered to be underrepresented minorities. However, statistics obscure the individual needs of the more than 20 ethnic subgroups that fall under the umbrella term Asian Americans. Using a participatory action research approach, this paper documents the institutional and sociocultural factors that push out HMoob (or Hmong) American college students from STEM programs at one large, predominantly White university; and the coordinate processes of gatekeeping and transactional advising that either redirect those students toward non-STEM programs or force them out of the university completely.

This study analyzed Pennsylvania School Climate Survey data from students and staff in the 2021/22 school year to assess the validity and reliability of the elementary school student version of the survey; approaches to scoring the survey in individual schools at all grade levels; and perceptions of school climate across student, staff, and school groups. The survey encourages data-informed efforts in participating Pennsylvania schools to foster supportive learning environments that promote social and emotional wellness for students and staff. The study validated the elementary school student survey but found that one domain--safe and respectful school climate--did not meet the reliability threshold and thus suggests that revisions are needed. At all grade levels noninstructional staff had the most positive perceptions of school climate, followed by classroom teachers then students. The study found that different approaches to combining the school climate scores of students, teachers, and noninstructional staff within schools yielded slightly different distributions of school climate summary index scores. It also found that different performance category thresholds resulted in similar distributions of schools across categories. Scores calculated using simple averages were strongly and positively correlated with scores calculated using a more complex approach (Rasch models), suggesting that both approaches deliver similar information. School climate scores varied across student groups (defined by race/ethnicity, gender, and grade level) within schools and across school groups. Larger schools and schools with higher percentages of Black students tended to have lower school climate scores than other schools. The findings can inform the Pennsylvania Department of Education's decisionmaking on revisions to the elementary school student survey, approaches to scoring and reporting survey results, and efforts to increase participation in future survey administrations.

This article clarifies historical and sociocultural factors that impact the role of STEM in the racialization of Asian Americans. Drawing on critical race and other theories of Asian American racialization, and a review of empirical research on the experiences of Asian American college students in STEM, we develop a conceptual framework called "STEM Asianization" that highlights the role of STEM ideology in the model minority racialization of Asian Americans. Consequences for Asian American students include (1) erasure of the intersectional experiences of minoritized Asian American students; (2) dehumanization of Asian Americans and establishment of a bamboo ceiling; (3) representation of Asian Americans as a perpetual foreigner/Yellow Peril during times of cultural and political crisis; and (4) representation of Asian Americans who cannot or do not conform to the STEM achievement narrative as a failed minority. We argue that STEM Asianization reproduces White supremacy by ideologically reinforcing the colorblind meritocracy of STEM institutions in the United States. [Additional funding provided by the Wisconsin Louis Stokes Alliance for Minority Participation.]

Hybrid school enrollments are trending up and many parents express a diverse range of reasons for enrolling their children in hybrid schools. Yet little is known about the pedagogical goals pursued by hybrid schools. We aim to help close this gap in the literature with a stated preferences experiment of hybrid school leaders' perceptions of program success. Sixty-three school leaders participated in a survey experiment in which we randomly assigned attributes to hypothetical programs and asked school leaders to identify the most successful program. We find that hybrid school leaders consider a broad range of student outcomes when evaluating program success, including labor market outcomes, civic outcomes, and family life. Students' religious observance produced the largest effect sizes, a reasonable finding considering that roughly two-thirds of the schools represented in our sample have some religious affiliation. We do not find evidence that test score outcomes and higher education matriculation contribute meaningfully to perceived success.

Social-emotional development and well-being are integral to the teaching and learning of literacy practices. This introductory brief focuses on the underlying science of how thinking, feeling, and perceptions along multiple dimensions interact to influence what we do as learners. This brief draws on the work of scholars in the fields of neuroscience, psychology, human development, learning sciences, literacy, and social and emotional learning (SEL) to provide a grounding framework for understanding the relationship between social-emotional development and literacy development. This brief also provides concrete examples of how supporting the five core competencies of SEL -- self-awareness, self-management, social awareness, relationship skills, and responsible decision-making -- can support students' literacy development, and vice versa. Finally, informed by the civic goals of public education, this brief also documents the relationship between social and emotional learning and literacy development are central to civic reasoning and discourse.

Brain signals accompany various information relevant to human actions and mental imagery, making them crucial to interpreting and understanding human intentions. Brain-computer interface technology leverages this brain activity to generate external commands for controlling the environment, offering critical advantages to individuals with paralysis or locked-in syndrome. Within the brain-computer interface domain, brain-to-speech research has gained attention, focusing on the direct synthesis of audible speech from brain signals. Most current studies decode speech from brain activity using invasive techniques and emphasize spoken speech data. However, humans express various speech states, and distinguishing these states through non-invasive approaches remains a significant yet challenging task. This research investigated the effectiveness of deep learning models for non-invasive-based neural signal decoding, with an emphasis on distinguishing between different speech paradigms, including perceived, overt, whispered, and imagined speech, across multiple frequency bands. The model utilizing the spatial conventional neural network module demonstrated superior performance compared to other models, especially in the gamma band. Additionally, imagined speech in the theta frequency band, where deep learning also showed strong effects, exhibited statistically significant differences compared to the other speech paradigms.

Interpreting human neural signals to decode static speech intentions such as text or images and dynamic speech intentions such as audio or video is showing great potential as an innovative communication tool. Human communication accompanies various features, such as articulatory movements, facial expressions, and internal speech, all of which are reflected in neural signals. However, most studies only generate short or fragmented outputs, while providing informative communication by leveraging various features from neural signals remains challenging. In this study, we introduce a dynamic neural communication method that leverages current computer vision and brain-computer interface technologies. Our approach captures the user's intentions from neural signals and decodes visemes in short time steps to produce dynamic visual outputs. The results demonstrate the potential to rapidly capture and reconstruct lip movements during natural speech attempts from human neural signals, enabling dynamic neural communication through the convergence of computer vision and brain--computer interface., Comment: 4 pages, 2 figures, 1 table, Name of Conference: International Conference on Brain-Computer Interface

The Atacama Large Millimeter/submillimeter Array Survey of Orion Planck Galactic Cold Clumps (ALMASOP) reveals complex nested morphological and kinematic features of molecular outflows through the CO (J = 2 - 1) and SiO (J = 5 - 4) emission. We characterize the jet and outflow kinematics of the ALMASOP sample in four representative sources (HOPS 10, 315, 358, and G203.21-11.20W2) through channel maps and position-velocity diagrams (PVDs) parallel and transverse to the outflow axes. The combined CO and SiO emission exhibits the coexistence of the conventional extremely-high-velocity (EHV) jets and shell-like low-velocity (LV) cavity walls and new features. More complex, nested bubble-like and filamentary structures in the images and channel maps, triangle-shaped regions near the base of the parallel PVDs, and regions composed of rhombus/oval shapes in the transverse PVDs, are also evident. Such features find natural explanations within the bubble structure of the unified model of jet, wind, and ambient medium. The reverse shock cavity is revealed on the PVD base regions, and other features naturally arise within the dynamic postshock region of magnetic interaction. The finer nested shells observed within the compressed wind region reveal previously unnoticed shocked emission between the jet and the conventional large cavity walls. These pseudopulse-produced filamentary features connect to the jet-like knotty blobs, creating an impression of episodicity in mass ejection. SiO emission is enhanced downstream of the reverse shock boundary, with jet-like excitation conditions. Combined, these observed features reveal the extended structures induced by the magnetic interplay between a jet-bearing magnetized wide-angle wind and its ambient magnetized surrounding medium., Comment: 27 pages, 11 figures, accepted by ApJ

We carried out a project involving the systematic analysis of microlensing data from the Korea Microlensing Telescope Network survey. The aim of this project is to identify lensing events with complex anomaly features that are difficult to explain using standard binary-lens or binary-source models. Our investigation reveals that the light curves of microlensing events KMT-2021-BLG-0284, KMT-2022-BLG-2480, and KMT-2024-BLG-0412 display highly complex patterns with three or more anomaly features. These features cannot be adequately explained by a binary-lens (2L1S) model alone. However, the 2L1S model can effectively describe certain segments of the light curve. By incorporating an additional source into the modeling, we identified a comprehensive model that accounts for all the observed anomaly features. Bayesian analysis, based on constraints provided by lensing observables, indicates that the lenses of KMT-2021-BLG-0284 and KMT-2024-BLG-0412 are binary systems composed of M dwarfs. For KMT-2022-BLG-2480, the primary lens is an early K-type main-sequence star with an M dwarf companion. The lenses of KMT-2021-BLG-0284 and KMT-2024-BLG-0412 are likely located in the bulge, whereas the lens of KMT-2022-BLG-2480 is more likely situated in the disk. In all events, the binary stars of the sources have similar magnitudes due to a detection bias favoring binary source events with a relatively bright secondary source star, which increases detection efficiency., Comment: 9 pages, 9 figures

Rapid progress in precision nanofabrication and atomic design over the past 50 years has ushered in a succession of transformative eras for molding the generation and flow of light. The use of nanoscale and atomic features to design light sources and optical elements-encapsulated by the term nanophotonics-has led to new fundamental science and innovative technologies across the entire electromagnetic spectrum, with substantial emphasis on the microwave to visible regimes. In this review, we pay special attention to the impact and potential of nanophotonics in a relatively exotic yet technologically disruptive regime: high-energy particles such as X-ray photons and free electrons-where nanostructures and atomic design open the doors to unprecedented technologies in quantum science and versatile X-ray sources and optics. As the practical generation of X-rays is intrinsically linked to the existence of energetic free or quasi-free-electrons, our review will also capture related phenomena and technologies that combine free electrons with nanophotonics, including free-electron-driven nanophotonics at other photon energies. In particular, we delve into the demonstration and study of quantum recoil in the X-ray regime, the study of nanomaterial design and free-electron wave shaping as means to enhance and control X-ray radiation, examine the free-electron generation enabled by nanophotonics, and analyze the high-harmonic generation by quasi-free electrons. We also discuss applications of quantum nanophotonics for X-rays and free electrons, including nanostructure waveguides for X-rays, photon pair enhanced X-ray imaging, mirrors, and lenses for X-rays, among others.

This paper presents a bimanual haptic display based on collaborative robot arms. We address the limitations of existing robot arm-based haptic displays by optimizing the setup configuration and implementing inertia/friction compensation techniques. The optimized setup configuration maximizes workspace coverage, dexterity, and haptic feedback capability while ensuring collision safety. Inertia/friction compensation significantly improve transparency and reduce user fatigue, leading to a more seamless and transparent interaction. The effectiveness of our system is demonstrated in various applications, including bimanual bilateral teleoperation in both real and simulated environments. This research contributes to the advancement of haptic technology by presenting a practical and effective solution for creating high-performance bimanual haptic displays using collaborative robot arms., Comment: Part of proceedings of 6th International Conference AsiaHaptics 2024

Eye gaze is considered a promising interaction modality in extende reality (XR) environments. However, determining selection intention from gaze data often requires additional manual selection techniques. We present a Bayesian-based machine learning (ML) model to predict user selection intention in real-time using only gaze data. Our model uses a Bayesian approach to transform gaze data into selection probabilities, which are then fed into an ML model to discriminate selection intentions. In Study 1, our model achieved real-time inference with an accuracy of 0.97 and an F1 score of 0.96. In Study 2, we found that the selection intention inferred by our model enables more comfortable and accurate interactions compared to traditional techniques., Comment: 18 pages, 6 figures, 2 Tables

Fine-tuning pre-trained models for downstream tasks is a widely adopted technique known for its adaptability and reliability across various domains. Despite its conceptual simplicity, fine-tuning entails several troublesome engineering choices, such as selecting hyperparameters and determining checkpoints from an optimization trajectory. To tackle the difficulty of choosing the best model, one effective solution is model fusion, which combines multiple models in a parameter space. However, we observe a large discrepancy between loss and metric landscapes during the fine-tuning of pre-trained language models. Building on this observation, we introduce a novel model fusion technique that optimizes both the desired metric and loss through multi-objective Bayesian optimization. In addition, to effectively select hyperparameters, we establish a two-stage procedure by integrating Bayesian optimization processes into our framework. Experiments across various downstream tasks show considerable performance improvements using our Bayesian optimization-guided method.

Neural additive model (NAM) is a recently proposed explainable artificial intelligence (XAI) method that utilizes neural network-based architectures. Given the advantages of neural networks, NAMs provide intuitive explanations for their predictions with high model performance. In this paper, we analyze a critical yet overlooked phenomenon: NAMs often produce inconsistent explanations, even when using the same architecture and dataset. Traditionally, such inconsistencies have been viewed as issues to be resolved. However, we argue instead that these inconsistencies can provide valuable explanations within the given data model. Through a simple theoretical framework, we demonstrate that these inconsistencies are not mere artifacts but emerge naturally in datasets with multiple important features. To effectively leverage this information, we introduce a novel framework, Bayesian Neural Additive Model (BayesNAM), which integrates Bayesian neural networks and feature dropout, with theoretical proof demonstrating that feature dropout effectively captures model inconsistencies. Our experiments demonstrate that BayesNAM effectively reveals potential problems such as insufficient data or structural limitations of the model, providing more reliable explanations and potential remedies., Comment: Under Review

Generative retrieval has recently emerged as a new alternative of traditional information retrieval approaches. However, existing generative retrieval methods directly decode docid when a query is given, making it impossible to provide users with explanations as an answer for "Why this document is retrieved?". To address this limitation, we propose Hierarchical Category Path-Enhanced Generative Retrieval(HyPE), which enhances explainability by generating hierarchical category paths step-by-step before decoding docid. HyPE leverages hierarchical category paths as explanation, progressing from broad to specific semantic categories. This approach enables diverse explanations for the same document depending on the query by using shared category paths between the query and the document, and provides reasonable explanation by reflecting the document's semantic structure through a coarse-to-fine manner. HyPE constructs category paths with external high-quality semantic hierarchy, leverages LLM to select appropriate candidate paths for each document, and optimizes the generative retrieval model with path-augmented dataset. During inference, HyPE utilizes path-aware reranking strategy to aggregate diverse topic information, allowing the most relevant documents to be prioritized in the final ranked list of docids. Our extensive experiments demonstrate that HyPE not only offers a high level of explainability but also improves the retrieval performance in the document retrieval task.

Multimodal foundation models, such as Gemini and ChatGPT, have revolutionized human-machine interactions by seamlessly integrating various forms of data. Developing a universal spoken language model that comprehends a wide range of natural language instructions is critical for bridging communication gaps and facilitating more intuitive interactions. However, the absence of a comprehensive evaluation benchmark poses a significant challenge. We present Dynamic-SUPERB Phase-2, an open and evolving benchmark for the comprehensive evaluation of instruction-based universal speech models. Building upon the first generation, this second version incorporates 125 new tasks contributed collaboratively by the global research community, expanding the benchmark to a total of 180 tasks, making it the largest benchmark for speech and audio evaluation. While the first generation of Dynamic-SUPERB was limited to classification tasks, Dynamic-SUPERB Phase-2 broadens its evaluation capabilities by introducing a wide array of novel and diverse tasks, including regression and sequence generation, across speech, music, and environmental audio. Evaluation results indicate that none of the models performed well universally. SALMONN-13B excelled in English ASR, while WavLLM demonstrated high accuracy in emotion recognition, but current models still require further innovations to handle a broader range of tasks. We will soon open-source all task data and the evaluation pipeline.

A new 2,400 L liquid scintillator has been produced for the COSINE-100 Upgrade, which is under construction at Yemilab for the next COSINE dark matter experiment phase. The linear-alkyl-benzene-based scintillator is designed to serve as a veto for NaI(Tl) crystal targets and a separate platform for rare event searches. We measured using a sample consisting of a custom-made 445 mL cylindrical Teflon container equipped with two 3-inch photomultiplier tubes. Analyses show activity levels of $0.091 \pm 0.042$ mBq/kg for $^{238}$U and $0.012 \pm 0.007$ mBq/kg for $^{232}$Th.

We proposed a haptic dial based on magnetorheological fluid (MRF) which enhances performance by increasing the MRF-exposed area through concave shaft and housing structure. We developed a breakout-style game to show that the proposed haptic dial allows users to efficiently interact with virtual objects., Comment: Part of proceedings of 6th International Conference AsiaHaptics 2024

To increase social bonding with interlocutors, humans naturally acquire the ability to respond appropriately in a given situation by considering which conversational skill is most suitable for the response - a process we call skill-of-mind. For large language model (LLM)-based conversational agents, planning appropriate conversational skills, as humans do, is challenging due to the complexity of social dialogue, especially in interactive scenarios. To address this, we propose a skill-of-mind-annotated conversation dataset, named Multifaceted Skill-of-Mind, which includes multi-turn and multifaceted conversational skills across various interactive scenarios (e.g., long-term, counseling, task-oriented), grounded in diverse social contexts (e.g., demographics, persona, rules of thumb). This dataset consists of roughly 100K conversations. Using this dataset, we introduce a new family of skill-of-mind-infused LLMs, named Thanos, with model sizes of 1B, 3B, and 8B parameters. With extensive experiments, these models successfully demonstrate the skill-of-mind process and exhibit strong generalizability in inferring multifaceted skills across a variety of domains. Moreover, we show that Thanos significantly enhances the quality of responses generated by LLM-based conversational agents and promotes prosocial behavior in human evaluations., Comment: Code: https://github.com/passing2961/Thanos

Anomalous transverse transport of electrons such as the anomalous Hall effect and the anomalous Nernst effect provide opportunities to realize advanced spintronic and thermoelectric devices. To materialize these opportunities, it is crucial to strengthen the transverse transport. There have been considerable efforts to find new materials that fulfill this goal. Topological materials received a surge of recent attention in this regard. Here we report a different approach to enhance the transverse transport. Instead of searching for new materials, we propose mixing known materials to form composites. We show theoretically that randomly mixed arrays of two materials can exhibit significantly stronger transverse transport than the constituent materials. This enhancement is experimentally demonstrated for mixtures of crystallized and amorphous ferromagnetic metals. We identify the requirement of this enhancement, which can be satisfied by a wide class of materials. Thus, this scheme provides a universal method to strengthen transverse transport, together with rooms to accommodate various engineering requirements for device applications.

We present an investigation of Complex Organic Molecules (COMs) in the spatially resolved Keplerian disk around V883 Ori, an eruptive young star, based on a spectral survey carried out with ALMA in Band 6 (220.7$-$274.9 GHz). We identified about 3,700 molecular emission lines and discovered 23 COMs in the disk. We estimated the column densities of COMs detected through the iterative LTE line fitting method. According to our analyses, using only optically thin lines is critical to deriving the reliable column densities of COMs. Therefore, covering a large frequency range is important for the studies of COMs. The most distinct phenomenon found from the spectra of the V883 Ori disk is that nitrogen-bearing COMs other than CH$_{3}$CN are missing, whereas various oxygen-bearing COMs, except for the CH$_2$OH-bearing molecules, are detected. The missing CH$_2$OH-bearing COMs may indicate the warm water-ice dominant environment for forming COMs. We compared our results with various objects in different evolutionary stages, from Class 0 hot corinos to a Solar System comet 67P/Churyumov-Gerasimenko, to examine the effect of evolution on the COM compositions. In general, the COMs abundances relative to methanol in V883 Ori are higher than in the hot corinos and hot cores, while they are comparable to the cometary values. This may indicate the planet-forming material chemically evolves in the disk midplane after being accreted from the envelope. In addition, as found in the comet 67P/Churyumov-Gerasimenko, nitrogen might also be trapped as ammonium salt within the dust grains in the V883 Ori disk., Comment: Accepted for publication in ApJS

Occupational mobility is an emergent strategy to cope with technological unemployment by facilitating efficient labor redeployment. However, previous studies analyzing networks show that the boundaries to smooth mobility are constrained by a fragmented structure in the occupation network. In this study, positing that this structure will significantly change due to automation, we propose the skill automation view, which asserts that automation substitutes for skills, not for occupations, and simulate a scenario of skill automation drawing on percolation theory. We sequentially remove skills from the occupation-skill bipartite network and investigate the structural changes in the projected occupation network. The results show that the accumulation of small changes (the emergence of bridges between occupations due to skill automation) triggers significant structural changes in the occupation network. The structural changes accelerate as the components integrate into a new giant component. This result suggests that automation mitigates the bottlenecks to smooth occupational mobility.

This document is comprised of a collection of updated preliminary parameters for the key parts of the muon collider. The updated preliminary parameters follow on from the October 2023 Tentative Parameters Report. Particular attention has been given to regions of the facility that are believed to hold greater technical uncertainty in their design and that have a strong impact on the cost and power consumption of the facility. The data is collected from a collaborative spreadsheet and transferred to overleaf.

While piano music has become a significant area of study in Music Information Retrieval (MIR), there is a notable lack of datasets for piano solo music with text labels. To address this gap, we present PIAST (PIano dataset with Audio, Symbolic, and Text), a piano music dataset. Utilizing a piano-specific taxonomy of semantic tags, we collected 9,673 tracks from YouTube and added human annotations for 2,023 tracks by music experts, resulting in two subsets: PIAST-YT and PIAST-AT. Both include audio, text, tag annotations, and transcribed MIDI utilizing state-of-the-art piano transcription and beat tracking models. Among many possible tasks with the multi-modal dataset, we conduct music tagging and retrieval using both audio and MIDI data and report baseline performances to demonstrate its potential as a valuable resource for MIR research., Comment: Accepted for publication at the 3rd Workshop on NLP for Music and Audio (NLP4MusA 2024)

We study the instability of antiferromagnets with easy-axis anisotropy under a magnetic field, uncovering single or even multiple phase transitions at the boundary between non-collinear and collinear spin orderings. Near the phase boundary, the entanglement between the sublattice magnons diverges due to the interplay among antiferromagnetic exchange interaction, anisotropy, and magnetic field. Furthermore, our study reveals that this magnetic criticality extends to a superradiant phase transition within cavity magnonics systems. The magnon-photon interaction results in diverging cavity photon numbers and squeezing in the ground state at the transition points between spin orderings. This investigation not only elucidates the criticality of multi-component squeezed magnons in antiferromagnets, but also proposes cavity photon measurements as a viable method for detecting magnetic phase transitions., Comment: 9 pages, 4 figures

We present 850 $\mu$m polarization observations of the IC 348 star-forming region in the Perseus molecular cloud as part of the B-fields In STar-forming Region Observation (BISTRO) survey. We study the magnetic properties of two cores (HH 211 MMS and IC 348 MMS) and a filamentary structure of IC 348. We find that the overall field tends to be more perpendicular than parallel to the filamentary structure of the region. The polarization fraction decreases with intensity, and we estimate the trend by power-law and the mean of the Rice distribution fittings. The power indices for the cores are much smaller than 1, indicative of possible grain growth to micron size in the cores. We also measure the magnetic field strengths of the two cores and the filamentary area separately by applying the Davis-Chandrasekhar-Fermi method and its alternative version for compressed medium. The estimated mass-to-flux ratios are 0.45-2.20 and 0.63-2.76 for HH 211 MMS and IC 348 MMS, respectively, while the ratios for the filament is 0.33-1.50. This result may suggest that the transition from subcritical to supercritical conditions occurs at the core scale ($\sim$ 0.05 pc) in the region. In addition, we study the energy balance of the cores and find that the relative strength of turbulence to the magnetic field tends to be stronger for IC 348 MMS than HH 211 MMS. The result could potentially explain the different configurations inside the two cores: a single protostellar system in HH 211 MMS and multiple protostars in IC 348 MMS., Comment: Accepted for publication in ApJ. 21 pages, 12 figures

Metallic glass is a frozen liquid with structural disorder that retains degenerate free energy without spontaneous symmetry breaking to become a solid. For over half a century, this puzzling structure has raised fundamental questions about how structural disorder impacts glass-liquid phase transition kinetics, which remain elusive without direct evidence. In this study, through single-pulse, time-resolved imaging using X-ray free-electron lasers, we visualized the glass-to-liquid transition, revealing a previously hidden dormant phase that does not involve any macroscopic volume change within the crossover regime between the two phases. Although macroscopically inactive, nanoscale redistribution occurs, forming channeld low-density bands within this dormant phase that drives the glass transition. By providing direct microscopic evidence, this work presents a new perspective on the phase transition process in disordered materials, which can be extended to various liquid and solid phases in other complex systems., Comment: 25 pages, 4 figures

Referring Image Segmentation is a comprehensive task to segment an object referred by a textual query from an image. In nature, the level of difficulty in this task is affected by the existence of similar objects and the complexity of the referring expression. Recent RIS models still show a significant performance gap between easy and hard scenarios. We pose that the bottleneck exists in the data, and propose a simple but powerful data augmentation method, Negative-mined Mosaic Augmentation (NeMo). This method augments a training image into a mosaic with three other negative images carefully curated by a pretrained multimodal alignment model, e.g., CLIP, to make the sample more challenging. We discover that it is critical to properly adjust the difficulty level, neither too ambiguous nor too trivial. The augmented training data encourages the RIS model to recognize subtle differences and relationships between similar visual entities and to concretely understand the whole expression to locate the right target better. Our approach shows consistent improvements on various datasets and models, verified by extensive experiments., Comment: Accepted at ECCV 2024. Project page: https://dddonghwa.github.io/NeMo/

Pt-based electrocatalysts are the primary choice for fuel cells due to their superior oxygen reduction reaction (ORR) activity. To enhance ORR performance and durability, extensive studies have investigated transition metal alloying, doping, and shape control to optimize the three key governing factors for ORR: geometry, local chemistry, and strain of their surface and subsurface. However, systematic optimization remains incomplete, as it requires an atomic-scale understanding of these factors and their dynamics over potential cycling, as well as their relationship to ORR activity. Here, we implement neural network-assisted atomic electron tomography to measure the 3D atomic structural dynamics and their effects on the functional degradation of PtNi alloy catalysts. Our results reveal that PtNi catalysts undergo shape changes, surface alloying, and strain relaxation during cycling, which can be effectively mitigated by Ga doping. By combining geometry, local chemistry, and strain analysis, we calculated the changes in ORR activity over thousands of cycles and observed that Ga doping leads to higher initial activity and greater stability. These findings offer a pathway to understanding 3D atomic structural dynamics and their relation to ORR activity during cycling, paving the way for the systematic design of durable, high-efficiency nanocatalysts., Comment: 45 pages, 4 main figures, 15 supplementary figures

In this study, we introduce FEET, a standardized protocol designed to guide the development and benchmarking of foundation models. While numerous benchmark datasets exist for evaluating these models, we propose a structured evaluation protocol across three distinct scenarios to gain a comprehensive understanding of their practical performance. We define three primary use cases: frozen embeddings, few-shot embeddings, and fully fine-tuned embeddings. Each scenario is detailed and illustrated through two case studies: one in sentiment analysis and another in the medical domain, demonstrating how these evaluations provide a thorough assessment of foundation models' effectiveness in research applications. We recommend this protocol as a standard for future research aimed at advancing representation learning models., Comment: Findings paper presented at Machine Learning for Health (ML4H) symposium 2024, December 15-16, 2024, Vancouver, Canada, 11 pages

In the study of orbital angular momentum (OAM), the focus has been predominantly on the intra-atomic contribution. However, recent research has begun to shift towards exploring the inter-atomic contribution to OAM dynamics. In this paper, we investigate the orbital Edelstein effect (OEE) arising from the inter-atomic OAM at the edges. We explore the OAM texture within edge states and unveil the OAM accumulation at the edges using several lattice models based on the $s$ orbital. By comparing slabs with differently shaped edges, we not only clarify the role of electron wiggling motion in shaping OAM texture but also highlight the absence of bulk-boundary correspondence in the accumulation process. The topological insulator and higher-order topological insulator models further confirm these findings and provide evidence for the relationship between the higher-order topology and the OEE. Our study advances the comprehension of orbital physics and extends its scope to higher-order topological insulators., Comment: 9 pages, 4 figures, Physical Review B accepted version

Rectified flow and reflow procedures have significantly advanced fast generation by progressively straightening ordinary differential equation (ODE) flows. They operate under the assumption that image and noise pairs, known as couplings, can be approximated by straight trajectories with constant velocity. However, we observe that modeling with constant velocity and using reflow procedures have limitations in accurately learning straight trajectories between pairs, resulting in suboptimal performance in few-step generation. To address these limitations, we introduce Constant Acceleration Flow (CAF), a novel framework based on a simple constant acceleration equation. CAF introduces acceleration as an additional learnable variable, allowing for more expressive and accurate estimation of the ODE flow. Moreover, we propose two techniques to further improve estimation accuracy: initial velocity conditioning for the acceleration model and a reflow process for the initial velocity. Our comprehensive studies on toy datasets, CIFAR-10, and ImageNet 64x64 demonstrate that CAF outperforms state-of-the-art baselines for one-step generation. We also show that CAF dramatically improves few-step coupling preservation and inversion over Rectified flow. Code is available at \href{https://github.com/mlvlab/CAF}{https://github.com/mlvlab/CAF}.

To train a deblurring network, an appropriate dataset with paired blurry and sharp images is essential. Existing datasets collect blurry images either synthetically by aggregating consecutive sharp frames or using sophisticated camera systems to capture real blur. However, these methods offer limited diversity in blur types (blur trajectories) or require extensive human effort to reconstruct large-scale datasets, failing to fully reflect real-world blur scenarios. To address this, we propose GS-Blur, a dataset of synthesized realistic blurry images created using a novel approach. To this end, we first reconstruct 3D scenes from multi-view images using 3D Gaussian Splatting (3DGS), then render blurry images by moving the camera view along the randomly generated motion trajectories. By adopting various camera trajectories in reconstructing our GS-Blur, our dataset contains realistic and diverse types of blur, offering a large-scale dataset that generalizes well to real-world blur. Using GS-Blur with various deblurring methods, we demonstrate its ability to generalize effectively compared to previous synthetic or real blur datasets, showing significant improvements in deblurring performance., Comment: Accepted at NeurIPS 2024 Datasets & Benchmarks Track

Mamba has recently emerged as a promising alternative to Transformers, offering near-linear complexity in processing sequential data. However, while channels in time series (TS) data have no specific order in general, recent studies have adopted Mamba to capture channel dependencies (CD) in TS, introducing a sequential order bias. To address this issue, we propose SOR-Mamba, a TS forecasting method that 1) incorporates a regularization strategy to minimize the discrepancy between two embedding vectors generated from data with reversed channel orders, thereby enhancing robustness to channel order, and 2) eliminates the 1D-convolution originally designed to capture local information in sequential data. Furthermore, we introduce channel correlation modeling (CCM), a pretraining task aimed at preserving correlations between channels from the data space to the latent space in order to enhance the ability to capture CD. Extensive experiments demonstrate the efficacy of the proposed method across standard and transfer learning scenarios. Code is available at https://github.com/seunghan96/SOR-Mamba., Comment: NeurIPS Workshop on Time Series in the Age of Large Models, 2024

Federated Learning (FL) is a distributed machine learning framework that trains accurate global models while preserving clients' privacy-sensitive data. However, most FL approaches assume that clients possess labeled data, which is often not the case in practice. Federated Semi-Supervised Learning (FSSL) addresses this label deficiency problem, targeting situations where only the server has a small amount of labeled data while clients do not. However, a significant performance gap exists between Centralized Semi-Supervised Learning (SSL) and FSSL. This gap arises from confirmation bias, which is more pronounced in FSSL due to multiple local training epochs and the separation of labeled and unlabeled data. We propose $(FL)^2$, a robust training method for unlabeled clients using sharpness-aware consistency regularization. We show that regularizing the original pseudo-labeling loss is suboptimal, and hence we carefully select unlabeled samples for regularization. We further introduce client-specific adaptive thresholding and learning status-aware aggregation to adjust the training process based on the learning progress of each client. Our experiments on three benchmark datasets demonstrate that our approach significantly improves performance and bridges the gap with SSL, particularly in scenarios with scarce labeled data., Comment: Accepted to NeurIPS 2024

Recent advancements in foundation models have been successfully extended to the time series (TS) domain, facilitated by the emergence of large-scale TS datasets. However, previous efforts have primarily focused on designing model architectures to address explicit heterogeneity among datasets such as various numbers of channels, while often overlooking implicit heterogeneity such as varying dependencies between channels. In this work, we introduce the concept of partial channel dependence (PCD), which enables a more sophisticated adjustment of channel dependencies based on dataset-specific information. To achieve PCD, we propose a channel mask that captures the relationships between channels within a dataset using two key components: 1) a correlation matrix that encodes relative dependencies between channels, and 2) domain parameters that learn the absolute dependencies specific to each dataset, refining the correlation matrix. We validate the effectiveness of PCD across four tasks in TS including forecasting, classification, imputation, and anomaly detection, under diverse settings, including few-shot and zero-shot scenarios with both TS foundation models and single-task models. Code is available at https://github.com/seunghan96/CM., Comment: NeurIPS Workshop on Time Series in the Age of Large Models, 2024. Oral presentation

With the advancement of chatbots and the growing demand for automatic depression detection, identifying depression in patient conversations has gained more attention. However, prior methods often assess depression in a binary way or only a single score without diverse feedback and lack focus on enhancing dialogue responses. In this paper, we present a novel task of multi-aspect depression severity assessment via an inductive dialogue system (MaDSA), evaluating a patient's depression level on multiple criteria by incorporating an assessment-aided response generation. Further, we propose a foundational system for MaDSA, which induces psychological dialogue responses with an auxiliary emotion classification task within a hierarchical severity assessment structure. We synthesize the conversational dataset annotated with eight aspects of depression severity alongside emotion labels, proven robust via human evaluations. Experimental results show potential for our preliminary work on MaDSA.

Very-high-energy (0.1-100 TeV) gamma-ray emission was observed in HAWC data from the lobes of the microquasar SS 433, making them the first set of astrophysical jets that were resolved at TeV energies. In this work, we update the analysis of SS 433 using 2,565 days of data from the High Altitude Water Cherenkov (HAWC) observatory. Our analysis reports the detection of a point-like source in the east lobe at a significance of $6.6\,\sigma$ and in the west lobe at a significance of $8.2\,\sigma$. For each jet lobe, we localize the gamma-ray emission and identify a best-fit position. The locations are close to the X-ray emission sites "e1" and "w1" for the east and west lobes, respectively. We analyze the spectral energy distributions and find that the energy spectra of the lobes are consistent with a simple power-law $\text{d}N/\text{d}E\propto E^{\alpha}$ with $\alpha = -2.44^{+0.13+0.04}_{-0.12-0.04}$ and $\alpha = -2.35^{+0.12+0.03}_{-0.11-0.03}$ for the east and west lobes, respectively. The maximum energy of photons from the east and west lobes reaches 56 TeV and 123 TeV, respectively. We compare our observations to various models and conclude that the very-high-energy gamma-ray emission can be produced by a population of electrons that were efficiently accelerated.

Recent advances in 3D object detection leveraging multi-view cameras have demonstrated their practical and economical value in various challenging vision tasks. However, typical supervised learning approaches face challenges in achieving satisfactory adaptation toward unseen and unlabeled target datasets (\ie, direct transfer) due to the inevitable geometric misalignment between the source and target domains. In practice, we also encounter constraints on resources for training models and collecting annotations for the successful deployment of 3D object detectors. In this paper, we propose Unified Domain Generalization and Adaptation (UDGA), a practical solution to mitigate those drawbacks. We first propose Multi-view Overlap Depth Constraint that leverages the strong association between multi-view, significantly alleviating geometric gaps due to perspective view changes. Then, we present a Label-Efficient Domain Adaptation approach to handle unfamiliar targets with significantly fewer amounts of labels (\ie, 1$\%$ and 5$\%)$, while preserving well-defined source knowledge for training efficiency. Overall, UDGA framework enables stable detection performance in both source and target domains, effectively bridging inevitable domain gaps, while demanding fewer annotations. We demonstrate the robustness of UDGA with large-scale benchmarks: nuScenes, Lyft, and Waymo, where our framework outperforms the current state-of-the-art methods., Comment: Accepted to NeurIPS 2024

Recently, large language models (LLMs) have been increasingly used to support various decision-making tasks, assisting humans in making informed decisions. However, when LLMs confidently provide incorrect information, it can lead humans to make suboptimal decisions. To prevent LLMs from generating incorrect information on topics they are unsure of and to improve the accuracy of generated content, prior works have proposed Retrieval Augmented Generation (RAG), where external documents are referenced to generate responses. However, traditional RAG methods focus only on retrieving documents most relevant to the input query, without specifically aiming to ensure that the human user's decisions are well-calibrated. To address this limitation, we propose a novel retrieval method called Calibrated Retrieval-Augmented Generation (CalibRAG), which ensures that decisions informed by the retrieved documents are well-calibrated. Then we empirically validate that CalibRAG improves calibration performance as well as accuracy, compared to other baselines across various datasets.

Narrow passage path planning is a prevalent problem from industrial to household sites, often facing difficulties in finding feasible paths or requiring excessive computational resources. Given that deep penetration into the environment can cause optimization failure, we propose a framework to ensure feasibility throughout the process using a series of subproblems tailored for narrow passage problem. We begin by decomposing the environment into convex objects and initializing collision constraints with a subset of these objects. By continuously interpolating the collision constraints through the process of sequentially introducing remaining objects, our proposed framework generates subproblems that guide the optimization toward solving the narrow passage problem. Several examples are presented to demonstrate how the proposed framework addresses narrow passage path planning problems., Comment: 7 pages, 7 figure

Omnidirectional (or 360-degree) images are increasingly being used for 3D applications since they allow the rendering of an entire scene with a single image. Existing works based on neural radiance fields demonstrate successful 3D reconstruction quality on egocentric videos, yet they suffer from long training and rendering times. Recently, 3D Gaussian splatting has gained attention for its fast optimization and real-time rendering. However, directly using a perspective rasterizer to omnidirectional images results in severe distortion due to the different optical properties between two image domains. In this work, we present ODGS, a novel rasterization pipeline for omnidirectional images, with geometric interpretation. For each Gaussian, we define a tangent plane that touches the unit sphere and is perpendicular to the ray headed toward the Gaussian center. We then leverage a perspective camera rasterizer to project the Gaussian onto the corresponding tangent plane. The projected Gaussians are transformed and combined into the omnidirectional image, finalizing the omnidirectional rasterization process. This interpretation reveals the implicit assumptions within the proposed pipeline, which we verify through mathematical proofs. The entire rasterization process is parallelized using CUDA, achieving optimization and rendering speeds 100 times faster than NeRF-based methods. Our comprehensive experiments highlight the superiority of ODGS by delivering the best reconstruction and perceptual quality across various datasets. Additionally, results on roaming datasets demonstrate that ODGS restores fine details effectively, even when reconstructing large 3D scenes. The source code is available on our project page (https://github.com/esw0116/ODGS).

Navigating the vast chemical space of druggable compounds is a formidable challenge in drug discovery, where generative models are increasingly employed to identify viable candidates. Conditional 3D structure-based drug design (3D-SBDD) models, which take into account complex three-dimensional interactions and molecular geometries, are particularly promising. Scaffold hopping is an efficient strategy that facilitates the identification of similar active compounds by strategically modifying the core structure of molecules, effectively narrowing the wide chemical space and enhancing the discovery of drug-like products. However, the practical application of 3D-SBDD generative models is hampered by their slow processing speeds. To address this bottleneck, we introduce TurboHopp, an accelerated pocket-conditioned 3D scaffold hopping model that merges the strategic effectiveness of traditional scaffold hopping with rapid generation capabilities of consistency models. This synergy not only enhances efficiency but also significantly boosts generation speeds, achieving up to 30 times faster inference speed as well as superior generation quality compared to existing diffusion-based models, establishing TurboHopp as a powerful tool in drug discovery. Supported by faster inference speed, we further optimize our model, using Reinforcement Learning for Consistency Models (RLCM), to output desirable molecules. We demonstrate the broad applicability of TurboHopp across multiple drug discovery scenarios, underscoring its potential in diverse molecular settings., Comment: 22 pages, 11 figures, 8 tables. Presented at NeurIPS 2024

GPT-4o is an autoregressive omni model that accepts as input any combination of text, audio, image, and video, and generates any combination of text, audio, and image outputs. It's trained end-to-end across text, vision, and audio, meaning all inputs and outputs are processed by the same neural network. GPT-4o can respond to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in conversation. It matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages, while also being much faster and 50\% cheaper in the API. GPT-4o is especially better at vision and audio understanding compared to existing models. In line with our commitment to building AI safely and consistent with our voluntary commitments to the White House, we are sharing the GPT-4o System Card, which includes our Preparedness Framework evaluations. In this System Card, we provide a detailed look at GPT-4o's capabilities, limitations, and safety evaluations across multiple categories, focusing on speech-to-speech while also evaluating text and image capabilities, and measures we've implemented to ensure the model is safe and aligned. We also include third-party assessments on dangerous capabilities, as well as discussion of potential societal impacts of GPT-4o's text and vision capabilities.