Search

We present MS2Mesh-XR, a novel multi-modal sketch-to-mesh generation pipeline that enables users to create realistic 3D objects in extended reality (XR) environments using hand-drawn sketches assisted by voice inputs. In specific, users can intuitively sketch objects using natural hand movements in mid-air within a virtual environment. By integrating voice inputs, we devise ControlNet to infer realistic images based on the drawn sketches and interpreted text prompts. Users can then review and select their preferred image, which is subsequently reconstructed into a detailed 3D mesh using the Convolutional Reconstruction Model. In particular, our proposed pipeline can generate a high-quality 3D mesh in less than 20 seconds, allowing for immersive visualization and manipulation in run-time XR scenes. We demonstrate the practicability of our pipeline through two use cases in XR settings. By leveraging natural user inputs and cutting-edge generative AI capabilities, our approach can significantly facilitate XR-based creative production and enhance user experiences. Our code and demo will be available at: https://yueqiu0911.github.io/MS2Mesh-XR/, Comment: IEEE AIxVR 2025

Recent advances in multimodal imaging acquisition techniques have allowed us to measure different aspects of brain structure and function. Multimodal fusion, such as linked independent component analysis (LICA), is popularly used to integrate complementary information. However, it has suffered from missing data, commonly occurring in neuroimaging data. Therefore, in this paper, we propose a Full Information LICA algorithm (FI-LICA) to handle the missing data problem during multimodal fusion under the LICA framework. Built upon complete cases, our method employs the principle of full information and utilizes all available information to recover the missing latent information. Our simulation experiments showed the ideal performance of FI-LICA compared to current practices. Further, we applied FI-LICA to multimodal data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study, showcasing better performance in classifying current diagnosis and in predicting the AD transition of participants with mild cognitive impairment (MCI), thereby highlighting the practical utility of our proposed method., Comment: 17 pages, 6 figures

In mediation analysis, the exposure often influences the mediating effect, i.e., there is an interaction between exposure and mediator on the dependent variable. When the mediator is high-dimensional, it is necessary to identify non-zero mediators (M) and exposure-by-mediator (X-by-M) interactions. Although several high-dimensional mediation methods can naturally handle X-by-M interactions, research is scarce in preserving the underlying hierarchical structure between the main effects and the interactions. To fill the knowledge gap, we develop the XMInt procedure to select M and X-by-M interactions in the high-dimensional mediators setting while preserving the hierarchical structure. Our proposed method employs a sequential regularization-based forward-selection approach to identify the mediators and their hierarchically preserved interaction with exposure. Our numerical experiments showed promising selection results. Further, we applied our method to ADNI morphological data and examined the role of cortical thickness and subcortical volumes on the effect of amyloid-beta accumulation on cognitive performance, which could be helpful in understanding the brain compensation mechanism., Comment: 15 pages, 3 figures

Prosthetic Joint Infection (PJI) is a prevalent and severe complication characterized by high diagnostic challenges. Currently, a unified diagnostic standard incorporating both computed tomography (CT) images and numerical text data for PJI remains unestablished, owing to the substantial noise in CT images and the disparity in data volume between CT images and text data. This study introduces a diagnostic method, HGT, based on deep learning and multimodal techniques. It effectively merges features from CT scan images and patients' numerical text data via a Unidirectional Selective Attention (USA) mechanism and a graph convolutional network (GCN)-based feature fusion network. We evaluated the proposed method on a custom-built multimodal PJI dataset, assessing its performance through ablation experiments and interpretability evaluations. Our method achieved an accuracy (ACC) of 91.4\% and an area under the curve (AUC) of 95.9\%, outperforming recent multimodal approaches by 2.9\% in ACC and 2.2\% in AUC, with a parameter count of only 68M. Notably, the interpretability results highlighted our model's strong focus and localization capabilities at lesion sites. This proposed method could provide clinicians with additional diagnostic tools to enhance accuracy and efficiency in clinical practice., Comment: the content has some errors

This paper discusses the finite element method for the Yang-Mills equations with temporal gauge. The new contributions reported in this paper are threefold: an efficient linearized strategy for the Lie bracket $[A, A]$ is introduced, the novel implicit scheme in time for the Yang-Mills equations based on the above linearized strategy is presented, which preserves the conservation of its discrete energy and the error estimates for the semi-discrete scheme and the linearized scheme are proved. Finally, numerical test studies are then carried out to confirm the theoretical results., Comment: Theories are wrong and need to be fixed

High-performance quantum memory for quantized states of light is a prerequisite building block of quantum information technology. Despite great progresses of optical quantum memories based on interactions of light and atoms, physical features of these memories still cannot satisfy requirements for applications in practical quantum information systems, since all of them suffer from trade-off between memory efficiency and excess noise. Here, we report a high-performance cavity-enhanced electromagnetically-induced-transparency memory with warm atomic cell in which a scheme of optimizing the spatial and temporal modes based on the time-reversal approach is applied. The memory efficiency up to 67% is directly measured and a noise level close to quantum noise limit is simultaneously reached. It has been experimentally demonstrated that the average fidelities for a set of input coherent states with different phases and amplitudes within a Gaussian distribution have exceeded the classical benchmark fidelities. Thus the realized quantum memory platform has been capable of preserving quantized optical states, and is ready to be applied in quantum information systems, such as distributed quantum logic gates and quantum-enhanced atomic magnetometry., Comment: 15 pages,2 figures

Phonon Boltzmann transport equation (BTE) is a key tool for modeling multiscale phonon transport, which is critical to the thermal management of miniaturized integrated circuits, but assumptions about the system temperatures (i.e., small temperature gradients) are usually made to ensure that it is computationally tractable. To include the effects of large temperature non-equilibrium, we demonstrate a data-free deep learning scheme, physics-informed neural network (PINN), for solving stationary, mode-resolved phonon BTE with arbitrary temperature gradients. This scheme uses the temperature-dependent phonon relaxation times and learns the solutions in parameterized spaces with both length scale and temperature gradient treated as input variables. Numerical experiments suggest that the proposed PINN can accurately predict phonon transport (from 1D to 3D) under arbitrary temperature gradients. Moreover, the proposed scheme shows great promise in simulating device-level phonon heat conduction efficiently and can be potentially used for thermal design.

The traditional picture of heat transfer in solids by atomic vibrations, also known as phonons, involves phonons scattering with each other like gas particles and is commonly referred to as the phonon gas model (PGM). This physical picture accounts for interactions among propagating (i.e., plane wave modulated) vibrational modes in an ideal crystal, but it becomes problematic when describing non-propagating modes arising in realistic non-idealized systems. Here, we introduce a more general formalism for studying phonon transport, which involves projection of the interatomic interactions themselves (i.e., not just the atom motion), onto the normal modes of the system. This shows, for the first time, how energy is exchanged between modes in real-time during molecular dynamics (MD) simulations, as opposed to other MD methods which use inferences based on correlations, or other time averaged schemes that do not preserve specific features in the real-time dynamics. Applying this formalism to the example case of modes interacting in a superlattice, we illustrate a new perspective on how phonon transport occurs, whereby individual normal modes share energy through specific channels of interaction with other modes. We also highlight that while a myriad of interaction pathways exist, only a tiny fraction of these pathways actually transfer significant amounts of energy, which is surprising. The approach allows for the prediction and simulation of these mode/phonon interactions, thus unveiling the real-time dynamics of phonon behavior and advancing our ability to understanding and engineer phonon transport.

Interfaces impede heat flow in micro/nanostructured systems. Conventional theories for interfacial thermal transport were derived based on bulk phonon properties of the materials making up the interface without explicitly considering the atomistic interfacial details, which are found critical to correctly describing thermal boundary conductance (TBC). Recent theoretical studies predicted the existence of localized phonon modes at the interface which can play an important role in understanding interfacial thermal transport. However, experimental validation is still lacking. Through a combination of Raman spectroscopy and high-energy resolution electron energy-loss spectroscopy (EELS) in a scanning transmission electron microscope, we report the first experimental observation of localized interfacial phonon modes at ~12 THz at a high-quality epitaxial Si-Ge interface. These modes are further confirmed using molecular dynamics simulations with a high-fidelity neural network interatomic potential, which also yield TBC agreeing well with that measured from time-domain thermoreflectance (TDTR) experiments. Simulations find that the interfacial phonon modes have obvious contribution to the total TBC. Our findings may significantly contribute to the understanding of interfacial thermal transport physics and have impact on engineering TBC at interfaces in applications such as electronics thermal management and thermoelectric energy conversion.

Deformable image registration is widely utilized in medical image analysis, but most proposed methods fail in the situation of complex deformations. In this paper, we pre-sent a cascaded feature warping network to perform the coarse-to-fine registration. To achieve this, a shared-weights encoder network is adopted to generate the feature pyramids for the unaligned images. The feature warping registration module is then used to estimate the deformation field at each level. The coarse-to-fine manner is implemented by cascading the module from the bottom level to the top level. Furthermore, the multi-scale loss is also introduced to boost the registration performance. We employ two public benchmark datasets and conduct various experiments to evaluate our method. The results show that our method outperforms the state-of-the-art methods, which also demonstrates that the cascaded feature warping network can perform the coarse-to-fine registration effectively and efficiently., Comment: Accepted by ISBI2021

Boltzmann transport equation (BTE) is an ideal tool to describe the multiscale phonon transport phenomena, which are critical to applications like microelectronics cooling. Numerically solving phonon BTE is extremely computationally challenging due to the high dimensionality of such problems, especially when mode-resolved properties are considered. In this work, we demonstrate the use of physics-informed neural networks (PINNs) to efficiently solve phonon BTE for multiscale thermal transport problems with the consideration of phonon dispersion and polarization. In particular, a PINN framework is devised to predict the phonon energy distribution by minimizing the residuals of governing equations and boundary conditions, without the need for any labeled training data. Moreover, geometric parameters, such as the characteristic length scale, are included as a part of the input to PINN, which enables learning BTE solutions in a parametric setting. The effectiveness of the present scheme is demonstrated by solving a number of phonon transport problems in different spatial dimensions (from 1D to 3D). Compared to existing numerical BTE solvers, the proposed method exhibits superiority in efficiency and accuracy, showing great promises for practical applications, such as the thermal design of electronic devices.

Photothermal surface bubbles play important roles in a wide range of applications like catalysis, microfluidics and biosensing, but their formation on a transparent substrate immersed in a plasmonic nanoparticle (NP) suspension has an unknown origin. Here, we show that NPs deposited on the substrate by dispersive optical forces are responsible for the nucleation of such photothermal surface bubbles. High-speed videography shows that the surface bubble formation is always preceded by the optically driven NPs moving toward and adhering to the surface. We observe that the thresholds of laser power density to form a surface bubble drastically differ depending on if the surface is forward- or backward-facing the light propagation direction, which cannot be explained by a purely thermal process (e.g., volumetric heating by plasmonic NPs). This can be attributed to different optical power densities needed to enable optical pulling and pushing of NPs in the suspension. Optical pulling requires higher light intensity to excite supercavitation around NPs to enable proper optical configuration. Eventually, these optically deposited NPs work as a surface photothermal heater, seeding the surface bubble nucleation. We also find that there is a critical number density of deposited NPs to nucleate a surface bubble at a given laser power density, and it is nearly the same for both the forward- and the backward-facing surfaces. Our finding reveals interesting physics leading to photothermal surface bubble generation in plasmonic NP suspensions.

Estimating a massive drive time matrix between locations is a practical but challenging task. The challenges include availability of reliable road network (including traffic) data, programming expertise, and access to high-performance computing resources. This research proposes a method for estimating a nationwide drive time matrix between ZIP code areas in the U.S.--a geographic unit at which many national datasets such as health information are compiled and distributed. The method (1) does not rely on intensive efforts in data preparation or access to advanced computing resources, (2) uses algorithms of varying complexity and computational time to estimate drive times of different trip lengths, and (3) accounts for both interzonal and intrazonal drive times. The core design samples ZIP code pairs with various intensities according to trip lengths and derives the drive times via Google Maps API, and the Google times are then used to adjust and improve some primitive estimates of drive times with low computational costs. The result provides a valuable resource for researchers.

Molecular dynamics simulations have been extensively used to predict thermal properties, but simulating different phases with similar precision using a unified force field is often difficult, due to the lack of accurate and transferrable interatomistic potential fields. As a result, this issue has become a major barrier to predicting the phase change of materials and their transport properties with atomistic-level modeling techniques. Recently, machine learning based algorithms have emerged as promising tools to develop accurate potentials for molecular dynamics simulations. In this work, we approach the problem of predicting the thermal conductivity of silicon in different phases by performing molecular dynamics simulations with a deep neural network potential. This neural network potential is trained with ab-initio data of silicon in the crystalline, liquid and amorphous phases. The accuracy of our potential is first validated through reproducing the atomistic structures during the phase transition, where other empirical potentials usually fail. The thermal conductivity of different phases is then calculated, showing a good agreement with the experimental results and ab-initio calculation results. Our work shows that a unified neural network-based potential can be a promising tool for studying phase change and thermal transport of materials with high accuracy.

AlN is an ultra-wide bandgap semiconductor which has been developed for applications including power electronics and optoelectronics. Thermal management of these applications is the key for stable device performance and allowing for long lifetimes. AlN, with its potentially high thermal conductivity, can play an important role serving as a dielectric layer, growth substrate, and heat spreader to improve device performance. However, the intrinsic high thermal conductivity of bulk AlN predicted by theoretical calculations has not been experimentally observed because of the difficulty in producing materials with low vacancy and impurity levels, and other associated defect complexes in AlN which can decrease the thermal conductivity. This work reports the growth of thick AlN layers by MOCVD with an air-pocketed AlN layer and the first experimental observation of intrinsic thermal conductivity from 130 K to 480 K that matches density-function-theory calculations for single crystal AlN, producing some of the highest values ever measured. Detailed material characterizations confirm the high quality of these AlN samples with one or two orders of magnitude lower impurity concentrations than seen in commercially available bulk AlN. Measurements of these commercially available bulk AlN substrates from 80 K to 480 K demonstrated a lower thermal conductivity, as expected. A theoretical thermal model is built to interpret the measured temperature dependent thermal conductivity. Our work demonstrates that it is possible to obtain theoretically high values of thermal conductivity in AlN and such films may impact the thermal management and reliability of future electronic and optoelectronics devices.

A unified understanding of interfacial thermal transport is missing due to the complicated nature of interfaces which involves complex factors such as interfacial bonding, interfacial mixing, surface chemistry, crystal orientation, roughness, contamination, and interfacial disorder. This is especially true for metal nonmetal interfaces which incorporate multiple fundamental heat transport mechanisms such as elastic and inelastic phonon scattering as well as electron phonon coupling in the metal and across the interface. All these factors jointly affect thermal boundary conductance (TBC). As a result, the experimentally measured interfaces may not be the same as the ideally modelled interfaces, thus obfuscating any conclusions drawn from experimental and modeling comparisons. This work provides a systematic study of interfacial thermal conductance across well controlled and ultraclean epitaxial (111) Al parallel (0001) sapphire interfaces, known as harmonic matched interface. A comparison with thermal models such as atomistic Green s function (AGF) and a nonequilibrium Landauer approach shows that elastic phonon scattering dominates the interfacial thermal transport of Al sapphire interface. By scaling the TBC with the Al heat capacity, a nearly constant transmission coefficient is observed, indicating that the phonons on the Al side limits the Al sapphire TBC. This nearly constant transmission coefficient validates the assumptions in AGF and nonequilibrium Landauer calculations. Our work not only provides a benchmark for interfacial thermal conductance across metal nonmetal interfaces and enables a quantitative study of TBC to validate theoretical thermal carrier transport mechanisms, but also acts as a reference when studying how other factors impact TBC.