Search

In this paper, we study the tensor products of irreducible highest weight modules with irreducible loop modules over the affine-Virasoro algebra with aid of the ``shifting technique" established for the Virasoro algebra in [H. Chen, X. Guo, K. Zhao, Tensor product weight modules over the Virasoro algebra, J. Lond. Math. Soc. 88(2013), 829-844.]. All such tensor product modules are indecomposable modules with infinite-dimensional weight spaces. Moreover, we obtain the necessary and sufficient conditions for such tensor product modules to be irreducible. Therefore, we obtain a class of new irreducible weight modules over the affine-Virasoro algebra. Finally, the necessary and sufficient conditions for any two such tensor product modules to be isomorphic are also determined., Comment: 23 pages

Deep models often struggle with out-of-distribution (OOD) generalization, limiting their real-world applicability beyond controlled laboratory settings. Invariant risk minimization (IRM) addresses this issue by learning invariant features and minimizing the risk across different domains. Thus, it avoids the pitfalls of pseudo-invariant features and spurious causality associated with empirical risk minimization (ERM). However, according to the support overlap theorem, ERM and IRM may fail to address the OOD problem when pseudo-invariant features have insufficient support overlap. To this end, we propose a novel method to enlarge feature support overlap for domain generalization. Specifically, we introduce Bayesian random semantic data augmentation to increase sample diversity and overcome the deficiency of IRM. Experiments on several challenging OOD generalization benchmarks demonstrate that our approach surpasses existing models, delivering superior performance and robustness. The code is available at \url{https://github.com/YaoyaoZhu19/BSDG}.

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state space models (SSMs), has emerged as a competitive alternative to Transformer, offering comparable performance with higher throughput and linear complexity related to sequence length. In this study, we analyze the limitations of current Mamba in LTSF and propose four targeted improvements, leading to MambaTS. We first introduce variable scan along time to arrange the historical information of all the variables together. We suggest that causal convolution in Mamba is not necessary for LTSF and propose the Temporal Mamba Block (TMB). We further incorporate a dropout mechanism for selective parameters of TMB to mitigate model overfitting. Moreover, we tackle the issue of variable scan order sensitivity by introducing variable permutation training. We further propose variable-aware scan along time to dynamically discover variable relationships during training and decode the optimal variable scan order by solving the shortest path visiting all nodes problem during inference. Extensive experiments conducted on eight public datasets demonstrate that MambaTS achieves new state-of-the-art performance.

Two-dimensional (2D) materials are promising candidates for spintronic applications. Maintaining their atomically smooth interfaces during integration of ferromagnetic (FM) electrodes is crucial since conventional metal deposition tends to induce defects at the interfaces. Meanwhile, the difficulties in picking up FM metals with strong adhesion and in achieving conductance match between FM electrodes and spin transport channels make it challenging to fabricate high-quality 2D spintronic devices using metal transfer techniques. Here, we report a solvent-free magnetic electrode transfer technique that employs a graphene layer to assist in the transfer of FM metals. It also serves as part of the FM electrode after transfer for optimizing spin injection, which enables the realization of spin valves with excellent performance based on various 2D materials. In addition to two-terminal devices, we demonstrate that the technique is applicable for four-terminal spin valves with nonlocal geometry. Our results provide a promising future of realizing 2D spintronic applications using the developed magnetic electrode transfer technique.

Testing conditional independence has many applications, such as in Bayesian network learning and causal discovery. Different test methods have been proposed. However, existing methods generally can not work when only discretized observations are available. Specifically, consider $X_1$, $\tilde{X}_2$ and $X_3$ are observed variables, where $\tilde{X}_2$ is a discretization of latent variables $X_2$. Applying existing test methods to the observations of $X_1$, $\tilde{X}_2$ and $X_3$ can lead to a false conclusion about the underlying conditional independence of variables $X_1$, $X_2$ and $X_3$. Motivated by this, we propose a conditional independence test specifically designed to accommodate the presence of such discretization. To achieve this, we design the bridge equations to recover the parameter reflecting the statistical information of the underlying latent continuous variables. An appropriate test statistic and its asymptotic distribution under the null hypothesis of conditional independence have also been derived. Both theoretical results and empirical validation have been provided, demonstrating the effectiveness of our test methods.

The Sun stands out as the closest and clearest astrophysical accelerator of cosmic rays, while other objects within and beyond the galaxy remain enigmatic. It is probable that the cosmic ray spectrum and mass components from these celestial sources share similarities, offering a novel approach to study their origin. In this study, we analyze of spectra and mass in the energy range from MeV to 10~EeV. We find: (1) the mean-logarithmic mass $\rm\left\langle lnA \right\rangle$ distribution with energy exhibits much clearer feature structures than the spectra; (2) a 100~TeV bump is presented in the $\rm\left\langle lnA \right\rangle$ distribution; (3) for protons, the knee is located at $\sim2$ PeV, the boundary between the galaxy and extra-galaxy occurs at $\sim30$ PeV, marked by a sharp dip; (4) the all-particle spectrum exhibits hardening at $\sim30$~PeV due to the contribution of nearby galaxies, and the extra-galactic dominate $\sim0.7$~EeV. We hope the LHAASO experiment can perform spectral measurements of individual species to validate our results., Comment: 6 pages, 3 figures

Radiation therapy is crucial in cancer treatment. Experienced experts typically iteratively generate high-quality dose distribution maps, forming the basis for excellent radiation therapy plans. Therefore, automated prediction of dose distribution maps is significant in expediting the treatment process and providing a better starting point for developing radiation therapy plans. With the remarkable results of diffusion models in predicting high-frequency regions of dose distribution maps, dose prediction methods based on diffusion models have been extensively studied. However, existing methods mainly utilize CNNs or Transformers as denoising networks. CNNs lack the capture of global receptive fields, resulting in suboptimal prediction performance. Transformers excel in global modeling but face quadratic complexity with image size, resulting in significant computational overhead. To tackle these challenges, we introduce a novel diffusion model, MD-Dose, based on the Mamba architecture for predicting radiation therapy dose distribution in thoracic cancer patients. In the forward process, MD-Dose adds Gaussian noise to dose distribution maps to obtain pure noise images. In the backward process, MD-Dose utilizes a noise predictor based on the Mamba to predict the noise, ultimately outputting the dose distribution maps. Furthermore, We develop a Mamba encoder to extract structural information and integrate it into the noise predictor for localizing dose regions in the planning target volume (PTV) and organs at risk (OARs). Through extensive experiments on a dataset of 300 thoracic tumor patients, we showcase the superiority of MD-Dose in various metrics and time consumption.

Data augmentation is a crucial regularization technique for deep neural networks, particularly in medical image classification. Mainstream data augmentation (DA) methods are usually applied at the image level. Due to the specificity and diversity of medical imaging, expertise is often required to design effective DA strategies, and improper augmentation operations can degrade model performance. Although automatic augmentation methods exist, they are computationally intensive. Semantic data augmentation can implemented by translating features in feature space. However, over-translation may violate the image label. To address these issues, we propose \emph{Bayesian Random Semantic Data Augmentation} (BSDA), a computationally efficient and handcraft-free feature-level DA method. BSDA uses variational Bayesian to estimate the distribution of the augmentable magnitudes, and then a sample from this distribution is added to the original features to perform semantic data augmentation. We performed experiments on nine 2D and five 3D medical image datasets. Experimental results show that BSDA outperforms current DA methods. Additionally, BSDA can be easily assembled into CNNs or Transformers as a plug-and-play module, improving the network's performance. The code is available online at \url{https://github.com/YaoyaoZhu19/BSDA}.

The detection of GW170817/GRB170817A implied the strong association between short gamma-ray bursts (SGRBs) and binary neutron star (BNS) mergers which produce gravitational waves (GWs). More evidence is needed to confirm the association and reveal the physical processes of BNS mergers. The upcoming High Altitude Detection of Astronomical Radiation (HADAR) experiment, excelling in a wide field of view (FOV) and a large effective area above tens of GeV, is a hope for the prompt detection of very-high-energy (VHE; > 10 GeV) SGRBs. The aim of this paper is to simulate and analyse GW/SGRB joint detections by future GW detector networks in synergy with HADAR, including the second generation LIGO, Virgo and KAGRA and the third generation ET and CE. We provide a brief introduction of the HADAR experiment for SGRB simulations and its expected SGRB detections. For GW simulations, we adopt a phenomenological model to describe GWs produced by BNS mergers and introduce the signal-noise ratios (SNRs) as detector responses. Following a theoretical analysis we compute the redshift-dependent efficiency functions of GW detector networks. We then construct the simulation of GW detection by Monte Carlo sampling. We compare the simulated results of LIGO-Virgo O2 and O3 runs with their actual detections as a check. The combination of GW and SGRB models is then discussed for joint detection, including parameter correlations, triggered SNRs and efficiency skymaps. The estimated joint detection rates are 0.09-2.52 per year for LHVK network with HADAR under different possible configurations, and approximately 0.27-7.89 per year for ET+CE network with HADAR.

In this note, we investigate Jacobian conjecture through investigation of automorphisms of polynomial rings in characteristic $p$. Making use of the technique of inverse limits, we show that under Jacobian condition for a given homomorphism $\varphi$ of the polynomial ring $\mathbf{k}[x_1,\ldots,x_n]$, if $\varphi$ preserves the maximal ideals, then $\varphi$ is an automorphism., Comment: 8 pages, to appcar in JAA

The AMS-02 experiment has observed new properties of primary cosmic rays (CRs) categorized into two groups: He-C-O-Fe and Ne-Mg-Si-S, which are independent of CR propagation. In this study, we investigate the unexpected properties of these nuclei using a spatial propagation model. All nuclei spectra are accurately reproduced and separated into primary and secondary contributions. Our findings include: 1. Primary CR spectra are identical. 2. Our calculations align with AMS-02 results for primary-dominated nuclei within a 10\% difference, but show significant discrepancies for the secondary-dominated nuclei. 3. The primary element abundance is presented for the first time. We anticipate that the DAMPE and future HERD experiments will provide observations of nuclei spectra above TeV energy., Comment: 8 pages, 8 figures. accepted by PRD

Radiation therapy serves as an effective and standard method for cancer treatment. Excellent radiation therapy plans always rely on high-quality dose distribution maps obtained through repeated trial and error by experienced experts. However, due to individual differences and complex clinical situations, even seasoned expert teams may need help to achieve the best treatment plan every time quickly. Many automatic dose distribution prediction methods have been proposed recently to accelerate the radiation therapy planning process and have achieved good results. However, these results suffer from over-smoothing issues, with the obtained dose distribution maps needing more high-frequency details, limiting their clinical application. To address these limitations, we propose a dose prediction diffusion model based on SwinTransformer and a projector, SP-DiffDose. To capture the direct correlation between anatomical structure and dose distribution maps, SP-DiffDose uses a structural encoder to extract features from anatomical images, then employs a conditional diffusion process to blend noise and anatomical images at multiple scales and gradually map them to dose distribution maps. To enhance the dose prediction distribution for organs at risk, SP-DiffDose utilizes SwinTransformer in the deeper layers of the network to capture features at different scales in the image. To learn good representations from the fused features, SP-DiffDose passes the fused features through a designed projector, improving dose prediction accuracy. Finally, we evaluate SP-DiffDose on an internal dataset. The results show that SP-DiffDose outperforms existing methods on multiple evaluation metrics, demonstrating the superiority and generalizability of our method.

The rapid development of functional graphene-like nanoribbons with high-quality has become increasingly reliant on multiple nanofabrication platforms while traditional methods are facing mounting limitations in this regard. Consequently, the demand for novel techniques to explore and manipulate graphene-like nanoribbons has surged. Herein, we report an on-surface synthesis of graphene-like nanoribbons on pentacene/picene monomers via a series of self-assembly and annealing on the one-dimensional(1D) Au(110) substrate. Our scanning tunneling microscope(STM) research reveals that four-/eight- membered rings are formed between adjacent molecules. Furthermore, we demonstrate the technique to manipulate the pentacene dimer without breaking its structure by operating an STM tip. Our results exhibit a possible platform for developing next generation graphene-based quantum computing designs and a technique to obtain multiple functional graphene-like nanoribbons with high-precision.

Solitons have garnered significant attention across various fields, yet a contentious debate persists regarding the precise structure of solitons on indium chains. Currently, multiple forms of solitons in one-dimensional atomic chains have been reported. STM provides an effective means to study the precise atomic structure of solitons, particularly their dynamics and interactions. However, limited research has been conducted on soliton interactions and soliton-chain interactions, despite their profound impact on relative soliton motions and the overall physical properties of the system. In this work, we characterized the structures of the soliton dimer and trimer, observed the displacements induced by the soliton entity and statisticized the dynamic behaviors of soliton dimers over time evolution or temperature. To reveal the soliton mechanism, we further utilized STM to investigate the CDWs between two solitons when two monomers were encountered. Additionally, we achieved the manipulation of the monomer on the indium chain by the STM tip. Our work serves as an important approach to elucidate interactions in correlated electronic systems and advance the development of potential topological soliton computers.

Self-supervised learning has been known for learning good representations from data without the need for annotated labels. We explore the simple siamese (SimSiam) architecture for representation learning on strong gravitational lens images. Commonly used image augmentations tend to change lens properties; for example, zoom-in would affect the Einstein radius. To create image pairs representing the same underlying lens model, we introduce a lens augmentation method to preserve lens properties by fixing the lens model while varying the source galaxies. Our research demonstrates this lens augmentation works well with SimSiam for learning the lens image representation without labels, so we name it LenSiam. We also show that a pre-trained LenSiam model can benefit downstream tasks. We open-source our code and datasets at https://github.com/kuanweih/LenSiam ., Comment: 5 pages, 2 figures. Accepted by NeurIPS 2023 AI for Science Workshop

In conventional optical microscopes, image contrast of objects mainly results from the differences in light intensity and/or color. Muller matrix optical microscopes (MMMs), on the other hand, can provide significantly enhanced image contrast and rich information about objects by analyzing their interactions with polarized light. However, state-of-art MMMs are fundamentally limited by bulky and slow polarization state generators and analyzers. Here, we demonstrated the feasibility of applying metasurfaces to enable a fast and compact MMM, i.e., Meta-MMM. We developed a dual-color MMM, in both reflection and transmission modes, based on a chip-integrated high-speed (>20fps) metasurface polarization state analyzer (Meta-PSA) and realized high measurement accuracy for Muller matrix (MM) imaging. We then applied our Meta-MMM to nanostructure characterization, surface morphology analysis and discovered birefringent structures in honeybee wings. Our meta-MMMs hold the promise to revolutionize various applications from biological imaging, medical diagnosis, material characterization to industry inspection and space exploration.

Talking face generation has a wide range of potential applications in the field of virtual digital humans. However, rendering high-fidelity facial video while ensuring lip synchronization is still a challenge for existing audio-driven talking face generation approaches. To address this issue, we propose HyperLips, a two-stage framework consisting of a hypernetwork for controlling lips and a high-resolution decoder for rendering high-fidelity faces. In the first stage, we construct a base face generation network that uses the hypernetwork to control the encoding latent code of the visual face information over audio. First, FaceEncoder is used to obtain latent code by extracting features from the visual face information taken from the video source containing the face frame.Then, HyperConv, which weighting parameters are updated by HyperNet with the audio features as input, will modify the latent code to synchronize the lip movement with the audio. Finally, FaceDecoder will decode the modified and synchronized latent code into visual face content. In the second stage, we obtain higher quality face videos through a high-resolution decoder. To further improve the quality of face generation, we trained a high-resolution decoder, HRDecoder, using face images and detected sketches generated from the first stage as input.Extensive quantitative and qualitative experiments show that our method outperforms state-of-the-art work with more realistic, high-fidelity, and lip synchronization. Project page: https://semchan.github.io/HyperLips Project/

The HADAR experiment, which will be constructed in Tibet, China, combines the wide-angle advantages of traditional EAS array detectors with the high sensitivity advantages of focused Cherenkov detectors. Its physics objective is to observe transient sources such as gamma-ray bursts and counterparts of gravitational waves. The aim of this study is to utilize the latest AI technology to enhance the sensitivity of the HADAR experiment. We have built training datasets and models with distinctive creativity by incorporating relevant physical theories for various applications. They are able to determine the kind, energy, and direction of incident particles after careful design. We have obtained a background identification accuracy of 98.6%, a relative energy reconstruction error of 10.0%, and an angular resolution of 0.22-degrees in a test dataset at 10 TeV. These findings demonstrate the enormous potential for enhancing the precision and dependability of detector data analysis in astrophysical research. Thanks to deep learning techniques, the HADAR experiment's observational sensitivity to the Crab Nebula has surpassed that of MAGIC and H.E.S.S. at energies below 0.5 TeV and remains competitive with conventional narrow-field Cherenkov telescopes at higher energies. Additionally, our experiment offers a fresh approach to dealing with strongly connected scattered data.

In autonomous driving tasks, scene understanding is the first step towards predicting the future behavior of the surrounding traffic participants. Yet, how to represent a given scene and extract its features are still open research questions. In this study, we propose a novel text-based representation of traffic scenes and process it with a pre-trained language encoder. First, we show that text-based representations, combined with classical rasterized image representations, lead to descriptive scene embeddings. Second, we benchmark our predictions on the nuScenes dataset and show significant improvements compared to baselines. Third, we show in an ablation study that a joint encoder of text and rasterized images outperforms the individual encoders confirming that both representations have their complementary strengths.

Recent observations of cosmic rays (CRs) have revealed a two-component anomaly in the spectra of primary and secondary particles, as well as their ratios, prompting investigation into their common origin. In this study, we incorporate the identification of slow diffusion zones around sources as a common phenomenon into our calculations, which successfully reproduces all previously described anomalies except for the positron spectrum. Crucially, our research offers a clear physical picture of the origin of CR: while high-energy ($\textrm{>200~GV}$, including the knee) particles are primarily produced by fresh accelerators and are confined to local regions, low energy ($\textrm{<200~GV}$) components come from distant sources and travel through the outer diffusive zone outside of the galactic disk. This scenario can be universally applied in the galactic disk, as evidenced by ultra-high energy diffuse $\rm\gamma$-ray emissions detected by the AS$\rm\gamma$ experiment. Furthermore, our results predict that the spectrum of diffuse $\rm\gamma$-ray is spatial-dependent, resting with local sources, which can be tested by LHAASO experiment., Comment: 9 pages, 7 figures, accepted by PhysRevD

Owing to its atomically thin thickness, layer-dependent tunable band gap, flexibility, and CMOS compatibility, MoS$_2$ is a promising candidate for photodetection. However, mono-layer MoS2-based photodetectors typically show poor optoelectronic performances, mainly limited by their low optical absorption. In this work, we hybridized CVD-grown monolayer MoS$_2$ with a gold nanodisk (AuND) array to demonstrate a superior visible photodetector through a synergetic effect. It is evident from our experimental results that there is a strong light-matter interaction between AuNDs and monolayer MoS$_2$, which results in better photodetection due to a surface trap state passivation with a longer charge carrier lifetime compared to pristine MoS$_2$. In particular, the AuND/MoS$_2$ system demonstrated a photoresponsivity of $8.7 \times 10^{4}$ A/W, specific detectivity of $6.9 \times 10^{13}$ Jones, and gain $1.7 \times 10^{5}$ at $31.84 \mu W/cm^{2}$ illumination power density of 632 nm wavelength with an applied voltage of 4.0 V for an AuND/MoS$_2$-based photodetector. To our knowledge, these optoelectronic responses are one order higher than reported results for CVD MoS$_2$-based photodetector in the literature., Comment: 30 pages, 14 figures

Cone Beam CT (CBCT) plays a crucial role in Adaptive Radiation Therapy (ART) by accurately providing radiation treatment when organ anatomy changes occur. However, CBCT images suffer from scatter noise and artifacts, making relying solely on CBCT for precise dose calculation and accurate tissue localization challenging. Therefore, there is a need to improve CBCT image quality and Hounsfield Unit (HU) accuracy while preserving anatomical structures. To enhance the role and application value of CBCT in ART, we propose an energy-guided diffusion model (EGDiff) and conduct experiments on a chest tumor dataset to generate synthetic CT (sCT) from CBCT. The experimental results demonstrate impressive performance with an average absolute error of 26.87$\pm$6.14 HU, a structural similarity index measurement of 0.850$\pm$0.03, a peak signal-to-noise ratio of the sCT of 19.83$\pm$1.39 dB, and a normalized cross-correlation of the sCT of 0.874$\pm$0.04. These results indicate that our method outperforms state-of-the-art unsupervised synthesis methods in accuracy and visual quality, producing superior sCT images.

Relying on large-scale training data with pixel-level labels, previous edge detection methods have achieved high performance. However, it is hard to manually label edges accurately, especially for large datasets, and thus the datasets inevitably contain noisy labels. This label-noise issue has been studied extensively for classification, while still remaining under-explored for edge detection. To address the label-noise issue for edge detection, this paper proposes to learn Pixel-level NoiseTransitions to model the label-corruption process. To achieve it, we develop a novel Pixel-wise Shift Learning (PSL) module to estimate the transition from clean to noisy labels as a displacement field. Exploiting the estimated noise transitions, our model, named PNT-Edge, is able to fit the prediction to clean labels. In addition, a local edge density regularization term is devised to exploit local structure information for better transition learning. This term encourages learning large shifts for the edges with complex local structures. Experiments on SBD and Cityscapes demonstrate the effectiveness of our method in relieving the impact of label noise. Codes are available at https://github.com/DREAMXFAR/PNT-Edge., Comment: Accepted by ACM-MM 2023

Several Pulsar Timing Array (PTA) collaborations have recently provided strong evidence for a nHz Stochastic Gravitational-Wave Background (SGWB). Here we investigate the implications of a first-order phase transition occurring within the early universe's dark quantum chromodynamics (dQCD) epoch, specifically within the framework of the mirror twin Higgs dark sector model. Our analysis indicates a distinguishable SGWB signal originating from this phase transition, which can explain the measurements obtained by PTAs. Remarkably, a significant portion of the parameter space for the SGWB signal also effectively resolves the existing tensions in both the $H_0$ and $S_8$ measurements in Cosmology. This intriguing correlation suggests a possible common origin of these three phenomena for $0.2 < \Delta N_{\rm eff} < 0.5$, where the mirror dark matter component constitutes about $30\%$ of the total dark matter abundance. Next generation CMB experiment such as CMB-S4 is able to test this parameter region., Comment: 7 pages, 4 figures

The origin of interstellar and intergalactic magnetic fields remains largely unknown. One possibility is that they are related to the primordial magnetic fields (PMFs) produced by, for instance, the phase transitions of the early Universe. In this paper, we show that the PMF-induced turbulence generated at around the QCD phase transition epoch--the characteristic magnetic field strength $B_{\rm ch}^* \sim \mathcal{O}(1)~\rm{\mu G}$ and coherent length scale $\ell_{\rm ch}^* \sim \mathcal{O}(1)~\rm{pc}$--can naturally accommodate nanohertz gravitational waves reported by pulsar timing array (PTA) collaborations. Moreover, the evolution of the PMFs to the recombination era with the form of $B_{\rm ch}\sim \ell_{\rm ch}^{-\alpha}$ can induce baryon density inhomogeneities, alter the recombination history, and alleviate the tension of the Hubble parameter $H_0$ and the matter clumpiness parameter $S_8$ between early- and late-time measurements for $0.88\leq \alpha \leq 1.17$ (approximate 95\% credible region based on three PTA likelihoods). The further evolved PMFs may account for the $\sim {\cal O}(10^{-16})$ Gauss extragalactic magnetic field inferred with GRB 221009A., Comment: 7 pages, 3 figures, 1 table

Exploring novel materials with enhanced optical nonlinearities at low power levels with ultrafast response and small footprints is of great interests for information processing, communication, sensing and quantum systems. Recent progress on nonlinear metamaterials and metasurfaces suggests promising solutions to overcome the limitations of nonlinear materials in nature. Here we present a design concept for highly enhanced saturable absorption effect based on subwavelength-thick (<1/5$\lambda$0) hybrid graphene-plasmonic metasurface structures in infrared wavelengths. Our theoretical and experimental results demonstrated that, by exciting nonequilibrium carriers inside nanoscale hotspots, one could not only enhance the saturable absorption in graphene, but also reduce the saturation fluence by over 3 orders of magnitude (from ~ 1 mJ/cm2 to ~100 nJ/cm2). Our pump-probe measurement results suggested an ultrashort saturable absorption recovery time (<60 fs), which is ultimately determined by the relaxation dynamics of photoexcited carriers in graphene. We also observed pulse narrowing effects in our devices based on the autocorrelation measurement results. Such design concepts can be tailored via structure engineering to operate in broader wavelength ranges up to mid- and far- infrared spectral regions. These ultrafast low-saturation fluence saturable absorber designs can enable low-threshold, compact, self-starting mode-locked lasers, laser pulse shaping, and high-speed optical information processing.

The observation of short gamma ray bursts (SGRBs) in the TeV energy range plays an important role in understanding the radiation mechanism and probing new areas of physics such as Lorentz invariance violation. However, no SGRB has been observed in this energy range due to the short duration of SGRBs and the weakness of current experiments. New experiments with new technology are required to detect sub-TeV SGRBs. In this work, we observe the very high energy (VHE) $\gamma$-ray emissions from SGRBs and calculate the annual detection rate with the High Altitude Detection of Astronomical Radiation HADAR (HADAR) experiment. First, a set of pseudo-SGRB samples is generated and checked using the observations of Fermi-GBM, Fermi-LAT, and SWIFT measurements. The annual detection rate is calculated from these SGRB samples based on the performance of the HADAR instrument. As a result, the HADAR experiment can detect 0.5 SGRB per year if the spectral break-off of $\gamma$-rays caused by the internal absorption is larger than 100 GeV. For a GRB09010-like GRB in HADAR's view, it should be possible to detect approximately 2000 photons considering the internal absorption. With a time delay assumption due to the Lorentz invariance violation effects, a simulated light curve of GRB090510 has evident energy dependence. We hope that the HADAR experiment can perform the SGRB observations and test our calculations in the future.

Polarimetric imaging has a wide range of applications for uncovering features invisible to human eyes and conventional imaging sensors. Compact, fast, cost-effective and accurate full-Stokes polarimetric imaging sensors are highly desirable in many applications, which, however, remain elusive due to fundamental material limitations. Here we present a Metasurface-based Full-Stokes Polarimetric Imaging sensor (MetaPolarIm) realized by integrating an ultrathin (~600 nm) metasurface polarization filter array (MPFA) onto a visible imaging sensor with CMOS compatible fabrication processes. The MPFA is featured with broadband dielectric-metal hybrid chiral metasurfaces and double-layer nanograting polarizers. This chip-integrated polarimetric imaging sensor enables single-shot full-Stokes imaging (speed limited by the CMOS imager) with the most compact form factor, record high measurement accuracy, dual-color operation (green and red) and a full angle of view up to 40 degrees. MetaPolarIm holds great promise to enable transformative applications in autonomous vision, industry inspection, space exploration, medical imaging and diagnosis., Comment: 27 pages, 5 figures

Automated anesthesia promises to enable more precise and personalized anesthetic administration and free anesthesiologists from repetitive tasks, allowing them to focus on the most critical aspects of a patient's surgical care. Current research has typically focused on creating simulated environments from which agents can learn. These approaches have demonstrated good experimental results, but are still far from clinical application. In this paper, Policy Constraint Q-Learning (PCQL), a data-driven reinforcement learning algorithm for solving the problem of learning anesthesia strategies on real clinical datasets, is proposed. Conservative Q-Learning was first introduced to alleviate the problem of Q function overestimation in an offline context. A policy constraint term is added to agent training to keep the policy distribution of the agent and the anesthesiologist consistent to ensure safer decisions made by the agent in anesthesia scenarios. The effectiveness of PCQL was validated by extensive experiments on a real clinical anesthesia dataset. Experimental results show that PCQL is predicted to achieve higher gains than the baseline approach while maintaining good agreement with the reference dose given by the anesthesiologist, using less total dose, and being more responsive to the patient's vital signs. In addition, the confidence intervals of the agent were investigated, which were able to cover most of the clinical decisions of the anesthesiologist. Finally, an interpretable method, SHAP, was used to analyze the contributing components of the model predictions to increase the transparency of the model., Comment: 11 pages, 7 figures

We investigate Siamese networks for learning related embeddings for augmented samples of molecular conformers. We find that a non-contrastive (positive-pair only) auxiliary task aids in supervised training of Euclidean neural networks (E3NNs) and increases manifold smoothness (MS) around point-cloud geometries. We demonstrate this property for multiple drug-activity prediction tasks while maintaining relevant performance metrics, and propose an extension of MS to probabilistic and regression settings. We provide an analysis of representation collapse, finding substantial effects of task-weighting, latent dimension, and regularization. We expect the presented protocol to aid in the development of reliable E3NNs from molecular conformers, even for small-data drug discovery programs., Comment: Submitted to the MLDD workshop, ICLR 2023

In an unpaired setting, lacking sufficient content constraints for image-to-image translation (I2I) tasks, GAN-based approaches are usually prone to model collapse. Current solutions can be divided into two categories, reconstruction-based and Siamese network-based. The former requires that the transformed or transforming image can be perfectly converted back to the original image, which is sometimes too strict and limits the generative performance. The latter involves feeding the original and generated images into a feature extractor and then matching their outputs. This is not efficient enough, and a universal feature extractor is not easily available. In this paper, we propose EnCo, a simple but efficient way to maintain the content by constraining the representational similarity in the latent space of patch-level features from the same stage of the \textbf{En}coder and de\textbf{Co}der of the generator. For the similarity function, we use a simple MSE loss instead of contrastive loss, which is currently widely used in I2I tasks. Benefits from the design, EnCo training is extremely efficient, while the features from the encoder produce a more positive effect on the decoding, leading to more satisfying generations. In addition, we rethink the role played by discriminators in sampling patches and propose a discriminative attention-guided (DAG) patch sampling strategy to replace random sampling. DAG is parameter-free and only requires negligible computational overhead, while significantly improving the performance of the model. Extensive experiments on multiple datasets demonstrate the effectiveness and advantages of EnCo, and we achieve multiple state-of-the-art compared to previous methods. Our code is available at https://github.com/XiudingCai/EnCo-pytorch., Comment: Accepted by AAAI 2024

Architected 2D lattice materials are appealing for shape-shifting applications due to the tunable sign of Poisson's ratio. It is commonly believed that the positive and negative Poisson's ratios lead to anticlastic and synclastic curvatures respectively when the material is bent in one direction. Here, taking 2D beam lattices with star-shaped unit cells as examples, we show theoretically and demonstrate experimentally that this is not always true. At a fixed Poisson's ratio, we find a transition between anticlastic and synclastic bending curvatures controlled by the beam's cross-sectional aspect ratio. Such an unexpected behavior roots in the competition between torsion and bending of the beams, and can be well captured by a Cosserat continuum model., Comment: 14 pages, 4 figures, 47 references

In this paper, we revisit the inconsistency problem of EKF-based cooperative localization (CL) from the perspective of system decomposition. By transforming the linearized system used by the standard EKF into its Kalman observable canonical form, the observable and unobservable components of the system are separated. Consequently, the factors causing the dimension reduction of the unobservable subspace are explicitly isolated in the state propagation and measurement Jacobians of the Kalman observable canonical form. Motivated by these insights, we propose a new CL algorithm called KD-EKF which aims to enhance consistency. The key idea behind the KD-EKF algorithm involves perform state estimation in the transformed coordinates so as to eliminate the influencing factors of observability in the Kalman observable canonical form. As a result, the KD-EKF algorithm ensures correct observability properties and consistency. We extensively verify the effectiveness of the KD-EKF algorithm through both Monte Carlo simulations and real-world experiments. The results demonstrate that the KD-EKF outperforms state-of-the-art algorithms in terms of accuracy and consistency.

Quantifying the parameters and corresponding uncertainties of hundreds of strongly lensed quasar systems holds the key to resolving one of the most important scientific questions: the Hubble constant ($H_{0}$) tension. The commonly used Markov chain Monte Carlo (MCMC) method has been too time-consuming to achieve this goal, yet recent work has shown that convolution neural networks (CNNs) can be an alternative with seven orders of magnitude improvement in speed. With 31,200 simulated strongly lensed quasar images, we explore the usage of Vision Transformer (ViT) for simulated strong gravitational lensing for the first time. We show that ViT could reach competitive results compared with CNNs, and is specifically good at some lensing parameters, including the most important mass-related parameters such as the center of lens $\theta_{1}$ and $\theta_{2}$, the ellipticities $e_1$ and $e_2$, and the radial power-law slope $\gamma'$. With this promising preliminary result, we believe the ViT (or attention-based) network architecture can be an important tool for strong lensing science for the next generation of surveys. The open source of our code and data is in \url{https://github.com/kuanweih/strong_lensing_vit_resnet}., Comment: Accepted by ECCV 2022 AI for Space Workshop

Increasing investment in computing technologies and the advancements in silicon technology has fueled rapid growth in advanced driver assistance systems (ADAS) and corresponding SoC developments. An ADAS SoC represents a heterogeneous architecture that consists of CPUs, GPUs and artificial intelligence (AI) accelerators. In order to guarantee its safety and reliability, it must process massive amount of raw data collected from multiple redundant sources such as high-definition video cameras, Radars, and Lidars to recognize objects correctly and to make the right decisions promptly. A domain specific memory architecture is essential to achieve the above goals. We present a shared memory architecture that enables high data throughput among multiple parallel accesses native to the ADAS applications. It also provides deterministic access latency with proper isolation under the stringent real-time QoS constraints. A prototype is built and analyzed. The results validate that the proposed architecture provides close to 100\% throughput for both read and write accesses generated simultaneously by many accessing masters with full injection rate. It can also provide consistent QoS to the domain specific payloads while enabling the scalability and modularity of the design.

Multimodal sentiment analysis in videos is a key task in many real-world applications, which usually requires integrating multimodal streams including visual, verbal and acoustic behaviors. To improve the robustness of multimodal fusion, some of the existing methods let different modalities communicate with each other and modal the crossmodal interaction via transformers. However, these methods only use the single-scale representations during the interaction but forget to exploit multi-scale representations that contain different levels of semantic information. As a result, the representations learned by transformers could be biased especially for unaligned multimodal data. In this paper, we propose a multi-scale cooperative multimodal transformer (MCMulT) architecture for multimodal sentiment analysis. On the whole, the "multi-scale" mechanism is capable of exploiting the different levels of semantic information of each modality which are used for fine-grained crossmodal interactions. Meanwhile, each modality learns its feature hierarchies via integrating the crossmodal interactions from multiple level features of its source modality. In this way, each pair of modalities progressively builds feature hierarchies respectively in a cooperative manner. The empirical results illustrate that our MCMulT model not only outperforms existing approaches on unaligned multimodal sequences but also has strong performance on aligned multimodal sequences.

High-fidelity quantum dynamics emulators can be used to predict the time evolution of complex physical systems. Here, we introduce an efficient training framework for constructing machine learning-based emulators. Our approach is based on the idea of knowledge distillation and uses elements of curriculum learning. It works by constructing a set of simple, but rich-in-physics training examples (a curriculum). These examples are used by the emulator to learn the general rules describing the time evolution of a quantum system (knowledge distillation). The goal is not only to obtain high-quality predictions, but also to examine the process of how the emulator learns the physics of the underlying problem. This allows us to discover new facts about the physical system, detect symmetries, and measure relative importance of the contributing physical processes. We illustrate this approach by training an artificial neural network to predict the time evolution of quantum wave packages propagating through a potential landscape. We focus on the question of how the emulator learns the rules of quantum dynamics from the curriculum of simple training examples and to which extent it can generalize the acquired knowledge to solve more challenging cases., Comment: 11 pages plus methods plus supplementary information

Algorithms which minimize the averaged loss have been widely designed for dealing with noisy labels. Intuitively, when there is a finite training sample, penalizing the variance of losses will improve the stability and generalization of the algorithms. Interestingly, we found that the variance should be increased for the problem of learning with noisy labels. Specifically, increasing the variance will boost the memorization effects and reduce the harmfulness of incorrect labels. By exploiting the label noise transition matrix, regularizers can be easily designed to reduce the variance of losses and be plugged in many existing algorithms. Empirically, the proposed method by increasing the variance of losses significantly improves the generalization ability of baselines on both synthetic and real-world datasets.

Gamma-ray bursts (GRBs) are widely believed to be from massive collapsars and/or compact binary mergers, which accordingly, would generate long and short GRBs, respectively. The details on this classification scheme have been in constant debate given more and more observational data available to us. In this work, we apply a series of data mining methods to studying the potential classification information contained in the prompt emission of GRBs detected by the Fermi Gamma-ray Burst Monitor. A tight global correlation is found between fluence ($f$), peak flux ($F$) and prompt duration ($T_{90}$) which takes the form of $ \log {\it f}= 0.75 \log T_{90} +0.92 \log F -7.14$. Based on this correlation, we can define a new parameter $L = 1.66\log T_{90} + 0.84 \log {\it f} - 0.46 \log F + 3.24$ by linear discriminant analysis that would distinguish between long and short GRBs with much less ambiguity than $T_{90}$. We also discussed the three subclasses scheme of GRB classification derived from clusters analysis based on a Gaussian mixture model, and suggest that, besides SGRBs, LGRBs may be divided into long-bright gamma-ray bursts (LBGRBs) and long-faint gamma-ray bursts (LFGRBs), LBGRBs have statistical higher $f$ and $F$ than LFGRBs; further statistical analysis found that LBGRBs also have higher number of GRB pulses than LFGRBs., Comment: 12 pages, 8 figures. Accepted for Publication in ApJ

It is well known that quantum codes can be constructed by means of classical symplectic dual-containing codes. This paper considers a family of two-generator quasi-cyclic codes and derives sufficient conditions for these codes to be symplectic dual-containing. Then, a new method for constructing binary quantum codes using symplectic dual-containing codes is proposed. As an application, we construct 8 binary quantum codes that exceed the best-known results. Further, another 36 new binary quantum codes are obtained by propagation rules, all of which improve the lower bound on the minimum distances.

In this paper, we construct a class of non-weight modules over the affine-Virasoro algebra of type $A_1$ by taking tensor products of a finite number of irreducible modules $M(\lambda, \alpha, \beta, \gamma)$ with irreducible highest weight modules $V(\eta, \epsilon, \theta)$. We obtain the necessary and sufficient conditions for such tensor product modules to be irreducible, and determine the necessary and sufficient conditions for such two modules to be isomorphic. We also compare these modules with other known non-weight modules, showing that these irreducible modules are new., Comment: 21 pages. arXiv admin note: substantial text overlap with arXiv:2102.00979

The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for the EHT is how well key parameters, such as trapped magnetic flux and the associated disk models, can be extracted from present and future EHT VLBI data products. The process of modeling visibilities and analyzing them is complicated by the fact that the data are sparsely sampled in the Fourier domain while most of the theory/simulation is constructed in the image domain. Here we propose a data-driven approach to analyze complex visibilities and closure quantities for radio interferometric data with neural networks. Using mock interferometric data, we show that our neural networks are able to infer the accretion state as either high magnetic flux (MAD) or low magnetic flux (SANE), suggesting that it is possible to perform parameter extraction directly in the visibility domain without image reconstruction. We have applied VLBInet to real M87 EHT data taken on four different days in 2017 (April 5, 6, 10, 11), and our neural networks give a score prediction 0.52, 0.4, 0.43, 0.76 for each day, with an average score 0.53, which shows no significant indication for the data to lean toward either the MAD or SANE state., Comment: 10 pages, 7 figures

Quantifying the morphology of galaxies has been an important task in astrophysics to understand the formation and evolution of galaxies. In recent years, the data size has been dramatically increasing due to several on-going and upcoming surveys. Labeling and identifying interesting objects for further investigations has been explored by citizen science through the Galaxy Zoo Project and by machine learning in particular with the convolutional neural networks (CNNs). In this work, we explore the usage of Vision Transformer (ViT) for galaxy morphology classification for the first time. We show that ViT could reach competitive results compared with CNNs, and is specifically good at classifying smaller-sized and fainter galaxies. With this promising preliminary result, we believe the ViT network architecture can be an important tool for galaxy morphological classification for the next generation surveys. Our open source, is publicly available at \url{https://github.com/sliao-mi-luku/Galaxy-Zoo-Classification}, Comment: 11 pages, 4 figures, accepted by the NeurIPS Machine Learning and the Physical Sciences workshop

Label noise will degenerate the performance of deep learning algorithms because deep neural networks easily overfit label errors. Let X and Y denote the instance and clean label, respectively. When Y is a cause of X, according to which many datasets have been constructed, e.g., SVHN and CIFAR, the distributions of P(X) and P(Y|X) are entangled. This means that the unsupervised instances are helpful to learn the classifier and thus reduce the side effect of label noise. However, it remains elusive on how to exploit the causal information to handle the label noise problem. In this paper, by leveraging a structural causal model, we propose a novel generative approach for instance-dependent label-noise learning. In particular, we show that properly modeling the instances will contribute to the identifiability of the label noise transition matrix and thus lead to a better classifier. Empirically, our method outperforms all state-of-the-art methods on both synthetic and real-world label-noise datasets.

Supermassive black holes (SMBHs) are ubiquitously found at the centers of most massive galaxies. Measuring SMBH mass is important for understanding the origin and evolution of SMBHs. However, traditional methods require spectroscopic data which is expensive to gather. We present an algorithm that weighs SMBHs using quasar light time series, circumventing the need for expensive spectra. We train, validate, and test neural networks that directly learn from the Sloan Digital Sky Survey (SDSS) Stripe 82 light curves for a sample of $38,939$ spectroscopically confirmed quasars to map out the nonlinear encoding between SMBH mass and multi-color optical light curves. We find a 1$\sigma$ scatter of 0.37 dex between the predicted SMBH mass and the fiducial virial mass estimate based on SDSS single-epoch spectra, which is comparable to the systematic uncertainty in the virial mass estimate. Our results have direct implications for more efficient applications with future observations from the Vera C. Rubin Observatory. Our code, \textsf{AGNet}, is publicly available at \url{https://github.com/snehjp2/AGNet}., Comment: 8 pages, 7 figures, 1 table, Accepted by MNRAS

Let $A(1):=k[X]/(X^p)$ be the natural representation of the Witt algebra $W(1)$ over an algebraically closed field of prime characteristic $p>3$. In this note, we decompose the $W(1)$-module $A(1)\otimes A(1)$ into two invariant subspaces, and precisely construct their Jordan-H\"older composition series. As a consequence, we obtain all decomposition factors of the tensor product of the simple restricted $W(1)$-module with "highest" weight $p-1$., Comment: 11 pages

Slow ionic transport and high voltage drop (IR drop) of homogeneous porous electrodes are the critical causes of severe performance degradation of lithium-ion (Li-ion) batteries under high charging rates. Herein, we demonstrate that a bio-inspired vascularized porous electrode can simultaneously solve these two problems by introducing low tortuous channels and graded porosity. To optimize the vasculature structural parameters, we employ artificial neural networks (ANNs) to accelerate the computation of possible structures with high accuracy. Furthermore, an inverse-design searching library is compiled to find the optimal vascular structures under different industrial fabrication and design criteria. The prototype delivers a customizable package containing optimal geometric parameters and their uncertainty and sensitivity analysis. Finally, the full-vascularized cell shows a 66% improvement of charging capacity than the traditional homogeneous cell under 3.2C current density. This research provides an innovative methodology to solve the fast-charging problem in batteries and broaden the applicability of deep learning algorithm to different scientific or engineering areas.

Among the most extreme objects in the Universe, active galactic nuclei (AGN) are luminous centers of galaxies where a black hole feeds on surrounding matter. The variability patterns of the light emitted by an AGN contain information about the physical properties of the underlying black hole. Upcoming telescopes will observe over 100 million AGN in multiple broadband wavelengths, yielding a large sample of multivariate time series with long gaps and irregular sampling. We present a method that reconstructs the AGN time series and simultaneously infers the posterior probability density distribution (PDF) over the physical quantities of the black hole, including its mass and luminosity. We apply this method to a simulated dataset of 11,000 AGN and report precision and accuracy of 0.4 dex and 0.3 dex in the inferred black hole mass. This work is the first to address probabilistic time series reconstruction and parameter inference for AGN in an end-to-end fashion., Comment: 6 pages, 4 figures, 1 table, written for non-astronomers, submitted to the ICML 2021 Time Series and Uncertainty and Robustness in Deep Learning Workshops. Comments welcome! Added affiliations and references for Fig 1

Accurate prediction of pedestrian crossing behaviors by autonomous vehicles can significantly improve traffic safety. Existing approaches often model pedestrian behaviors using trajectories or poses but do not offer a deeper semantic interpretation of a person's actions or how actions influence a pedestrian's intention to cross in the future. In this work, we follow the neuroscience and psychological literature to define pedestrian crossing behavior as a combination of an unobserved inner will (a probabilistic representation of binary intent of crossing vs. not crossing) and a set of multi-class actions (e.g., walking, standing, etc.). Intent generates actions, and the future actions in turn reflect the intent. We present a novel multi-task network that predicts future pedestrian actions and uses predicted future action as a prior to detect the present intent and action of the pedestrian. We also designed an attention relation network to incorporate external environmental contexts thus further improve intent and action detection performance. We evaluated our approach on two naturalistic driving datasets, PIE and JAAD, and extensive experiments show significantly improved and more explainable results for both intent detection and action prediction over state-of-the-art approaches. Our code is available at: https://github.com/umautobots/pedestrian_intent_action_detection., Comment: 7pages, 4 figures, 3 tables. Accepted to IJCAI2021