Search

Invariant learning methods, aimed at identifying a consistent predictor across multiple environments, are gaining prominence in out-of-distribution (OOD) generalization. Yet, when environments aren't inherent in the data, practitioners must define them manually. This environment partitioning--algorithmically segmenting the training dataset into environments--crucially affects invariant learning's efficacy but remains underdiscussed. Proper environment partitioning could broaden the applicability of invariant learning and enhance its performance. In this paper, we suggest partitioning the dataset into several environments by isolating low-correlation data subsets. Through experiments with synthetic and real data, our Decorr method demonstrates superior performance in combination with invariant learning. Decorr mitigates the issue of spurious correlations, aids in identifying stable predictors, and broadens the applicability of invariant learning methods.

Adaptive Mesh Refinement (AMR) is becoming a prevalent data representation for scientific visualization. Resulting from large fluid mechanics simulations, the data is usually cell centric, imposing a number of challenges for high quality reconstruction at sample positions. While recent work has concentrated on real-time volume and isosurface rendering on GPUs, the rendering methods used still focus on simple lighting models without scattering events and global illumination. As in other areas of rendering, key to real-time performance are acceleration data structures; in this work we analyze the major bottlenecks of data structures that were originally optimized for camera/primary ray traversal when used with the incoherent ray tracing workload of a volumetric path tracer, and propose strategies to overcome the challenges coming with this.

Image super-resolution is a common task on mobile and IoT devices, where one often needs to upscale and enhance low-resolution images and video frames. While numerous solutions have been proposed for this problem in the past, they are usually not compatible with low-power mobile NPUs having many computational and memory constraints. In this Mobile AI challenge, we address this problem and propose the participants to design an efficient quantized image super-resolution solution that can demonstrate a real-time performance on mobile NPUs. The participants were provided with the DIV2K dataset and trained INT8 models to do a high-quality 3X image upscaling. The runtime of all models was evaluated on the Synaptics VS680 Smart Home board with a dedicated edge NPU capable of accelerating quantized neural networks. All proposed solutions are fully compatible with the above NPU, demonstrating an up to 60 FPS rate when reconstructing Full HD resolution images. A detailed description of all models developed in the challenge is provided in this paper., Comment: arXiv admin note: text overlap with arXiv:2105.07825, arXiv:2105.08826, arXiv:2211.04470, arXiv:2211.03885, arXiv:2211.05256

The light hadron decay processes of $Z_b(10610)/Z_b(10650)$ provide us a way to study their nature and decay mechanism. In this work, we evaluate the branching ratios of $Z_b(10610)/Z_b(10650) \to VP$ ($V$ and $P$ stand for light vector and pseudoscalar mesons, respectively) using an effective Lagrangian approach, in which the contributions of intermediate bottomed meson triangle loops are considered. In our calculations, the $Z_b(10610)$ and $Z_b(10650)$ are regarded as $B\bar{B}^*+c.c.$ and $B^*\bar{B}^*$ molecular states, respectively. The predicted branching ratios of $Z_b(10610)\rightarrow VP$ are about in the order of $10^{-2}$, while the branching ratios of $Z_b(10650)\rightarrow VP$ are in the order of $10^{-3}$. Furthermore, the dependence of these ratios between different decay modes of $Z_b(10610)/Z_b(10650)$ on the mixing $\eta-\eta^\prime$ angle $\theta_P$ is investigated, which may be a good quantity for the experiments. It is hoped that the calculations here could be tested by future experiments., Comment: 7 pages, 8 figures and 1 table

The charmless decay processes of $X(3872)$ provide us a good platform to study the nature and the decay mechanism of $X(3872)$. Based on a molecular nature of $X(3872)$ as a $\bar{D}D^*$ bound state, we have investigated the charmless decays $X(3872) \to VV$ and $VP$ via intermediate $D^*{\bar D} +c.c.$ meson loops, where $V$ and $P$ stand for light vector and pseudoscalar mesons, respectively. We discuss three cases, i.e., pure neutral components ($\theta=0$), isospin singlet ($\theta=\pi/4$) and neutral components dominant ($\theta = \pi/6$), where $\theta$ is a phase angle describing the proportion of neutral and charged constituents. The proportion of neutral and charged constituent have an influence on the decay widths of $X(3872) \to VV$ and $VP$. With the coupling constant of $X(3872)$ to the $\bar{D}D^*$ channel obtained under the molecule ansatz of $X(3872)$ resonance, the predicted decay widths of $X(3872)\rightarrow VV$ are about tens of keVs, while the decay width can reach a few hundreds of keVs for $X(3872)\to VP$. The dependence of these ratios between different decay modes of $X(3872)\to VV$ and $X(3872)\to VP$ to the mixing angle $\theta$ is also investigated. It is expected that the theoretical calculations here can be tested by future experiments., Comment: 9 pages, 8 figures, submitted to Phys. Rev. D

Text-based Visual Question Answering~(TextVQA) aims to produce correct answers for given questions about the images with multiple scene texts. In most cases, the texts naturally attach to the surface of the objects. Therefore, spatial reasoning between texts and objects is crucial in TextVQA. However, existing approaches are constrained within 2D spatial information learned from the input images and rely on transformer-based architectures to reason implicitly during the fusion process. Under this setting, these 2D spatial reasoning approaches cannot distinguish the fine-grain spatial relations between visual objects and scene texts on the same image plane, thereby impairing the interpretability and performance of TextVQA models. In this paper, we introduce 3D geometric information into a human-like spatial reasoning process to capture the contextual knowledge of key objects step-by-step. %we formulate a human-like spatial reasoning process by introducing 3D geometric information for capturing key objects' contextual knowledge. To enhance the model's understanding of 3D spatial relationships, Specifically, (i)~we propose a relation prediction module for accurately locating the region of interest of critical objects; (ii)~we design a depth-aware attention calibration module for calibrating the OCR tokens' attention according to critical objects. Extensive experiments show that our method achieves state-of-the-art performance on TextVQA and ST-VQA datasets. More encouragingly, our model surpasses others by clear margins of 5.7\% and 12.1\% on questions that involve spatial reasoning in TextVQA and ST-VQA valid split. Besides, we also verify the generalizability of our model on the text-based image captioning task., Comment: Accepted by TIP2023, The Arxiv version of "Weakly-Supervised 3D Spatial Reasoning for Text-based Visual Question Answering"

Ultrafast optical spectroscopy was used to investigate the ultrafast quasiparticle dynamics of antiferromagnetic Kondo lattice CeAuSb$_2$ as a function of temperature and fluence. Our results reveal (i) the opening of a narrow hybridization gap ($\Delta$ $\sim$ 4.5 meV) near the Fermi level below the coherence temperature $T^*$ $\approx$ 100 K, (ii) the coupling of coherent phonon modes with Kondo effect and magnetic orders, leading to the frequencies anomaly at the characteristic temperatures, and (iii) a possible photoinduced nonthermal phase transition. Our observations thus shed light on the hybridization dynamics and magnetic orders in heavy fermion systems., Comment: 6 pages with 4 figures

Volume data is found in many important scientific and engineering applications. Rendering this data for visualization at high quality and interactive rates for demanding applications such as virtual reality is still not easily achievable even using professional-grade hardware. We introduce FoVolNet -- a method to significantly increase the performance of volume data visualization. We develop a cost-effective foveated rendering pipeline that sparsely samples a volume around a focal point and reconstructs the full-frame using a deep neural network. Foveated rendering is a technique that prioritizes rendering computations around the user's focal point. This approach leverages properties of the human visual system, thereby saving computational resources when rendering data in the periphery of the user's field of vision. Our reconstruction network combines direct and kernel prediction methods to produce fast, stable, and perceptually convincing output. With a slim design and the use of quantization, our method outperforms state-of-the-art neural reconstruction techniques in both end-to-end frame times and visual quality. We conduct extensive evaluations of the system's rendering performance, inference speed, and perceptual properties, and we provide comparisons to competing neural image reconstruction techniques. Our test results show that FoVolNet consistently achieves significant time saving over conventional rendering while preserving perceptual quality., Comment: To appear at IEEE VIS 2022 and later TVCG

Over the years, state-of-the-art (SoTA) image captioning methods have achieved promising results on some evaluation metrics (e.g., CIDEr). However, recent findings show that the captions generated by these methods tend to be biased toward the "average" caption that only captures the most general mode (a.k.a, language pattern) in the training corpus, i.e., the so-called mode collapse problem. Affected by it, the generated captions are limited in diversity and usually less informative than natural image descriptions made by humans. In this paper, we seek to avoid this problem by proposing a Discrete Mode Learning (DML) paradigm for image captioning. Our innovative idea is to explore the rich modes in the training caption corpus to learn a set of "mode embeddings", and further use them to control the mode of the generated captions for existing image captioning models. Specifically, the proposed DML optimizes a dual architecture that consists of an image-conditioned discrete variational autoencoder (CdVAE) branch and a mode-conditioned image captioning (MIC) branch. The CdVAE branch maps each image caption to one of the mode embeddings stored in a learned codebook, and is trained with a pure non-autoregressive generation objective to make the modes distinct and representative. The MIC branch can be simply modified from an existing image captioning model, where the mode embedding is added to the original word embeddings as the control signal. In the experiments, we apply the proposed DML to two widely used image captioning models, Transformer and AoANet. The results show that the learned mode embedding successfully facilitates these models to generate high-quality image captions with different modes, further leading to better performance for both diversity and quality on the MSCOCO dataset., Comment: NeurIPS 2022

Pulsar wind nebula (PWN) Boomerang and the associated supernova remnant (SNR) G106.3+2.7 are among candidates for the ultra-high-energy (UHE) gamma-ray counterparts published by LHAASO. Although the centroid of the extended source, LHAASO J2226+6057, deviates from the pulsar's position by about $0.3^\circ$, the source partially covers the PWN. Therefore, we cannot totally exclude the possibility that a part of the UHE emission comes from the PWN. Previous studies mainly focus on whether the SNR is a PeVatron, while neglecting the energetic PWN. Here, we explore the possibility of the Boomerang Nebula being a PeVatron candidate by studying its X-ray radiation. By modelling the diffusion of relativistic electrons injected in the PWN, we fit the radial profiles of the X-ray surface brightness and the photon index. The solution with a magnetic field $B=140\mu$G can well reproduce the observed profiles and implies a severe suppression of IC scattering of electrons. Therefore, a proton component need be introduced to account for the UHE emission, in light of recent LHAASO's measurement on Crab Nebula, if future observations reveal part of the UHE emission originating from the PWN. In this sense, Boomerang Nebula would be a hadronic PeVatron., Comment: 15 pages, 5 figures, 5 tables; Invited contribution to Special Issue of Universe "Advances in Astrophysics and Cosmology in China - in Memory of Prof. Tan Lu"

Nonorthogonal quantum state discrimination (QSD) plays an important role in quantum information and quantum communication. In addition, compared to Hermitian quantum systems, parity-time-($\mathcal{PT}$-)symmetric non-Hermitian quantum systems exhibit novel phenomena and have attracted considerable attention. Here, we experimentally demonstrate QSD in a $\mathcal{PT}$-symmetric system (i.e., $\mathcal{PT}$-symmetric QSD), by having quantum states evolve under a $\mathcal{PT}$-symmetric Hamiltonian in a lossy linear optical setup. We observe that two initially nonorthogonal states can rapidly evolve into orthogonal states, and the required evolution time can even be vanishing provided the matrix elements of the Hamiltonian become sufficiently large. We also observe that the cost of such a discrimination is a dissipation of quantum states into the environment. Furthermore, by comparing $\mathcal{PT}$-symmetric QSD with optimal strategies in Hermitian systems, we find that at the critical value, $\mathcal{PT}$-symmetric QSD is equivalent to the optimal unambiguous state discrimination in Hermitian systems. We also extend the $\mathcal{PT}$-symmetric QSD to the case of discriminating three nonorthogonal states. The QSD in a $\mathcal{PT}$-symmetric system opens a new door for quantum state discrimination, which has important applications in quantum computing, quantum cryptography, and quantum communication., Comment: 12 pages, 9 figures, comments are welcome

Wave-particle duality relations are fundamental for quantum physics. Previous experimental studies of duality relations mainly focus on the quadratic relation $D^2+V^2\leq1$, based on symmetric beam interference, while a linear form of the duality relation, predicated earlier theoretically, has never been experimentally tested. In addition, the difference between the quadratic form and the linear form has not been explored yet. In this work, with a designed asymmetric beam interference and by utilizing the polarization degree of freedom of the photon as a which-way detector, we experimentally confirm both forms of the duality relations. The results show that more path information is obtained in the quadratic case. Our findings reveal the difference between the two duality relations and have fundamental implications in better understanding these important duality relations., Comment: 9 pages, 7 figures, comments are welcome

Estimating the average treatment effect (ATE) from observational data is challenging due to selection bias. Existing works mainly tackle this challenge in two ways. Some researchers propose constructing a score function that satisfies the orthogonal condition, which guarantees that the established ATE estimator is "orthogonal" to be more robust. The others explore representation learning models to achieve a balanced representation between the treated and the controlled groups. However, existing studies fail to 1) discriminate treated units from controlled ones in the representation space to avoid the over-balanced issue; 2) fully utilize the "orthogonality information". In this paper, we propose a moderately-balanced representation learning (MBRL) framework based on recent covariates balanced representation learning methods and orthogonal machine learning theory. This framework protects the representation from being over-balanced via multi-task learning. Simultaneously, MBRL incorporates the noise orthogonality information in the training and validation stages to achieve a better ATE estimation. The comprehensive experiments on benchmark and simulated datasets show the superiority and robustness of our method on treatment effect estimations compared with existing state-of-the-art methods., Comment: This paper was accepted and will be published at the 19th Pacific Rim International Conference on Artificial Intelligence (PRICAI2022)

Many practical decision-making problems in economics and healthcare seek to estimate the average treatment effect (ATE) from observational data. The Double/Debiased Machine Learning (DML) is one of the prevalent methods to estimate ATE in the observational study. However, the DML estimators can suffer an error-compounding issue and even give an extreme estimate when the propensity scores are misspecified or very close to 0 or 1. Previous studies have overcome this issue through some empirical tricks such as propensity score trimming, yet none of the existing literature solves this problem from a theoretical standpoint. In this paper, we propose a Robust Causal Learning (RCL) method to offset the deficiencies of the DML estimators. Theoretically, the RCL estimators i) are as consistent and doubly robust as the DML estimators, and ii) can get rid of the error-compounding issue. Empirically, the comprehensive experiments show that i) the RCL estimators give more stable estimations of the causal parameters than the DML estimators, and ii) the RCL estimators outperform the traditional estimators and their variants when applying different machine learning models on both simulation and benchmark datasets., Comment: This paper was accepted and will be published at The 2022 International Joint Conference on Neural Networks (IJCNN2022). arXiv admin note: substantial text overlap with arXiv:2103.11869

Although Transformers have successfully transitioned from their language modelling origins to image-based applications, their quadratic computational complexity remains a challenge, particularly for dense prediction. In this paper we propose a content-based sparse attention method, as an alternative to dense self-attention, aiming to reduce the computation complexity while retaining the ability to model long-range dependencies. Specifically, we cluster and then aggregate key and value tokens, as a content-based method of reducing the total token count. The resulting clustered-token sequence retains the semantic diversity of the original signal, but can be processed at a lower computational cost. Besides, we further extend the clustering-guided attention from single-scale to multi-scale, which is conducive to dense prediction tasks. We label the proposed Transformer architecture ClusTR, and demonstrate that it achieves state-of-the-art performance on various vision tasks but at lower computational cost and with fewer parameters. For instance, our ClusTR small model with 22.7M parameters achieves 83.2\% Top-1 accuracy on ImageNet. Source code and ImageNet models will be made publicly available., Comment: 14 pages

Deep learning-based single image super-resolution (SISR) approaches have drawn much attention and achieved remarkable success on modern advanced GPUs. However, most state-of-the-art methods require a huge number of parameters, memories, and computational resources, which usually show inferior inference times when applying them to current mobile device CPUs/NPUs. In this paper, we propose a simple plain convolution network with a fast nearest convolution module (NCNet), which is NPU-friendly and can perform a reliable super-resolution in real-time. The proposed nearest convolution has the same performance as the nearest upsampling but is much faster and more suitable for Android NNAPI. Our model can be easily deployed on mobile devices with 8-bit quantization and is fully compatible with all major mobile AI accelerators. Moreover, we conduct comprehensive experiments on different tensor operations on a mobile device to illustrate the efficiency of our network architecture. Our NCNet is trained and validated on the DIV2K 3x dataset, and the comparison with other efficient SR methods demonstrated that the NCNet can achieve high fidelity SR results while using fewer inference times. Our codes and pretrained models are publicly available at \url{https://github.com/Algolzw/NCNet}., Comment: AIM & Mobile AI 2022

One of the universal features of unconventional superconductors is that the superconducting (SC) state is developed in the proximity of an antiferromagnetic (AFM) state. Understanding the interplay between these two states is one of the key issues to uncover the underlying physics of unconventional SC mechanism. Here, we report a pressure-induced flipping of the AFM state to SC state in the quasi-one-dimensional AMn6Bi5 (A = K, Rb, and Cs) compounds. We find that at a critical pressure the AFM state suddenly disappears at a finite temperature and a SC state simultaneously emerges at a lower temperature without detectable structural changes. Intriguingly, all members of the family present the AFM-SC transition at almost the same critical pressures (Pc), though their ambient-pressure unit-cell volumes vary substantially. Our theoretical calculations indicate that the increasing weight of dxz orbital electrons near Fermi energy under the pressure may be the origin of the flipping. These results reveal a diversity of competing nature between the AFM and SC states among the 3d-transition-metal compounds., Comment: 18 pages and 4 figures

The strange metal (SM) state, characterized by a linear-in-temperature resistivity, is often seen in the normal state of high temperature superconductors. It is believed that the SM state is one of the keys to understand the underlying mechanism of high-Tc superconductivity. Here we report the first observation of the concurrent breakdown of the SM normal state and superconductivity at a pressure-induced quantum critical point in an iron-pnictide superconductor, Ca10(Pt4As8)((Fe0.97Pt0.03)2As2)5. We find that, upon suppressing the superconducting state by applying pressure, the power exponent changes from 1 to 2, and the corresponding coefficient A, the slope of the temperature-linear resistivity per FeAs layer, gradually diminishes. At a critical pressure (12.5 GPa), A and Tc go to zero concurrently,where a quantum phase transition (QPT) from a superconducting state with a SM normal state to a non-superconducting Fermi liquid state takes place. Scaling analysis on the results obtained from the pressurized 1048 superconductor reveals that A and Tc have a positive relation, which exhibits a similarity with that is seen in other chemically-doped unconventional superconductors, regardless of the type of the tuning method (doping or pressurizing), the crystal structure, the bulk or film superconductors and the nature of dopant. These results suggest that there is a simple but powerful organizational principle of connecting the SM normal state with the high-Tc superconductivity., Comment: 16 pages, 4 figures

Neural networks have shown great potential in compressing volume data for visualization. However, due to the high cost of training and inference, such volumetric neural representations have thus far only been applied to offline data processing and non-interactive rendering. In this paper, we demonstrate that by simultaneously leveraging modern GPU tensor cores, a native CUDA neural network framework, and a well-designed rendering algorithm with macro-cell acceleration, we can interactively ray trace volumetric neural representations (10-60fps). Our neural representations are also high-fidelity (PSNR > 30dB) and compact (10-1000x smaller). Additionally, we show that it is possible to fit the entire training step inside a rendering loop and skip the pre-training process completely. To support extreme-scale volume data, we also develop an efficient out-of-core training strategy, which allows our volumetric neural representation training to potentially scale up to terascale using only an NVIDIA RTX 3090 workstation., Comment: There is a supplementary video for this manuscript, which can be accessed via this link: https://drive.google.com/file/d/17wSgIm_VsoeGhfyZwMpOnCYy2Mj3ydGv/view?usp=sharing

In the past years, many efforts have been made to study various noteworthy phenomena in both parity-time ($\mathcal{PT}$) and anti-parity-time ($\mathcal{APT}$) symmetric systems. However, entanglement dynamics in $\mathcal{APT}$-symmetric systems has not previously been investigated in both theory and experiments. Here, we investigate the entanglement evolution of two qubits in an $\mathcal{APT}$-symmetric system. In the $\mathcal{APT}$-symmetric unbroken regime, our theoretical simulations demonstrate the periodic oscillations of entanglement when each qubit evolves identically, while the nonperiodic oscillations of entanglement when each qubit evolves differently. In particular, when each qubit evolves near the exceptional point in the $\mathcal{APT}$-symmetric unbroken regime, there exist entanglement sudden vanishing and revival. Moreover, our simulations demonstrate rapid decay and delayed death of entanglement provided one qubit evolves in the $\mathcal{APT}$-symmetric broken regime. In this work, we also perform an experiment with a linear optical setup. The experimental results agree well with our theoretical simulation results. Our findings reveal novel phenomena of entanglement evolution in the $\mathcal{APT}$-symmetric system and opens a new direction for future studies on the dynamics of quantum entanglement in multiqubit $\mathcal{APT}$-symmetric systems or other non-Hermitian quantum systems., Comment: 13 pages, 8 figures

Optical full-field recovery makes it possible to compensate for fiber impairments such as chromatic dispersion and polarization mode dispersion (PMD) in the digital signal processing. For cost-sensitive short-reach optical networks, some advanced single-polarization (SP) optical field recovery schemes are recently proposed to avoid chromatic dispersion-induced power fading effect, and improve the spectral efficiency for larger potential capacity. Polarization division multiplexing (PDM) can further double both the spectral efficiency and the system capacity of these SP carrier-assisted direct detection (DD) schemes. However, the so-called polarization fading phenomenon induced by random polarization rotation is a fundamental obstacle which prevents SP carrier-assisted DD systems from polarization diversity. In this paper, we propose a receiver of Jones-space field recovery (JSFR) to realize polarization diversity with SP carrier-assisted DD schemes in Jones space. Different receiver structures and simplified recovery procedures for JSFR are explored theoretically. The proposed JSFR pushes the SP DD schemes towards PDM without extra optical signal-to-noise ratio (OSNR) penalty. In addition, the JSFR shows good tolerance to PMD since the optical field recovery is conducted before polarization recovery. In the concept-of-proof experiment, we demonstrate 448-Gb/s reception over 80-km single-mode fiber using the proposed JSFR based on 22 couplers. Furthermore, we qualitatively compare the optical field recovery in Jones space and Stokes space from the perspective of the modulation dimension. Qualitatively, we compare the optical field recovery in the Jones space and Stokes space from the perspective of the modulation dimension., Comment: 8 pages and 9 figures

Recently, online shopping has gradually become a common way of shopping for people all over the world. Wonderful merchandise advertisements often attract more people to buy. These advertisements properly integrate multimodal multi-structured information of commodities, such as visual spatial information and fine-grained structure information. However, traditional multimodal text generation focuses on the conventional description of what existed and happened, which does not match the requirement of advertisement copywriting in the real world. Because advertisement copywriting has a vivid language style and higher requirements of faithfulness. Unfortunately, there is a lack of reusable evaluation frameworks and a scarcity of datasets. Therefore, we present a dataset, E-MMAD (e-commercial multimodal multi-structured advertisement copywriting), which requires, and supports much more detailed information in text generation. Noticeably, it is one of the largest video captioning datasets in this field. Accordingly, we propose a baseline method and faithfulness evaluation metric on the strength of structured information reasoning to solve the demand in reality on this dataset. It surpasses the previous methods by a large margin on all metrics. The dataset and method are coming soon on \url{https://e-mmad.github.io/e-mmad.net/index.html}.

This work addresses the Burst Super-Resolution (BurstSR) task using a new architecture, which requires restoring a high-quality image from a sequence of noisy, misaligned, and low-resolution RAW bursts. To overcome the challenges in BurstSR, we propose a Burst Super-Resolution Transformer (BSRT), which can significantly improve the capability of extracting inter-frame information and reconstruction. To achieve this goal, we propose a Pyramid Flow-Guided Deformable Convolution Network (Pyramid FG-DCN) and incorporate Swin Transformer Blocks and Groups as our main backbone. More specifically, we combine optical flows and deformable convolutions, hence our BSRT can handle misalignment and aggregate the potential texture information in multi-frames more efficiently. In addition, our Transformer-based structure can capture long-range dependency to further improve the performance. The evaluation on both synthetic and real-world tracks demonstrates that our approach achieves a new state-of-the-art in BurstSR task. Further, our BSRT wins the championship in the NTIRE2022 Burst Super-Resolution Challenge., Comment: CVPRW, Winner method in NTIRE 2022 Burst Super-Resolution Challenge Real-World Track

Not until recently, robust bipedal locomotion has been achieved through reinforcement learning. However, existing implementations rely heavily on insights and efforts from human experts, which is costly for the iterative design of robot systems. Also, styles of the learned motion are strictly limited to that of the reference. In this paper, we propose a new way to learn bipedal locomotion from a simple sine wave as the reference for foot heights. With the naive human insight that the two feet should be lifted up alternatively and periodically, we experimentally demonstrate on the Cassie robot that, a simple reward function is able to make the robot learn to walk end-to-end and efficiently without any explicit knowledge of the model. With custom sine waves, the learned gait pattern can also have customized styles. Codes are released at github.com/WooQi57/sin-cassie-rl., Comment: \c{opyright} 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

A long-term goal of AI research is to build intelligent agents that can communicate with humans in natural language, perceive the environment, and perform real-world tasks. Vision-and-Language Navigation (VLN) is a fundamental and interdisciplinary research topic towards this goal, and receives increasing attention from natural language processing, computer vision, robotics, and machine learning communities. In this paper, we review contemporary studies in the emerging field of VLN, covering tasks, evaluation metrics, methods, etc. Through structured analysis of current progress and challenges, we highlight the limitations of current VLN and opportunities for future work. This paper serves as a thorough reference for the VLN research community., Comment: 19 pages. Accepted to ACL 2022

Pre-training has been adopted in a few of recent works for Vision-and-Language Navigation (VLN). However, previous pre-training methods for VLN either lack the ability to predict future actions or ignore the trajectory contexts, which are essential for a greedy navigation process. In this work, to promote the learning of spatio-temporal visual-textual correspondence as well as the agent's capability of decision making, we propose a novel history-and-order aware pre-training paradigm (HOP) with VLN-specific objectives that exploit the past observations and support future action prediction. Specifically, in addition to the commonly used Masked Language Modeling (MLM) and Trajectory-Instruction Matching (TIM), we design two proxy tasks to model temporal order information: Trajectory Order Modeling (TOM) and Group Order Modeling (GOM). Moreover, our navigation action prediction is also enhanced by introducing the task of Action Prediction with History (APH), which takes into account the history visual perceptions. Extensive experimental results on four downstream VLN tasks (R2R, REVERIE, NDH, RxR) demonstrate the effectiveness of our proposed method compared against several state-of-the-art agents.

Layered tellurides have been extensively studied as a platform for investigating the Fermi surface (FS) nesting-driven charge density wave (CDW) states. EuTe4, one of quasi-two-dimensional (quasi-2D) binary rare-earth tetratellurides CDW compounds, with unconventional hysteretic transition, is currently receiving much attention. Here, the CDW modulation vector, momentum and temperature dependence of CDW gaps in EuTe4 are investigated using angle-resolved photoemission spectroscopy. Our results reveal that (i) a FS nesting vector q ~ 0.67 b* drives the formation of CDW state, (ii) a large anisotropic CDW gap is fully open in the whole FS, and maintains a considerable size even at 300 K, leading to appearance of semiconductor properties, (iii) an abnormal non-monotonic increase of CDW gap in magnitude as a function of temperature, (iv) an extra, larger gap opens at a higher binding energy due to the interaction between the different orbits of the main bands., Comment: 5 pages, 4 figures

Knowledge-based visual question answering requires the ability of associating external knowledge for open-ended cross-modal scene understanding. One limitation of existing solutions is that they capture relevant knowledge from text-only knowledge bases, which merely contain facts expressed by first-order predicates or language descriptions while lacking complex but indispensable multimodal knowledge for visual understanding. How to construct vision-relevant and explainable multimodal knowledge for the VQA scenario has been less studied. In this paper, we propose MuKEA to represent multimodal knowledge by an explicit triplet to correlate visual objects and fact answers with implicit relations. To bridge the heterogeneous gap, we propose three objective losses to learn the triplet representations from complementary views: embedding structure, topological relation and semantic space. By adopting a pre-training and fine-tuning learning strategy, both basic and domain-specific multimodal knowledge are progressively accumulated for answer prediction. We outperform the state-of-the-art by 3.35% and 6.08% respectively on two challenging knowledge-required datasets: OK-VQA and KRVQA. Experimental results prove the complementary benefits of the multimodal knowledge with existing knowledge bases and the advantages of our end-to-end framework over the existing pipeline methods. The code is available at https://github.com/AndersonStra/MuKEA., Comment: Accepted by CVPR2022

Quantum entanglement between an interfering particle and a detector for acquiring the which-path information plays a central role for enforcing Bohr's complementarity principle. However, the quantitative relation between this entanglement and the fringe visibility remains untouched upon for an initial mixed state. Here we find an equality for quantifying this relation. Our equality characterizes how well the interference pattern can be preserved when an interfering particle, initially carrying a definite amount of coherence, is entangled, to a certain degree, with a which-path detector. This equality provides a connection between entanglement and interference in the unified framework of coherence, revealing the quantitative entanglement-interference complementarity. We experimentally demonstrate this relation with a superconducting circuit, where a resonator serves as a which-path detector for an interfering qubit. The measured fringe visibility of the qubit's Ramsey signal and the qubit-resonator entanglement exhibit a complementary relation, in well agreement with the theoretical prediction., Comment: 19 pages, 9 figures, 1 table

Given their extremely large distances and small apparent sizes, quasars are generally considered as objects with near-zero parallax and proper motion. However, some special quasars may have abnormal astrometric characteristics, such as quasar pairs, lensed quasars, AGNs with bright parsec-scale optical jets, which are scientifically interesting objects, such as binary black holes. These quasars may come with astrometric jitter detectable with Gaia data, or significant changes in the position at different wavelengths. In this work, we aim to find these quasar candidates from Gaia EDR3 astrometric data combining with Sloan Digital Sky Survey (SDSS) spectroscopic data to provide a candidate catalog to the science community. We propose a series of criteria for selecting abnormal quasars based on Gaia astrometric data. We obtain two catalogs containing 155 sources and 44 sources, respectively. They are potential candidates of quasar pairs., Comment: 17 pages, 13 figures Accepted on 28 January 2022 Front. Astron. Space Sci

The newly discovered ternary chalcogenide superconductor Bi$_2$Rh$_3$Se$_2$ has attracted growing attention, which provides an opportunity to explore the interplay between charge density wave (CDW) order and superconductivity. However, whether the phase transition at 240 K can be attributed to CDW formation remains controversial. To help resolve the debate, we study the electronic structure study of Bi2Rh3Se2 by angle-resolved photoemission spectroscopy experiments, with emphasis on the nature of its high-temperature phase transition at 240 K. Our measurements demonstrate that the phase transition at 240 K is a second-order CDW phase transition. Our results reveal (i) a 2 x 2 CDW order in Bi$_2$Rh$_3$Se$_2$, accompanied by the reconstruction of electronic structure, such as band folding, band splitting, and opening of CDW gaps at and away from Fermi level; (ii) the existence of electron-phonon coupling, which is manifested as an obvious kink and peak-dip-hump structure in dispersion; and (iii) the appearance of a flat band. Our observations thus enable us to shed light on the nature of the CDW order and its interplay with superconductivity in Bi$_2$Rh$_3$Se$_2$., Comment: 5 pages, 5 figures

Most existing works in vision-and-language navigation (VLN) focus on either discrete or continuous environments, training agents that cannot generalize across the two. The fundamental difference between the two setups is that discrete navigation assumes prior knowledge of the connectivity graph of the environment, so that the agent can effectively transfer the problem of navigation with low-level controls to jumping from node to node with high-level actions by grounding to an image of a navigable direction. To bridge the discrete-to-continuous gap, we propose a predictor to generate a set of candidate waypoints during navigation, so that agents designed with high-level actions can be transferred to and trained in continuous environments. We refine the connectivity graph of Matterport3D to fit the continuous Habitat-Matterport3D, and train the waypoints predictor with the refined graphs to produce accessible waypoints at each time step. Moreover, we demonstrate that the predicted waypoints can be augmented during training to diversify the views and paths, and therefore enhance agent's generalization ability. Through extensive experiments we show that agents navigating in continuous environments with predicted waypoints perform significantly better than agents using low-level actions, which reduces the absolute discrete-to-continuous gap by 11.76% Success Weighted by Path Length (SPL) for the Cross-Modal Matching Agent and 18.24% SPL for the Recurrent VLN-BERT. Our agents, trained with a simple imitation learning objective, outperform previous methods by a large margin, achieving new state-of-the-art results on the testing environments of the R2R-CE and the RxR-CE datasets.