Search

When a local impurity spin interacts with conduction electrons whose density of states (DOS) has a (pseudo)gap or diverges at the Fermi energy, a local moment (LM) phase can be favored over a Kondo phase. Theoretically studying quantum entanglement between the impurity and conduction electrons, we demonstrate that conduction electrons form an ''LM spin cloud'' in general LM phases, which corresponds to, but has fundamental difference from, the Kondo cloud screening the impurity spin in the Kondo phase. The LM cloud algebraically decays over the distance from the impurity when the DOS has a pseudogap or divergence, and exponentially when it has a hard gap. We find an ''LM cloud length'', a single length scale characterizing a universal form of the LM cloud. The findings are supported by both of analytic theories and numerical computations., Comment: 21 pages, 4 figures for the manuscript; Supplementary material included

Training agents that are robust to environmental changes remains a significant challenge in deep reinforcement learning (RL). Unsupervised environment design (UED) has recently emerged to address this issue by generating a set of training environments tailored to the agent's capabilities. While prior works demonstrate that UED has the potential to learn a robust policy, their performance is constrained by the capabilities of the environment generation. To this end, we propose a novel UED algorithm, adversarial environment design via regret-guided diffusion models (ADD). The proposed method guides the diffusion-based environment generator with the regret of the agent to produce environments that the agent finds challenging but conducive to further improvement. By exploiting the representation power of diffusion models, ADD can directly generate adversarial environments while maintaining the diversity of training environments, enabling the agent to effectively learn a robust policy. Our experimental results demonstrate that the proposed method successfully generates an instructive curriculum of environments, outperforming UED baselines in zero-shot generalization across novel, out-of-distribution environments. Project page: https://github.com/rllab-snu.github.io/projects/ADD, Comment: 38th Conference on Neural Information Processing Systems

Recently, pre-trained language models (PLMs) have been increasingly adopted in spoken language understanding (SLU). However, automatic speech recognition (ASR) systems frequently produce inaccurate transcriptions, leading to noisy inputs for SLU models, which can significantly degrade their performance. To address this, our objective is to train SLU models to withstand ASR errors by exposing them to noises commonly observed in ASR systems, referred to as ASR-plausible noises. Speech noise injection (SNI) methods have pursued this objective by introducing ASR-plausible noises, but we argue that these methods are inherently biased towards specific ASR systems, or ASR-specific noises. In this work, we propose a novel and less biased augmentation method of introducing the noises that are plausible to any ASR system, by cutting off the non-causal effect of noises. Experimental results and analyses demonstrate the effectiveness of our proposed methods in enhancing the robustness and generalizability of SLU models against unseen ASR systems by introducing more diverse and plausible ASR noises in advance., Comment: 9 pages, 3 figures

We propose a novel visual localization and navigation framework for real-world environments directly integrating observed visual information into the bird-eye-view map. While the renderable neural radiance map (RNR-Map) shows considerable promise in simulated settings, its deployment in real-world scenarios poses undiscovered challenges. RNR-Map utilizes projections of multiple vectors into a single latent code, resulting in information loss under suboptimal conditions. To address such issues, our enhanced RNR-Map for real-world robots, RNR-Map++, incorporates strategies to mitigate information loss, such as a weighted map and positional encoding. For robust real-time localization, we integrate a particle filter into the correlation-based localization framework using RNRMap++ without a rendering procedure. Consequently, we establish a real-world robot system for visual navigation utilizing RNR-Map++, which we call "RNR-Nav." Experimental results demonstrate that the proposed methods significantly enhance rendering quality and localization robustness compared to previous approaches. In real-world navigation tasks, RNR-Nav achieves a success rate of 84.4%, marking a 68.8% enhancement over the methods of the original RNR-Map paper.

Handling long input contexts remains a significant challenge for Large Language Models (LLMs), particularly in resource-constrained environments such as mobile devices. Our work aims to address this limitation by introducing InfiniPot, a novel KV cache control framework designed to enable pre-trained LLMs to manage extensive sequences within fixed memory constraints efficiently, without requiring additional training. InfiniPot leverages Continual Context Distillation (CCD), an iterative process that compresses and retains essential information through novel importance metrics, effectively maintaining critical data even without access to future context. Our comprehensive evaluations indicate that InfiniPot significantly outperforms models trained for long contexts in various NLP tasks, establishing its efficacy and versatility. This work represents a substantial advancement toward making LLMs applicable to a broader range of real-world scenarios., Comment: EMNLP 2024 Main

This paper studies the problem of information retrieval, to adapt to unseen tasks. Existing work generates synthetic queries from domain-specific documents to jointly train the retriever. However, the conventional query generator assumes the query as a question, thus failing to accommodate general search intents. A more lenient approach incorporates task-adaptive elements, such as few-shot learning with an 137B LLM. In this paper, we challenge a trend equating query and question, and instead conceptualize query generation task as a "compilation" of high-level intent into task-adaptive query. Specifically, we propose EGG, a query generator that better adapts to wide search intents expressed in the BeIR benchmark. Our method outperforms baselines and existing models on four tasks with underexplored intents, while utilizing a query generator 47 times smaller than the previous state-of-the-art. Our findings reveal that instructing the LM with explicit search intent is a key aspect of modeling an effective query generator.

The rapid advancement of large language models (LLMs) has facilitated their transformation into conversational chatbots that can grasp contextual nuances and generate pertinent sentences, closely mirroring human values through advanced techniques such as instruction tuning and reinforcement learning from human feedback (RLHF). However, the computational efficiency required for LLMs, achieved through techniques like post-training quantization (PTQ), presents challenges such as token-flipping that can impair chatbot performance. In response, we propose a novel preference alignment approach, quantization-aware direct preference optimization (QDPO), that aligns quantized LLMs with their full-precision counterparts, improving conversational abilities. Evaluated on two instruction-tuned LLMs in various languages, QDPO demonstrated superior performance in improving conversational abilities compared to established PTQ and knowledge-distillation fine-tuning techniques, marking a significant step forward in the development of efficient and effective conversational LLMs., Comment: ACL 2024 Main

In metals and semiconductors, an impurity spin is quantum entangled with and thereby screened by surrounding conduction electrons at low temperatures, called the Kondo screening cloud. Quantum confinement of the Kondo screening cloud in a region, called a Kondo box, with a length smaller than the original cloud extension length strongly deforms the screening cloud and provides a way of controlling the entanglement. Here we realize such a Kondo box and develop an approach to controlling and monitoring the entanglement. It is based on a spin localized in a semiconductor quantum dot, which is screened by conduction electrons along a quasi-one-dimensional channel. The box is formed between the dot and a quantum point contact placed on a channel. As the quantum point contact is tuned to make the confinement stronger, electron conductance through the dot as a function of temperature starts to deviate from the known universal function of the single energy scale, the Kondo temperature. Nevertheless, the entanglement is monitored by the measured conductance according to our theoretical development. The dependence of the monitored entanglement on the confinement strength and temperature implies that the Kondo screening is controlled by tuning the quantum point contact. Namely, the Kondo cloud is deformed by the Kondo box in the region across the original cloud length. Our findings offer a way of manipulating and detecting spatially extended quantum many-body entanglement in solids by electrical means.

Deep learning-based face recognition continues to face challenges due to its reliance on huge datasets obtained from web crawling, which can be costly to gather and raise significant real-world privacy concerns. To address this issue, we propose VIGFace, a novel framework capable of generating synthetic facial images. Initially, we train the face recognition model using a real face dataset and create a feature space for both real and virtual IDs where virtual prototypes are orthogonal to other prototypes. Subsequently, we generate synthetic images by using the diffusion model based on the feature space. Our proposed framework provides two significant benefits. Firstly, it allows for creating virtual facial images without concerns about portrait rights, guaranteeing that the generated virtual face images are clearly differentiated from existing individuals. Secondly, it serves as an effective augmentation method by incorporating real existing images. Further experiments demonstrate the efficacy of our framework, achieving state-of-the-art results from both perspectives without any external data.

In the realm of face image quality assesment (FIQA), method based on sample relative classification have shown impressive performance. However, the quality scores used as pseudo-labels assigned from images of classes with low intra-class variance could be unrelated to the actual quality in this method. To address this issue, we present IG-FIQA, a novel approach to guide FIQA training, introducing a weight parameter to alleviate the adverse impact of these classes. This method involves estimating sample intra-class variance at each iteration during training, ensuring minimal computational overhead and straightforward implementation. Furthermore, this paper proposes an on-the-fly data augmentation methodology for improved generalization performance in FIQA. On various benchmark datasets, our proposed method, IG-FIQA, achieved novel state-of-the-art (SOTA) performance.

In recent years, there has been a significant focus on advancing the next generation of power systems. Despite these efforts, persistent challenges revolve around addressing the operational impact of uncertainty on predicted data, especially concerning economic dispatch and optimal power flow. To tackle these challenges, we introduce a stochastic day-ahead scheduling approach for a community. This method involves iterative improvements in economic dispatch and optimal power flow, aiming to minimize operational costs by incorporating quantile forecasting. Then, we present a real-time market and payment problem to handle optimization in real-time decision-making and payment calculation. We assess the effectiveness of our proposed method against benchmark results and conduct a test using data from 50 real households to demonstrate its practicality. Furthermore, we compare our method with existing studies in the field across two different seasons of the year. In the summer season, our method decreases optimality gap by 60% compared to the baseline, and in the winter season, it reduces optimality gap by 67%. Moreover, our proposed method mitigates the congestion of distribution network by 16.7\% within a day caused by uncertain energy, which is a crucial aspect for implementing energy markets in the real world.

Extensive efforts have been undertaken to combine superconductivity and the quantum Hall effect so that Cooper-pair transport between superconducting electrodes in Josephson junctions is mediated by one-dimensional edge states. This interest has been motivated by prospects of finding new physics, including topologically-protected quasiparticles, but also extends into metrology and device applications. So far it has proven challenging to achieve detectable supercurrents through quantum Hall conductors. Here we show that domain walls in minimally twisted bilayer graphene support exceptionally robust proximity superconductivity in the quantum Hall regime, allowing Josephson junctions to operate in fields close to the upper critical field of superconducting electrodes. The critical current is found to be non-oscillatory and practically unchanging over the entire range of quantizing fields, with its value being limited by the quantum conductance of ballistic, strictly one-dimensional electronic channels residing within the domain walls. The system described is unique in its ability to support Andreev bound states at quantizing fields and offers many interesting directions for further exploration., Comment: 24 pages, 14 figures

Successful integration of point-of-care testing (POCT) into clinical settings requires improved assay sensitivity and precision to match laboratory standards. Here, we show how innovations in amplified biosensing, imaging, and data processing, coupled with deep learning, can help improve POCT. To demonstrate the performance of our approach, we present a rapid and cost-effective paper-based high-sensitivity vertical flow assay (hs-VFA) for quantitative measurement of cardiac troponin I (cTnI), a biomarker widely used for measuring acute cardiac damage and assessing cardiovascular risk. The hs-VFA includes a colorimetric paper-based sensor, a portable reader with time-lapse imaging, and computational algorithms for digital assay validation and outlier detection. Operating at the level of a rapid at-home test, the hs-VFA enabled the accurate quantification of cTnI using 50 uL of serum within 15 min per test and achieved a detection limit of 0.2 pg/mL, enabled by gold ion amplification chemistry and time-lapse imaging. It also achieved high precision with a coefficient of variation of < 7% and a very large dynamic range, covering cTnI concentrations over six orders of magnitude, up to 100 ng/mL, satisfying clinical requirements. In blinded testing, this computational hs-VFA platform accurately quantified cTnI levels in patient samples and showed a strong correlation with the ground truth values obtained by a benchtop clinical analyzer. This nanoparticle amplification-based computational hs-VFA platform can democratize access to high-sensitivity point-of-care diagnostics and provide a cost-effective alternative to laboratory-based biomarker testing., Comment: 23 Pages, 4 Figures, 1 Table

Large Language Models (LLMs) are proficient in natural language processing tasks, but their deployment is often restricted by extensive parameter sizes and computational demands. This paper focuses on post-training quantization (PTQ) in LLMs, specifically 4-bit weight and 8-bit activation (W4A8) quantization, to enhance computational efficiency -- a topic less explored compared to weight-only quantization. We present two innovative techniques: activation-quantization-aware scaling (AQAS) and sequence-length-aware calibration (SLAC) to enhance PTQ by considering the combined effects on weights and activations and aligning calibration sequence lengths to target tasks. Moreover, we introduce dINT, a hybrid data format combining integer and denormal representations, to address the underflow issue in W4A8 quantization, where small values are rounded to zero. Through rigorous evaluations of LLMs, including OPT and LLaMA, we demonstrate that our techniques significantly boost task accuracies to levels comparable with full-precision models. By developing arithmetic units compatible with dINT, we further confirm that our methods yield a 2$\times$ hardware efficiency improvement compared to 8-bit integer MAC unit., Comment: EMNLP 2023 Main Conference. Corrected an error in the first author name

Magnetic microrobots have been developed for navigating microscale environments by means of remote magnetic fields. However, limited propulsion speeds at small scales remain an issue in the maneuverability of these devices as magnetic force and torque are proportional to their magnetic volume. Here, we propose a microrobotic superstructure, which, as analogous to a supramolecular system, consists of two or more microrobotic units that are interconnected and organized through a physical (transient) component (a polymeric frame or a thread). Our superstructures consist of microfabricated magnetic helical micromachines interlocked by a magnetic gelatin nanocomposite containing iron oxide nanoparticles (IONPs). While the microhelices enable the motion of the superstructure, the IONPs serve as heating transducers for dissolving the gelatin chassis via magnetic hyperthermia. In a practical demonstration, we showcase the superstructure's motion with a gradient magnetic field in a large channel, the disassembly of the superstructure and release of the helical micromachines by a high-frequency alternating magnetic field, and the corkscrew locomotion of the released helices through a small channel via a rotating magnetic field. This adaptable microrobotic superstructure reacts to different magnetic inputs, which could be used to perform complex delivery procedures within intricate regions of the human body.

Generative Language Models (GLMs) have shown impressive performance in tasks such as text generation, understanding, and reasoning. However, the large model size poses challenges for practical deployment. To solve this problem, Quantization-Aware Training (QAT) has become increasingly popular. However, current QAT methods for generative models have resulted in a noticeable loss of accuracy. To counteract this issue, we propose a novel knowledge distillation method specifically designed for GLMs. Our method, called token-scaled logit distillation, prevents overfitting and provides superior learning from the teacher model and ground truth. This research marks the first evaluation of ternary weight quantization-aware training of large-scale GLMs with less than 1.0 degradation in perplexity and achieves enhanced accuracy in tasks like common-sense QA and arithmetic reasoning as well as natural language understanding. Our code is available at https://github.com/aiha-lab/TSLD., Comment: NeurIPS 2023 Camera Ready

Conventional solvers are often computationally expensive for constrained optimization, particularly in large-scale and time-critical problems. While this leads to a growing interest in using neural networks (NNs) as fast optimal solution approximators, incorporating the constraints with NNs is challenging. In this regard, we propose deep Lagrange dual with equality embedding (DeepLDE), a framework that learns to find an optimal solution without using labels. To ensure feasible solutions, we embed equality constraints into the NNs and train the NNs using the primal-dual method to impose inequality constraints. Furthermore, we prove the convergence of DeepLDE and show that the primal-dual learning method alone cannot ensure equality constraints without the help of equality embedding. Simulation results on convex, non-convex, and AC optimal power flow (AC-OPF) problems show that the proposed DeepLDE achieves the smallest optimality gap among all the NN-based approaches while always ensuring feasible solutions. Furthermore, the computation time of the proposed method is about 5 to 250 times faster than DC3 and the conventional solvers in solving constrained convex, non-convex optimization, and/or AC-OPF., Comment: 11 pages, 5 figures

We propose a systematic framework to conduct design-technology pathfinding for PPAC in advanced nodes. Our goal is to provide configurable, scalable generation of process design kit (PDK) and standard-cell library, spanning key scaling boosters (backside PDN and buried power rail), to explore PPAC across given technology and design parameters. We build on PROBE2.0, which addressed only area and cost (AC), to include power and performance (PP) evaluations through automated generation of full design enablements. We also improve the use of artificial designs in the PPAC assessment of technology and design configurations. We generate more realistic artificial designs by applying a machine learning-based parameter tuning flow. We further employ clustering-based cell width-regularized placements at the core of routability assessment, enabling more realistic placement utilization and improved experimental efficiency. We demonstrate PPAC evaluation across scaling boosters and artificial designs in a predictive technology node., Comment: 14 pages, 17 figures, submitted to IEEE Trans. on CAD

The main challenge in vision-and-language navigation (VLN) is how to understand natural-language instructions in an unseen environment. The main limitation of conventional VLN algorithms is that if an action is mistaken, the agent fails to follow the instructions or explores unnecessary regions, leading the agent to an irrecoverable path. To tackle this problem, we propose Meta-Explore, a hierarchical navigation method deploying an exploitation policy to correct misled recent actions. We show that an exploitation policy, which moves the agent toward a well-chosen local goal among unvisited but observable states, outperforms a method which moves the agent to a previously visited state. We also highlight the demand for imagining regretful explorations with semantically meaningful clues. The key to our approach is understanding the object placements around the agent in spectral-domain. Specifically, we present a novel visual representation, called scene object spectrum (SOS), which performs category-wise 2D Fourier transform of detected objects. Combining exploitation policy and SOS features, the agent can correct its path by choosing a promising local goal. We evaluate our method in three VLN benchmarks: R2R, SOON, and REVERIE. Meta-Explore outperforms other baselines and shows significant generalization performance. In addition, local goal search using the proposed spectral-domain SOS features significantly improves the success rate by 17.1% and SPL by 20.6% for the SOON benchmark., Comment: Accepted by CVPR 2023. Project page: https://rllab-snu.github.io/projects/Meta-Explore/doc.html

Pre-trained Transformer models such as BERT have shown great success in a wide range of applications, but at the cost of substantial increases in model complexity. Quantization-aware training (QAT) is a promising method to lower the implementation cost and energy consumption. However, aggressive quantization below 2-bit causes considerable accuracy degradation due to unstable convergence, especially when the downstream dataset is not abundant. This work proposes a proactive knowledge distillation method called Teacher Intervention (TI) for fast converging QAT of ultra-low precision pre-trained Transformers. TI intervenes layer-wise signal propagation with the intact signal from the teacher to remove the interference of propagated quantization errors, smoothing loss surface of QAT and expediting the convergence. Furthermore, we propose a gradual intervention mechanism to stabilize the recovery of subsections of Transformer layers from quantization. The proposed schemes enable fast convergence of QAT and improve the model accuracy regardless of the diverse characteristics of downstream fine-tuning tasks. We demonstrate that TI consistently achieves superior accuracy with significantly lower fine-tuning iterations on well-known Transformers of natural language processing as well as computer vision compared to the state-of-the-art QAT methods., Comment: Accepted to EACL 2023 (main conference)

Divergent density of states (DOS) can induce extraordinary phenomena such as significant enhancement of superconductivity and unexpected phase transitions. Moreover, van Hove singularities (VHSs) are known to lead to divergent DOS in two-dimensional (2D) systems. Despite the recent interest in VHSs, only a few controllable cases have been reported to date. In this work, we investigate the electronic band structures of a 2D VHS with angle-resolved photoemission spectroscopy and control transport properties by utilizing an atomically ultrathin SrRuO$_3$ film. By applying electric fields with alkali metal deposition and ionic-liquid gating methods, we precisely control the 2D VHS, and the sign of the charge carrier. Use of a tunable 2D VHS in an atomically flat oxide film could serve as a new strategy to realize infinite DOS near the Fermi level, thereby allowing efficient tuning of electric properties., Comment: 7 pages, 4 figures

Knowledge distillation (KD) has been a ubiquitous method for model compression to strengthen the capability of a lightweight model with the transferred knowledge from the teacher. In particular, KD has been employed in quantization-aware training (QAT) of Transformer encoders like BERT to improve the accuracy of the student model with the reduced-precision weight parameters. However, little is understood about which of the various KD approaches best fits the QAT of Transformers. In this work, we provide an in-depth analysis of the mechanism of KD on attention recovery of quantized large Transformers. In particular, we reveal that the previously adopted MSE loss on the attention score is insufficient for recovering the self-attention information. Therefore, we propose two KD methods; attention-map and attention-output losses. Furthermore, we explore the unification of both losses to address task-dependent preference between attention-map and output losses. The experimental results on various Transformer encoder models demonstrate that the proposed KD methods achieve state-of-the-art accuracy for QAT with sub-2-bit weight quantization., Comment: EMNLP 2022 Main Track Long Paper

Advanced flexible electronics and soft robotics require the development and implementation of flexible functional materials. Magnetoelectric (ME) oxide materials can convert magnetic input into electric output and vice versa, making them excellent candidates for advanced sensing, actuating, data storage, and communication. However, their application has been limited to rigid devices due to their brittle nature. Here, we report flexible ME oxide composite (BaTiO3/CoFe2O4) thin film nanostructures that can be transferred onto a stretchable substrate such as polydimethylsiloxane (PDMS). In contrast to rigid bulk counterparts, these ceramic nanostructures display a flexible behavior and exhibit reversibly tunable ME coupling via mechanical stretching. We believe our study can open up new avenues for integrating ceramic ME composites into flexible electronics and soft robotic devices.

Embeddings, which compress information in raw text into semantics-preserving low-dimensional vectors, have been widely adopted for their efficacy. However, recent research has shown that embeddings can potentially leak private information about sensitive attributes of the text, and in some cases, can be inverted to recover the original input text. To address these growing privacy challenges, we propose a privatization mechanism for embeddings based on homomorphic encryption, to prevent potential leakage of any piece of information in the process of text classification. In particular, our method performs text classification on the encryption of embeddings from state-of-the-art models like BERT, supported by an efficient GPU implementation of CKKS encryption scheme. We show that our method offers encrypted protection of BERT embeddings, while largely preserving their utility on downstream text classification tasks., Comment: NAACL 2022

Session-based recommendations aim to predict the next behavior of users based on ongoing sessions. The previous works have been modeling the session as a variable-length of a sequence of items and learning the representation of both individual items and the aggregated session. Recent research has applied graph neural networks with an attention mechanism to capture complicated item transitions and dependencies by modeling the sessions into graph-structured data. However, they still face fundamental challenges in terms of data and learning methodology such as sparse supervision signals and noisy interactions in sessions, leading to sub-optimal performance. In this paper, we propose SR-GCL, a novel contrastive learning framework for a session-based recommendation. As a crucial component of contrastive learning, we propose two global context enhanced data augmentation methods while maintaining the semantics of the original session. The extensive experiment results on two real-world E-commerce datasets demonstrate the superiority of SR-GCL as compared to other state-of-the-art methods., Comment: 11 pages. This paper has been accepted by DLG-AAAI'22

Nanoporous membranes based on two dimensional materials are predicted to provide highly selective gas transport in combination with extreme permeability. Here we investigate membranes made from multilayer graphdiyne, a graphene-like crystal with a larger unit cell. Despite being nearly a hundred of nanometers thick, the membranes allow fast, Knudsen-type permeation of light gases such as helium and hydrogen whereas heavy noble gases like xenon exhibit strongly suppressed flows. Using isotope and cryogenic temperature measurements, the seemingly conflicting characteristics are explained by a high density of straight-through holes (direct porosity of ~0.1%), in which heavy atoms are adsorbed on the walls, partially blocking Knudsen flows. Our work offers important insights into intricate transport mechanisms playing a role at nanoscale.

The shape recovery ability of shape-memory alloys vanishes below a critical size (~50nm), which prevents their practical applications at the nanoscale. In contrast, ferroic materials, even when scaled down to dimensions of a few nanometers, exhibit actuation strain through domain switching, though the generated strain is modest (~1%). Here, we develop free-standing twisted architectures of nanoscale ferroic oxides showing shape-memory effect with a giant recoverable strain (>10%). The twisted geometrical design amplifies the strain generated during ferroelectric domain switching, which cannot be achieved in bulk ceramics or substrate-bonded thin films. The twisted ferroic nanocomposites allow us to overcome the size limitations in traditional shape-memory alloys and opens new avenues in engineering large-stroke shape-memory materials for small-scale actuating devices such as nanorobots and artificial muscle fibrils.

Deep learning for Information Retrieval (IR) requires a large amount of high-quality query-document relevance labels, but such labels are inherently sparse. Label smoothing redistributes some observed probability mass over unobserved instances, often uniformly, uninformed of the true distribution. In contrast, we propose knowledge distillation for informed labeling, without incurring high computation overheads at evaluation time. Our contribution is designing a simple but efficient teacher model which utilizes collective knowledge, to outperform state-of-the-arts distilled from a more complex teacher model. Specifically, we train up to x8 faster than the state-of-the-art teacher, while distilling the rankings better. Our code is publicly available at https://github.com/jihyukkim-nlp/CollectiveKD, Comment: NAACL 2022

Finding d-electron heavy fermion (HF) states has been an important topic as the diversity in d-electron materials can lead to many exotic Kondo effect-related phenomena or new states of matter such as correlation-driven topological Kondo insulator or cooperation between long-range magnetism and Kondo lattice behavior. Yet, obtaining direct spectroscopic evidence for a d-electron HF system has been elusive to date. Here, we report the observation of Kondo lattice behavior in an antiferromagnetic metal, FeTe, via angle-resolved photoemission spectroscopy (ARPES) and transport properties measurements. The Kondo lattice behavior is represented by the emergence of a sharp quasiparticle at low temperatures. The transport property measurements confirm the low-temperature Fermi liquid behavior and reveal successive coherent-incoherent crossover upon increasing temperature. We interpret the Kondo lattice behavior as a result of hybridization between localized Fe 3dxy and itinerant Te 5pz orbitals. Our interpretation is further evidenced by Fano-type tunneling spectra which accompany a hybridization gap. Our observations strongly suggest unusual cooperation between Kondo lattice behavior and long-range magnetic order., Comment: 17 pages, 6 figures

Unstructured environments are difficult for autonomous driving. This is because various unknown obstacles are lied in drivable space without lanes, and its width and curvature change widely. In such complex environments, searching for a path in real-time is difficult. Also, inaccurate localization data reduce the path tracking accuracy, increasing the risk of collision. Instead of searching and tracking the path, an alternative approach has been proposed that reactively avoids obstacles in real-time. Some methods are available for tracking global path while avoiding obstacles using the candidate paths and the artificial potential field. However, these methods require heuristics to find specific parameters for handling various complex environments. In addition, it is difficult to track the global path accurately in practice because of inaccurate localization data. If the drivable space is not accurately recognized (i.e., noisy state), the vehicle may not smoothly drive or may collide with obstacles. In this study, a method in which the vehicle drives toward drivable space only using a vision-based occupancy grid map is proposed. The proposed method uses imitation learning, where a deep neural network is trained with expert driving data. The network can learn driving patterns suited for various complex and noisy situations because these situations are contained in the training data. Experiments with a vehicle in actual parking lots demonstrated the limitations of general model-based methods and the effectiveness of the proposed imitation learning method., Comment: 16 pages

Rapidly-exploring random tree (RRT) has been applied for autonomous parking due to quickly solving high-dimensional motion planning and easily reflecting constraints. However, planning time increases by the low probability of extending toward narrow parking spots without collisions. To reduce the planning time, the target tree algorithm was proposed, substituting a parking goal in RRT with a set (target tree) of backward parking paths. However, it consists of circular and straight paths, and an autonomous vehicle cannot park accurately because of curvature-discontinuity. Moreover, the planning time increases in complex environments; backward paths can be blocked by obstacles. Therefore, this paper introduces the continuous-curvature target tree algorithm for complex parking environments. First, a target tree includes clothoid paths to address such curvature-discontinuity. Second, to reduce the planning time further, a cost function is defined to construct a target tree that considers obstacles. Integrated with optimal-variant RRT and searching for the shortest path among the reached backward paths, the proposed algorithm obtains a near-optimal path as the sampling time increases. Experiment results in real environments show that the vehicle more accurately parks, and continuous-curvature paths are obtained more quickly and with higher success rates than those acquired with other sampling-based algorithms., Comment: 10 pages, 7 figures

Non-linear operations such as GELU, Layer normalization, and Softmax are essential yet costly building blocks of Transformer models. Several prior works simplified these operations with look-up tables or integer computations, but such approximations suffer inferior accuracy or considerable hardware cost with long latency. This paper proposes an accurate and hardware-friendly approximation framework for efficient Transformer inference. Our framework employs a simple neural network as a universal approximator with its structure equivalently transformed into a LUT. The proposed framework called NN-LUT can accurately replace all the non-linear operations in popular BERT models with significant reductions in area, power consumption, and latency., Comment: 7 pages, 3 figures

We performed in-situ angle-resolved photoemission spectroscopy (ARPES) and spin-resolved ARPES (SARPES) experiments to investigate the relationship between electronic band structures and ferromagnetism in SrRuO$_3$ (SRO) thin films. Our high-quality ARPES and SARPES results show clear spin-lifted band structures. The spin polarization is strongly dependent on momentum around the Fermi level, whereas it becomes less dependent at high-binding energies. This experimental observation matches our dynamical mean-field theory (DMFT) results very well. As temperature increases from low to the Curie temperature, spin-splitting gap decreases and band dispersions become incoherent. Based on the ARPES study and theoretical calculation results, we found that SRO possesses spin-dependent electron correlations in which majority and minority spins are localized and itinerant, respectively. Our finding explains how ferromagnetism and electronic structure are connected, which has been under debate for decades in SRO., Comment: 6 pages, 4 figures

Correlated electrons in transition metal oxides (TMOs) exhibit a variety of emergent phases. When TMOs are confined to a single-atomic-layer thickness, experiments so far have shown that they usually lose diverse properties and become insulators. In an attempt to extend the range of electronic phases of the single-atomic-layer oxide, we search for a metallic phase in a monolayer-thick epitaxial SrRuO$_3$ film. Combining atomic-scale epitaxy and angle-resolved photoemission measurements, we show that the monolayer SrRuO$_3$ is a strongly correlated metal. Systematic investigation reveals that the interplay between dimensionality and electronic correlation makes the monolayer SrRuO$_3$ an incoherent metal with orbital-selective correlation. Furthermore, the unique electronic phase of the monolayer SrRuO$_3$ is found to be highly tunable, as charge modulation demonstrates an incoherent-to-coherent crossover of the two-dimensional metal. Our work emphasizes the potentially rich phases of single-atomic-layer oxides and provides a guide to the manipulation of their two-dimensional correlated electron systems.

In recent times, the production of multidimensional data in various domains and their storage in array databases has witnessed a sharp increase; this rapid growth in data volumes necessitates compression in array databases. However, existing compression schemes used in array databases are general-purpose and not designed specifically for the databases. They could degrade query performance with complex analytical tasks, which incur huge computing costs. Thus, a compression scheme that considers the workflow of array databases is required. This study presents a compression scheme, SEACOW, for storing and querying multidimensional array data. The scheme is specially designed to be efficient for both dimension-based and value-based exploration. It considers data access patterns for exploration queries and embeds a synopsis, which can be utilized as an index, in the compressed array. In addition, we implement an array storage system, namely MSDB, to perform experiments. We evaluate query performance on real scientific datasets and compared it with those of existing compression schemes. Finally, our experiments demonstrate that SEACOW provides high compression rates compared to existing compression schemes, and the synopsis improves analytical query processing performance., Comment: (c) 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

In spectroscopic experiments, data acquisition in multi-dimensional phase space may require long acquisition time, owing to the large phase space volume to be covered. In such case, the limited time available for data acquisition can be a serious constraint for experiments in which multidimensional spectral data are acquired. Here, taking angle-resolved photoemission spectroscopy (ARPES) as an example, we demonstrate a denoising method that utilizes deep learning as an intelligent way to overcome the constraint. With readily available ARPES data and random generation of training data set, we successfully trained the denoising neural network without overfitting. The denoising neural network can remove the noise in the data while preserving its intrinsic information. We show that the denoising neural network allows us to perform similar level of second-derivative and line shape analysis on data taken with two orders of magnitude less acquisition time. The importance of our method lies in its applicability to any multidimensional spectral data that are susceptible to statistical noise., Comment: 8 pages, 8 figures

In thermodynamic equilibrium, current in metallic systems is carried by electronic states near the Fermi energy whereas the filled bands underneath contribute little to conduction. Here we describe a very different regime in which carrier distribution in graphene and its superlattices is shifted so far from equilibrium that the filled bands start playing an essential role, leading to a critical-current behavior. The criticalities develop upon the velocity of electron flow reaching the Fermi velocity. Key signatures of the out-of-equilibrium state are current-voltage characteristics resembling those of superconductors, sharp peaks in differential resistance, sign reversal of the Hall effect, and a marked anomaly caused by the Schwinger-like production of hot electron-hole plasma. The observed behavior is expected to be common for all graphene-based superlattices., Comment: 22 pages, 11 figures

Face recognition now requires a large number of labelled masked face images in the era of this unprecedented COVID-19 pandemic. Unfortunately, the rapid spread of the virus has left us little time to prepare for such dataset in the wild. To circumvent this issue, we present a 3D model-based approach called WearMask3D for augmenting face images of various poses to the masked face counterparts. Our method proceeds by first fitting a 3D morphable model on the input image, second overlaying the mask surface onto the face model and warping the respective mask texture, and last projecting the 3D mask back to 2D. The mask texture is adapted based on the brightness and resolution of the input image. By working in 3D, our method can produce more natural masked faces of diverse poses from a single mask texture. To compare precisely between different augmentation approaches, we have constructed a dataset comprising masked and unmasked faces with labels called MFW-mini. Experimental results demonstrate WearMask3D produces more realistic masked faces, and utilizing these images for training leads to state-of-the-art recognition accuracy for masked faces., Comment: 5 pages, 5 figures and 2 tables; accepted to ICIP 2021

The heavy fermion state with Kondo-hybridization (KH), usually manifested in f-electron systems with lanthanide or actinide elements, was recently discovered in several 3d transition metal compounds without f-electrons. However, KH has not yet been observed in 4d/5d transition metal compounds, since more extended 4d/5d orbitals do not usually form flat bands that supply localized electrons appropriate for Kondo pairing. Here, we report a doping- and temperature-dependent angle-resolved photoemission study on 4d Ca2-xSrxRuO4, which shows the signature of KH. We observed a spectral weight transfer in the {\gamma}-band, reminiscent of an orbital-selective Mott phase (OSMP). The Mott localized {\gamma}-band induces KH with the itinerant \b{eta}-band, resulting in spectral weight suppression around the Fermi level. Our work is the first to demonstrate the evolution of the OSMP with possible KH among 4d electrons, and thereby expands the material boundary of Kondo physics to 4d multi-orbital systems.

Alkali metal dosing (AMD) has been widely used as a way to control doping without chemical substitution. This technique, in combination with angle resolved photoemission spectroscopy (ARPES), often provides an opportunity to observe unexpected phenomena. However, the amount of transferred charge and the corresponding change in the electronic structure vary significantly depending on the material. Here, we report study on the correlation between the sample work function and alkali metal induced electronic structure change for three iron-based superconductors: FeSe, Ba(Fe$_{0.94}$Co$_{0.06}$)$_{2}$As$_{2}$ and NaFeAs which share a similar Fermi surface topology. Electronic structure change upon monolayer of alkali metal dosing and the sample work function were measured by ARPES. Our results show that the degree of electronic structure change is proportional to the difference between the work function of the sample and Mulliken's absolute electronegativity of the dosed alkali metal. This finding provides a possible way to estimate the AMD induced electronic structure change., Comment: 4 pages

Rotation of MO6 (M = transition metal) octahedra is a key determinant of the physical properties of perovskite materials. Therefore, tuning physical properties, one of the most important goals in condensed matter research, may be accomplished by controlling octahedral rotation (OR). In this study, it is demonstrated that OR can be driven by an electric field in Sr$_2$RuO$_4$. Rotated octahedra in the surface layer of Sr$_2$RuO$_4$ are restored to the unrotated bulk structure upon dosing the surface with K. Theoretical investigation shows that OR in Sr$_2$RuO$_4$ originates from the surface electric field, which can be tuned via the screening effect of the overlaid K layer. This work establishes not only that variation in the OR angle can be induced by an electric field, but also provides a way to control OR, which is an important step towards in situ control of the physical properties of perovskite oxides.

We present a variational matrix product state (vMPS) for the ground state of the spin-1/2 Heisenberg model. The MPS effectively organizes the various dimer configurations, in faithful reflection of the resonating valence bond (RVB) picture of the spin liquid, with the energy only 0.024% higher than the exact value given by Bethe ansatz. Building on the ground-state vMPS, the one-spin wave function is constructed in a simple manner with the dispersion that matches well with the exact spectrum. The vMPS scheme is applied to the family of Hamiltonian extrapolating between the Heisenberg model and the Majumdar-Ghosh model., Comment: 6 pages including supplementary material, 3 figures

Ferromagnetism and exotic topological structures in SrRuO$_3$ (SRO) induce sign-changing anomalous Hall effect (AHE). Recently, hump structures have been reported in the Hall resistivity of SRO thin films, especially in the ultra-thin regime. We investigate the AHE and hump structure in the Hall resistivity of SRO ultra-thin films with an SrTiO$_3$ (STO) capping layer and ionic liquid gating. STO capping results in sign changes in the AHE and modulation of the hump structure. In particular, the hump structure in the Hall resistivity is strongly modulated and even vanishes in STO-capped 4 unit cell (uc) films. In addition, the conductivity of STO-capped SRO ultra-thin films is greatly enhanced with restored ferromagnetism. We also performed ionic liquid gating to modulate the electric field at SRO/STO interface. Drastic changes in the AHE and hump structure are observed with different gate voltages. Our study shows that the hump structure as well as the AHE can be controlled by tuning inversion symmetry and the electric field at the interface., Comment: 5 pages, 5 figures

In quantizing magnetic fields, graphene superlattices exhibit a complex fractal spectrum often referred to as the Hofstadter butterfly. It can be viewed as a collection of Landau levels that arise from quantization of Brown-Zak minibands recurring at rational ($p/q$) fractions of the magnetic flux quantum per superlattice unit cell. Here we show that, in graphene-on-boron-nitride superlattices, Brown-Zak fermions can exhibit mobilities above 10$^6$ cm$^2$V$^{-1}$s$^{-1}$ and the mean free path exceeding several micrometers. The exceptional quality of our devices allows us to show that Brown-Zak minibands are $4q$ times degenerate and all the degeneracies (spin, valley and mini-valley) can be lifted by exchange interactions below 1K. We also found negative bend resistance at $1/q$ fractions for electrical probes placed as far as several micrometers apart. The latter observation highlights the fact that Brown-Zak fermions are Bloch quasiparticles propagating in high fields along straight trajectories, just like electrons in zero field., Comment: 16 pages, 13 figures

We propose a simple variational wave function that captures the correct ground state energy of the spin-1 Heisenberg chain model to within 0.04\%. The wave function is written in the matrix product state (MPS) form with the bond dimension $D=8$, and characterized by three fugacity parameters. The proposed MPS generalizes the Affleck-Kennedy-Lieb-Tasaki (AKLT) state by dressing it with dimers, trimers, and general $q$-dimers. The fugacity parameters control the number and the average size of the $q$-mers. Furthermore, the $D=8$ variational MPS state captures the ground states of the entire family of bilinear-biquadratic Hamiltonian belonging to the Haldane phase to high accuracy. The 2-4-2 degeneracy structure in the entanglement spectrum of our MPS state is found to match well with the results of density matrix renormalization group (DMRG) calculation, which is computationally much heavier. Spin-spin correlation functions also find excellent fit with those obtained by DMRG.

We studied the electronic band structure of pulsed laser deposition (PLD) grown (111)-oriented SrRuO$_3$ (SRO) thin films using \textit{in situ} angle-resolved photoemission spectroscopy (ARPES) technique. We observed previously unreported, light bands with a renormalized quasiparticle effective mass of about 0.8$m_{e}$. The electron-phonon coupling underlying this mass renormalization yields a characteristic "kink" in the band dispersion. The self-energy analysis using the Einstein model suggests five optical phonon modes covering an energy range 44 to 90 meV contribute to the coupling. Besides, we show that the quasiparticle spectral intensity at the Fermi level is considerably suppressed, and two prominent peaks appear in the valance band spectrum at binding energies of 0.8 eV and 1.4 eV, respectively. We discuss the possible implications of these observations. Overall, our work demonstrates that high-quality thin films of oxides with large spin-orbit coupling can be grown along the polar (111) orientation by the PLD technique, enabling \textit{in situ} electronic band structure study. This could allow for characterizing the thickness-dependent evolution of band structure of (111) heterostructures$-$a prerequisite for exploring possible topological quantum states in the bilayer limit.

Magnetism and spin-orbit coupling (SOC) are two quintessential ingredients underlying novel topological transport phenomena in itinerant ferromagnets. When spin-polarized bands support nodal points/lines with band degeneracy that can be lifted by SOC, the nodal structures become a source of Berry curvature; this leads to a large anomalous Hall effect (AHE). Contrary to three-dimensional systems that naturally host nodal points/lines, two-dimensional (2D) systems can possess stable nodal structures only when proper crystalline symmetry exists. Here we show that 2D spin-polarized band structures of perovskite oxides generally support symmetry-protected nodal lines and points that govern both the sign and the magnitude of the AHE. To demonstrate this, we performed angle-resolved photoemission studies of ultrathin films of SrRuO$_3$, a representative metallic ferromagnet with SOC. We show that the sign-changing AHE upon variation in the film thickness, magnetization, and chemical potential can be well explained by theoretical models. Our study is the first to directly characterize the topological band structure of 2D spin-polarized bands and the corresponding AHE, which could facilitate new switchable devices based on ferromagnetic ultrathin films.

We present a technically simple implementation of quantitative phase imaging in confocal microscopy based on synthetic optical holography with sinusoidal-phase reference waves. Using a Mirau interference objective and low-amplitude vertical sample vibration with a piezo-controlled stage, we record synthetic holograms on commercial confocal microscopes (Nikon, model: A1R; Zeiss: model: LSM-880), from which quantitative phase images are reconstructed. We demonstrate our technique by stain-free imaging of cervical (HeLa) and ovarian (ES-2) cancer cells and stem cell (mHAT9a) samples. Our technique has the potential to extend fluorescence imaging applications in confocal microscopy by providing label-free cell finding, monitoring cell morphology, as well as non-perturbing long-time observation of live cells based on quantitative phase contrast., Comment: (c) 2019 Optical Society of America. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modifications of the content of this paper are prohibited. https://www.osapublishing.org/ao/abstract.cfm?uri=ao-58-5-A55

The coupling of electron orbital motion and spin leads to nontrivial changes in energy-level structures, leading to various spectroscopies and applications. In atoms, such spin-orbit coupling (SOC) causes anomalous Zeeman splitting, known as the Paschen-Back (PB) effect, in the pres-ence of a strong magnetic field. In solids, SOC generates energy-band inversion or splitting, a prerequisite for topological phases or Majorana fermions, at zero or weak magnetic fields. Here, we present the first observation of PB splitting of Landau levels (LLs) in indium arsenide nan-owires in a strong-field regime. Our energy-resolved transport spectroscopy results indicated the presence of LL-dependent anomalous Zeeman splitting in these nanowires, analogous to the atomic PB effect. This result was found to be in good agreement with a theoretical analysis based on Rashba SOC. Our findings also suggested a way of generating spin-resolved electron transport in nanowires., Comment: 23 pages, 5 figures, SI

We present a unified framework to predict tumor proliferation scores from breast histopathology whole slide images. Our system offers a fully automated solution to predicting both a molecular data-based, and a mitosis counting-based tumor proliferation score. The framework integrates three modules, each fine-tuned to maximize the overall performance: An image processing component for handling whole slide images, a deep learning based mitosis detection network, and a proliferation scores prediction module. We have achieved 0.567 quadratic weighted Cohen's kappa in mitosis counting-based score prediction and 0.652 F1-score in mitosis detection. On Spearman's correlation coefficient, which evaluates predictive accuracy on the molecular data based score, the system obtained 0.6171. Our approach won first place in all of the three tasks in Tumor Proliferation Assessment Challenge 2016 which is MICCAI grand challenge., Comment: Accepted to the 3rd Workshop on Deep Learning in Medical Image Analysis (DLMIA 2017), MICCAI 2017