Search

This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only communications, the proposed AVIN-Chat can offer audio-visual communications providing users with a superior experience quality. In addition, the proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state. Thus, it enables users to establish a strong bond with the chatbot system, increasing the user's immersion. Through user subjective tests, it is demonstrated that the proposed system provides users with a higher sense of immersion than previous chatbot systems. The demonstration video is available at https://www.youtube.com/watch?v=Z74uIV9k7_k.

Carlotto, Chodosh and Rubinstein have studied the convergence rate of the Yamabe flow. Inspired by their result, we study the convergence rate of the $Q$-curvature flow in this paper. In particular, we provide an example of a slowly converging $Q_6$-curvature flow in dimension 6, in constrast to the dimension 2 case, where the $Q$-curvature flow always converges exponentially., Comment: All comments welcome! arXiv admin note: substantial text overlap with arXiv:2107.09616, arXiv:2212.04367; substantial text overlap with arXiv:1401.3738 by other authors

We investigate 1D and 2D cross-stitch lattices with hard-core bosons and analytically construct exact groundstates that feature macroscopic degeneracy. The construction relies on the presence of a flatband in the single particle spectrum and the orthogonality of the associated compact localized states (CLS). Up to filling fraction $\nu=1/2$, the groundstate is constructed by occupying the CLS. Exactly at $\nu=1/2$, the groundstate becomes a Wigner crystal. For higher filling fractions, the groundstate is constructed by filling the CLS sites completely one by one. Macroscopic degeneracy arises from the multiple choices available when occupying or filling the CLS sites. An occupied CLS acts as an impenetrable barrier for bosons both in 1D and 2D, leading to Hilbert space fragmentation. A similar phenomenology also holds for hard-core bosons on the diamond chain and its higher dimensional generalizations. We also discuss the mapping of these hard-core models onto spin models with quantum many-body scars., Comment: 9 pages, 5 figures

In smart manufacturing systems (SMSs), flexible job-shop scheduling with transportation constraints (FJSPT) is essential to optimize solutions for maximizing productivity, considering production flexibility based on automated guided vehicles (AGVs). Recent developments in deep reinforcement learning (DRL)-based methods for FJSPT have encountered a scale generalization challenge. These methods underperform when applied to environment at scales different from their training set, resulting in low-quality solutions. To address this, we introduce a novel graph-based DRL method, named the Heterogeneous Graph Scheduler (HGS). Our method leverages locally extracted relational knowledge among operations, machines, and vehicle nodes for scheduling, with a graph-structured decision-making framework that reduces encoding complexity and enhances scale generalization. Our performance evaluation, conducted with benchmark datasets, reveals that the proposed method outperforms traditional dispatching rules, meta-heuristics, and existing DRL-based approaches in terms of makespan performance, even on large-scale instances that have not been experienced during training.

Molecular core structures and R-groups are essential concepts in drug development. Integration of these concepts with conventional graph pre-training approaches can promote deeper understanding in molecules. We propose MolPLA, a novel pre-training framework that employs masked graph contrastive learning in understanding the underlying decomposable parts inmolecules that implicate their core structure and peripheral R-groups. Furthermore, we formulate an additional framework that grants MolPLA the ability to help chemists find replaceable R-groups in lead optimization scenarios. Experimental results on molecular property prediction show that MolPLA exhibits predictability comparable to current state-of-the-art models. Qualitative analysis implicate that MolPLA is capable of distinguishing core and R-group sub-structures, identifying decomposable regions in molecules and contributing to lead optimization scenarios by rationally suggesting R-group replacements given various query core templates. The code implementation for MolPLA and its pre-trained model checkpoint is available at https://github.com/dmis-lab/MolPLA

In this paper, we establish Liouville-type theorems for a one-parameter family of elliptic PDEs on the standard upper half-plane model of the hyperbolic space, under specific geometric assumptions. Our results indicate that the Euclidean half-plane is the only compactification of the hyperbolic space when the scalar curvature of the compactified metric has a designated sign., Comment: 21 pages, all comments welcome!

We present a novel unsupervised domain adaption method for person re-identification (reID) that generalizes a model trained on a labeled source domain to an unlabeled target domain. We introduce a camera-driven curriculum learning (CaCL) framework that leverages camera labels of person images to transfer knowledge from source to target domains progressively. To this end, we divide target domain dataset into multiple subsets based on the camera labels, and initially train our model with a single subset (i.e., images captured by a single camera). We then gradually exploit more subsets for training, according to a curriculum sequence obtained with a camera-driven scheduling rule. The scheduler considers maximum mean discrepancies (MMD) between each subset and the source domain dataset, such that the subset closer to the source domain is exploited earlier within the curriculum. For each curriculum sequence, we generate pseudo labels of person images in a target domain to train a reID model in a supervised way. We have observed that the pseudo labels are highly biased toward cameras, suggesting that person images obtained from the same camera are likely to have the same pseudo labels, even for different IDs. To address the camera bias problem, we also introduce a camera-diversity (CD) loss encouraging person images of the same pseudo label, but captured across various cameras, to involve more for discriminative feature learning, providing person representations robust to inter-camera variations. Experimental results on standard benchmarks, including real-to-real and synthetic-to-real scenarios, demonstrate the effectiveness of our framework., Comment: Accepted to ICCV 2023

We generate compact localized states in an electrical diamond lattice, comprised of only capacitors and inductors, via local driving near its flatband frequency. We compare experimental results to numerical simulations and find very good agreement. We also examine the stub lattice, which features a flatband of a different class where neighboring compact localized states share lattice sites. We find that local driving, while exciting the lattice at that flatband frequency, is unable to isolate a single compact localized state due to their non-orthogonality. Finally, we introduce lattice nonlinearity and showcase the realization of nonlinear compact localized states in the diamond lattice. Our findings pave the way of applying flatband physics to complex electric circuit dynamics.

In this paper, we establish an improved decay estimate for the Dirichlet energy of Dir-stationary $Q$-valued functions. As a direct application of this estimate, we derive a Liouville-type theorem for bounded Dir-stationary $Q$-valued functions defined on $\mathbb{R}^m$. Additionally, in an attempt to establish the continuity of Dir-stationary $Q$-valued functions, we confirm that such functions exhibit the Lebesgue property at every point within their domain. Finally, we observe that the improved decay estimate implicates that Dir-stationary $Q$-valued functions reside within a generalized Campanato-Morrey space., Comment: All comments welcome!

In this paper, we establish the existence of conformal deformations that uniformize fourth order curvature on 4-dimensional Riemannian manifolds with positive conformal invariants. Specifically, we prove that any closed, compact Riemannian manifold with positive Yamabe invariant and total $Q$-curvature can be conformally deformed into a metric with positive scalar curvature and constant $Q$-curvature. For a Riemannian manifold with umbilic boundary, positive first Yamabe invariant and total $(Q, T)$-curvature, it is possible to deform it into two types of Riemannian manifolds with totally geodesic boundary and positive scalar curvature. The first type satisfies $Q\equiv \text{constant}, T \equiv 0$ while the second type satisfies $Q\equiv 0, T \equiv \text{constant}$., Comment: All comments welcome!

Although gold nanorods have been the subject of much research, the pathways for controlling their shape and thereby their optical properties remain largely heuristically understood. Although it is apparent that the simultaneous presence of and interaction between various reagents during synthesis control these properties, computational and experimental approaches for exploring the synthesis space can be either intractable or too time-consuming in practice. This motivates an alternative approach leveraging the wealth of synthesis information already embedded in the body of scientific literature by developing tools to extract relevant structured data in an automated, high-throughput manner. To that end, we present an approach using the powerful GPT-3 language model to extract structured multi-step seed-mediated growth procedures and outcomes for gold nanorods from unstructured scientific text. GPT-3 prompt completions are fine-tuned to predict synthesis templates in the form of JSON documents from unstructured text input with an overall accuracy of $86\%$. The performance is notable, considering the model is performing simultaneous entity recognition and relation extraction. We present a dataset of 11,644 entities extracted from 1,137 papers, resulting in 268 papers with at least one complete seed-mediated gold nanorod growth procedure and outcome for a total of 332 complete procedures.

One-dimensional all-bands-flat lattices are networks with all bands being flat and highly degenerate. They can always be diagonalized by a finite sequence of local unitary transformations parameterized by a set of angles \(\theta_{i}\). In our previous work, Ref.~\onlinecite{lee2023critical}, we demonstrated that quasiperiodic perturbations of the one-dimensional all-bands-flat lattice with \(\theta_{i} = \pi/4\) give rise to a critical-to-insulator transition and fractality edges separating critical from localized states. In this study we consider the full range of angles \(\theta_{i}\)s available for the all-bands-flat model and study the effect of the quasiperiodic perturbation. For weak perturbation, we derive an effective Hamiltonian and we identify the sets of \(\theta_{i}\)s for which the effective model maps to extended or off-diagonal Harper models and hosts critical states. For all the other values of the angles the spectrum is localized. Upon increasing the perturbation strength, the extended Harper model evolves into the system with energy dependent critical-to-insulator transitions, that we dub \emph{fractality edges}. The case where the effective model maps onto the off-diagonal Harper model features a critical-to-insulator transition at a finite disorder strength., Comment: 8 pages, 6 figures, 1 table

Intelligently extracting and linking complex scientific information from unstructured text is a challenging endeavor particularly for those inexperienced with natural language processing. Here, we present a simple sequence-to-sequence approach to joint named entity recognition and relation extraction for complex hierarchical information in scientific text. The approach leverages a pre-trained large language model (LLM), GPT-3, that is fine-tuned on approximately 500 pairs of prompts (inputs) and completions (outputs). Information is extracted either from single sentences or across sentences in abstracts/passages, and the output can be returned as simple English sentences or a more structured format, such as a list of JSON objects. We demonstrate that LLMs trained in this way are capable of accurately extracting useful records of complex scientific knowledge for three representative tasks in materials chemistry: linking dopants with their host materials, cataloging metal-organic frameworks, and general chemistry/phase/morphology/application information extraction. This approach represents a simple, accessible, and highly-flexible route to obtaining large databases of structured knowledge extracted from unstructured text. An online demo is available at http://www.matscholar.com/info-extraction.

Class-incremental semantic segmentation (CISS) labels each pixel of an image with a corresponding object/stuff class continually. To this end, it is crucial to learn novel classes incrementally without forgetting previously learned knowledge. Current CISS methods typically use a knowledge distillation (KD) technique for preserving classifier logits, or freeze a feature extractor, to avoid the forgetting problem. The strong constraints, however, prevent learning discriminative features for novel classes. We introduce a CISS framework that alleviates the forgetting problem and facilitates learning novel classes effectively. We have found that a logit can be decomposed into two terms. They quantify how likely an input belongs to a particular class or not, providing a clue for a reasoning process of a model. The KD technique, in this context, preserves the sum of two terms (i.e., a class logit), suggesting that each could be changed and thus the KD does not imitate the reasoning process. To impose constraints on each term explicitly, we propose a new decomposed knowledge distillation (DKD) technique, improving the rigidity of a model and addressing the forgetting problem more effectively. We also introduce a novel initialization method to train new classifiers for novel classes. In CISS, the number of negative training samples for novel classes is not sufficient to discriminate old classes. To mitigate this, we propose to transfer knowledge of negatives to the classifiers successively using an auxiliary classifier, boosting the performance significantly. Experimental results on standard CISS benchmarks demonstrate the effectiveness of our framework., Comment: Accepted to NeurIPS 2022

We study the effect of quasiperiodic perturbations on one-dimensional all-bands-flat lattice models. Such networks can be diagonalized by a finite sequence of local unitary transformations parameterized by angles $\theta_i$. Without loss of generality, we focus on the case of two bands with bandgap $\Delta$. Weak perturbations lead to an effective Hamiltonian with both on- and off-diagonal quasiperiodic terms that depend on $\theta_i$. For some angle values, the effective model coincides with the extended Harper model. By varying the parameters of the quasiperiodic potentials, \iffalse and the manifold angles $\theta_i$ \fi we observe localized insulating states and an entire parameter range hosting critical states with subdiffusive transport. For finite quasiperiodic potential strength, the critical-to-insulating transition becomes energy dependent with what we term fractality edges separating localized from critical states., Comment: 10 pages, 6 figures, 1 table

We address the task of person search, that is, localizing and re-identifying query persons from a set of raw scene images. Recent approaches are typically built upon OIMNet, a pioneer work on person search, that learns joint person representations for performing both detection and person re-identification (reID) tasks. To obtain the representations, they extract features from pedestrian proposals, and then project them on a unit hypersphere with L2 normalization. These methods also incorporate all positive proposals, that sufficiently overlap with the ground truth, equally to learn person representations for reID. We have found that 1) the L2 normalization without considering feature distributions degenerates the discriminative power of person representations, and 2) positive proposals often also depict background clutter and person overlaps, which could encode noisy features to person representations. In this paper, we introduce OIMNet++ that addresses the aforementioned limitations. To this end, we introduce a novel normalization layer, dubbed ProtoNorm, that calibrates features from pedestrian proposals, while considering a long-tail distribution of person IDs, enabling L2 normalized person representations to be discriminative. We also propose a localization-aware feature learning scheme that encourages better-aligned proposals to contribute more in learning discriminative representations. Experimental results and analysis on standard person search benchmarks demonstrate the effectiveness of OIMNet++., Comment: Accepted to ECCV 2022

Gold nanoparticles are highly desired for a range of technological applications due to their tunable properties, which are dictated by the size and shape of the constituent particles. Many heuristic methods for controlling the morphological characteristics of gold nanoparticles are well known. However, the underlying mechanisms controlling their size and shape remain poorly understood, partly due to the immense range of possible combinations of synthesis parameters. Data-driven methods can offer insight to help guide understanding of these underlying mechanisms, so long as sufficient synthesis data are available. To facilitate data mining in this direction, we have constructed and made publicly available a dataset of codified gold nanoparticle synthesis protocols and outcomes extracted directly from the nanoparticle materials science literature using natural language processing and text-mining techniques. This dataset contains 5,154 data records, each representing a single gold nanoparticle synthesis article, filtered from a database of 4,973,165 publications. Each record contains codified synthesis protocols and extracted morphological information from a total of 7,608 experimental and 12,519 characterization paragraphs., Comment: 40 pages; 4 figures; 4 tables; to be published in Scientific Data; for associated dataset, see https://doi.org/10.6084/m9.figshare.16614262.v3

We address the problem of visible-infrared person re-identification (VI-reID), that is, retrieving a set of person images, captured by visible or infrared cameras, in a cross-modal setting. Two main challenges in VI-reID are intra-class variations across person images, and cross-modal discrepancies between visible and infrared images. Assuming that the person images are roughly aligned, previous approaches attempt to learn coarse image- or rigid part-level person representations that are discriminative and generalizable across different modalities. However, the person images, typically cropped by off-the-shelf object detectors, are not necessarily well-aligned, which distract discriminative person representation learning. In this paper, we introduce a novel feature learning framework that addresses these problems in a unified way. To this end, we propose to exploit dense correspondences between cross-modal person images. This allows to address the cross-modal discrepancies in a pixel-level, suppressing modality-related features from person representations more effectively. This also encourages pixel-wise associations between cross-modal local features, further facilitating discriminative feature learning for VI-reID. Extensive experiments and analyses on standard VI-reID benchmarks demonstrate the effectiveness of our approach, which significantly outperforms the state of the art., Comment: iccv 2021