Search

Lighting and display, relying on electric and optical down-conversion emission with sluggish power efficiency, account for >15% global electricity consumption1,2. In 2014, quantum-dot (QD) LEDs (QLEDs) with near-optimal external quantum efficiency emerged3 and promised a pathway to avoid the vast down-conversion energy loss4,5. Despite a decade of progress4-22, fabrication of energy-efficient QLEDs with application-relevant brightness remains elusive. Here, the main roadblock is identified as the oxidative species adsorbed in the nanocrystalline electron-injection layer of QLEDs, which is then addressed by a simple reductive treatment to simultaneously boosts electron conductivity and hole blockage of the electron-injection layer. The resulting sub-bandgap-driven QLEDs with optimal efficiency achieve ultra-high brightness across the entire visible spectrum at least 2.6-fold higher than existing benchmarks. The brightness fully satisfies the demands of various forms of lighting and display, which surges to a remarkable level sufficient for QD laser diodes with a moderate bias (~9 V). Optimized electron injection further enables new types of QD-blend LEDs for diffuse white-light sources surpassing the 2035 R&D targets set by the U.S. Department of Energy. Our findings open a door for understanding and optimizing carrier transport in nanocrystalline semiconductors shared by various types of solution-processed optoelectronic devices.

We address the problem of generating realistic 3D human-object interactions (HOIs) driven by textual prompts. To this end, we take a modular design and decompose the complex task into simpler sub-tasks. We first develop a dual-branch diffusion model (HOI-DM) to generate both human and object motions conditioned on the input text, and encourage coherent motions by a cross-attention communication module between the human and object motion generation branches. We also develop an affordance prediction diffusion model (APDM) to predict the contacting area between the human and object during the interactions driven by the textual prompt. The APDM is independent of the results by the HOI-DM and thus can correct potential errors by the latter. Moreover, it stochastically generates the contacting points to diversify the generated motions. Finally, we incorporate the estimated contacting points into the classifier-guidance to achieve accurate and close contact between humans and objects. To train and evaluate our approach, we annotate BEHAVE dataset with text descriptions. Experimental results on BEHAVE and OMOMO demonstrate that our approach produces realistic HOIs with various interactions and different types of objects., Comment: Project Page: https://neu-vi.github.io/HOI-Diff/

3D multi-person motion prediction is a challenging task that involves modeling individual behaviors and interactions between people. Despite the emergence of approaches for this task, comparing them is difficult due to the lack of standardized training settings and benchmark datasets. In this paper, we introduce the Multi-Person Interaction Motion (MI-Motion) Dataset, which includes skeleton sequences of multiple individuals collected by motion capture systems and refined and synthesized using a game engine. The dataset contains 167k frames of interacting people's skeleton poses and is categorized into 5 different activity scenes. To facilitate research in multi-person motion prediction, we also provide benchmarks to evaluate the performance of prediction methods in three settings: short-term, long-term, and ultra-long-term prediction. Additionally, we introduce a novel baseline approach that leverages graph and temporal convolutional networks, which has demonstrated competitive results in multi-person motion prediction. We believe that the proposed MI-Motion benchmark dataset and baseline will facilitate future research in this area, ultimately leading to better understanding and modeling of multi-person interactions.

In recent years, the task of weakly supervised audio-visual violence detection has gained considerable attention. The goal of this task is to identify violent segments within multimodal data based on video-level labels. Despite advances in this field, traditional Euclidean neural networks, which have been used in prior research, encounter difficulties in capturing highly discriminative representations due to limitations of the feature space. To overcome this, we propose HyperVD, a novel framework that learns snippet embeddings in hyperbolic space to improve model discrimination. Our framework comprises a detour fusion module for multimodal fusion, effectively alleviating modality inconsistency between audio and visual signals. Additionally, we contribute two branches of fully hyperbolic graph convolutional networks that excavate feature similarities and temporal relationships among snippets in hyperbolic space. By learning snippet representations in this space, the framework effectively learns semantic discrepancies between violent and normal events. Extensive experiments on the XD-Violence benchmark demonstrate that our method outperforms state-of-the-art methods by a sizable margin., Comment: 11 pages, 12 figures, typos are fixed

Multi-person pose forecasting remains a challenging problem, especially in modeling fine-grained human body interaction in complex crowd scenarios. Existing methods typically represent the whole pose sequence as a temporal series, yet overlook interactive influences among people based on skeletal body parts. In this paper, we propose a novel Trajectory-Aware Body Interaction Transformer (TBIFormer) for multi-person pose forecasting via effectively modeling body part interactions. Specifically, we construct a Temporal Body Partition Module that transforms all the pose sequences into a Multi-Person Body-Part sequence to retain spatial and temporal information based on body semantics. Then, we devise a Social Body Interaction Self-Attention (SBI-MSA) module, utilizing the transformed sequence to learn body part dynamics for inter- and intra-individual interactions. Furthermore, different from prior Euclidean distance-based spatial encodings, we present a novel and efficient Trajectory-Aware Relative Position Encoding for SBI-MSA to offer discriminative spatial information and additional interactive clues. On both short- and long-term horizons, we empirically evaluate our framework on CMU-Mocap, MuPoTS-3D as well as synthesized datasets (6 ~ 10 persons), and demonstrate that our method greatly outperforms the state-of-the-art methods. Code will be made publicly available upon acceptance., Comment: Accepted by CVPR2023, 8 pages, 6 figures. arXiv admin note: text overlap with arXiv:2208.09224

Facial expression recognition (FER) plays a significant role in the ubiquitous application of computer vision. We revisit this problem with a new perspective on whether it can acquire useful representations that improve FER performance in the image generation process, and propose a novel generative method based on the image inversion mechanism for the FER task, termed Inversion FER (IFER). Particularly, we devise a novel Adversarial Style Inversion Transformer (ASIT) towards IFER to comprehensively extract features of generated facial images. In addition, ASIT is equipped with an image inversion discriminator that measures the cosine similarity of semantic features between source and generated images, constrained by a distribution alignment loss. Finally, we introduce a feature modulation module to fuse the structural code and latent codes from ASIT for the subsequent FER work. We extensively evaluate ASIT on facial datasets such as FFHQ and CelebA-HQ, showing that our approach achieves state-of-the-art facial inversion performance. IFER also achieves competitive results in facial expression recognition datasets such as RAF-DB, SFEW and AffectNet. The code and models are available at https://github.com/Talented-Q/IFER-master.

Some self-supervised cross-modal learning approaches have recently demonstrated the potential of image signals for enhancing point cloud representation. However, it remains a question on how to directly model cross-modal local and global correspondences in a self-supervised fashion. To solve it, we proposed PointCMC, a novel cross-modal method to model multi-scale correspondences across modalities for self-supervised point cloud representation learning. In particular, PointCMC is composed of: (1) a local-to-local (L2L) module that learns local correspondences through optimized cross-modal local geometric features, (2) a local-to-global (L2G) module that aims to learn the correspondences between local and global features across modalities via local-global discrimination, and (3) a global-to-global (G2G) module, which leverages auxiliary global contrastive loss between the point cloud and image to learn high-level semantic correspondences. Extensive experiment results show that our approach outperforms existing state-of-the-art methods in various downstream tasks such as 3D object classification and segmentation. Code will be made publicly available upon acceptance., Comment: In order to revise the paper

Multi-person motion prediction remains a challenging problem, especially in the joint representation learning of individual motion and social interactions. Most prior methods only involve learning local pose dynamics for individual motion (without global body trajectory) and also struggle to capture complex interaction dependencies for social interactions. In this paper, we propose a novel Social-Aware Motion Transformer (SoMoFormer) to effectively model individual motion and social interactions in a joint manner. Specifically, SoMoFormer extracts motion features from sub-sequences in displacement trajectory space to effectively learn both local and global pose dynamics for each individual. In addition, we devise a novel social-aware motion attention mechanism in SoMoFormer to further optimize dynamics representations and capture interaction dependencies simultaneously via motion similarity calculation across time and social dimensions. On both short- and long-term horizons, we empirically evaluate our framework on multi-person motion datasets and demonstrate that our method greatly outperforms state-of-the-art methods of single- and multi-person motion prediction. Code will be made publicly available upon acceptance.

Electroluminescence (EL) of colloidal nanocrystals promises a new generation of high-performance and solution-processable light-emitting diodes (LEDs). The operation of nanocrystal-based LEDs relies on the recombination of electrically-generated excitons. However, a fundamental question, i.e, how excitons are electrically generated in individual nanocrystals, remains unanswered. Here, we reveal a molecular mechanism of sequential electron-hole injection for the exciton generation in nanocrystal-based EL devices. To decipher the corresponding elementary processes, we develop electrically-pumped single-nanocrystal spectroscopy. While hole injection into neutral quantum dots (QDs) is generally-considered to be inefficient, we find that the intermediate negatively-charged state of QD triggers confinement-enhanced Coulomb interactions, which simultaneously accelerate hole injection and hinder excessive electron injection. In-situ/operando spectroscopy on state-of-the-art QD-LEDs demonstrate that exciton generation at the ensemble level is consistent with the charge-confinement-enabled sequential electron-hole injection mechanism revealed at the single-nanocrystal level. Our findings provide a universal mechanism for enhancing charge balance in nanocrystal-based EL devices.

Colloidal quantum dots (QDs) are promising emitters for electroluminescence devices (QD light-emitting-diodes, QLEDs). Though QDs have been synthesized with efficient and stable photoluminescence, inheriting their superior luminescence in QLEDs remains challenging. This is commonly attributed to unbalanced charge injection and/or interfacial exciton quenching in the devices, instead of lack of suited QD materials. Here, a general but previously overlooked degradation channel in QLEDs, i.e., operando electrochemical reactions of surface ligands with injected charge carriers, is identified after systematic studies of various combination of core/shell QDs and ligands. Applying electrochemically-inert ligands to highly photoluminescent QDs is developed to bridge their photoluminescence-electroluminescence gap. This material-design principle is general for boosting electroluminescence efficiency and lifetime of the QLEDs, resulting in record-long operational lifetimes for both red-emitting QLEDs (T95 > 3800 hours at 1000 cd m-2) and blue-emitting QLEDs (T50 >10,000 hours at 100 cd m-2). Our study provides a critical guideline for the QDs to be used in optoelectronic and electronic devices., Comment: 46 pages, 14 figures, 2 tables (main text and supporting information merged), submitted

Upon photo- or electrical-excitation, colloidal quantum dots (QDs) are often found in multi-carrier states due to multi-photon absorption and photo-charging of the QDs. While many of these multi-carrier states are observed in single-dot spectroscopy, their properties are not well studied due to random charging/discharging, emission intensity intermittency, and uncontrolled surface defects of single QD. Here we report in-situ deciphering the charging status, and precisely assessing the absorption cross section, and determining the absolute emission quantum yield of mono-exciton and biexciton states for neutral, positively-charged, and negatively-charged single core/shell CdSe/CdS QD. We uncover very different photon statistics of the three charge states in single QD and unambiguously identify their charge sign together with the information of their photoluminescence decay dynamics. We then show their distinct photoluminescence saturation behaviors and evaluated the absolute values of absorption cross sections and quantum efficiencies of monoexcitons and biexcitons. We demonstrate that addition of an extra hole or electron in a QD changes not only its emission properties but also varies its absorption cross section.