Search

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities, yet balancing reconstruction fidelity and editability for real images remains a significant challenge. In this work, we introduce \textbf{T}ask-\textbf{O}riented \textbf{D}iffusion \textbf{I}nversion (\textbf{TODInv}), a novel framework that inverts and edits real images tailored to specific editing tasks by optimizing prompt embeddings within the extended \(\mathcal{P}^*\) space. By leveraging distinct embeddings across different U-Net layers and time steps, TODInv seamlessly integrates inversion and editing through reciprocal optimization, ensuring both high fidelity and precise editability. This hierarchical editing mechanism categorizes tasks into structure, appearance, and global edits, optimizing only those embeddings unaffected by the current editing task. Extensive experiments on benchmark dataset reveal TODInv's superior performance over existing methods, delivering both quantitative and qualitative enhancements while showcasing its versatility with few-step diffusion model.

In this paper, we present QueryWarp, a novel framework for temporally coherent human motion video translation. Existing diffusion-based video editing approaches that rely solely on key and value tokens to ensure temporal consistency, which scarifies the preservation of local and structural regions. In contrast, we aim to consider complementary query priors by constructing the temporal correlations among query tokens from different frames. Initially, we extract appearance flows from source poses to capture continuous human foreground motion. Subsequently, during the denoising process of the diffusion model, we employ appearance flows to warp the previous frame's query token, aligning it with the current frame's query. This query warping imposes explicit constraints on the outputs of self-attention layers, effectively guaranteeing temporally coherent translation. We perform experiments on various human motion video translation tasks, and the results demonstrate that our QueryWarp framework surpasses state-of-the-art methods both qualitatively and quantitatively., Comment: This is not a complete paper and the methods and results have not been updated. We decided to withdraw and make further improvements

2D ferroelectric \{beta}-InSe/graphene heterostructure was fabricated by mechanical exfoliation, and the carrier dynamics crossing the heterostructure interface has been systematically investigated by Raman, photoluminescence and transient absorption measurements. Due to the efficient interfacial photo excited electron transfer and photogating effect from trapped holes, the heterostructure devices demonstrate superior performance with maximum responsivity of 2.12*10e4 A/W, detectivity of 1.73*10e14 Jones and fast response time (241 us) under {\lambda} = 532 nm laser illumination. Furthermore, the photo responses influenced by ferroelectric polarization field are investigated. Our work confirms ferroelectric \{beta}-InSe/graphene heterostructure as an outstanding material platform for sensitive optoelectronic application.

Interface interactions in 2D vertically stacked heterostructures play an important role in optoe-lectronic applications, photodetectors based on graphene/InSe heterostructures had shown promising performance nowadays. However, nonlinear optical properties studies based on the graphene/InSe heterostructure was insufficient. Here, we fabricated graphene/InSe heterostruc-ture by mechanical exfoliation, and investigated the optically induced charge transfer between graphene/InSe heterostructures by taking photoluminescence and pump-probe measurements. The large built-in electric field at the interface is confirmed by Kelvin probe force microscopy. Furthermore, due to the efficient interfacial carrier transfer driven by built-in electric potential (~ 286 meV) and broadband nonlinear absorption, the application of graphene/InSe heterostruc-ture in mode-locked laser is realized. Our work not only provides a deeper understanding for the dipole orientation related interface interactions on the photoexcited charge transfer of gra-phene/InSe heterostructure, but also enrich the saturable absorber family for ultrafast photon-ics application.

Most of the state-of-the-art semantic segmentation reported in recent years is based on fully supervised deep learning in the medical domain. How?ever, the high-quality annotated datasets require intense labor and domain knowledge, consuming enormous time and cost. Previous works that adopt semi?supervised and unsupervised learning are proposed to address the lack of anno?tated data through assisted training with unlabeled data and achieve good perfor?mance. Still, these methods can not directly get the image annotation as doctors do. In this paper, inspired by self-training of semi-supervised learning, we pro?pose a novel approach to solve the lack of annotated data from another angle, called medical image pixel rearrangement (short in MIPR). The MIPR combines image-editing and pseudo-label technology to obtain labeled data. As the number of iterations increases, the edited image is similar to the original image, and the labeled result is similar to the doctor annotation. Therefore, the MIPR is to get labeled pairs of data directly from amounts of unlabled data with pixel rearrange?ment, which is implemented with a designed conditional Generative Adversarial Networks and a segmentation network. Experiments on the ISIC18 show that the effect of the data annotated by our method for segmentation task is is equal to or even better than that of doctors annotations

The medical datasets are usually faced with the problem of scarcity and data imbalance. Moreover, annotating large datasets for semantic segmentation of medical lesions is domain-knowledge and time-consuming. In this paper, we propose a new object-blend method(short in soft-CP) that combines the Copy-Paste augmentation method for semantic segmentation of medical lesions offline, ensuring the correct edge information around the lession to solve the issue above-mentioned. We proved the method's validity with several datasets in different imaging modalities. In our experiments on the KiTS19[2] dataset, Soft-CP outperforms existing medical lesions synthesis approaches. The Soft-CP augementation provides gains of +26.5% DSC in the low data regime(10% of data) and +10.2% DSC in the high data regime(all of data), In offline training data, the ratio of real images to synthetic images is 3:1., Comment: 9 pages, 6 figures, 1 table

Quantum-dot light-emitting diodes (QLEDs) promise high-performance and cost-effective electroluminescent devices. However, shelf stability of QLEDs, a must for practical applications, is currently overlooked. Here we reveal that the state-of-the-art QLEDs exhibit abnormal shelf-ageing behaviours, i.e., improvements in performance (positive ageing), followed by deterioration of performance (negative ageing). Mechanism studies show that the organic acids in the encapsulation acrylic resin induce in-situ reactions, which simultaneously improve electrical conductance and minimize interfacial exciton quenching at the positive-ageing stage. Progression of the in-situ reactions results in negative ageing. Inspired by these findings, we design an electron-transporting bi-layer structure, which delivers both improved electrical conductivity and suppressed interfacial exciton quenching. This design enables shelf-stable QLEDs with high operational performance, i.e., neglectable changes of external quantum efficiency (>20.0%) and ultra-long operational lifetime (T95: 5,500 hours at 1,000 cd m-2) after storage for 180 days. Our work paves the way towards the commercialization of QLEDs.