Search

Strange-metal behavior has been observed in superconductors ranging from cuprates to pressurized nickelates, but its relationship to unconventional superconductivity remains elusive. Here, we perform operando superfluid density measurements on ion-gated FeSe films. We observe for the first time a synchronized evolution of superconducting condensate and the strange-metal phase with electron doping. A linear scaling between zero-temperature superfluid density and the strange-metal resistivity coefficient is further established, which nails down a direct link between the formation of superfluid in the superconducting state and the scattering of carriers in the strange-metal normal state. Remarkably, the scaling also applies for different iron-based and cuprate superconductors despite their distinct electronic structures and pairing symmetries. Such a correlation can be reproduced in a theoretical calculation on the two-dimensional Yukawa-Sachdev-Ye-Kitaev model by considering a cooperative effect of quantum critical fluctuation and disorder. These findings indicate a fundamental principle governing superconducting condensation and strange-metal scattering in unconventional superconductors., Comment: 36 pages, 18 figures

The recent discovery of a superconductivity signature in La3Ni2O7-{\delta} under a pressure of 14 GPa, with a superconducting transition temperature of around 80 K, has attracted considerable attention. An important aspect of investigating electronic structures is discerning the extent to which the electronic ground state of La3Ni2O7-{\delta} resembles the parent state of the cuprate superconductor, a charge transfer insulator with long-range antiferromagnetism. Through X-ray absorption spectroscopy, we have uncovered the crucial influence of oxygen ligands on the electronic ground states of the Ni ions, displaying a charge transfer nature akin to cuprate but with distinct orbital configurations. Both in-plane and out-of-plane Zhang-Rice singlets associated with Ni d_(x^2-y^2 ) and d_(z^2) orbitals are identified, together with a strong interlayer coupling through inner apical oxygen. Additionally, in La3Ni2O7-{\delta} films, we have detected a superlattice reflection (1/4, 1/4, L) at the Ni L absorption edge using resonant X-ray scattering measurements. Further examination of the resonance profile indicates that the reflection originates from the Ni d orbitals. By evaluating the reflection's azimuthal angle dependence, we have confirmed the presence of collinear antiferromagnetic spin ordering and charge-like anisotropy ordered with the same periodicity. Notably, our findings reveal a microscopic relationship between these two components in the temperature dependence of the scattering intensity of the reflection. This investigation enriches our understanding of high-temperature superconductivity in La3Ni2O7-{\delta} under high pressure.

Fermionic Gaussian states are eigenstates of quadratic Hamiltonians and widely used in quantum many-body problems. We propose a highly efficient algorithm that converts fermionic Gaussian states to matrix product states. It can be formulated for finite-size systems without translation invariance, but becomes particularly appealing when applied to infinite systems with translation invariance. If the ground states of a topologically ordered system on infinite cylinders are expressed as matrix product states, then the fixed points of the transfer matrix can be harnessed to filter out the anyon eigenbasis, also known as minimally entangled states. This allows for efficient computation of universal properties such as entanglement spectrum and modular matrices. The potential of our method is demonstrated by numerical calculations in two chiral spin liquids that have the same topological orders as the bosonic Laughlin and Moore-Read states, respectively. The anyon eigenbasis for the first one has been worked out before and serves as a useful benchmark. The anyon eigenbasis of the second one is, however, not transparent and its successful construction provides a nontrivial corroboration of our method., Comment: 13 pages, 7 figures

Understanding the physics of doping a charge transfer insulator is the most important problem in high-temperature superconductivity. In this work, we show that an in-gap bound state emerges from the localized hole of the doped charge transfer insulator. We propose an approximate ground state wavefunction based on one localized Zhang-Rice singlet and the Neel state. By calculating the excitation states with one hole added and removed from this ground state, we successfully identify the existence of bound states inside the charge transfer gap. This feature is further proved by the MPS-based Lanczos study of a system of $4\times4$ CuO$_2$ unit cells. How these bound states evolve into metallic states is further discussed. Our findings identify the key component of recent STM results on lightly doped Ca$_2$CuO$_2$Cl$_2$ and provide a new understanding of hole-doped charge transfer insulators., Comment: 5 pages, 4 figures in the main text and 1 page, 1 figure in the supplemental material

The pairing symmetry of superconducting electrons can be identified through various phase-sensitive experiments. However, phenomena like the Josephson effect predominantly depend on frameworks exhibiting macroscopic interference. At the microscopic level, phase interference effects within momentum space are absent due to the intrinsic challenge of extracting phase information from specific momentum points. By incorporating the hybridization effect between a primary band and its replica bands generated by density wave orders or other interactions, we introduce a superconducting phase interference effect at the intersection points on the Fermi surfaces of these two bands. This effect clarifies the extraordinary behavior observed in the single-particle spectral function in recent angle-resolved photoemission spectroscopy (ARPES) measurements in the $Bi_2Sr_2CaCu_2O_{8+\delta}$ (Bi2212) superconductor. It also offers a new insight into the non-zero Josephson current observed in a $45^\circ$-twisted Josephson junction of cuprate superconductors.

Partial-Label Learning (PLL) is a typical problem of weakly supervised learning, where each training instance is annotated with a set of candidate labels. Self-training PLL models achieve state-of-the-art performance but suffer from error accumulation problem caused by mistakenly disambiguated instances. Although co-training can alleviate this issue by training two networks simultaneously and allowing them to interact with each other, most existing co-training methods train two structurally identical networks with the same task, i.e., are symmetric, rendering it insufficient for them to correct each other due to their similar limitations. Therefore, in this paper, we propose an asymmetric dual-task co-training PLL model called AsyCo, which forces its two networks, i.e., a disambiguation network and an auxiliary network, to learn from different views explicitly by optimizing distinct tasks. Specifically, the disambiguation network is trained with self-training PLL task to learn label confidence, while the auxiliary network is trained in a supervised learning paradigm to learn from the noisy pairwise similarity labels that are constructed according to the learned label confidence. Finally, the error accumulation problem is mitigated via information distillation and confidence refinement. Extensive experiments on both uniform and instance-dependent partially labeled datasets demonstrate the effectiveness of AsyCo. The code is available at https://github.com/libeibeics/AsyCo., Comment: 15 pages, accepted by Science China, Information Science

Watching micro-videos is becoming a part of public daily life. Usually, user watching behaviors are thought to be rooted in their multiple different interests. In the paper, we propose a model named OPAL for micro-video matching, which elicits a user's multiple heterogeneous interests by disentangling multiple soft and hard interest embeddings from user interactions. Moreover, OPAL employs a two-stage training strategy, in which the pre-train is to generate soft interests from historical interactions under the guidance of orthogonal hyper-categories of micro-videos and the fine-tune is to reinforce the degree of disentanglement among the interests and learn the temporal evolution of each interest of each user. We conduct extensive experiments on two real-world datasets. The results show that OPAL not only returns diversified micro-videos but also outperforms six state-of-the-art models in terms of recall and hit rate., Comment: 6 pages, accepted by ICME 2024

Vortex is a topological defect in the superconducting condensate when a magnetic field is applied to a type-II superconductor, as elucidated by the Ginzburg-Landau theory. Due to the confinement of the quasiparticles by a vortex, it exhibits a circular shaped pattern of bound states with discrete energy levels, as predicted by the Caroli-de Gennes-Matricon theory in 1964. Here, however, we report a completely new type of vortex pattern which is necklace-like in an iron-based superconductor KCa2Fe4As4F2. Our theoretical analysis shows that this necklace-like vortex pattern arises from selective off-shell interference between vortex bound states of opposite angular momenta in the presence of rotational symmetry breaking due to disorders. This fascinating effect can be observed in a system with a small Fermi energy and wave vector, conditions fortuitously met in our samples. Our results not only disclose a novel vortex structure but also provide insights into comprehending the physics of the superconducting condensate., Comment: 29 pages total; 16 pages of main text with 5 figures, 13 pages of supplementary materials with 10 figures

This paper propels creative control in generative visual AI by allowing users to "select". Departing from traditional text or sketch-based methods, we for the first time allow users to choose visual concepts by parts for their creative endeavors. The outcome is fine-grained generation that precisely captures selected visual concepts, ensuring a holistically faithful and plausible result. To achieve this, we first parse objects into parts through unsupervised feature clustering. Then, we encode parts into text tokens and introduce an entropy-based normalized attention loss that operates on them. This loss design enables our model to learn generic prior topology knowledge about object's part composition, and further generalize to novel part compositions to ensure the generation looks holistically faithful. Lastly, we employ a bottleneck encoder to project the part tokens. This not only enhances fidelity but also accelerates learning, by leveraging shared knowledge and facilitating information exchange among instances. Visual results in the paper and supplementary material showcase the compelling power of PartCraft in crafting highly customized, innovative creations, exemplified by the "charming" and creative birds. Code is released at https://github.com/kamwoh/partcraft., Comment: ECCV 2024. arXiv admin note: substantial text overlap with arXiv:2311.15477

This paper, for the first time, marries large foundation models with human sketch understanding. We demonstrate what this brings -- a paradigm shift in terms of generalised sketch representation learning (e.g., classification). This generalisation happens on two fronts: (i) generalisation across unknown categories (i.e., open-set), and (ii) generalisation traversing abstraction levels (i.e., good and bad sketches), both being timely challenges that remain unsolved in the sketch literature. Our design is intuitive and centred around transferring the already stellar generalisation ability of CLIP to benefit generalised learning for sketches. We first "condition" the vanilla CLIP model by learning sketch-specific prompts using a novel auxiliary head of raster to vector sketch conversion. This importantly makes CLIP "sketch-aware". We then make CLIP acute to the inherently different sketch abstraction levels. This is achieved by learning a codebook of abstraction-specific prompt biases, a weighted combination of which facilitates the representation of sketches across abstraction levels -- low abstract edge-maps, medium abstract sketches in TU-Berlin, and highly abstract doodles in QuickDraw. Our framework surpasses popular sketch representation learning algorithms in both zero-shot and few-shot setups and in novel settings across different abstraction boundaries., Comment: ECCV 2024

In superconductors with relatively low superfluid density, such as cuprate high-$T_c$ superconductors, the phase fluctuations of the superconducting order parameter are remarkable, presumably playing a nonnegligible role in shaping many distinctive physical properties. This work systematically investigates the electrical transport properties arising from thermal superconducting phase fluctuations in two-dimensional superconductors. Employing the Monte Carlo procedure, we access the numerically exact properties of a microscopic model of superconductivity, in which the classical XY model governs the thermal phase fluctuations of the superconducting order parameter. For both $s$-wave and $d_{x^2-y^2}$-wave pairings, the electrical resistivity exhibits a universal scaling behavior in the temperature range above $T_c$. Our numerical results demonstrate that the scaling behavior of the quasiparticle lifetime is associated with the correlation length of the superconducting order parameter, yielding the universal scaling behavior of electrical resistivity determined by the Berezinskii-Kosterlitz-Thouless critical scaling of the correlation length. Furthermore, we discuss the dependence of the electrical resistivity coefficient on the pairing amplitude and the possible implication on recent transport experiments.

Existing fine-grained hashing methods typically lack code interpretability as they compute hash code bits holistically using both global and local features. To address this limitation, we propose ConceptHash, a novel method that achieves sub-code level interpretability. In ConceptHash, each sub-code corresponds to a human-understandable concept, such as an object part, and these concepts are automatically discovered without human annotations. Specifically, we leverage a Vision Transformer architecture and introduce concept tokens as visual prompts, along with image patch tokens as model inputs. Each concept is then mapped to a specific sub-code at the model output, providing natural sub-code interpretability. To capture subtle visual differences among highly similar sub-categories (e.g., bird species), we incorporate language guidance to ensure that the learned hash codes are distinguishable within fine-grained object classes while maintaining semantic alignment. This approach allows us to develop hash codes that exhibit similarity within families of species while remaining distinct from species in other families. Extensive experiments on four fine-grained image retrieval benchmarks demonstrate that ConceptHash outperforms previous methods by a significant margin, offering unique sub-code interpretability as an additional benefit. Code at: https://github.com/kamwoh/concepthash., Comment: CVPRW 2024 - FGVC11 best paper award

This review provides a comprehensive overview of current research on the structural, electronic, and magnetic characteristics of the recently discovered high-temperature superconductor La$_3$Ni$_2$O$_7$ under high pressures. We present the experimental results for synthesizing and characterizing this material, derived from measurements of transport, thermodynamics, and various spectroscopic techniques, and discuss their physical implications. We also explore theoretical models proposed to describe the electronic structures and superconducting pairing symmetry in La$_3$Ni$_2$O$_7$, highlighting the intricate interplay between electronic correlations and magnetic interactions. Despite these advances, challenges remain in growing high-quality samples free of extrinsic phases and oxygen deficiencies and in developing reliable measurement tools for determining diamagnetism and other physical quantities under high pressures. Further investigations in these areas are essential to deepening our understanding of the physical properties of La$_3$Ni$_2$O$_7$ and unlocking its superconducting pairing mechanism., Comment: 15 pages, 11 figures

Federated self-supervised learning (FSSL) has recently emerged as a promising paradigm that enables the exploitation of clients' vast amounts of unlabeled data while preserving data privacy. While FSSL offers advantages, its susceptibility to backdoor attacks, a concern identified in traditional federated supervised learning (FSL), has not been investigated. To fill the research gap, we undertake a comprehensive investigation into a backdoor attack paradigm, where unscrupulous clients conspire to manipulate the global model, revealing the vulnerability of FSSL to such attacks. In FSL, backdoor attacks typically build a direct association between the backdoor trigger and the target label. In contrast, in FSSL, backdoor attacks aim to alter the global model's representation for images containing the attacker's specified trigger pattern in favor of the attacker's intended target class, which is less straightforward. In this sense, we demonstrate that existing defenses are insufficient to mitigate the investigated backdoor attacks in FSSL, thus finding an effective defense mechanism is urgent. To tackle this issue, we dive into the fundamental mechanism of backdoor attacks on FSSL, proposing the Embedding Inspector (EmInspector) that detects malicious clients by inspecting the embedding space of local models. In particular, EmInspector assesses the similarity of embeddings from different local models using a small set of inspection images (e.g., ten images of CIFAR100) without specific requirements on sample distribution or labels. We discover that embeddings from backdoored models tend to cluster together in the embedding space for a given inspection image. Evaluation results show that EmInspector can effectively mitigate backdoor attacks on FSSL across various adversary settings. Our code is avaliable at https://github.com/ShuchiWu/EmInspector., Comment: 18 pages, 12 figures

We propose a novel mechanism to explain the emergence of an intermediate gapless spin liquid phase (IGP) in the antiferromagnetic Kitaev model in an externally applied magnetic field, sandwiched between the well-known gapped chiral spin liquid (CSL) and the gapped partially polarized (PP) phase. We propose in moderate fields $\pi$-fluxes nucleate in the ground state and can trap Majorana zero modes. As these fluxes proliferate with increasing field, the Majorana zero modes overlap creating an emergent Majorana metallic state with a `Fermi surface' at zero energy. We further show that the Majorana spectral function captures the dynamical spin and dimer correlations obtained by the infinite Projected Entangled Pair States (iPEPS) ansatz. We discuss the implications of our results for candidate Kitaev materials., Comment: 6+13 pages, 4+7 figures

Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but these methods do not apply to diffusion models due to their fixed forward process. In this work, we propose SceneDiffusion to optimize a layered scene representation during the diffusion sampling process. Our key insight is that spatial disentanglement can be obtained by jointly denoising scene renderings at different spatial layouts. Our generated scenes support a wide range of spatial editing operations, including moving, resizing, cloning, and layer-wise appearance editing operations, including object restyling and replacing. Moreover, a scene can be generated conditioned on a reference image, thus enabling object moving for in-the-wild images. Notably, this approach is training-free, compatible with general text-to-image diffusion models, and responsive in less than a second., Comment: CVPR 2024 camera-ready

We explore the role of attention mechanism during inference in text-conditional diffusion models. Empirical observations suggest that cross-attention outputs converge to a fixed point after several inference steps. The convergence time naturally divides the entire inference process into two phases: an initial phase for planning text-oriented visual semantics, which are then translated into images in a subsequent fidelity-improving phase. Cross-attention is essential in the initial phase but almost irrelevant thereafter. However, self-attention initially plays a minor role but becomes crucial in the second phase. These findings yield a simple and training-free method known as temporally gating the attention (TGATE), which efficiently generates images by caching and reusing attention outputs at scheduled time steps. Experimental results show when widely applied to various existing text-conditional diffusion models, TGATE accelerates these models by 10%-50%. The code of TGATE is available at https://github.com/HaozheLiu-ST/T-GATE.

We investigate the signatures of fractionalization in quantum spin liquids by studying different phases of the Kitaev honeycomb model in the presence of an out-of-plane magnetic field through which the model becomes non-integrable. Using the infinite Projected Entangled Pair States (iPEPS) ansatz, along with analytical calculations and exact diagonalization, we calculate dynamical signatures of fractionalized particles through spin-spin and dimer-dimer correlations. Our analysis demonstrates the ability of these correlations to discern distinct fractionalized quantum sectors, namely Majorana fermions and the emergent $Z_2$ fluxes, in both the chiral spin liquid (CSL) phase under weak field and the emergent intermediate gapless phase (IGP) under moderate field. Importantly, our calculation reveals the nature of IGP observed at moderate fields, a region of ongoing debate, indicating that this phase is a Majorana metal induced by strong flux fluctuations., Comment: 5+8 pages, 4+9 figures

We propose SketchINR, to advance the representation of vector sketches with implicit neural models. A variable length vector sketch is compressed into a latent space of fixed dimension that implicitly encodes the underlying shape as a function of time and strokes. The learned function predicts the $xy$ point coordinates in a sketch at each time and stroke. Despite its simplicity, SketchINR outperforms existing representations at multiple tasks: (i) Encoding an entire sketch dataset into a fixed size latent vector, SketchINR gives $60\times$ and $10\times$ data compression over raster and vector sketches, respectively. (ii) SketchINR's auto-decoder provides a much higher-fidelity representation than other learned vector sketch representations, and is uniquely able to scale to complex vector sketches such as FS-COCO. (iii) SketchINR supports parallelisation that can decode/render $\sim$$100\times$ faster than other learned vector representations such as SketchRNN. (iv) SketchINR, for the first time, emulates the human ability to reproduce a sketch with varying abstraction in terms of number and complexity of strokes. As a first look at implicit sketches, SketchINR's compact high-fidelity representation will support future work in modelling long and complex sketches., Comment: CVPR 2024

In this paper, we explore the unique modality of sketch for explainability, emphasising the profound impact of human strokes compared to conventional pixel-oriented studies. Beyond explanations of network behavior, we discern the genuine implications of explainability across diverse downstream sketch-related tasks. We propose a lightweight and portable explainability solution -- a seamless plugin that integrates effortlessly with any pre-trained model, eliminating the need for re-training. Demonstrating its adaptability, we present four applications: highly studied retrieval and generation, and completely novel assisted drawing and sketch adversarial attacks. The centrepiece to our solution is a stroke-level attribution map that takes different forms when linked with downstream tasks. By addressing the inherent non-differentiability of rasterisation, we enable explanations at both coarse stroke level (SLA) and partial stroke level (P-SLA), each with its advantages for specific downstream tasks., Comment: CVPR 2024

This paper unravels the potential of sketches for diffusion models, addressing the deceptive promise of direct sketch control in generative AI. We importantly democratise the process, enabling amateur sketches to generate precise images, living up to the commitment of "what you sketch is what you get". A pilot study underscores the necessity, revealing that deformities in existing models stem from spatial-conditioning. To rectify this, we propose an abstraction-aware framework, utilising a sketch adapter, adaptive time-step sampling, and discriminative guidance from a pre-trained fine-grained sketch-based image retrieval model, working synergistically to reinforce fine-grained sketch-photo association. Our approach operates seamlessly during inference without the need for textual prompts; a simple, rough sketch akin to what you and I can create suffices! We welcome everyone to examine results presented in the paper and its supplementary. Contributions include democratising sketch control, introducing an abstraction-aware framework, and leveraging discriminative guidance, validated through extensive experiments., Comment: Accepted in CVPR 2024. Project page available at https://subhadeepkoley.github.io/StableSketching

Two primary input modalities prevail in image retrieval: sketch and text. While text is widely used for inter-category retrieval tasks, sketches have been established as the sole preferred modality for fine-grained image retrieval due to their ability to capture intricate visual details. In this paper, we question the reliance on sketches alone for fine-grained image retrieval by simultaneously exploring the fine-grained representation capabilities of both sketch and text, orchestrating a duet between the two. The end result enables precise retrievals previously unattainable, allowing users to pose ever-finer queries and incorporate attributes like colour and contextual cues from text. For this purpose, we introduce a novel compositionality framework, effectively combining sketches and text using pre-trained CLIP models, while eliminating the need for extensive fine-grained textual descriptions. Last but not least, our system extends to novel applications in composed image retrieval, domain attribute transfer, and fine-grained generation, providing solutions for various real-world scenarios., Comment: Accepted in CVPR 2024. Project page available at https://subhadeepkoley.github.io/Sketch2Word

In this paper, we propose a novel abstraction-aware sketch-based image retrieval framework capable of handling sketch abstraction at varied levels. Prior works had mainly focused on tackling sub-factors such as drawing style and order, we instead attempt to model abstraction as a whole, and propose feature-level and retrieval granularity-level designs so that the system builds into its DNA the necessary means to interpret abstraction. On learning abstraction-aware features, we for the first-time harness the rich semantic embedding of pre-trained StyleGAN model, together with a novel abstraction-level mapper that deciphers the level of abstraction and dynamically selects appropriate dimensions in the feature matrix correspondingly, to construct a feature matrix embedding that can be freely traversed to accommodate different levels of abstraction. For granularity-level abstraction understanding, we dictate that the retrieval model should not treat all abstraction-levels equally and introduce a differentiable surrogate Acc.@q loss to inject that understanding into the system. Different to the gold-standard triplet loss, our Acc.@q loss uniquely allows a sketch to narrow/broaden its focus in terms of how stringent the evaluation should be - the more abstract a sketch, the less stringent (higher q). Extensive experiments depict our method to outperform existing state-of-the-arts in standard SBIR tasks along with challenging scenarios like early retrieval, forensic sketch-photo matching, and style-invariant retrieval., Comment: Accepted in CVPR 2024. Project page available at https://subhadeepkoley.github.io/AbstractAway

This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to-image diffusion models to seamlessly bridge the gap between sketches and photos. This proficiency is underpinned by their robust cross-modal capabilities and shape bias, findings that are substantiated through our pilot studies. In order to harness pre-trained diffusion models effectively, we introduce a straightforward yet powerful strategy focused on two key aspects: selecting optimal feature layers and utilising visual and textual prompts. For the former, we identify which layers are most enriched with information and are best suited for the specific retrieval requirements (category-level or fine-grained). Then we employ visual and textual prompts to guide the model's feature extraction process, enabling it to generate more discriminative and contextually relevant cross-modal representations. Extensive experiments on several benchmark datasets validate significant performance improvements., Comment: Accepted in CVPR 2024. Project page available at https://subhadeepkoley.github.io/DiffusionZSSBIR

What factors fundamentally determine the value of superconducting transition temperature (Tc) in high temperature superconductors has been the subject of intense debate. Following the establishment of an empirical law known as Homes'law, there is a growing consensus in the community that the Tc value of the cuprate superconductors is closely linked to its superfluid density and conductivity. However, all the data supporting this empirical law have been obtained from the ambient-pressure superconductors. In this study, we present the first high-pressure results about the connection of these two quantities with Tc, through the studies on the Bi1.74Pb0.38Sr1.88CuO6+delta and Bi2Sr2CaCu2O8+delta, in which the value of their high-pressure resistivity (the reciprocal of conductivity) is achieved by adopting our newly established method, while the value of superfluid density is extracted using the Homes'law. We highlight that the Tc values are strongly linked the two joint response factors of magnetic field and electric field, i.e. superfluid density and conductivity, respectively, implying that the physics governing the determination of Tc is influenced by the intrinsic electromagnetic fields of the system., Comment: 11 pages, 3 figures

Non-Hermitian physics, studying systems described by non-Hermitian Hamiltonians, reveals unique phenomena not present in Hermitian systems. Unlike Hermitian systems, non-Hermitian systems have complex eigenvalues, making their effects less directly observable. Recently, significant efforts have been devoted to incorporating the non-Hermitian effects into condensed matter physics. However, progress has been hindered by the absence of a viable experimental approach. Here, the discovery of surface-selectively spontaneous reconstructed Weyl semimetal NdAlSi provides a feasible experimental platform for studying non-Hermitian physics. Utilizing angle-resolved photoemission spectroscopy measurements, surface-projected density functional theory calculations, and scanning tunneling microscopy measurements, we demonstrate that surface reconstruction in NdAlSi alters surface Fermi arc connectivity and generates new isolated non-topological surface Fermi arcs. In the presence of a magnetic field, the surface-selective spontaneous reconstructed Weyl semimetal NdAlSi can be viewed as a Hermitian bulk--non-Hermitian boundary system. The isolated non-topological surface Fermi arcs on the reconstructed surface act as a loss mechanism and open boundary condition for the topological electrons and bulk states, serving as non-Hermitian boundary states. This discovery provides a good experimental platform for exploring new physical phenomena and potential applications based on boundary non-Hermitian effects, extending beyond purely mathematical concepts., Comment: 21 pages, 4 figures

For several decades, it was widely believed that a non-interacting disordered electronic system could only undergo an Anderson metal-insulator transition due to Anderson localization. However, numerous recent theoretical works have predicted the existence of a disorder-driven non-Anderson phase transition that differ from Anderson localization. The frustration lies in the fact that this non-Anderson disorder-driven transition has not yet been experimentally demonstrated in any system. Here, using angle-resolved photoemission spectroscopy, we present a case study of observing the non-Anderson disorder-driven transition by visualizing the electronic structure of the Weyl semimetal NdAlSi on surfaces with varying amounts of disorder. Our observations reveal that strong disorder can effectively suppress all surface states in the Weyl semimetal NdAlSi, including the topological surface Fermi arcs. This disappearance of surface Fermi arcs is associated with the vanishing of the bulk topological invariant, indicating a quantum phase transition from a Weyl semimetal to a diffusive metal. By analyzing the changes in the electronic structure of NdAlSi, as the surface degrades, we provide a physical picture of this non-Anderson transition from a Weyl semimetal to a diffuse metal. These observations provide the first direct experimental evidence of the non-Anderson disorder-driven transition, a discovery long anticipated by theoretical physicists. The finding dispels longstanding suspicions among researchers that non-Anderson transitions exist in real quantum systems., Comment: 13 pages, 4 figures

Pre-trained models (PTMs) are extensively utilized in various downstream tasks. Adopting untrusted PTMs may suffer from backdoor attacks, where the adversary can compromise the downstream models by injecting backdoors into the PTM. However, existing backdoor attacks to PTMs can only achieve partially task-agnostic and the embedded backdoors are easily erased during the fine-tuning process. In this paper, we propose a novel transferable backdoor attack, TransTroj, to simultaneously meet functionality-preserving, durable, and task-agnostic. In particular, we first formalize transferable backdoor attacks as the indistinguishability problem between poisoned and clean samples in the embedding space. We decompose the embedding indistinguishability into pre- and post-indistinguishability, representing the similarity of the poisoned and reference embeddings before and after the attack. Then, we propose a two-stage optimization that separately optimizes triggers and victim PTMs to achieve embedding indistinguishability. We evaluate TransTroj on four PTMs and six downstream tasks. Experimental results show that TransTroj significantly outperforms SOTA task-agnostic backdoor attacks (18%$\sim$99%, 68% on average) and exhibits superior performance under various system settings. The code is available at https://github.com/haowang-cqu/TransTroj ., Comment: 13 pages, 16 figures, 5 tables

Neural Radiance Field (NeRF) models have gained significant attention in the computer vision community in the recent past with state-of-the-art visual quality and produced impressive demonstrations. Since then, technopreneurs have sought to leverage NeRF models into a profitable business. Therefore, NeRF models make it worth the risk of plagiarizers illegally copying, re-distributing, or misusing those models. This paper proposes a comprehensive intellectual property (IP) protection framework for the NeRF model in both black-box and white-box settings, namely IPR-NeRF. In the black-box setting, a diffusion-based solution is introduced to embed and extract the watermark via a two-stage optimization process. In the white-box setting, a designated digital signature is embedded into the weights of the NeRF model by adopting the sign loss objective. Our extensive experiments demonstrate that not only does our approach maintain the fidelity (\ie, the rendering quality) of IPR-NeRF models, but it is also robust against both ambiguity and removal attacks compared to prior arts., Comment: Error on result tabulation of state of the art method which might cause misleading to readers

The discovery of superconductivity at 80 K under high pressure in La$_3$Ni$_2$O$_7$ presents the groundbreaking confirmation that high-$T_c$ superconductivity is a property of strongly correlated materials beyond cuprates. We use density functional theory (DFT) calculations of the band structure of La$_3$Ni$_2$O$_7$ under pressure to verify that the low-energy bands are composed almost exclusively of Ni 3$d_{x^2-y^2}$ and O 2$p$ orbitals. We deduce that the Ni 3$d_{z^2}$ orbitals are essentially decoupled by the geometry of the high-pressure structure and by the effect of the Ni Hund coupling being strongly suppressed, which results from the enhanced interlayer antiferromagnetic interaction between $d_{z^2}$ orbitals and the strong intralayer hybridization of the $d_{x^2-y^2}$ orbitals with O 2$p$. By introducing a tight-binding model for the Fermi surfaces and low-energy dispersions, we arrive at a bilayer $t$-$t_\perp$-$J$ model with strong interlayer hopping, which we show is a framework unifying La$_3$Ni$_2$O$_7$ with cuprate materials possessing similar band structures, particularly the compounds La$_2$CaCu$_2$O$_6$, Pb$_2$Sr$_2$YCu$_3$O$_8$, and EuSr$_2$Cu$_2$NbO$_8$. We use a renormalized mean-field theory to show that these systems should have ($d$+$is$)-wave superconductivity, with a dominant $d$-wave component and the high $T_c$ driven by the near-optimally doped $\beta$ band, while the $\alpha$ band adds an $s$-wave component that should lead to clear experimental signatures., Comment: 11 pages, 4 figures

Solving image-to-3D from a single view is an ill-posed problem, and current neural reconstruction methods addressing it through diffusion models still rely on scene-specific optimization, constraining their generalization capability. To overcome the limitations of existing approaches regarding generalization and consistency, we introduce a novel neural rendering technique. Our approach employs the signed distance function as the surface representation and incorporates generalizable priors through geometry-encoding volumes and HyperNetworks. Specifically, our method builds neural encoding volumes from generated multi-view inputs. We adjust the weights of the SDF network conditioned on an input image at test-time to allow model adaptation to novel scenes in a feed-forward manner via HyperNetworks. To mitigate artifacts derived from the synthesized views, we propose the use of a volume transformer module to improve the aggregation of image features instead of processing each viewpoint separately. Through our proposed method, dubbed as Hyper-VolTran, we avoid the bottleneck of scene-specific optimization and maintain consistency across the images generated from multiple viewpoints. Our experiments show the advantages of our proposed approach with consistent results and rapid generation.

In this paper, we democratise 3D content creation, enabling precise generation of 3D shapes from abstract sketches while overcoming limitations tied to drawing skills. We introduce a novel part-level modelling and alignment framework that facilitates abstraction modelling and cross-modal correspondence. Leveraging the same part-level decoder, our approach seamlessly extends to sketch modelling by establishing correspondence between CLIPasso edgemaps and projected 3D part regions, eliminating the need for a dataset pairing human sketches and 3D shapes. Additionally, our method introduces a seamless in-position editing process as a byproduct of cross-modal part-aligned modelling. Operating in a low-dimensional implicit space, our approach significantly reduces computational demands and processing time., Comment: CVPR 2024, Project Page: https://hmrishavbandy.github.io/doodle23d/

In this study, we explore Transformer-based diffusion models for image and video generation. Despite the dominance of Transformer architectures in various fields due to their flexibility and scalability, the visual generative domain primarily utilizes CNN-based U-Net architectures, particularly in diffusion-based models. We introduce GenTron, a family of Generative models employing Transformer-based diffusion, to address this gap. Our initial step was to adapt Diffusion Transformers (DiTs) from class to text conditioning, a process involving thorough empirical exploration of the conditioning mechanism. We then scale GenTron from approximately 900M to over 3B parameters, observing significant improvements in visual quality. Furthermore, we extend GenTron to text-to-video generation, incorporating novel motion-free guidance to enhance video quality. In human evaluations against SDXL, GenTron achieves a 51.1% win rate in visual quality (with a 19.8% draw rate), and a 42.3% win rate in text alignment (with a 42.9% draw rate). GenTron also excels in the T2I-CompBench, underscoring its strengths in compositional generation. We believe this work will provide meaningful insights and serve as a valuable reference for future research., Comment: CVPR2024 Camera Ready. Website: https://www.shoufachen.com/gentron_website/

This paper introduces RDA, a pioneering approach designed to address two primary deficiencies prevalent in previous endeavors aiming at stealing pre-trained encoders: (1) suboptimal performances attributed to biased optimization objectives, and (2) elevated query costs stemming from the end-to-end paradigm that necessitates querying the target encoder every epoch. Specifically, we initially Refine the representations of the target encoder for each training sample, thereby establishing a less biased optimization objective before the steal-training phase. This is accomplished via a sample-wise prototype, which consolidates the target encoder's representations for a given sample's various perspectives. Demanding exponentially fewer queries compared to the end-to-end approach, prototypes can be instantiated to guide subsequent query-free training. For more potent efficacy, we develop a multi-relational extraction loss that trains the surrogate encoder to Discriminate mismatched embedding-prototype pairs while Aligning those matched ones in terms of both amplitude and angle. In this way, the trained surrogate encoder achieves state-of-the-art results across the board in various downstream datasets with limited queries. Moreover, RDA is shown to be robust to multiple widely-used defenses., Comment: 25 pages, 12 figures, 15 tables

Creating multi-view wire art (MVWA), a static 3D sculpture with diverse interpretations from different viewpoints, is a complex task even for skilled artists. In response, we present DreamWire, an AI system enabling everyone to craft MVWA easily. Users express their vision through text prompts or scribbles, freeing them from intricate 3D wire organisation. Our approach synergises 3D B\'ezier curves, Prim's algorithm, and knowledge distillation from diffusion models or their variants (e.g., ControlNet). This blend enables the system to represent 3D wire art, ensuring spatial continuity and overcoming data scarcity. Extensive evaluation and analysis are conducted to shed insight on the inner workings of the proposed system, including the trade-off between connectivity and visual aesthetics., Comment: CVPR 2024

Recently, the signatures of superconductivity near 80 K have been discovered in the single crystal of La3Ni2O7 under pressure and thus has attracted significant attention. However, there are several critical issues that have been perplexing the scientific community. These include (1) what factors contribute to the poor reproducibility of the experimental results, (2) what the intrinsic nature of the pressure-induced superconductivity is, bulk or filamentary, (3) where the superconducting phase locates within the sample if it is indeed filamentary, and (4) what the oxygen content is necessary for the development and stabilization of superconductivity. In this study, we employ comprehensive high-pressure measurements to address these crucial issues. By demonstrating both zero resistance and diamagnetism, we are the first to confirm the existence of high-temperature superconductivity in La3Ni2O7. Through our sensitive ac susceptibility measurements, we are the first to quantify the superconducting volume fraction in La3Ni2O7 at the level of 1%. In tandem with our observation of the anisotropic zero-resistance state only in some of the samples, we suggest that the superconductivity in this nickelate is filamentary-like. By our scanning transmission electron microscopy (STEM) investigations, we propose that the filamentary superconductivity most likely emerges at the interface between the La3Ni2O7 and La4Ni3O10 phases. Further, the upper and lower bounds of the oxygen content required for the presence of superconductivity were determined. Our results provide not only new insights into understanding the puzzling issues in this material, but also significant information for achieving a better understanding on the superconductivity of this material., Comment: 25 pages, 4 figures

Text-to-video editing aims to edit the visual appearance of a source video conditional on textual prompts. A major challenge in this task is to ensure that all frames in the edited video are visually consistent. Most recent works apply advanced text-to-image diffusion models to this task by inflating 2D spatial attention in the U-Net into spatio-temporal attention. Although temporal context can be added through spatio-temporal attention, it may introduce some irrelevant information for each patch and therefore cause inconsistency in the edited video. In this paper, for the first time, we introduce optical flow into the attention module in the diffusion model's U-Net to address the inconsistency issue for text-to-video editing. Our method, FLATTEN, enforces the patches on the same flow path across different frames to attend to each other in the attention module, thus improving the visual consistency in the edited videos. Additionally, our method is training-free and can be seamlessly integrated into any diffusion-based text-to-video editing methods and improve their visual consistency. Experiment results on existing text-to-video editing benchmarks show that our proposed method achieves the new state-of-the-art performance. In particular, our method excels in maintaining the visual consistency in the edited videos., Comment: Accepted by ICLR2024. Project page: https://flatten-video-editing.github.io/

Artificial Intelligence Generated Content (AIGC) has shown remarkable progress in generating realistic images. However, in this paper, we take a step "backward" and address AIGC for the most rudimentary visual modality of human sketches. Our objective is on the creative nature of sketches, and that creative sketching should take the form of an interactive process. We further enable text to drive the sketch ideation process, allowing creativity to be freely defined, while simultaneously tackling the challenge of "I can't sketch". We present a method to generate controlled sketches using a text-conditioned diffusion model trained on pixel representations of images. Our proposed approach, referred to as SketchDreamer, integrates a differentiable rasteriser of Bezier curves that optimises an initial input to distil abstract semantic knowledge from a pretrained diffusion model. We utilise Score Distillation Sampling to learn a sketch that aligns with a given caption, which importantly enable both text and sketch to interact with the ideation process. Our objective is to empower non-professional users to create sketches and, through a series of optimisation processes, transform a narrative into a storyboard by expanding the text prompt while making minor adjustments to the sketch input. Through this work, we hope to aspire the way we create visual content, democratise the creative process, and inspire further research in enhancing human creativity in AIGC. The code is available at \url{https://github.com/WinKawaks/SketchDreamer}., Comment: BMVC 2023

We perform classical simulations of the 127-qubit kicked Ising model, which was recently emulated using a quantum circuit with error mitigation [Nature 618, 500 (2023)]. Our approach is based on the projected entangled pair operator (PEPO) in the Heisenberg picture. Its main feature is the ability to automatically identify the underlying low-rank and low-entanglement structures in the quantum circuit involving Clifford and near-Clifford gates. We assess our approach using the quantum circuit with 5+1 trotter steps which was previously considered beyond classical verification. We develop a Clifford expansion theory to compute exact expectation values and use them to evaluate algorithms. The results indicate that PEPO significantly outperforms existing methods, including the tensor network with belief propagation, the matrix product operator, and the Clifford perturbation theory, in both efficiency and accuracy. In particular, PEPO with bond dimension $\chi=2$ already gives similar accuracy to the CPT with $K=10$ and MPO with bond dimension $\chi=1024$. And PEPO with $\chi=184$ provides exact results in $3$ seconds using a single CPU. Furthermore, we apply our method to the circuit with 20 Trotter steps. We observe the monotonic and consistent convergence of the results with $\chi$, allowing us to estimate the outcome with $\chi\to\infty$ through extrapolations. We then compare the extrapolated results to those achieved in quantum hardware and with existing tensor network methods. Additionally, we discuss the potential usefulness of our approach in simulating quantum circuits, especially in scenarios involving near-Clifford circuits and quantum approximate optimization algorithms. Our approach is the first use of PEPO in solving the time evolution problem, and our results suggest it could be a powerful tool for exploring the dynamical properties of quantum many-body systems., Comment: 8 pages, 3 figures

Deep hiding, embedding images with others using deep neural networks, has demonstrated impressive efficacy in increasing the message capacity and robustness of secret sharing. In this paper, we challenge the robustness of existing deep hiding schemes by preventing the recovery of secret images, building on our in-depth study of state-of-the-art deep hiding schemes and their vulnerabilities. Leveraging our analysis, we first propose a simple box-free removal attack on deep hiding that does not require any prior knowledge of the deep hiding schemes. To improve the removal performance on the deep hiding schemes that may be enhanced by adversarial training, we further design a more powerful removal attack, efficient box-free removal attack (EBRA), which employs image inpainting techniques to remove secret images from container images. In addition, to ensure the effectiveness of our attack and preserve the fidelity of the processed container images, we design an erasing phase based on the locality of deep hiding to remove secret information and then make full use of the visual information of container images to repair the erased visual content. Extensive evaluations show our method can completely remove secret images from container images with negligible impact on the quality of container images.

Superconductivity is realized by opening a gap in the superconducting state. The gap symmetry is crucial in understanding the underlying superconductivity mechanism. The magnitude and the phase are essential in fully characterizing the superconducting gap. Angle-resolved photoemission spectroscopy (ARPES) has played a key role in determining the gap symmetry in unconventional superconductors. However, it has been considered so far that ARPES can only measure the magnitude of the superconducting gap but not its phase; the phase has to be detected by other phase-sensitive techniques. Here we propose a new method to directly detect the superconducting gap sign by using ARPES. This method is successfully validated in a cuprate superconductor with a well-known $d$-wave gap symmetry. When two bands are nearby in momentum space and have a strong interband interaction, the resulted electronic structures in the superconducting state are sensitive to the relative gap sign between the two bands which can be captured by ARPES measurements. Our present work provides a new way to detect the gap sign and can be applied to various superconductors, particularly those with multiple orbitals like the iron-based superconductors. It also makes ARPES more powerful to determine both the gap magnitude and the phase that are significant in understanding the superconductivity mechanism of unconventional superconductors., Comment: 22 pages, 4 figures

Machine learning makes multimedia data (e.g., images) more attractive, however, multimedia data is usually distributed and privacy sensitive. Multiple distributed multimedia clients can resort to federated learning (FL) to jointly learn a global shared model without requiring to share their private samples with any third-party entities. In this paper, we show that FL suffers from the cross-client generative adversarial networks (GANs)-based (C-GANs) attack, in which a malicious client (i.e., adversary) can reconstruct samples with the same distribution as the training samples from other clients (i.e., victims). Since a benign client's data can be leaked to the adversary, this attack brings the risk of local data leakage for clients in many security-critical FL applications. Thus, we propose Fed-EDKD (i.e., Federated Ensemble Data-free Knowledge Distillation) technique to improve the current popular FL schemes to resist C-GANs attack. In Fed-EDKD, each client submits a local model to the server for obtaining an ensemble global model. Then, to avoid model expansion, Fed-EDKD adopts data-free knowledge distillation techniques to transfer knowledge from the ensemble global model to a compressed model. By this way, Fed-EDKD reduces the adversary's control capability over the global model, so Fed-EDKD can effectively mitigate C-GANs attack. Finally, the experimental results demonstrate that Fed-EDKD significantly mitigates C-GANs attack while only incurring a slight accuracy degradation of FL.

3D shape modeling is labor-intensive, time-consuming, and requires years of expertise. To facilitate 3D shape modeling, we propose a 3D shape generation network that takes a 3D VR sketch as a condition. We assume that sketches are created by novices without art training and aim to reconstruct geometrically realistic 3D shapes of a given category. To handle potential sketch ambiguity, our method creates multiple 3D shapes that align with the original sketch's structure. We carefully design our method, training the model step-by-step and leveraging multi-modal 3D shape representation to support training with limited training data. To guarantee the realism of generated 3D shapes we leverage the normalizing flow that models the distribution of the latent space of 3D shapes. To encourage the fidelity of the generated 3D shapes to an input sketch, we propose a dedicated loss that we deploy at different stages of the training process. The code is available at https://github.com/Rowl1ng/3Dsketch2shape., Comment: Accepted by ICCV 2023

In contrast to the standard learning paradigm where all classes can be observed in training data, learning with augmented classes (LAC) tackles the problem where augmented classes unobserved in the training data may emerge in the test phase. Previous research showed that given unlabeled data, an unbiased risk estimator (URE) can be derived, which can be minimized for LAC with theoretical guarantees. However, this URE is only restricted to the specific type of one-versus-rest loss functions for multi-class classification, making it not flexible enough when the loss needs to be changed with the dataset in practice. In this paper, we propose a generalized URE that can be equipped with arbitrary loss functions while maintaining the theoretical guarantees, given unlabeled data for LAC. To alleviate the issue of negative empirical risk commonly encountered by previous studies, we further propose a novel risk-penalty regularization term. Experiments demonstrate the effectiveness of our proposed method., Comment: Accepted by AAAI 2023, 17 pages, 4 tables, 4 figures

Federated Learning (FL) offers collaborative model training without data sharing but is vulnerable to backdoor attacks, where poisoned model weights lead to compromised system integrity. Existing countermeasures, primarily based on anomaly detection, are prone to erroneous rejections of normal weights while accepting poisoned ones, largely due to shortcomings in quantifying similarities among client models. Furthermore, other defenses demonstrate effectiveness only when dealing with a limited number of malicious clients, typically fewer than 10%. To alleviate these vulnerabilities, we present G$^2$uardFL, a protective framework that reinterprets the identification of malicious clients as an attributed graph clustering problem, thus safeguarding FL systems. Specifically, this framework employs a client graph clustering approach to identify malicious clients and integrates an adaptive mechanism to amplify the discrepancy between the aggregated model and the poisoned ones, effectively eliminating embedded backdoors. We also conduct a theoretical analysis of convergence to confirm that G$^2$uardFL does not affect the convergence of FL systems. Through empirical evaluation, comparing G$^2$uardFL with cutting-edge defenses, such as FLAME (USENIX Security 2022) [28] and DeepSight (NDSS 2022) [36], against various backdoor attacks including 3DFed (SP 2023) [20], our results demonstrate its significant effectiveness in mitigating backdoor attacks while having a negligible impact on the aggregated model's performance on benign samples (i.e., the primary task performance). For instance, in an FL system with 25% malicious clients, G$^2$uardFL reduces the attack success rate to 10.61%, while maintaining a primary task performance of 73.05% on the CIFAR-10 dataset. This surpasses the performance of the best-performing baseline, which merely achieves a primary task performance of 19.54%., Comment: 19 pages, 7 figures

Recently, the claim of "near-ambient superconductivity" in a N-doped lutetium hydride attracted enormous following-up investigations in the community of condensed matter physics and material sciences. But quite soon, the experimental results from different groups indicate consistently that no evidence of near-ambient superconductivity is found in the samples synthesized by the same method as the reported one, or by the other alternative methods. From our extended high-pressure heat capacity and magnetic susceptibility measurements on the samples prepared with the lutetium foil and H2/N2 gas mixture, we report the finding of a magnetic transition at the temperature about 56 K. Our results show that this magnetic phase is robust against pressure up to 4.3 GPa, which covers the critical pressure of boosting the claimed near room temperature superconductivity., Comment: 14 pages, 4 figures

We investigate the electronic and phonon properties of hydrogen sulfide (SH$_3$) under ultrahigh pressure to elucidate the origin of its high-T$_c$ superconductivity. Contrary to the prevailing belief that the metalized S-H $\sigma$ bond is responsible, our analysis, based on the anisotropic Migdal-Eliashberg equation and the crystal orbital Hamilton population (COHP) calculation, reveals that the H-H $\sigma$-antibonding states play a dominant role in the large electron-phonon coupling that leads to the superconducting pairing in SH$_3$. Furthermore, by partially restricting the vibration of S atoms, we demonstrate that the S-H bonds provide subsidiary contributions to the pairing interaction. These findings shed light on the importance of the previously overlooked H-H $\sigma^*$ bonds in driving high-T$_c$ superconductivity in SH$_3$ and offer insights into the relationship between metallic H-H covalent antibonding and high-T$_c$ superconductivity in other hydrogen-rich materials under high pressure., Comment: 11 pages, 9 figures, 59 references

Recently, text-guided 3D generative methods have made remarkable advancements in producing high-quality textures and geometry, capitalizing on the proliferation of large vision-language and image diffusion models. However, existing methods still struggle to create high-fidelity 3D head avatars in two aspects: (1) They rely mostly on a pre-trained text-to-image diffusion model whilst missing the necessary 3D awareness and head priors. This makes them prone to inconsistency and geometric distortions in the generated avatars. (2) They fall short in fine-grained editing. This is primarily due to the inherited limitations from the pre-trained 2D image diffusion models, which become more pronounced when it comes to 3D head avatars. In this work, we address these challenges by introducing a versatile coarse-to-fine pipeline dubbed HeadSculpt for crafting (i.e., generating and editing) 3D head avatars from textual prompts. Specifically, we first equip the diffusion model with 3D awareness by leveraging landmark-based control and a learned textual embedding representing the back view appearance of heads, enabling 3D-consistent head avatar generations. We further propose a novel identity-aware editing score distillation strategy to optimize a textured mesh with a high-resolution differentiable rendering technique. This enables identity preservation while following the editing instruction. We showcase HeadSculpt's superior fidelity and editing capabilities through comprehensive experiments and comparisons with existing methods., Comment: Webpage: https://brandonhan.uk/HeadSculpt/