Search

Differentiable rendering is a key ingredient for inverse rendering and machine learning, as it allows to optimize scene parameters (shape, materials, lighting) to best fit target images. Differentiable rendering requires that each scene parameter relates to pixel values through differentiable operations. While 3D mesh rendering algorithms have been implemented in a differentiable way, these algorithms do not directly extend to Constructive-Solid-Geometry (CSG), a popular parametric representation of shapes, because the underlying boolean operations are typically performed with complex black-box mesh-processing libraries. We present an algorithm, DiffCSG, to render CSG models in a differentiable manner. Our algorithm builds upon CSG rasterization, which displays the result of boolean operations between primitives without explicitly computing the resulting mesh and, as such, bypasses black-box mesh processing. We describe how to implement CSG rasterization within a differentiable rendering pipeline, taking special care to apply antialiasing along primitive intersections to obtain gradients in such critical areas. Our algorithm is simple and fast, can be easily incorporated into modern machine learning setups, and enables a range of applications for computer-aided design, including direct and image-based editing of CSG primitives. Code and data: https://yyyyyhc.github.io/DiffCSG/.

Piezoelectric and ferroelectric wurtzite are promising to reshape modern microelectronics because they can be easily integrated with mainstream semiconductor technology. Sc doped AlN (Al$_{1-x}$Sc$_x$N) has attracted much attention for its enhanced piezoelectric and emerging ferroelectric properties, yet the commonly used sputtering results in polycrystalline Al$_{1-x}$Sc$_x$N films with high leakage current. Here we report the pulsed laser deposition of single crystalline epitaxial Al$_{1-x}$Sc$_x$N thin films on sapphire and 4H-SiC substrates. Pure wurtzite phase is maintained up to $x = 0.3$ with minimal oxygen contamination. Polarization is estimated to be 140 $\mu$C/cm$^2$ via atomic scale microscopy imaging and found to be switchable via a scanning probe. The piezoelectric coefficient is found to be 5 times of undoped one when $x = 0.3$, making it desirable for high frequency radiofrequency (RF) filters and three-dimensional nonvolatile memories.

This paper introduces a novel anomaly detection (AD) problem that focuses on identifying `odd-looking' objects relative to the other instances within a scene. Unlike the traditional AD benchmarks, in our setting, anomalies in this context are scene-specific, defined by the regular instances that make up the majority. Since object instances are often partly visible from a single viewpoint, our setting provides multiple views of each scene as input. To provide a testbed for future research in this task, we introduce two benchmarks, ToysAD-8K and PartsAD-15K. We propose a novel method that generates 3D object-centric representations for each instance and detects the anomalous ones through a cross-examination between the instances. We rigorously analyze our method quantitatively and qualitatively in the presented benchmarks., Comment: Codes & Dataset at https://github.com/VICO-UoE/OddOneOutAD

Automatic anomaly detection based on visual cues holds practical significance in various domains, such as manufacturing and product quality assessment. This paper introduces a new conditional anomaly detection problem, which involves identifying anomalies in a query image by comparing it to a reference shape. To address this challenge, we have created a large dataset, BrokenChairs-180K, consisting of around 180K images, with diverse anomalies, geometries, and textures paired with 8,143 reference 3D shapes. To tackle this task, we have proposed a novel transformer-based approach that explicitly learns the correspondence between the query image and reference 3D shape via feature alignment and leverages a customized attention mechanism for anomaly detection. Our approach has been rigorously evaluated through comprehensive experiments, serving as a benchmark for future research in this domain., Comment: Accepted at CVPR'24. Codes & dataset available at https://github.com/VICO-UoE/Looking3D

We present Canonical Consolidation Fields (CanFields): a method for reconstructing a time series of independently-sampled point clouds into a single deforming coherent shape. Such input often comes from motion capture. Existing methods either couple the geometry and the deformation, where by doing so they smooth fine details and lose the ability to track moving points, or they track the deformation explicitly, but introduce topological and geometric artifacts. Our novelty lies in the consolidation of the point clouds into a single canonical shape in a way that reduces the effect of noise and outliers, and enables us to overcome missing regions. We simultaneously reconstruct the velocity fields that guide the deformation. This consolidation allows us to retain the high-frequency details of the geometry, while faithfully reproducing the low-frequency deformation. Our architecture comprises simple components, and fits any single input shape without using datasets. We demonstrate the robustness and accuracy of our methods on a diverse benchmark of dynamic point clouds, including missing regions, sparse frames, and noise.

Topotactic reduction utilizing metal hydrides as reagents emerges as an effective approach to achieve exceptionally low oxidization states of metal ions and unconventional coordination networks. This method opens avenues to the development of entirely new functional materials, with one notable example being the infinite-layer nickelate superconductors. However, the reduction effect on the atomic reconstruction and electronic structures -- crucial for superconductivity -- remains largely unresolved. We design two sets of control Nd$_{0.8}$Sr$_{0.2}$NiO$_2$ thin films and implement secondary ion mass spectroscopy to highlight the absence of reduction-induced hydrogen intercalation. X-ray absorption spectroscopy shows a significant linear dichroism with dominant Ni 3d$_{x2{-}y2}$ orbitals on superconducting samples, indicating a Ni single-band nature of infinite-layer nickelates. Consistent with the superconducting $T_c$, the Ni 3d orbitals asymmetry manifests a dome-like reduction duration dependence. Our results unveil the critical role of reduction in modulating the Ni-3d orbital polarization and its impact on the superconducting properties., Comment: Main: 21 pages, 4 figure - Supplementary: 7 pages, 5 figure

CAD programs are a popular way to compactly encode shapes as a sequence of operations that are easy to parametrically modify. However, without sufficient semantic comments and structure, such programs can be challenging to understand, let alone modify. We introduce the problem of semantic commenting CAD programs, wherein the goal is to segment the input program into code blocks corresponding to semantically meaningful shape parts and assign a semantic label to each block. We solve the problem by combining program parsing with visual-semantic analysis afforded by recent advances in foundational language and vision models. Specifically, by executing the input programs, we create shapes, which we use to generate conditional photorealistic images to make use of semantic annotators for such images. We then distill the information across the images and link back to the original programs to semantically comment on them. Additionally, we collected and annotated a benchmark dataset, CADTalk, consisting of 5,288 machine-made programs and 45 human-made programs with ground truth semantic comments. We extensively evaluated our approach, compared it to a GPT-based baseline, and an open-set shape segmentation baseline, and reported an 83.24% accuracy on the new CADTalk dataset. Code and data: https://enigma-li.github.io/CADTalk/.

Sketch semantic segmentation is a well-explored and pivotal problem in computer vision involving the assignment of pre-defined part labels to individual strokes. This paper presents ContextSeg - a simple yet highly effective approach to tackling this problem with two stages. In the first stage, to better encode the shape and positional information of strokes, we propose to predict an extra dense distance field in an autoencoder network to reinforce structural information learning. In the second stage, we treat an entire stroke as a single entity and label a group of strokes within the same semantic part using an auto-regressive Transformer with the default attention mechanism. By group-based labeling, our method can fully leverage the context information when making decisions for the remaining groups of strokes. Our method achieves the best segmentation accuracy compared with state-of-the-art approaches on two representative datasets and has been extensively evaluated demonstrating its superior performance. Additionally, we offer insights into solving part imbalance in training data and the preliminary experiment on cross-category training, which can inspire future research in this field.

Point clouds acquired by 3D scanning devices are often sparse, noisy, and non-uniform, causing a loss of geometric features. To facilitate the usability of point clouds in downstream applications, given such input, we present a learning-based point upsampling method, i.e., iPUNet, which generates dense and uniform points at arbitrary ratios and better captures sharp features. To generate feature-aware points, we introduce cross fields that are aligned to sharp geometric features by self-supervision to guide point generation. Given cross field defined frames, we enable arbitrary ratio upsampling by learning at each input point a local parameterized surface. The learned surface consumes the neighboring points and 2D tangent plane coordinates as input, and maps onto a continuous surface in 3D where arbitrary ratios of output points can be sampled. To solve the non-uniformity of input points, on top of the cross field guided upsampling, we further introduce an iterative strategy that refines the point distribution by moving sparse points onto the desired continuous 3D surface in each iteration. Within only a few iterations, the sparse points are evenly distributed and their corresponding dense samples are more uniform and better capture geometric features. Through extensive evaluations on diverse scans of objects and scenes, we demonstrate that iPUNet is robust to handle noisy and non-uniformly distributed inputs, and outperforms state-of-the-art point cloud upsampling methods.

The integration of high-temperature superconducting YBa2Cu3O6+x (YBCO) into flexible electronic devices has the potential to revolutionize the technology industry. The effective preparation of high-quality flexible YBCO films therefore plays a key role in this development. We present a novel approach for transferring water-sensitive YBCO films onto flexible substrates without any buffer layer. Freestanding YBCO film on a polydimethylsiloxane substrate is extracted by etching the Sr3Al2O6 sacrificial layer from the LaAlO3 substrate. In addition to the obtained freestanding YBCO thin film having a Tc of 89.1 K, the freestanding YBCO thin films under inward and outward bending conditions have Tc of 89.6 K and 88.9 K, respectively. A comprehensive characterization involving multiple experimental techniques including high-resolution transmission electron microscopy, scanning electron microscopy, Raman and X-ray Absorption Spectroscopy is conducted to investigate the morphology, structural and electronic properties of the YBCO film before and after the extraction process where it shows the preservation of the structural and superconductive properties of the freestanding YBCO virtually in its pristine state. Further investigation reveals the formation of a YBCO passivated layer serves as a protective layer which effectively preserves the inner section of the freestanding YBCO during the etching process. This work plays a key role in actualizing the fabrication of flexible oxide thin films and opens up new possibilities for a diverse range of device applications involving thin-films and low-dimensional materials., Comment: 22 pages,4 figures,references added

Cone Beam Computed Tomography (CBCT) is the most widely used imaging method in dentistry. As hundreds of X-ray projections are needed to reconstruct a high-quality CBCT image (i.e., the attenuation field) in traditional algorithms, sparse-view CBCT reconstruction has become a main focus to reduce radiation dose. Several attempts have been made to solve it while still suffering from insufficient data or poor generalization ability for novel patients. This paper proposes a novel attenuation field encoder-decoder framework by first encoding the volumetric feature from multi-view X-ray projections, then decoding it into the desired attenuation field. The key insight is when building the volumetric feature, we comply with the multi-view CBCT reconstruction nature and emphasize the view consistency property by geometry-aware spatial feature querying and adaptive feature fusing. Moreover, the prior knowledge information learned from data population guarantees our generalization ability when dealing with sparse view input. Comprehensive evaluations have demonstrated the superiority in terms of reconstruction quality, and the downstream application further validates the feasibility of our method in real-world clinics.

We fabricated Pt/La0.5Ba0.5MnO3 ultrathin films with integration to the PbZr0.2Ti0.8O3 ferroelectric. Strong Topological Hall Effect can be measured across a wide temperature range, which can be turned on and off corresponding to the ferroelectric polarization switching driven by short voltage pulses, indicating creation and annihilation of magnetic Skyrmions. However, its magnetoelectric coupling polarity was found to be opposite to the earlier consensus, which involves a phase transition between ferromagnetic and A-type antiferromagnetic in manganites due to electrostatic doping into the eg-orbitals by the ferroelectric bound charges. In our case, we propose a novel yet complementary picture where the transition occurs between C-type antiferromagnetic and ferromagnetic. The distinction between the earlier consensus and our picture lies at the tetragonal distortion of the manganite unit cell, resulting in an opposite magnetoelectric coupling polarity. We support the perceived relationship between the phase transition and tuning of Topological Hall Effect by micromagnetic simulations., Comment: 12 pages, 3 figures

The interplay between dimensionality and various phases of matter is a central inquiry in condensed matter physics. New phases are often discovered through spontaneously broken symmetry. Understanding the dimensionality of superconductivity in the high-temperature cuprate analogue $-$ layered nickelates and revealing a new symmetry-breaking state are the keys to deciphering the underlying pairing mechanism. Here, we demonstrate the highly-tunable dimensionality and a broken rotational symmetry state in the superconductivity of square-planar layered nickelates. The superconducting state, probed by superconducting critical current and magnetoresistance within superconducting transition under direction-dependent in-plane magnetic fields, exhibits a $C_2$ rotational symmetry which breaks the $C_4$ rotational symmetry of the square-planar lattice. Furthermore, by performing detailed examination of the angular dependent upper critical fields at temperatures down to 0.5 K with high-magnetic pulsed-fields, we observe a crossover from two-dimensional to three-dimensional superconducting states which can be manipulated by the ionic size fluctuations in the rare-earth spacer layer. Such a large degree of controllability is desired for tailoring strongly two/three-dimensional superconductors and navigating various pairing landscapes for a better understanding of the correlation between reduced dimensionality and unconventional pairing. These results illuminate new directions to unravel the high-temperature superconducting pairing mechanism., Comment: 30 pages, 4 main figures, 8 extended data figures

Cone beam computed tomography (CBCT) has been widely used in clinical practice, especially in dental clinics, while the radiation dose of X-rays when capturing has been a long concern in CBCT imaging. Several research works have been proposed to reconstruct high-quality CBCT images from sparse-view 2D projections, but the current state-of-the-arts suffer from artifacts and the lack of fine details. In this paper, we propose SNAF for sparse-view CBCT reconstruction by learning the neural attenuation fields, where we have invented a novel view augmentation strategy to overcome the challenges introduced by insufficient data from sparse input views. Our approach achieves superior performance in terms of high reconstruction quality (30+ PSNR) with only 20 input views (25 times fewer than clinical collections), which outperforms the state-of-the-arts. We have further conducted comprehensive experiments and ablation analysis to validate the effectiveness of our approach.

In orthodontic treatment, a full tooth model consisting of both the crown and root is indispensable in making the treatment plan. However, acquiring tooth root information to obtain the full tooth model from CBCT images is sometimes restricted due to the massive radiation of CBCT scanning. Thus, reconstructing the full tooth shape from the ready-to-use input, e.g., the partial intra-oral scan and the 2D panoramic image, is an applicable and valuable solution. In this paper, we propose a neural network, called ToothInpaintor, that takes as input a partial 3D dental model and a 2D panoramic image and reconstructs the full tooth model with high-quality root(s). Technically, we utilize the implicit representation for both the 3D and 2D inputs, and learn a latent space of the full tooth shapes. At test time, given an input, we successfully project it to the learned latent space via neural optimization to obtain the full tooth model conditioned on the input. To help find the robust projection, a novel adversarial learning module is exploited in our pipeline. We extensively evaluate our method on a dataset collected from real-world clinics. The evaluation, comparison, and comprehensive ablation studies demonstrate that our approach produces accurate complete tooth models robustly and outperforms the state-of-the-art methods.

Metal-insulator transitions (MIT),an intriguing correlated phenomenon induced by the subtle competition of the electrons' repulsive Coulomb interaction and kinetic energy, is of great potential use for electronic applications due to the dramatic change in resistivity. Here, we demonstrate a reversible control of MIT in VO2 films via oxygen stoichiometry engineering. By facilely depositing and dissolving a water-soluble yet oxygen-active Sr3Al2O6 capping layer atop the VO2 at room temperature, oxygen ions can reversibly migrate between VO2 and Sr3Al2O6, resulting in a gradual suppression and a complete recovery of MIT in VO2. The migration of the oxygen ions is evidenced in a combination of transport measurement, structural characterization and first-principles calculations. This approach of chemically-induced oxygen migration using a water-dissolvable adjacent layer could be useful for advanced electronic and iontronic devices and studying oxygen stoichiometry effects on the MIT., Comment: 16 pages, 4 figures

Empowering conventional materials with unexpected magnetoelectric properties is appealing to the multi-functionalization of existing devices and the exploration of future electronics. Recently, owing to its unique effect in modulating a matter's properties, ultra-small dopants, e.g. H, D, and Li, attract enormous attention in creating emergent functionalities, such as superconductivity, and metal-insulator transition. Here, we report an observation of bipolar conduction accompanied by a giant positive magnetoresistance in D-doped metallic Ti oxide (TiOxDy) films. To overcome the challenges in intercalating the D into a crystalline oxide, a series of TiOxDy were formed by sequentially doping Ti with D and surface/interface oxidation. Intriguingly, while the electron mobility of the TiOxDy increases by an order of magnitude larger after doping, the emergent holes also exhibit high mobility. Moreover, the bipolar conduction induces a giant magnetoresistance up to 900% at 6 T, which is ~6 times higher than its conventional phase. Our study paves a way to empower conventional materials in existing electronics and induce novel electronic phases.

We introduce Point2Skeleton, an unsupervised method to learn skeletal representations from point clouds. Existing skeletonization methods are limited to tubular shapes and the stringent requirement of watertight input, while our method aims to produce more generalized skeletal representations for complex structures and handle point clouds. Our key idea is to use the insights of the medial axis transform (MAT) to capture the intrinsic geometric and topological natures of the original input points. We first predict a set of skeletal points by learning a geometric transformation, and then analyze the connectivity of the skeletal points to form skeletal mesh structures. Extensive evaluations and comparisons show our method has superior performance and robustness. The learned skeletal representation will benefit several unsupervised tasks for point clouds, such as surface reconstruction and segmentation., Comment: Accepted to CVPR2021 (oral). Project: https://github.com/clinplayer/Point2Skeleton

Deep Reinforcement Learning (DRL) has recently achieved significant advances in various domains. However, explaining the policy of RL agents still remains an open problem due to several factors, one being the complexity of explaining neural networks decisions. Recently, a group of works have used decision-tree-based models to learn explainable policies. Soft decision trees (SDTs) and discretized differentiable decision trees (DDTs) have been demonstrated to achieve both good performance and share the benefit of having explainable policies. In this work, we further improve the results for tree-based explainable RL in both performance and explainability. Our proposal, Cascading Decision Trees (CDTs) apply representation learning on the decision path to allow richer expressivity. Empirical results show that in both situations, where CDTs are used as policy function approximators or as imitation learners to explain black-box policies, CDTs can achieve better performances with more succinct and explainable models than SDTs. As a second contribution our study reveals limitations of explaining black-box policies via imitation learning with tree-based explainable models, due to its inherent instability.

Segmenting arbitrary 3D objects into constituent parts that are structurally meaningful is a fundamental problem encountered in a wide range of computer graphics applications. Existing methods for 3D shape segmentation suffer from complex geometry processing and heavy computation caused by using low-level features and fragmented segmentation results due to the lack of global consideration. We present an efficient method, called SEG-MAT, based on the medial axis transform (MAT) of the input shape. Specifically, with the rich geometrical and structural information encoded in the MAT, we are able to develop a simple and principled approach to effectively identify the various types of junctions between different parts of a 3D shape. Extensive evaluations and comparisons show that our method outperforms the state-of-the-art methods in terms of segmentation quality and is also one order of magnitude faster., Comment: IEEE Transactions on Visualization and Computer Graphics (TVCG), to appear

We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities between the steps industrial designers follow to draw 3D shapes, and the operations CAD modeling systems offer to create similar shapes. To overcome the strong ambiguity with parsing 2D sketches, we observe that in a sketching sequence, each step makes sense and can be interpreted in the \emph{context} of what has been drawn before. In our system, this context corresponds to a partial CAD model, inferred in the previous steps, which we feed along with the input sketch to a deep neural network in charge of interpreting how the model should be modified by that sketch. Our deep network architecture then recognizes the intended CAD operation and segments the sketch accordingly, such that a subsequent optimization estimates the parameters of the operation that best fit the segmented sketch strokes. Since there exists no datasets of paired sketching and CAD modeling sequences, we train our system by generating synthetic sequences of CAD operations that we render as line drawings. We present a proof of concept realization of our algorithm supporting four frequently used CAD operations. Using our system, participants are able to quickly model a large and diverse set of objects, demonstrating Sketch2CAD to be an alternate way of interacting with current CAD modeling systems.

Exploring exotic interface magnetism due to charge transfer and strong spin-orbit coupling has profound application in future development of spintronic memory. Here, the emergence, tuning and interpretation of hump-shape Hall Effect from a CaMnO3/CaIrO3/CaMnO3 trilayer structure are studied in detail. The hump signal can be recognized as Topological Hall Effect suggesting the presence of Skyrmion-like magnetic bubbles; but the debated alternative interpretation where the signal being an artefact between two cancelling Anomalous Hall Effect loops is also discussed. Firstly, by tilting the magnetic field direction, the evolution of Hall signal suggests transformation of the bubbles topology into a more trivial kind. Secondly, by varying the thickness of CaMnO3, the optimal thicknesses for the hump signal emergence are found, suggesting a tuning of charge transfer fraction. Using high-resolution transmission electron microscopy, a stacking fault is also identified, which distinguishes the top and bottom CaMnO3/CaIrO3 interfaces in terms of charge transfer fraction and possible interfacial Dzyaloshinskii-Moriya Interaction. Finally, a spin-transfer torque experiment revealed a low threshold current density of ~10^9 A/m^2 for initiating the motion of bubbles. This discovery opens a possible route for integrating Skyrmions with antiferromagnetic spintronics., Comment: Keywords: Charge transfer, Spin-orbit coupling, Topological Hall Effect, CaIrO3, Skyrmion-like bubbles

Infinite-layer Nd1-xSrxNiO2 thin films with Sr doping level x from 0.08 to 0.3 were synthesized and investigated. We found a superconducting dome to be between 0.12 and 0.235 which is accompanied by a weakly insulating behaviour in both underdoped and overdoped regimes. The dome is akin to that in the electron-doped 214-type and infinite-layer cuprate superconductors. For x higher than 0.18, the normal state Hall coefficient ($R_{H}$) changes the sign from negative to positive as the temperature decreases. The temperature of the sign changes monotonically decreases with decreasing x from the overdoped side and approaches the superconducting dome at the mid-point, suggesting a reconstruction of the Fermi surface as the dopant concentration changes across the center of the dome., Comment: 23 pages (including Supplemental Material), 12 Figures (including 8 supplemental figures)

Using interlayer interaction to control functional heterostructures with atomic-scale designs has become one of the most effective interface-engineering strategies nowadays. Here, we demonstrate the effect of a crystalline LaFeO3 buffer layer on amorphous and crystalline LaAlO3/SrTiO3 heterostructures. The LaFeO3 buffer layer acts as an energetically favored electron acceptor in both LaAlO3/SrTiO3 systems, resulting in modulation of interfacial carrier density and hence metal-to-insulator transition. For amorphous and crystalline LaAlO3/SrTiO3 heterostructures, the metal-to-insulator transition is found when the LaFeO3 layer thickness crosses 3 and 6 unit cells, respectively. Such different critical LaFeO3 thicknesses are explained in terms of distinct characteristic lengths of the redox-reaction-mediated and polar-catastrophe-dominated charge transfer, controlled by the interfacial atomic contact and Thomas-Fermi screening effect, respectively. Our results not only shed light on the complex interlayer charge transfer across oxide heterostructures but also provides a new route to precisely tailor the charge-transfer process at a functional interface., Comment: 40 Pages, 14 Figures, 1 Table

A lifelong reinforcement learning system is a learning system that has the ability to learn through trail-and-error interaction with the environment over its lifetime. In this paper, I give some arguments to show that the traditional reinforcement learning paradigm fails to model this type of learning system. Some insights into lifelong reinforcement learning are provided, along with a simplistic prototype lifelong reinforcement learning system.