Search

Recent reports on machine learning (ML) and machine vision (MV) devices have demonstrated the potentials of 2D materials and devices. Yet, scalable 2D devices are being challenged by contact resistance and Fermi Level Pinning (FLP), power consumption, and low-cost CMOS compatible lithography processes. To enable CMOS+2D, it is essential to find a proper lithography strategy that can fulfill these requirements. Here, we explore modified van der Waals (vdW) deposition lithography and demonstrate a relatively new class of van-der-Waals-Field-Effect-Transistors (vdW-FETs) based on 2D materials. This lithography strategy enables us to unlock high performance devices evident by high current on-off ratio (Ion/Ioff), high turn-on current density (Ion), and weak Fermi Level Pinning (FLP). We utilize this approach to demonstrate a gate-tunable near-ideal diode using MoS2/WSe2 heterojunction with an ideality factor of ~1.65 and current rectification of 102. We finally demonstrate a highly sensitive, scalable, and ultra-low power phototransistor using MoS2/ WSe2 vdW-FET for Back-End-of-Line (BEOL) integration. Our phototransistor exhibits the highest gate-tunable photoresponsivity achieved to date for white light detection with ultra-low power dissipation, enabling ultra-sensitive, ultra-fast, and efficient optoelectronic applications such as in-sensor neuromorphic machine vision. Our approach shows the great potential of modified vdW deposition lithography for back-end-of-line CMOS+2D applications.

Due to its tunable band gap, anisotropic behavior, and superior thermoelectric properties, device applications using layered tellurene (Te) are becoming attractive. Here, we report a thinning technique for exfoliated tellurene nanosheets using thermal annealing in an oxygen environment. We characterize different thinning parameters including temperature and annealing time. Based on our measurements, we show that controlled layer thinning occurs in the narrow temperature range of 325 oC to 350 oC. We also show a reliable method to form \b{eta}-tellurene oxide (\b{eta}- TeO2), which is an emerging wide band gap semiconductor with promising electronic and optoelectronic properties. This wide band gap semiconductor exhibits a broad photoluminescence (PL) spectrum with multiple peaks covering the range 1.76 eV to 2.08 eV. This PL emission coupled with Raman spectra are strong evidence of the formation of 2D \b{eta}- TeO2. We discuss the results obtained and the mechanisms of Te thinning and \b{eta}-TeO2 formation at different temperature regimes. We also discuss the optical band gap of \b{eta}-TeO2 and show the existence of pronounced excitonic effects evident by the large exciton binding energy in this 2D \b{eta}-TeO2 system that reach 1.54 eV to 1.62 eV for bulk to monolayer, respectively. Our work can be utilized to have better control over Te nanosheet thickness. It also sheds light on the formation of well-controlled \b{eta}-TeO2 layered semiconductor for electronic and optoelectronic applications.

We investigate the thermal properties of these Zirconium based materials using confocal Raman spectroscopy. We observed 2 different and distinctive Raman signatures for exfoliated ZrX2 (where X = S or Se). These Raman modes generally depend on the shape of the exfoliated nanosheets, regardless of the incident laser polarization. These 2 shapes are divided into 2D- ZrX2 and quasi 1D- ZrX2. For 2D- ZrX2, Raman modes are in alignment with those reported in literature. However, for quasi 1D-ZrX2, we show that Raman modes are identical to exfoliated ZrX3 nanosheets, indicating a major lattice transformation from 2D to quasi-1D. We also measure thermal properties of each resonant Raman mode for each ZrX2 shape. Based on our measurements, most Raman modes exhibit a linear downshift dependence with temperature. However, for ZrS2, we see an upshift (blueshift) with temperature for A1g mode, which is attributed to non-harmonic effects caused by dipolar coupling with IR-active modes. Moreover, the observed temperature dependence coefficient for some phonon modes of quasi 1D-ZrX2 differ dramatically, which can be caused by the quasi 1D lattice. Finally, we measure phonon dynamics under optical heating for each of 2D-ZrX2 and quasi 1D-ZrX2 and show phonon confinement in quasi 1D-ZrX2 nanosheets. We extract the thermal conductivity and the interfacial thermal conductance for each of 2D-ZrX2 and quasi 1D-ZrX2 nanosheets. Our calculations indicate lower interfacial thermal conductance for quasi 1D-ZrX2 compared to 2D-ZrX2, which can be attributed to the phonon confinement in 1D. Based on our model, we show low thermal conductivity for all ZrX2 nanosheets. Our results demonstrate exceptional thermal properties for ZrX2 materials, making them ideal for future thermal management strategies and thermoelectric device applications.

Researchers have demonstrated various techniques for fingerprinting and identifying devices. Previous approaches have identified devices from their network traffic or transmitted signals while relying on software or operating system specific artifacts (e.g., predictability of protocol header fields) or characteristics of the underlying protocol (e.g.,frequency offset). As these constraints can be a hindrance in real-world settings, we introduce a practical, generalizable approach that offers significant operational value for a variety of scenarios, including as an additional factor of authentication for preventing impersonation attacks. Our goal is to identify artifacts in transmitted signals that are caused by a device's unique hardware "imperfections" without any knowledge about the nature of the signal. We develop RF-DCN, a novel Deep Complex-valued Neural Network (DCN) that operates on raw RF signals and is completely agnostic of the underlying applications and protocols. We present two DCN variations: (i) Convolutional DCN (CDCN) for modeling full signals, and (ii) Recurrent DCN (RDCN) for modeling time series. Our system handles raw I/Q data from open air captures within a given spectrum window, without knowledge of the modulation scheme or even the carrier frequencies. While our experiments demonstrate the effectiveness of our system, especially under challenging conditions where other neural network architectures break down, we identify additional challenges in signal-based fingerprinting and provide guidelines for future explorations. Our work lays the foundation for more research within this vast and challenging space by establishing fundamental directions for using raw RF I/Q data in novel complex-valued networks.

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vision tasks, mainly due to the lack of domain knowledge that is hardcoded into CNNs, such as spatially oriented translation invariant filters. However, a great advantage of GCNs is the ability to work on irregular inputs, such as superpixels of images. This could significantly reduce the computational cost of image reasoning tasks. Another key advantage inherent to GCNs is the natural ability to model multirelational data. Building upon these two promising properties, in this work, we show best practices for designing GCNs for image classification; in some cases even outperforming CNNs on the MNIST, CIFAR-10 and PASCAL image datasets., Comment: 13 pages, BMVC 2019

Measuring Mutual Information (MI) between high-dimensional, continuous, random variables from observed samples has wide theoretical and practical applications. Recent work, MINE (Belghazi et al. 2018), focused on estimating tight variational lower bounds of MI using neural networks, but assumed unlimited supply of samples to prevent overfitting. In real world applications, data is not always available at a surplus. In this work, we focus on improving data efficiency and propose a Data-Efficient MINE Estimator (DEMINE), by developing a relaxed predictive MI lower bound that can be estimated at higher data efficiency by orders of magnitudes. The predictive MI lower bound also enables us to develop a new meta-learning approach using task augmentation, Meta-DEMINE, to improve generalization of the network and further boost estimation accuracy empirically. With improved data-efficiency, our estimators enables statistical testing of dependency at practical dataset sizes. We demonstrate the effectiveness of our estimators on synthetic benchmarks and a real world fMRI data, with application of inter-subject correlation analysis.

We aim to better understand attention over nodes in graph neural networks (GNNs) and identify factors influencing its effectiveness. We particularly focus on the ability of attention GNNs to generalize to larger, more complex or noisy graphs. Motivated by insights from the work on Graph Isomorphism Networks, we design simple graph reasoning tasks that allow us to study attention in a controlled environment. We find that under typical conditions the effect of attention is negligible or even harmful, but under certain conditions it provides an exceptional gain in performance of more than 60% in some of our classification tasks. Satisfying these conditions in practice is challenging and often requires optimal initialization or supervised training of attention. We propose an alternative recipe and train attention in a weakly-supervised fashion that approaches the performance of supervised models, and, compared to unsupervised models, improves results on several synthetic as well as real datasets. Source code and datasets are available at https://github.com/bknyaz/graph_attention_pool., Comment: NeurIPS 2019, camera-ready and supplementary material

Spectral Graph Convolutional Networks (GCNs) are a generalization of convolutional networks to learning on graph-structured data. Applications of spectral GCNs have been successful, but limited to a few problems where the graph is fixed, such as shape correspondence and node classification. In this work, we address this limitation by revisiting a particular family of spectral graph networks, Chebyshev GCNs, showing its efficacy in solving graph classification tasks with a variable graph structure and size. Chebyshev GCNs restrict graphs to have at most one edge between any pair of nodes. To this end, we propose a novel multigraph network that learns from multi-relational graphs. We model learned edges with abstract meaning and experiment with different ways to fuse the representations extracted from annotated and learned edges, achieving competitive results on a variety of chemical classification benchmarks., Comment: 11 pages, 5 figures, NIPS 2018 Workshop on Machine Learning for Molecules and Materials

We present a novel generative model for human motion modeling using Generative Adversarial Networks (GANs). We formulate the GAN discriminator using dense validation at each time-scale and perturb the discriminator input to make it translation invariant. Our model is capable of motion generation and completion. We show through our evaluations the resiliency to noise, generalization over actions, and generation of long diverse sequences. We evaluate our approach on Human 3.6M and CMU motion capture datasets using inception scores.

A popular testbed for deep learning has been multimodal recognition of human activity or gesture involving diverse inputs such as video, audio, skeletal pose and depth images. Deep learning architectures have excelled on such problems due to their ability to combine modality representations at different levels of nonlinear feature extraction. However, designing an optimal architecture in which to fuse such learned representations has largely been a non-trivial human engineering effort. We treat fusion structure optimization as a hyper-parameter search and cast it as a discrete optimization problem under the Bayesian optimization framework. We propose a novel graph-induced kernel to compute structural similarities in the search space of tree-structured multimodal architectures and demonstrate its effectiveness using two challenging multimodal human activity recognition datasets., Comment: Proceedings of the 25th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, April 2017, Bruges, Belgium

We observe photothermal self-oscillations in individual, suspended, quasi-metallic carbon nanotube (CNT) pn devices irradiated with focused CW 633nm light. Here, the bottom of the trench forms an optical cavity with an anti-node at lambda/4. Oscillations arise from the optical heating of the nanotube, which causes thermal contraction of the nanotube (negative thermal expansion coefficient). This, in turn, moves the CNT out of the anti-node (maximum field intensity), where the nanotube cools to a lower temperature. It then expands and returns to the maximum field intensity anti-node where it is optically heated once again. The oscillations are observed through a change of the tunneling current in the CNT device. A pn-junction, established by two electrostatic gates positioned beneath the nanotube, results in Zener tunneling, which depends strongly on temperature. A Zener tunneling model with oscillating temperature shows good agreement with our measured I-V curves, providing further evidence that these oscillations are photothermal in nature.

Most recent work focused on affect from facial expressions, and not as much on body. This work focuses on body affect analysis. Affect does not occur in isolation. Humans usually couple affect with an action in natural interactions; for example, a person could be talking and smiling. Recognizing body affect in sequences requires efficient algorithms to capture both the micro movements that differentiate between happy and sad and the macro variations between different actions. We depart from traditional approaches for time-series data analytics by proposing a multi-task learning model that learns a shared representation that is well-suited for action-affect classification as well as generation. For this paper we choose Conditional Restricted Boltzmann Machines to be our building block. We propose a new model that enhances the CRBM model with a factored multi-task component to become Multi-Task Conditional Restricted Boltzmann Machines (MTCRBMs). We evaluate our approach on two publicly available datasets, the Body Affect dataset and the Tower Game dataset, and show superior classification performance improvement over the state-of-the-art, as well as the generative abilities of our model.

We present a novel approach to computational modeling of social interactions based on modeling of essential social interaction predicates (ESIPs) such as joint attention and entrainment. Based on sound social psychological theory and methodology, we collect a new "Tower Game" dataset consisting of audio-visual capture of dyadic interactions labeled with the ESIPs. We expect this dataset to provide a new avenue for research in computational social interaction modeling. We propose a novel joint Discriminative Conditional Restricted Boltzmann Machine (DCRBM) model that combines a discriminative component with the generative power of CRBMs. Such a combination enables us to uncover actionable constituents of the ESIPs in two steps. First, we train the DCRBM model on the labeled data and get accurate (76\%-49\% across various ESIPs) detection of the predicates. Second, we exploit the generative capability of DCRBMs to activate the trained model so as to generate the lower-level data corresponding to the specific ESIP that closely matches the actual training data (with mean square error 0.01-0.1 for generating 100 frames). We are thus able to decompose the ESIPs into their constituent actionable behaviors. Such a purely computational determination of how to establish an ESIP such as engagement is unprecedented.