1. Model of the Weak Reset Process in HfO x Resistive Memory for Deep Learning Frameworks
- Author
-
Etienne Nowak, Damien Querlioz, Marc Bocquet, Axel Laborieux, Atreya Majumdar, Elisa Vianello, Jean-Michel Portal, Tifenn Hirtzlin, Jacques-Olivier Klein, Institut des Matériaux, de Microélectronique et des Nanosciences de Provence (IM2NP), Aix Marseille Université (AMU)-Université de Toulon (UTLN)-Centre National de la Recherche Scientifique (CNRS), Commissariat à l'énergie atomique et aux énergies alternatives - Laboratoire d'Electronique et de Technologie de l'Information (CEA-LETI), Direction de Recherche Technologique (CEA) (DRT (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA), Centre de Nanosciences et de Nanotechnologies (C2N), Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), and ANR-18-CE24-0009,NEURONIC,Réseau Neuronal Binaire à base d'architecture hybride de mémoires intégrant des fonctions de calcul (CMOS/RRAM) pour la fusion de capteurs(2018)
- Subjects
FOS: Computer and information sciences ,Computer Science - Machine Learning ,Computer science ,FOS: Physical sciences ,Applied Physics (physics.app-ph) ,01 natural sciences ,Machine Learning (cs.LG) ,[SPI]Engineering Sciences [physics] ,0103 physical sciences ,Electronic engineering ,Electrical and Electronic Engineering ,ComputingMilieux_MISCELLANEOUS ,010302 applied physics ,Artificial neural network ,business.industry ,Deep learning ,Process (computing) ,Physics - Applied Physics ,Electronic, Optical and Magnetic Materials ,Resistive random-access memory ,Artificial intelligence ,business ,Reset (computing) ,MNIST database ,Random access ,AND gate - Abstract
The implementation of current deep learning training algorithms is power-hungry, due to data transfer between memory and logic units. Oxide-based resistive random access memories (RRAMs) are outstanding candidates to implement in-memory computing, which is less power-intensive. Their weak RESET regime is particularly attractive for learning, as it allows tuning the resistance of the devices with remarkable endurance. However, the resistive change behavior in this regime suffers from many fluctuations and is particularly challenging to model, especially in a way compatible with tools used for simulating deep learning. In this work, we present a model of the weak RESET process in hafnium oxide RRAM and integrate this model within the PyTorch deep learning framework. Validated on experiments on a hybrid CMOS/RRAM technology, our model reproduces both the noisy progressive behavior and the device-to-device (D2D) variability. We use this tool to train binarized neural networks (BNNs) for the MNIST handwritten digit recognition task and the CIFAR-10 object classification task. We simulate our model with and without various aspects of device imperfections to understand their impact on the training process and identify that the D2D variability is the most detrimental aspect. The framework can be used in the same manner for other types of memories to identify the device imperfections that cause the most degradation, which can, in turn, be used to optimize the devices to reduce the impact of these imperfections.
- Published
- 2021