Exploiting Non-idealities of Resistive ...
Document type :
Compte-rendu et recension critique d'ouvrage
Title :
Exploiting Non-idealities of Resistive Switching Memories for Efficient Machine Learning
Author(s) :
Yon, Victor [Auteur]
Institut Interdisciplinaire d'Innovation Technologique [Sherbrooke] [3IT]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Amirsoleimani, Amirali [Auteur]
York University [Toronto]
Alibart, Fabien [Auteur]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Nanostructures, nanoComponents & Molecules - IEMN [NCM - IEMN]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Melko, Roger [Auteur]
Department of Physics and Astronomy [Waterloo]
Perimeter Institute for Theoretical Physics [Waterloo]
Drouin, Dominique [Auteur]
Institut Interdisciplinaire d'Innovation Technologique [Sherbrooke] [3IT]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Beilliard, Yann [Auteur]
Institut Interdisciplinaire d'Innovation Technologique [Sherbrooke] [3IT]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Institut Interdisciplinaire d'Innovation Technologique [Sherbrooke] [3IT]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Amirsoleimani, Amirali [Auteur]
York University [Toronto]
Alibart, Fabien [Auteur]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Nanostructures, nanoComponents & Molecules - IEMN [NCM - IEMN]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Melko, Roger [Auteur]
Department of Physics and Astronomy [Waterloo]
Perimeter Institute for Theoretical Physics [Waterloo]
Drouin, Dominique [Auteur]
Institut Interdisciplinaire d'Innovation Technologique [Sherbrooke] [3IT]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Beilliard, Yann [Auteur]
Institut Interdisciplinaire d'Innovation Technologique [Sherbrooke] [3IT]
Laboratoire Nanotechnologies et Nanosystèmes [Sherbrooke] [LN2]
Journal title :
Frontiers in Electronics
Pages :
825077
Publisher :
Frontiers Media
Publication date :
2022-03-25
English keyword(s) :
resistive switching memories
memristor
in-memory computing
hardware non-idealities
artificial neural networks
bayesian neural networks
probabilistic computing
memristor
in-memory computing
hardware non-idealities
artificial neural networks
bayesian neural networks
probabilistic computing
HAL domain(s) :
Sciences de l'ingénieur [physics]
English abstract : [en]
Novel computing architectures based on resistive switching memories (also known as memristors or RRAMs) have been shown to be promising approaches for tackling the energy inefficiency of deep learning and spiking neural ...
Show more >Novel computing architectures based on resistive switching memories (also known as memristors or RRAMs) have been shown to be promising approaches for tackling the energy inefficiency of deep learning and spiking neural networks. However, resistive switch technology is immature and suffers from numerous imperfections, which are often considered limitations on implementations of artificial neural networks. Nevertheless, a reasonable amount of variability can be harnessed to implement efficient probabilistic or approximate computing. This approach turns out to improve robustness, decrease overfitting and reduce energy consumption for specific applications, such as Bayesian and spiking neural networks. Thus, certain non-idealities could become opportunities if we adapt machine learning methods to the intrinsic characteristics of resistive switching memories. In this short review, we introduce some key considerations for circuit design and the most common non-idealities. We illustrate the possible benefits of stochasticity and compression with examples of well-established software methods. We then present an overview of recent neural network implementations that exploit the imperfections of resistive switching memory, and discuss the potential and limitations of these approaches.Show less >
Show more >Novel computing architectures based on resistive switching memories (also known as memristors or RRAMs) have been shown to be promising approaches for tackling the energy inefficiency of deep learning and spiking neural networks. However, resistive switch technology is immature and suffers from numerous imperfections, which are often considered limitations on implementations of artificial neural networks. Nevertheless, a reasonable amount of variability can be harnessed to implement efficient probabilistic or approximate computing. This approach turns out to improve robustness, decrease overfitting and reduce energy consumption for specific applications, such as Bayesian and spiking neural networks. Thus, certain non-idealities could become opportunities if we adapt machine learning methods to the intrinsic characteristics of resistive switching memories. In this short review, we introduce some key considerations for circuit design and the most common non-idealities. We illustrate the possible benefits of stochasticity and compression with examples of well-established software methods. We then present an overview of recent neural network implementations that exploit the imperfections of resistive switching memory, and discuss the potential and limitations of these approaches.Show less >
Language :
Anglais
Popular science :
Non
ANR Project :
Source :
Files
- https://www.frontiersin.org/articles/10.3389/felec.2022.825077/pdf
- Open access
- Access the document
- https://hal.archives-ouvertes.fr/hal-03679671/document
- Open access
- Access the document
- https://hal.archives-ouvertes.fr/hal-03679671/document
- Open access
- Access the document
- document
- Open access
- Access the document
- Yon_2022_felec-03-825077.pdf
- Open access
- Access the document
- Open access
- Access the document