Neurons with dendrites can perform linearly ...
Type de document :
Article dans une revue scientifique
Titre :
Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
Auteur(s) :
Caze, Romain [Auteur]
Circuits Systèmes Applications des Micro-ondes - IEMN [CSAM - IEMN ]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Stimberg, Marcel [Auteur]
Institut de la Vision
Circuits Systèmes Applications des Micro-ondes - IEMN [CSAM - IEMN ]
Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520 [IEMN]
Stimberg, Marcel [Auteur]
Institut de la Vision
Titre de la revue :
F1000Research
Pagination :
1174
Éditeur :
Faculty of 1000
Date de publication :
2021-01-20
ISSN :
2046-1402
Mot(s)-clé(s) en anglais :
Dendrites
computation
linearly separable
implementation
computation
linearly separable
implementation
Discipline(s) HAL :
Sciences de l'ingénieur [physics]
Résumé en anglais : [en]
In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint ...
Lire la suite >In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.Lire moins >
Lire la suite >In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.Lire moins >
Langue :
Anglais
Comité de lecture :
Oui
Audience :
Internationale
Vulgarisation :
Non
Projet ANR :
Source :
Fichiers
- Accès libre
- Accéder au document