A novel deep learning approach for facial ...
Document type :
Article dans une revue scientifique: Article original
Permalink :
Title :
A novel deep learning approach for facial emotion recognition: application to detecting emotional responses in elderly individuals with Alzheimer’s disease
Author(s) :
Bohi, Amine [Auteur]
Laboratoire d'Innovation Numérique pour les Entreprises et les Apprentissages au service de la Compétitivité des Territoires [LINEACT]
Boudouri, Yassine El [Auteur]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Sfeir, Imad [Auteur]
Laboratoire d'Innovation Numérique pour les Entreprises et les Apprentissages au service de la Compétitivité des Territoires [LINEACT]
Boudouri, Yassine El [Auteur]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Sfeir, Imad [Auteur]
Journal title :
Neural Computing and Applications
Publisher :
Springer Verlag
Publication date :
2024-12-30
ISSN :
0941-0643
English keyword(s) :
Facial expression recognition (FER); Deep learning; Convolutional neural network; Emotion detection; Artificial intelligence; Alzheimer’s disease
HAL domain(s) :
Informatique [cs]/Intelligence artificielle [cs.AI]
Informatique [cs]/Vision par ordinateur et reconnaissance de formes [cs.CV]
Informatique [cs]/Réseau de neurones [cs.NE]
Sciences cognitives/Informatique
Informatique [cs]/Vision par ordinateur et reconnaissance de formes [cs.CV]
Informatique [cs]/Réseau de neurones [cs.NE]
Sciences cognitives/Informatique
English abstract : [en]
Facial expressions are a critical form of nonverbal communication, conveying a wide range of emotions. Recent advancements in artificial intelligence and computer vision have led to the development of deep learning methods, ...
Show more >Facial expressions are a critical form of nonverbal communication, conveying a wide range of emotions. Recent advancements in artificial intelligence and computer vision have led to the development of deep learning methods, particularly convolutional neural networks, which are highly effective in facial emotion recognition. This paper presents EmoNeXt, an advanced deep learning framework for FER that builds upon a modified ConvNeXt architecture and incorporates several key innovations. EmoNeXt integrates spatial transformer networks to enable the model to focus on the most expressive regions of the face, squeeze-and-excitation blocks to enhance channel dependencies, and a self-attention regularization term that encourages the learning of compact and discriminative feature vectors. Initially evaluated on the FER2013 dataset, EmoNeXt is now further validated on two other widely used benchmark datasets, AffectNet and CK+, to demonstrate its robustness and generalizability across various real-world and posed scenarios. Additionally, we conduct an extensive ablation study to analyze and quantify the contribution of each enhancement, confirming their positive impact on model performance. Finally, this paper explores the application of EmoNeXt in emotion recognition for elderly individuals with Alzheimer’s disease, highlighting the urgent need for accurate emotion recognition to improve patient care. Our results underscore the potential of EmoNeXt as a valuable tool for enhancing emotional communication in healthcare settings, particularly for patients with neurodegenerative disorders.Show less >
Show more >Facial expressions are a critical form of nonverbal communication, conveying a wide range of emotions. Recent advancements in artificial intelligence and computer vision have led to the development of deep learning methods, particularly convolutional neural networks, which are highly effective in facial emotion recognition. This paper presents EmoNeXt, an advanced deep learning framework for FER that builds upon a modified ConvNeXt architecture and incorporates several key innovations. EmoNeXt integrates spatial transformer networks to enable the model to focus on the most expressive regions of the face, squeeze-and-excitation blocks to enhance channel dependencies, and a self-attention regularization term that encourages the learning of compact and discriminative feature vectors. Initially evaluated on the FER2013 dataset, EmoNeXt is now further validated on two other widely used benchmark datasets, AffectNet and CK+, to demonstrate its robustness and generalizability across various real-world and posed scenarios. Additionally, we conduct an extensive ablation study to analyze and quantify the contribution of each enhancement, confirming their positive impact on model performance. Finally, this paper explores the application of EmoNeXt in emotion recognition for elderly individuals with Alzheimer’s disease, highlighting the urgent need for accurate emotion recognition to improve patient care. Our results underscore the potential of EmoNeXt as a valuable tool for enhancing emotional communication in healthcare settings, particularly for patients with neurodegenerative disorders.Show less >
Language :
Anglais
Peer reviewed article :
Oui
Audience :
Internationale
Popular science :
Non
Collections :
Source :
Submission date :
2025-01-22T04:59:52Z