3D facial expression recognition using SIFT descriptors of automatically detected keypoints

Berretti, Stefano; Ben Amor, Boulbaba; Daoudi, Mohamed; del Bimbo, Alberto

Document type :

Article dans une revue scientifique

DOI :

10.1007/s00371-011-0611-x

Title :

3D facial expression recognition using SIFT descriptors of automatically detected keypoints

Author(s) :

Berretti, Stefano [Auteur]
Dipartimento di Sistemi e Informatica [DSI]
Ben Amor, Boulbaba [Auteur]
FOX MIIRE [LIFL]
Daoudi, Mohamed [Auteur]
FOX MIIRE [LIFL]
del Bimbo, Alberto [Auteur]
Dipartimento di Sistemi e Informatica [DSI]

Journal title :

The Visual Computer

Pages :

1021-1036

Publisher :

Springer Verlag

Publication date :

2011-06

ISSN :

0178-2789

HAL domain(s) :

Informatique [cs]/Vision par ordinateur et reconnaissance de formes [cs.CV]

English abstract : [en]

Methods to recognize humans' facial expressions have been proposed mainly focusing on 2D still images and videos. In this paper, the problem of person-independent facial expression recognition is addressed using the 3D ...
Show more >Methods to recognize humans' facial expressions have been proposed mainly focusing on 2D still images and videos. In this paper, the problem of person-independent facial expression recognition is addressed using the 3D geometry information extracted from the 3D shape of the face. To this end, a completely automatic approach is proposed that relies on identifying a set of facial keypoints, computing SIFT feature descriptors of depth images of the face around sample points defined starting from the facial keypoints, and selecting the subset of features with maximum relevance. Training a Support Vector Machine (SVM) for each facial expression to be recognized, and combining them to form. a multi-class classifier, an average recognition rate of 78.43% on the BU-3DFE database has been obtained. Comparison with competitor approaches using a common experimental setting on the BU-3DFE database shows that our solution is capable of obtaining state of the art results. The same 3D face representation framework and testing database have been also used to perform. 3D facial expression retrieval (i.e., retrieve 3D scans with the same facial expression as shown by a target subject), with results proving the viability of the proposed solution.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

ANR Project :

Biométrie Faciale Utilisant les Visages 3D

Collections :