Privacy and utility of x-vector based ...
Type de document :
Compte-rendu et recension critique d'ouvrage
Titre :
Privacy and utility of x-vector based speaker anonymization
Auteur(s) :
Srivastava, Brij Mohan Lal [Auteur]
Machine Learning in Information Networks [MAGNET]
Speech Modeling for Facilitating Oral-Based Communication [MULTISPEECH]
Maouche, Mohamed [Auteur]
Machine Learning in Information Networks [MAGNET]
Sahidullah, Md [Auteur]
Speech Modeling for Facilitating Oral-Based Communication [MULTISPEECH]
Vincent, Emmanuel [Auteur]
Speech Modeling for Facilitating Oral-Based Communication [MULTISPEECH]
Bellet, Aurelien [Auteur]
Machine Learning in Information Networks [MAGNET]
Tommasi, Marc [Auteur]
Machine Learning in Information Networks [MAGNET]
Tomashenko, Natalia [Auteur]
Laboratoire Informatique d'Avignon [LIA]
Wang, Xin [Auteur]
National Institute of Informatics [NII]
Yamagishi, Junichi [Auteur]
National Institute of Informatics [NII]
Machine Learning in Information Networks [MAGNET]
Speech Modeling for Facilitating Oral-Based Communication [MULTISPEECH]
Maouche, Mohamed [Auteur]
Machine Learning in Information Networks [MAGNET]
Sahidullah, Md [Auteur]
Speech Modeling for Facilitating Oral-Based Communication [MULTISPEECH]
Vincent, Emmanuel [Auteur]
Speech Modeling for Facilitating Oral-Based Communication [MULTISPEECH]
Bellet, Aurelien [Auteur]
Machine Learning in Information Networks [MAGNET]
Tommasi, Marc [Auteur]
Machine Learning in Information Networks [MAGNET]
Tomashenko, Natalia [Auteur]
Laboratoire Informatique d'Avignon [LIA]
Wang, Xin [Auteur]
National Institute of Informatics [NII]
Yamagishi, Junichi [Auteur]
National Institute of Informatics [NII]
Titre de la revue :
IEEE/ACM Transactions on Audio, Speech and Language Processing
Éditeur :
Institute of Electrical and Electronics Engineers
Date de publication :
2022-06-15
ISSN :
2329-9290
Mot(s)-clé(s) en anglais :
privacy
linkability
utility
speech recognition
speaker identification
speaker anonymization
linkability
utility
speech recognition
speaker identification
speaker anonymization
Discipline(s) HAL :
Informatique [cs]/Intelligence artificielle [cs.AI]
Informatique [cs]/Informatique et langage [cs.CL]
Informatique [cs]/Apprentissage [cs.LG]
Informatique [cs]/Informatique et langage [cs.CL]
Informatique [cs]/Apprentissage [cs.LG]
Résumé en anglais : [en]
We study the scenario where individuals (speakers) contribute to the publication of an anonymized speech corpus. Data users then leverage this public corpus to perform downstream tasks (such as training automatic speech ...
Lire la suite >We study the scenario where individuals (speakers) contribute to the publication of an anonymized speech corpus. Data users then leverage this public corpus to perform downstream tasks (such as training automatic speech recognition systems), while attackers may try to de-anonymize itbased on auxiliary knowledge they collect. Motivated by this scenario, speaker anonymization aims to conceal the speaker identity while preserving the quality and usefulness of speech data. In this paper, we study x-vector based speaker anonymization, the leading approach in the recent Voice Privacy Challenge, which converts an input utterance into that of a random pseudo-speaker. We show that the strength of the anonymization varies significantly depending on how the pseudo-speaker is selected. In particular, we investigate four design choices: the distance measure between speakers, the region of x-vector space where the pseudo-speaker is mapped, the gender selection and whether to use speaker or utterance level assignment. We assess the quality of anonymization from the perspective of the three actors involved in our threat model, namely the speaker, the user and the attacker. To measure privacy and utility, we use respectively the linkability score achieved by the attackers and the decoding word error rate incurred by an ASR model trained with the anonymized data. Experiments on LibriSpeech dataset confirm that the optimal combination ofdesign choices yield state-of-the-art performance in terms of privacy protection as well as utility. Experiments on Mozilla Common Voice dataset show that the best design choices with 50 speakers guarantee the same anonymization level against re-identification attack as raw speech with 20,000 speakers.Lire moins >
Lire la suite >We study the scenario where individuals (speakers) contribute to the publication of an anonymized speech corpus. Data users then leverage this public corpus to perform downstream tasks (such as training automatic speech recognition systems), while attackers may try to de-anonymize itbased on auxiliary knowledge they collect. Motivated by this scenario, speaker anonymization aims to conceal the speaker identity while preserving the quality and usefulness of speech data. In this paper, we study x-vector based speaker anonymization, the leading approach in the recent Voice Privacy Challenge, which converts an input utterance into that of a random pseudo-speaker. We show that the strength of the anonymization varies significantly depending on how the pseudo-speaker is selected. In particular, we investigate four design choices: the distance measure between speakers, the region of x-vector space where the pseudo-speaker is mapped, the gender selection and whether to use speaker or utterance level assignment. We assess the quality of anonymization from the perspective of the three actors involved in our threat model, namely the speaker, the user and the attacker. To measure privacy and utility, we use respectively the linkability score achieved by the attackers and the decoding word error rate incurred by an ASR model trained with the anonymized data. Experiments on LibriSpeech dataset confirm that the optimal combination ofdesign choices yield state-of-the-art performance in terms of privacy protection as well as utility. Experiments on Mozilla Common Voice dataset show that the best design choices with 50 speakers guarantee the same anonymization level against re-identification attack as raw speech with 20,000 speakers.Lire moins >
Langue :
Anglais
Vulgarisation :
Non
Projet ANR :
Collections :
Source :
Fichiers
- https://hal.inria.fr/hal-03197376v3/document
- Accès libre
- Accéder au document
- https://hal.inria.fr/hal-03197376v3/document
- Accès libre
- Accéder au document
- https://hal.inria.fr/hal-03197376v3/document
- Accès libre
- Accéder au document
- document
- Accès libre
- Accéder au document
- design_choices_informed.pdf
- Accès libre
- Accéder au document