The Bures Metric for Generative Adversarial ...
Type de document :
Partie d'ouvrage
Titre :
The Bures Metric for Generative Adversarial Networks
Auteur(s) :
de Meulemeester, Hannes [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Schreurs, Joachim [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Fanuel, Michaël [Auteur]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Centre National de la Recherche Scientifique [CNRS]
de Moor, Bart [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Suykens, Johan [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Schreurs, Joachim [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Fanuel, Michaël [Auteur]
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]
Centre National de la Recherche Scientifique [CNRS]
de Moor, Bart [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Suykens, Johan [Auteur]
Department of Electrical Engineering [KU Leuven] [KU-ESAT]
Titre de l’ouvrage :
Machine Learning and Knowledge Discovery in Databases. Research Track
Éditeur :
Springer International Publishing
Lieu de publication :
Cham
Date de publication :
2021-09-10
Discipline(s) HAL :
Sciences de l'ingénieur [physics]
Mathématiques [math]
Informatique [cs]
Mathématiques [math]
Informatique [cs]
Résumé en anglais : [en]
Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping. To address this ...
Lire la suite >Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping. To address this problem, we use the last layer of the discriminator as a feature map to study the distribution of the real and the fake data. During training, we propose to match the real batch diversity to the fake batch diversity by using the Bures distance between covariance matrices in this feature space. The computation of the Bures distance can be conveniently done in either feature space or kernel space in terms of the covariance and kernel matrix respectively. We observe that diversity matching reduces mode collapse substantially and has a positive effect on sample quality. On the practical side, a very simple training procedure is proposed and assessed on several data sets.Lire moins >
Lire la suite >Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping. To address this problem, we use the last layer of the discriminator as a feature map to study the distribution of the real and the fake data. During training, we propose to match the real batch diversity to the fake batch diversity by using the Bures distance between covariance matrices in this feature space. The computation of the Bures distance can be conveniently done in either feature space or kernel space in terms of the covariance and kernel matrix respectively. We observe that diversity matching reduces mode collapse substantially and has a positive effect on sample quality. On the practical side, a very simple training procedure is proposed and assessed on several data sets.Lire moins >
Langue :
Anglais
Audience :
Internationale
Vulgarisation :
Non
Collections :
Source :
Fichiers
- http://arxiv.org/pdf/2006.09096
- Accès libre
- Accéder au document
- 2006.09096
- Accès libre
- Accéder au document