Interpretable Domain Adaptation Using ...
Type de document :
Compte-rendu et recension critique d'ouvrage
Titre :
Interpretable Domain Adaptation Using Unsupervised Feature Selection on Pre-trained Source Models
Auteur(s) :
Zhang, Luxin [Auteur]
Worldline France
MOdel for Data Analysis and Learning [MODAL]
Germain, Pascal [Auteur]
Université Laval [Québec] [ULaval]
Kessaci, Yacine [Auteur]
Worldline France
Biernacki, Christophe [Auteur]
MOdel for Data Analysis and Learning [MODAL]
Worldline France
MOdel for Data Analysis and Learning [MODAL]
Germain, Pascal [Auteur]
Université Laval [Québec] [ULaval]
Kessaci, Yacine [Auteur]
Worldline France
Biernacki, Christophe [Auteur]
MOdel for Data Analysis and Learning [MODAL]
Titre de la revue :
Neurocomputing
Pagination :
319-336
Éditeur :
Elsevier
Date de publication :
2022-10-28
ISSN :
0925-2312
Discipline(s) HAL :
Informatique [cs]/Apprentissage [cs.LG]
Résumé en anglais : [en]
We study a realistic domain adaptation setting where one has access to an already existing "black-box" machine learning model. Indeed, in real-life scenarios, an efficient pre-trained source domain predictive model is often ...
Lire la suite >We study a realistic domain adaptation setting where one has access to an already existing "black-box" machine learning model. Indeed, in real-life scenarios, an efficient pre-trained source domain predictive model is often available and required to be preserved. Our work extends a method that has been recently proposed to tackle this specific problem, yet providing an interpretable <i>target to source</i> transformation, by seeking a coordinate-wise adaptation of the feature space. However, this method requires partially labeled target data to select the features to be adapted. In contrast, we address the more challenging unsupervised version of this domain adaptation scenario. We propose a new pseudo-label estimator over unlabeled target examples, based on the rank-stability in regards to the source model prediction. Such estimated "labels" are further used in a feature selection process to assess whether each feature needs to be transformed to achieve adaptation. We provide theoretical foundations of our method as well as an efficient implementation. Numerical experiments on real datasets show particularly encouraging results since approaching the supervised case, where one has access to labeled target samples.Lire moins >
Lire la suite >We study a realistic domain adaptation setting where one has access to an already existing "black-box" machine learning model. Indeed, in real-life scenarios, an efficient pre-trained source domain predictive model is often available and required to be preserved. Our work extends a method that has been recently proposed to tackle this specific problem, yet providing an interpretable <i>target to source</i> transformation, by seeking a coordinate-wise adaptation of the feature space. However, this method requires partially labeled target data to select the features to be adapted. In contrast, we address the more challenging unsupervised version of this domain adaptation scenario. We propose a new pseudo-label estimator over unlabeled target examples, based on the rank-stability in regards to the source model prediction. Such estimated "labels" are further used in a feature selection process to assess whether each feature needs to be transformed to achieve adaptation. We provide theoretical foundations of our method as well as an efficient implementation. Numerical experiments on real datasets show particularly encouraging results since approaching the supervised case, where one has access to labeled target samples.Lire moins >
Langue :
Anglais
Vulgarisation :
Non
Collections :
Source :
Fichiers
- document
- Accès libre
- Accéder au document
- preprint.pdf
- Accès libre
- Accéder au document