PAC-Bayes and Domain Adaptation

Germain, Pascal; Habrard, Amaury; Laviolette, François; Morvant, Emilie

Document type :

Article dans une revue scientifique

DOI :

10.1016/j.neucom.2019.10.105

Permalink :

http://hdl.handle.net/20.500.12210/29385

Title :

PAC-Bayes and Domain Adaptation

Author(s) :

Germain, Pascal [Auteur]
Habrard, Amaury [Auteur]
Laviolette, François [Auteur]
Morvant, Emilie [Auteur]

Journal title :

Neurocomputing

Volume number :

379

Pages :

379-397

Publisher :

Elsevier

Publication date :

2020

ISSN :

0925-2312

Keyword(s) :

PAC-Bayesian Theory
Domain Adaptation

HAL domain(s) :

Statistiques [stat]/Machine Learning [stat.ML]

English abstract : [en]

We provide two main contributions in PAC-Bayesian theory for domain adaptation where the objective is to learn, from a source distribution, a well-performing majority vote on a different, but related, target distribution. ...
Show more >We provide two main contributions in PAC-Bayesian theory for domain adaptation where the objective is to learn, from a source distribution, a well-performing majority vote on a different, but related, target distribution. Firstly, we propose an improvement of the previous approach we proposed in Germain et al. (2013), which relies on a novel distribution pseudodistance based on a disagreement averaging, allowing us to derive a new tighter domain adaptation bound for the target risk. While this bound stands in the spirit of common domain adaptation works, we derive a second bound (introduced in Germain et al., 2016) that brings a new perspective on domain adaptation by deriving an upper bound on the target risk where the distributions' divergence\u2014expressed as a ratio\u2014controls the trade-off between a source error measure and the target voters' disagreement. We discuss and compare both results, from which we obtain PAC-Bayesian generalization bounds. Furthermore, from the PAC-Bayesian specialization to linear classifiers, we infer two learning algorithms, and we evaluate them on real data.Show less >

Language :

Anglais

Audience :

Internationale

Popular science :

Non

European Project :

Life Long Learning for Visual Scene Understanding (L3ViSU)

Administrative institution(s) :

CNRS
Université de Lille

Collections :

METRICS : Evaluation des technologies de santé et des pratiques médicales - ULR 2694

Submission date :

2020-06-08T14:11:27Z
2020-06-09T09:31:02Z

Files

documen
Open access
Access the document

Version	Link	Modification date
2	20.500.12210/29385*	2020-06-09T09:30:44Z
1	20.500.12210/29385.1	2020-06-08T14:11:27Z

PAC-Bayes and Domain Adaptation

BibTeX

CSV

Excel

RIS

Files

Version history

PAC-Bayes and Domain Adaptation BibTeX CSV Excel RIS

Files

Version history

PAC-Bayes and Domain Adaptation

BibTeX

CSV

Excel

RIS