MMD-FUSE: Learning and Combining Kernels for Two-Sample Testing Without Data Splitting

Biggs, Felix; Schrab, Antonin; Gretton, Arthur

Document type :

Pré-publication ou Document de travail

Title :

MMD-FUSE: Learning and Combining Kernels for Two-Sample Testing Without Data Splitting

Author(s) :

Biggs, Felix []
University College of London [London] [UCL]
Schrab, Antonin []
University College of London [London] [UCL]
MOdel for Data Analysis and Learning [MODAL]
The Inria London Programme [Inria-London]
Department of Computer science [University College of London] [UCL-CS]
Gatsby Computational Neuroscience Unit
Gretton, Arthur [Auteur]
Gatsby Computational Neuroscience Unit

Publication date :

2023-06-15

HAL domain(s) :

Statistiques [stat]/Machine Learning [stat.ML]

English abstract : [en]

We propose novel statistics which maximise the power of a two-sample test based on the Maximum Mean Discrepancy (MMD), by adapting over the set of kernels used in defining it. For finite sets, this reduces to combining ...
Show more >We propose novel statistics which maximise the power of a two-sample test based on the Maximum Mean Discrepancy (MMD), by adapting over the set of kernels used in defining it. For finite sets, this reduces to combining (normalised) MMD values under each of these kernels via a weighted soft maximum. Exponential concentration bounds are proved for our proposed statistics under the null and alternative. We further show how these kernels can be chosen in a data-dependent but permutation-independent way, in a wellcalibrated test, avoiding data splitting. This technique applies more broadly to general permutation-based MMD testing, and includes the use of deep kernels with features learnt using unsupervised models such as auto-encoders. We highlight the applicability of our MMD-FUSE test on both synthetic lowdimensional and real-world high-dimensional data, and compare its performance in terms of power against current state-of-the-art kernel tests.Show less >

Language :

Anglais

Collections :

Laboratoire Paul Painlevé - UMR 8524

Source :

Harvested from HAL

Files

document
Open access
Access the document

2306.08777.pdf
Open access
Access the document

2306.08777
Open access
Access the document

MMD-FUSE: Learning and Combining Kernels ... BibTeX CSV Excel RIS

Files

MMD-FUSE: Learning and Combining Kernels ...

BibTeX

CSV

Excel

RIS