MAGMA: Inference and Prediction using ...
Document type :
Compte-rendu et recension critique d'ouvrage
Title :
MAGMA: Inference and Prediction using Multi-Task Gaussian Processes with Common Mean
Author(s) :
Leroy, Arthur [Auteur]
Department of Computer Science [Sheffield]
Latouche, Pierre [Auteur]
Mathématiques Appliquées Paris 5 [MAP5 - UMR 8145]
Guedj, Benjamin [Auteur]
Department of Computer science [University College of London] [UCL-CS]
Inria-CWI [Inria-CWI]
MOdel for Data Analysis and Learning [MODAL]
The Inria London Programme [Inria-London]
Gey, Servane [Auteur]
Mathématiques Appliquées Paris 5 [MAP5 - UMR 8145]
Department of Computer Science [Sheffield]
Latouche, Pierre [Auteur]
Mathématiques Appliquées Paris 5 [MAP5 - UMR 8145]
Guedj, Benjamin [Auteur]
Department of Computer science [University College of London] [UCL-CS]
Inria-CWI [Inria-CWI]
MOdel for Data Analysis and Learning [MODAL]
The Inria London Programme [Inria-London]
Gey, Servane [Auteur]
Mathématiques Appliquées Paris 5 [MAP5 - UMR 8145]
Journal title :
Machine Learning
Publisher :
Springer Verlag
Publication date :
2022-05-06
ISSN :
0885-6125
English keyword(s) :
Multi-task learning
Gaussian process
EM algorithm
Common mean process
Functional data analysis
Gaussian process
EM algorithm
Common mean process
Functional data analysis
HAL domain(s) :
Statistiques [stat]/Calcul [stat.CO]
Statistiques [stat]/Machine Learning [stat.ML]
Statistiques [stat]/Méthodologie [stat.ME]
Informatique [cs]/Apprentissage [cs.LG]
Statistiques [stat]/Machine Learning [stat.ML]
Statistiques [stat]/Méthodologie [stat.ME]
Informatique [cs]/Apprentissage [cs.LG]
English abstract : [en]
A novel multi-task Gaussian process (GP) framework is proposed, by using a common mean process for sharing information across tasks. In particular, we investigate the problem of time series forecasting, with the objective ...
Show more >A novel multi-task Gaussian process (GP) framework is proposed, by using a common mean process for sharing information across tasks. In particular, we investigate the problem of time series forecasting, with the objective to improve multiple-step-ahead predictions. The common mean process is defined as a GP for which the hyper-posterior distribution is tractable. Therefore an EM algorithm is derived for handling both hyper-parameters optimisation and hyper-posterior computation. Unlike previous approaches in the literature, the model fully accounts for uncertainty and can handle irregular grids of observations while maintaining explicit formulations, by modelling the mean process in a unified GP framework. Predictive analytical equations are provided, integrating information shared across tasks through a relevant prior mean. This approach greatly improves the predictive performances, even far from observations, and may reduce significantly the computational complexity compared to traditional multi-task GP models. Our overall algorithm is called MAGMA (standing for Multi tAsk GPs with common MeAn). The quality of the mean process estimation, predictive performances, and comparisons to alternatives are assessed in various simulated scenarios and on real datasets.Show less >
Show more >A novel multi-task Gaussian process (GP) framework is proposed, by using a common mean process for sharing information across tasks. In particular, we investigate the problem of time series forecasting, with the objective to improve multiple-step-ahead predictions. The common mean process is defined as a GP for which the hyper-posterior distribution is tractable. Therefore an EM algorithm is derived for handling both hyper-parameters optimisation and hyper-posterior computation. Unlike previous approaches in the literature, the model fully accounts for uncertainty and can handle irregular grids of observations while maintaining explicit formulations, by modelling the mean process in a unified GP framework. Predictive analytical equations are provided, integrating information shared across tasks through a relevant prior mean. This approach greatly improves the predictive performances, even far from observations, and may reduce significantly the computational complexity compared to traditional multi-task GP models. Our overall algorithm is called MAGMA (standing for Multi tAsk GPs with common MeAn). The quality of the mean process estimation, predictive performances, and comparisons to alternatives are assessed in various simulated scenarios and on real datasets.Show less >
Language :
Anglais
Popular science :
Non
ANR Project :
Collections :
Source :
Files
- document
- Open access
- Access the document
- main.pdf
- Open access
- Access the document
- 2007.10731
- Open access
- Access the document