Optimisation de réseaux de neurones profonds: ...
Type de document :
Pré-publication ou Document de travail
Titre :
Optimisation de réseaux de neurones profonds: une taxinomie unifiée
Auteur(s) :
Mot(s)-clé(s) en anglais :
Metaheuristics
Machine learning
Optimization
Deep neural networks
Hyperparameter optimization
Network architecture search
Machine learning
Optimization
Deep neural networks
Hyperparameter optimization
Network architecture search
Discipline(s) HAL :
Informatique [cs]/Intelligence artificielle [cs.AI]
Résumé en anglais : [en]
During the last years, research in applying optimization approaches in the automatic design of deep neural networks (DNNs) becomes increasingly popular. Although various appproaches have been proposed, there is a lack of ...
Lire la suite >During the last years, research in applying optimization approaches in the automatic design of deep neural networks (DNNs) becomes increasingly popular. Although various appproaches have been proposed, there is a lack of a comprehensive survey and taxonomy on this hot research topic. In this paper, we propose a unified way to describe the various optimization algorithms which focus on common and important search components of optimization algorithms: representation, objective function, constraints, initial solution(s) and variation operators. In addition to large scale search space, the problem is characterized by its variable mixed design space, very expensive and multiple blackbox objective functions. Hence, this unified methodology has been extended to advanced optimization approaches such as surrogate-based, multi-objective and parallel optimization.Lire moins >
Lire la suite >During the last years, research in applying optimization approaches in the automatic design of deep neural networks (DNNs) becomes increasingly popular. Although various appproaches have been proposed, there is a lack of a comprehensive survey and taxonomy on this hot research topic. In this paper, we propose a unified way to describe the various optimization algorithms which focus on common and important search components of optimization algorithms: representation, objective function, constraints, initial solution(s) and variation operators. In addition to large scale search space, the problem is characterized by its variable mixed design space, very expensive and multiple blackbox objective functions. Hence, this unified methodology has been extended to advanced optimization approaches such as surrogate-based, multi-objective and parallel optimization.Lire moins >
Langue :
Anglais
Collections :
Source :
Fichiers
- https://hal.inria.fr/hal-02570804v2/document
- Accès libre
- Accéder au document
- https://hal.inria.fr/hal-02570804v2/document
- Accès libre
- Accéder au document
- https://hal.inria.fr/hal-02570804v2/document
- Accès libre
- Accéder au document
- document
- Accès libre
- Accéder au document
- Opti-ML.pdf
- Accès libre
- Accéder au document