Neural Architecture Tuning: A BO-Powered NAS Tool

Ouertatani, Houssem; Maxim, Cristian; Niar, Smail; Talbi, El-Ghazali

Document type :

Communication dans un congrès avec actes

Title :

Neural Architecture Tuning: A BO-Powered NAS Tool

Author(s) :

Ouertatani, Houssem [Auteur]
IRT SystemX
Inria Lille - Nord Europe
Maxim, Cristian [Auteur]
IRT SystemX
Niar, Smail [Auteur]
Université Polytechnique Hauts-de-France [UPHF]
Laboratoire d'Automatique, de Mécanique et d'Informatique industrielles et Humaines - UMR 8201 [LAMIH]
Talbi, El-Ghazali [Auteur]

Optimisation de grande taille et calcul large échelle [BONUS]
Université de Lille
Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 [CRIStAL]

Conference title :

International Conference in Optimization and Learning (OLA)

City :

Dubrovnik

Country :

Croatie

Start date of the conference :

2024-05-13

English keyword(s) :

Neural Architecture Search
Bayesian Optimization
Custom search space
Multi-fidelity BO

HAL domain(s) :

Informatique [cs]

English abstract : [en]

Neural Architecture Search (NAS) consists of applying anoptimization technique to find the best performing architecture(s) in adefined search space, with regard to an objective function. The practicalimplementation of NAS ...
Show more >Neural Architecture Search (NAS) consists of applying anoptimization technique to find the best performing architecture(s) in adefined search space, with regard to an objective function. The practicalimplementation of NAS currently carries certain limitations, includingprohibitive costs with the need for a large number of evaluations, an inflexibilityin defining the search space by often having to select from alimited set of possible design components, and a difficulty of integratingexisting architecture code by requiring a specialized design languagefor search space specification. We propose a simplified search tool, withefficiency in the number of evaluations needed to achieve good results,and flexibility by design, allowing for an easy and open definition of thesearch space and objective function. Interoperability with existing codeor newly released architectures from the literature allows the user toquickly and easily tune architectures to produce well-performing solutionstailor-made for particular use cases. We practically apply this toolto certain vision search spaces, and showcase its effectiveness.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

Collections :

Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189

Source :

Harvested from HAL

Neural Architecture Tuning: A BO-Powered NAS Tool BibTeX CSV Excel RIS

Neural Architecture Tuning: A BO-Powered NAS Tool

BibTeX

CSV

Excel

RIS