• English
    • français
  • Help
  •  | 
  • Contact
  •  | 
  • About
  •  | 
  • Login
  • HAL portal
  •  | 
  • Pages Pro
  • EN
  •  / 
  • FR
View Item 
  •   LillOA Home
  • Liste des unités
  • Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
  • View Item
  •   LillOA Home
  • Liste des unités
  • Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Geometric Deep Reinforcement Learning for ...
  • BibTeX
  • CSV
  • Excel
  • RIS

Document type :
Communication dans un congrès avec actes
Title :
Geometric Deep Reinforcement Learning for Dynamic DAG Scheduling
Author(s) :
Grinsztajn, Nathan [Auteur]
Scool [Scool]
Beaumont, Olivier [Auteur]
High-End Parallel Algorithms for Challenging Numerical Simulations [HiePACS]
Jeannot, Emmanuel [Auteur]
Topology-Aware System-Scale Data Management for High-Performance Computing [TADAAM]
Preux, Philippe [Auteur]
Scool [Scool]
Conference title :
IEEE SSCI 2020 - Symposium Series on Computational Intelligence
City :
Canberra / Virtual
Country :
Australie
Start date of the conference :
2020-12-01
Journal title :
SSCI 2020 proceedings
Publication date :
2020-12
English keyword(s) :
Reinforcement learning
scheduling
task graph
DAG
high performance computing
combinatorial optimization
HAL domain(s) :
Informatique [cs]/Intelligence artificielle [cs.AI]
English abstract : [en]
In practice, it is quite common to face combinatorial optimization problems which contain uncertainty along with non-determinism and dynamicity. These three properties call for appropriate algorithms; reinforcement learning ...
Show more >
In practice, it is quite common to face combinatorial optimization problems which contain uncertainty along with non-determinism and dynamicity. These three properties call for appropriate algorithms; reinforcement learning (RL) is dealing with them in a very natural way. Today, despite some efforts, most real-life combinatorial optimization problems remain out of the reach of reinforcement learning algorithms. In this paper, we propose a reinforcement learning approach to solve a realistic scheduling problem, and apply it to an algorithm commonly executed in the high performance computing community, the Cholesky factorization. On the contrary to static scheduling, where tasks are assigned to processors in a predetermined ordering before the beginning of the parallel execution, our method is dynamic: task allocations and their execution ordering are decided at runtime, based on the system state and unexpected events, which allows much more flexibility. To do so, our algorithm uses graph neural networks in combination with an actor-critic algorithm (A2C) to build an adaptive representation of the problem on the fly. We show that this approach is competitive with state-of-the-art heuristics used in high-performance computing runtime systems. Moreover, our algorithm does not require an explicit model of the environment, but we demonstrate that extra knowledge can easily be incorporated and improves performance. We also exhibit key properties provided by this RL approach, and study its transfer abilities to other instances.Show less >
Language :
Anglais
Peer reviewed article :
Oui
Audience :
Internationale
Popular science :
Non
Collections :
  • Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Source :
Harvested from HAL
Files
Thumbnail
  • https://hal.inria.fr/hal-03028981/document
  • Open access
  • Access the document
Thumbnail
  • http://arxiv.org/pdf/2011.04333
  • Open access
  • Access the document
Thumbnail
  • https://hal.inria.fr/hal-03028981/document
  • Open access
  • Access the document
Thumbnail
  • https://hal.inria.fr/hal-03028981/document
  • Open access
  • Access the document
Université de Lille

Mentions légales
Université de Lille © 2017