A debugging approach for live Big Data ...
Type de document :
Compte-rendu et recension critique d'ouvrage
Titre :
A debugging approach for live Big Data applications
Auteur(s) :
Marra, Matteo [Auteur]
Software Languages Lab [SLL]
Polito, Guillermo [Auteur]
Analyses and Languages Constructs for Object-Oriented Application Evolution [RMOD]
Gonzalez Boix, Elisa [Auteur]
Software Languages Lab [SLL]
Software Languages Lab [SLL]
Polito, Guillermo [Auteur]
Analyses and Languages Constructs for Object-Oriented Application Evolution [RMOD]
Gonzalez Boix, Elisa [Auteur]
Software Languages Lab [SLL]
Titre de la revue :
Science of Computer Programming
Éditeur :
Elsevier
Date de publication :
2021
ISSN :
0167-6423
Mot(s)-clé(s) en anglais :
Online Debugging
Big Data
Map/Reduce
Live Programming
Big Data
Map/Reduce
Live Programming
Discipline(s) HAL :
Informatique [cs]/Langage de programmation [cs.PL]
Résumé en anglais : [en]
Many frameworks exist for programmers to develop and deploy Big Data applications such as Hadoop Map/Reduce and Apache Spark. However, very little debugging support is currently provided in those frameworks. When an error ...
Lire la suite >Many frameworks exist for programmers to develop and deploy Big Data applications such as Hadoop Map/Reduce and Apache Spark. However, very little debugging support is currently provided in those frameworks. When an error occurs, developers are lost in trying to understand what has happened from the information provided in log files. Recently, new solutions allow developers to record & replay the application execution, but replaying is not always affordable when hours of computation need to be re-executed. In this paper, we present an online approach that allows developers to debug Big Data applications in isolation by moving the debugging session to an external process when a halting point is reached. We introduce IDRA MR , our prototype implementation in Pharo. IDRA MR centralizes the debugging of parallel applications by introducing novel debugging concepts, such as composite debugging events, and the ability to dynamically update both the code of the debugged application and the same configuration of the running framework. We validate our approach by debugging both application and configuration failures for two driving scenarios. The scenarios are implemented and executed using Port, our Map/Reduce framework for Pharo, also introduced in this paper.Lire moins >
Lire la suite >Many frameworks exist for programmers to develop and deploy Big Data applications such as Hadoop Map/Reduce and Apache Spark. However, very little debugging support is currently provided in those frameworks. When an error occurs, developers are lost in trying to understand what has happened from the information provided in log files. Recently, new solutions allow developers to record & replay the application execution, but replaying is not always affordable when hours of computation need to be re-executed. In this paper, we present an online approach that allows developers to debug Big Data applications in isolation by moving the debugging session to an external process when a halting point is reached. We introduce IDRA MR , our prototype implementation in Pharo. IDRA MR centralizes the debugging of parallel applications by introducing novel debugging concepts, such as composite debugging events, and the ability to dynamically update both the code of the debugged application and the same configuration of the running framework. We validate our approach by debugging both application and configuration failures for two driving scenarios. The scenarios are implemented and executed using Port, our Map/Reduce framework for Pharo, also introduced in this paper.Lire moins >
Langue :
Anglais
Vulgarisation :
Non
Collections :
Source :
Fichiers
- https://hal.inria.fr/hal-03358830/document
- Accès libre
- Accéder au document
- https://hal.inria.fr/hal-03358830/document
- Accès libre
- Accéder au document
- https://hal.inria.fr/hal-03358830/document
- Accès libre
- Accéder au document
- document
- Accès libre
- Accéder au document
- Marr20a-SCICO20.pdf
- Accès libre
- Accéder au document