Combining Data Lake and Data Wrangling for ...
Type de document :
Autre communication scientifique (congrès sans actes - poster - séminaire...): Communication dans un congrès avec actes
URL permanente :
Titre :
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Auteur(s) :
Azeroual, Otmane [Auteur]
Schopfel, Joachim [Auteur]
Groupe d'Études et de Recherche Interdisciplinaire en Information et COmmunication - ULR 4073 [GERIICO ]
Ivanovic, Dragan [Auteur]
University of Novi Sad
Nikiforova, Anastasija [Auteur]
Schopfel, Joachim [Auteur]
Groupe d'Études et de Recherche Interdisciplinaire en Information et COmmunication - ULR 4073 [GERIICO ]
Ivanovic, Dragan [Auteur]
University of Novi Sad
Nikiforova, Anastasija [Auteur]
Titre de la manifestation scientifique :
CRIS2022: 15th International Conference on Current Research Information Systems
Ville :
Dubrovnik
Pays :
Croatie
Date de début de la manifestation scientifique :
2022-05-12
Mot(s)-clé(s) en anglais :
CRIS
research information
research information system
heterogeneous data sources
data quality
data wrangling
data lifecycle
data consolidation
data lake
data cleaning
data warehouse
data lakehouse
research information
research information system
heterogeneous data sources
data quality
data wrangling
data lifecycle
data consolidation
data lake
data cleaning
data warehouse
data lakehouse
Discipline(s) HAL :
Sciences de l'Homme et Société/Sciences de l'information et de la communication
Informatique [cs]/Base de données [cs.DB]
Informatique [cs]/Base de données [cs.DB]
Résumé en anglais : [en]
Consolidation of the research information improves the quality of data integration, reducing duplicates between systems and enabling the required flexibility and scalability when processing various data sources. We assume ...
Lire la suite >Consolidation of the research information improves the quality of data integration, reducing duplicates between systems and enabling the required flexibility and scalability when processing various data sources. We assume that the combination of a data lake as a data repository and a data wrangling process should allow low-quality or "bad" data to be identified and eliminated, leaving only high-quality data, referred to as "research information" in the Research Information System (RIS) domain, allowing for the most accurate insights gained on their basis. This, however, would lead to increased value of both the data themselves and data-driven actions contributing to more accurate and aware decision-making. This cleansed research information is then entered into the appropriate target Current Research Information System (CRIS) so that it can be used for further data processing steps. In order to minimize the effort for the analysis, the proliferation and enrichment of large amounts of data and metadata, as well as to achieve far-reaching added value in information retrieval for CRIS employees, developers and end users, this paper outlines the concept of a curated data lake with the data wrangling process, showing how it can be used in CRIS to clean up data from heterogeneous data sources during their collection and integration.Lire moins >
Lire la suite >Consolidation of the research information improves the quality of data integration, reducing duplicates between systems and enabling the required flexibility and scalability when processing various data sources. We assume that the combination of a data lake as a data repository and a data wrangling process should allow low-quality or "bad" data to be identified and eliminated, leaving only high-quality data, referred to as "research information" in the Research Information System (RIS) domain, allowing for the most accurate insights gained on their basis. This, however, would lead to increased value of both the data themselves and data-driven actions contributing to more accurate and aware decision-making. This cleansed research information is then entered into the appropriate target Current Research Information System (CRIS) so that it can be used for further data processing steps. In order to minimize the effort for the analysis, the proliferation and enrichment of large amounts of data and metadata, as well as to achieve far-reaching added value in information retrieval for CRIS employees, developers and end users, this paper outlines the concept of a curated data lake with the data wrangling process, showing how it can be used in CRIS to clean up data from heterogeneous data sources during their collection and integration.Lire moins >
Langue :
Anglais
Comité de lecture :
Oui
Audience :
Internationale
Vulgarisation :
Non
Collections :
Source :
Date de dépôt :
2022-06-18T05:16:59Z
Fichiers
- https://hal.archives-ouvertes.fr/hal-03694519v1/document
- Accès libre
- Accéder au document