Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset

Martinez, Matias; Durieux, Thomas; Sommerard, Romain; Xuan, Jifeng; Monperrus, Martin

Document type :

Article dans une revue scientifique: Article original

DOI :

10.1007/s10664-016-9470-4

Title :

Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset

Author(s) :

Martinez, Matias [Auteur]
Université de Lille, Sciences et Technologies
Laboratoire d'Automatique, de Mécanique et d'Informatique industrielles et Humaines - UMR 8201 [LAMIH]
Durieux, Thomas [Auteur]
Self-adaptation for distributed services and large software systems [SPIRALS]
Sommerard, Romain [Auteur]
Université de Lille, Sciences et Technologies
Xuan, Jifeng [Auteur]
Wuhan University [China]
Monperrus, Martin [Auteur]
Université de Lille, Sciences et Technologies

Journal title :

Empirical Software Engineering

Pages :

1936-1964

Publisher :

Springer Verlag

Publication date :

2017

ISSN :

1382-3256

HAL domain(s) :

Informatique [cs]/Génie logiciel [cs.SE]

English abstract : [en]

Defects4J is a large, peer-reviewed, structured dataset of real-world Java bugs. Each bug in Defects4J comes with a test suite and at least one failing test case that triggers the bug. In this paper, we report on an ...
Show more >Defects4J is a large, peer-reviewed, structured dataset of real-world Java bugs. Each bug in Defects4J comes with a test suite and at least one failing test case that triggers the bug. In this paper, we report on an experiment to explore the effectiveness of automatic test-suite based repair on Defects4J. The result of our experiment shows that the considered state-of-the-art repair methods can generate patches for 47 out of 224 bugs. However, those patches are only test-suite adequate, which means that they pass the test suite and may potentially be incorrect beyond the test-suite satisfaction correctness criterion. We have manually analyzed 84 different patches to assess their real correctness. In total, 9 real Java bugs can be correctly repaired with test-suite based repair. This analysis shows that test-suite based repair suffers from under-specified bugs, for which trivial or incorrect patches still pass the test suite. With respect to practical applicability, it takes on average 14.8 minutes to find a patch. The experiment was done on a scientific grid, totaling 17.6 days of computation time. All the repair systems and experimental results are publicly available on Github in order to facilitate future research on automatic repair.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

Collections :

Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189

Source :

Harvested from HAL

Files

https://hal.archives-ouvertes.fr/hal-01387556/document
Open access
Access the document

https://hal.archives-ouvertes.fr/hal-01387556/file/framework.pdf
Open access
Access the document

https://hal.archives-ouvertes.fr/hal-01387556/file/intersection.pdf
Open access
Access the document

https://hal.archives-ouvertes.fr/hal-01387556/file/patch_correctness.pdf
Open access
Access the document

http://arxiv.org/pdf/1811.02429
Open access
Access the document

https://hal.archives-ouvertes.fr/hal-01387556/document
Open access
Access the document

https://hal.archives-ouvertes.fr/hal-01387556/document
Open access
Access the document

document
Open access
Access the document

automatic-repair-defects4j.pdf
Open access
Access the document

framework.pdf
Open access
Access the document

intersection.pdf
Open access
Access the document

patch_correctness.pdf
Open access
Access the document

1811.02429
Open access
Access the document

document
Open access
Access the document

automatic-repair-defects4j.pdf
Open access
Access the document

framework.pdf
Open access
Access the document

intersection.pdf
Open access
Access the document

patch_correctness.pdf
Open access
Access the document

Automatic Repair of Real Bugs in Java: A ... BibTeX CSV Excel RIS

Files

Automatic Repair of Real Bugs in Java: A ...

BibTeX

CSV

Excel

RIS