TY - GEN
T1 - Unit testing tool competitions - Lessons learned
AU - Bauersfeld, Sebastian
AU - Vos, Tanja E.J.
AU - Lakhotia, Kiran
PY - 2014
Y1 - 2014
N2 - This paper reports about the two rounds of the Java Unit Testing Tool Competition that ran in the context of the Search Based Software Testing (SBST) workshop at ICST 2013 and the first Future Internet Testing (FITTEST) workshop at ICTSS 2013. It describes the main objectives of the benchmark, the Java classes that were selected in both competitions, the data that was collected, the tools that were used for data collection, the protocol that was carried out to execute the benchmark and how the final benchmark scores for each participating tool were calculated. Eventually, we discuss the challenges encountered during the events, what we learned and how we plan to improve our framework for future competitions.
AB - This paper reports about the two rounds of the Java Unit Testing Tool Competition that ran in the context of the Search Based Software Testing (SBST) workshop at ICST 2013 and the first Future Internet Testing (FITTEST) workshop at ICTSS 2013. It describes the main objectives of the benchmark, the Java classes that were selected in both competitions, the data that was collected, the tools that were used for data collection, the protocol that was carried out to execute the benchmark and how the final benchmark scores for each participating tool were calculated. Eventually, we discuss the challenges encountered during the events, what we learned and how we plan to improve our framework for future competitions.
KW - Automated unit testing
KW - Benchmark
KW - Mutation testing
UR - https://www.scopus.com/pages/publications/84958544666
U2 - 10.1007/978-3-319-07785-7_5
DO - 10.1007/978-3-319-07785-7_5
M3 - Conference Article in proceeding
AN - SCOPUS:84958544666
SN - 9783319077840
VL - 84632
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 75
EP - 94
BT - Future Internet Testing - First International Workshop, FITTEST 2013, Revised Selected Papers
PB - Springer Verlag
T2 - 1st International Workshop on Future Internet Testing, FITTEST 2013
Y2 - 12 November 2013 through 12 November 2013
ER -