Scriptless Testing at the GUI Level in an Industrial Setting

Hatim Chahim; Mehmet Duran; T.E.J. Vos; P.K. Aho; Nelly Condori-Fernández

doi:10.1007/978-3-030-50316-1_16

Scriptless Testing at the GUI Level in an Industrial Setting

Hatim Chahim, Mehmet Duran, T.E.J. Vos, P.K. Aho, Nelly Condori-Fernández

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

Abstract

TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.

Original language	English
Title of host publication	Research Challenges in Information Science
Subtitle of host publication	14th International Conference, RCIS 2020
Editors	Fabiano Dalpiaz, Jelena Zdravkovic, Pericles Loucopoulos
Place of Publication	Cham
Publisher	Springer Nature Switzerland AG
Pages	267-284
Number of pages	18
ISBN (Electronic)	978-3-030-50316-1
ISBN (Print)	978-3-030-50315-4
DOIs	https://doi.org/10.1007/978-3-030-50316-1_16
Publication status	Published - 25 Sept 2020
Event	The 14th International Conference on Research Challenges in Information Science - Online, Limassol, Cyprus Duration: 22 Sept 2020 → 25 Sept 2020 Conference number: 14 http://www.rcis-conf.com/rcis2020/

Publication series

Series	Lecture Notes in Business Information Processing
ISSN	1865-1348

Conference

Conference	The 14th International Conference on Research Challenges in Information Science
Abbreviated title	RCIS 2020
Country/Territory	Cyprus
City	Limassol
Period	22/09/20 → 25/09/20
Internet address	http://www.rcis-conf.com/rcis2020/

Keywords

Compare test approaches
GUI test automation tools
Industrial case study
Railway sector
TESTAR
Technology transfer

Access to Document

10.1007/978-3-030-50316-1_16

Cite this

Chahim, H., Duran, M., Vos, T. E. J., Aho, P. K., & Condori-Fernández, N. (2020). Scriptless Testing at the GUI Level in an Industrial Setting. In F. Dalpiaz, J. Zdravkovic, & P. Loucopoulos (Eds.), Research Challenges in Information Science: 14th International Conference, RCIS 2020 (pp. 267-284). Springer Nature Switzerland AG. https://doi.org/10.1007/978-3-030-50316-1_16

Chahim, Hatim ; Duran, Mehmet ; Vos, T.E.J. et al. / Scriptless Testing at the GUI Level in an Industrial Setting. Research Challenges in Information Science: 14th International Conference, RCIS 2020. editor / Fabiano Dalpiaz ; Jelena Zdravkovic ; Pericles Loucopoulos. Cham : Springer Nature Switzerland AG, 2020. pp. 267-284 (Lecture Notes in Business Information Processing).

@inproceedings{b95ca04317cf43d7a68cc01f2c3e8fa0,

title = "Scriptless Testing at the GUI Level in an Industrial Setting",

abstract = "TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.",

keywords = "Compare test approaches, GUI test automation tools, Industrial case study, Railway sector, TESTAR, Technology transfer",

author = "Hatim Chahim and Mehmet Duran and T.E.J. Vos and P.K. Aho and Nelly Condori-Fern{\'a}ndez",

year = "2020",

month = sep,

day = "25",

doi = "10.1007/978-3-030-50316-1_16",

language = "English",

isbn = "978-3-030-50315-4",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer Nature Switzerland AG",

pages = "267--284",

editor = "Dalpiaz, {Fabiano } and { Zdravkovic}, {Jelena } and { Loucopoulos}, {Pericles }",

booktitle = "Research Challenges in Information Science",

address = "Switzerland",

note = "The 14th International Conference on Research Challenges in Information Science, RCIS 2020 ; Conference date: 22-09-2020 Through 25-09-2020",

url = "http://www.rcis-conf.com/rcis2020/",

}

Chahim, H, Duran, M, Vos, TEJ, Aho, PK & Condori-Fernández, N 2020, Scriptless Testing at the GUI Level in an Industrial Setting. in F Dalpiaz, J Zdravkovic & P Loucopoulos (eds), Research Challenges in Information Science: 14th International Conference, RCIS 2020. Springer Nature Switzerland AG, Cham, Lecture Notes in Business Information Processing, pp. 267-284, The 14th International Conference on Research Challenges in Information Science, Limassol, Cyprus, 22/09/20. https://doi.org/10.1007/978-3-030-50316-1_16

Scriptless Testing at the GUI Level in an Industrial Setting. / Chahim, Hatim; Duran, Mehmet; Vos, T.E.J. et al.
Research Challenges in Information Science: 14th International Conference, RCIS 2020. ed. / Fabiano Dalpiaz; Jelena Zdravkovic; Pericles Loucopoulos. Cham: Springer Nature Switzerland AG, 2020. p. 267-284 (Lecture Notes in Business Information Processing).

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

TY - GEN

T1 - Scriptless Testing at the GUI Level in an Industrial Setting

AU - Chahim, Hatim

AU - Duran, Mehmet

AU - Vos, T.E.J.

AU - Aho, P.K.

AU - Condori-Fernández, Nelly

N1 - Conference code: 14

PY - 2020/9/25

Y1 - 2020/9/25

N2 - TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.

AB - TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.

KW - Compare test approaches

KW - GUI test automation tools

KW - Industrial case study

KW - Railway sector

KW - TESTAR

KW - Technology transfer

U2 - 10.1007/978-3-030-50316-1_16

DO - 10.1007/978-3-030-50316-1_16

M3 - Conference Article in proceeding

SN - 978-3-030-50315-4

T3 - Lecture Notes in Business Information Processing

SP - 267

EP - 284

BT - Research Challenges in Information Science

A2 - Dalpiaz, Fabiano

A2 - Zdravkovic, Jelena

A2 - Loucopoulos, Pericles

PB - Springer Nature Switzerland AG

CY - Cham

T2 - The 14th International Conference on Research Challenges in Information Science

Y2 - 22 September 2020 through 25 September 2020

ER -

Chahim H, Duran M, Vos TEJ, Aho PK, Condori-Fernández N. Scriptless Testing at the GUI Level in an Industrial Setting. In Dalpiaz F, Zdravkovic J, Loucopoulos P, editors, Research Challenges in Information Science: 14th International Conference, RCIS 2020. Cham: Springer Nature Switzerland AG. 2020. p. 267-284. (Lecture Notes in Business Information Processing). doi: 10.1007/978-3-030-50316-1_16

Scriptless Testing at the GUI Level in an Industrial Setting

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this