Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation

Fernando Pastor Ricos; P.K. Aho; T.E.J. Vos; Ismael  Torres Boigues; Ernesto Calas Blasco; Hector Martınez Martınez

doi:10.1007/978-3-030-61362-4_31

Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation

Fernando Pastor Ricos, P.K. Aho, T.E.J. Vos, Ismael Torres Boigues, Ernesto Calas Blasco, Hector Martınez Martınez

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

Abstract

Companies are facing constant pressure towards shorter release cycles while still maintaining a high level of quality. Agile development, continuous integration and testing are commonly used quality assurance techniques applied in industry. Increasing the level of test automation is a key ingredient to address the short release cycles. Testing at the graphical user interface (GUI) level is challenging to automate, and therefore many companies still do this manually. To help find solutions for better GUI test automation, academics are researching scriptless GUI testing to complement the script-based approach. In order to better match industrial problems with academic results, more academia-industry collaborations for case-based evaluations are needed. This paper describes such an initiative to improve, transfer and integrate an academic scriptless GUI testing tool TESTAR into the CI pipeline of a Spanish company Prodevelop. The paper describes the steps taken, the outcome, the challenges, and some lessons learned for successful industry-academia collaboration.

Original language	English
Title of host publication	Leveraging Applications of Formal Methods, Verification and Validation
Subtitle of host publication	Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Proceedings
Editors	Tiziana Margaria, Bernhard Steffen
Publisher	Springer International Publishing AG
Pages	543-557
Number of pages	15
Volume	12476
Edition	1
ISBN (Electronic)	978-3-030-61362-4
ISBN (Print)	978-3-030-61361-7
DOIs	https://doi.org/10.1007/978-3-030-61362-4_31
Publication status	Published - 30 Nov 2020
Event	9th International Symposium on Leveraging Applications of Formal Methods - Online, Rhodes, Greece Duration: 20 Oct 2020 → 30 Oct 2020

Publication series

Series	Theoretical Computer Science and General Issues (LNCS subseries)
Volume	12476

Symposium

Symposium	9th International Symposium on Leveraging Applications of Formal Methods
Abbreviated title	ISoLA 2020
Country/Territory	Greece
City	Rhodes
Period	20/10/20 → 30/10/20

Keywords

Automated testing
CI
GUI level
TESTAR
Technology transfer

Access to Document

10.1007/978-3-030-61362-4_31

Cite this

Pastor Ricos, F., Aho, P. K., Vos, T. E. J., Torres Boigues, I., Calas Blasco, E., & Martınez Martınez, H. (2020). Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation. In T. Margaria, & B. Steffen (Eds.), Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Proceedings (1 ed., Vol. 12476, pp. 543-557). Springer International Publishing AG. https://doi.org/10.1007/978-3-030-61362-4_31

Pastor Ricos, Fernando ; Aho, P.K. ; Vos, T.E.J. et al. / Deploying TESTAR to enable remote testing in an industrial CI pipeline : a case-based evaluation. Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Proceedings. editor / Tiziana Margaria ; Bernhard Steffen. Vol. 12476 1. ed. Springer International Publishing AG, 2020. pp. 543-557 (Theoretical Computer Science and General Issues (LNCS subseries), Vol. 12476).

@inproceedings{d036eed86adf4f8db2c3a371d3a03149,

title = "Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation",

abstract = "Companies are facing constant pressure towards shorter release cycles while still maintaining a high level of quality. Agile development, continuous integration and testing are commonly used quality assurance techniques applied in industry. Increasing the level of test automation is a key ingredient to address the short release cycles. Testing at the graphical user interface (GUI) level is challenging to automate, and therefore many companies still do this manually. To help find solutions for better GUI test automation, academics are researching scriptless GUI testing to complement the script-based approach. In order to better match industrial problems with academic results, more academia-industry collaborations for case-based evaluations are needed. This paper describes such an initiative to improve, transfer and integrate an academic scriptless GUI testing tool TESTAR into the CI pipeline of a Spanish company Prodevelop. The paper describes the steps taken, the outcome, the challenges, and some lessons learned for successful industry-academia collaboration.",

keywords = "Automated testing, CI, GUI level, TESTAR, Technology transfer",

author = "{Pastor Ricos}, Fernando and P.K. Aho and T.E.J. Vos and {Torres Boigues}, Ismael and {Calas Blasco}, Ernesto and {Martınez Martınez}, Hector",

year = "2020",

month = nov,

day = "30",

doi = "10.1007/978-3-030-61362-4_31",

language = "English",

isbn = "978-3-030-61361-7",

volume = "12476",

series = "Theoretical Computer Science and General Issues (LNCS subseries)",

publisher = "Springer International Publishing AG",

pages = "543--557",

editor = "Tiziana Margaria and Bernhard Steffen",

booktitle = "Leveraging Applications of Formal Methods, Verification and Validation",

address = "Switzerland",

edition = "1",

note = "9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020 ; Conference date: 20-10-2020 Through 30-10-2020",

}

Pastor Ricos, F, Aho, PK, Vos, TEJ, Torres Boigues, I, Calas Blasco, E & Martınez Martınez, H 2020, Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation. in T Margaria & B Steffen (eds), Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Proceedings. 1 edn, vol. 12476, Springer International Publishing AG, Theoretical Computer Science and General Issues (LNCS subseries), vol. 12476, pp. 543-557, 9th International Symposium on Leveraging Applications of Formal Methods, Rhodes, Greece, 20/10/20. https://doi.org/10.1007/978-3-030-61362-4_31

Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation. / Pastor Ricos, Fernando; Aho, P.K.; Vos, T.E.J. et al.
Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Proceedings. ed. / Tiziana Margaria; Bernhard Steffen. Vol. 12476 1. ed. Springer International Publishing AG, 2020. p. 543-557 (Theoretical Computer Science and General Issues (LNCS subseries), Vol. 12476).

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

TY - GEN

T1 - Deploying TESTAR to enable remote testing in an industrial CI pipeline

T2 - 9th International Symposium on Leveraging Applications of Formal Methods

AU - Pastor Ricos, Fernando

AU - Aho, P.K.

AU - Vos, T.E.J.

AU - Torres Boigues, Ismael

AU - Calas Blasco, Ernesto

AU - Martınez Martınez, Hector

PY - 2020/11/30

Y1 - 2020/11/30

N2 - Companies are facing constant pressure towards shorter release cycles while still maintaining a high level of quality. Agile development, continuous integration and testing are commonly used quality assurance techniques applied in industry. Increasing the level of test automation is a key ingredient to address the short release cycles. Testing at the graphical user interface (GUI) level is challenging to automate, and therefore many companies still do this manually. To help find solutions for better GUI test automation, academics are researching scriptless GUI testing to complement the script-based approach. In order to better match industrial problems with academic results, more academia-industry collaborations for case-based evaluations are needed. This paper describes such an initiative to improve, transfer and integrate an academic scriptless GUI testing tool TESTAR into the CI pipeline of a Spanish company Prodevelop. The paper describes the steps taken, the outcome, the challenges, and some lessons learned for successful industry-academia collaboration.

AB - Companies are facing constant pressure towards shorter release cycles while still maintaining a high level of quality. Agile development, continuous integration and testing are commonly used quality assurance techniques applied in industry. Increasing the level of test automation is a key ingredient to address the short release cycles. Testing at the graphical user interface (GUI) level is challenging to automate, and therefore many companies still do this manually. To help find solutions for better GUI test automation, academics are researching scriptless GUI testing to complement the script-based approach. In order to better match industrial problems with academic results, more academia-industry collaborations for case-based evaluations are needed. This paper describes such an initiative to improve, transfer and integrate an academic scriptless GUI testing tool TESTAR into the CI pipeline of a Spanish company Prodevelop. The paper describes the steps taken, the outcome, the challenges, and some lessons learned for successful industry-academia collaboration.

KW - Automated testing

KW - CI

KW - GUI level

KW - TESTAR

KW - Technology transfer

U2 - 10.1007/978-3-030-61362-4_31

DO - 10.1007/978-3-030-61362-4_31

M3 - Conference Article in proceeding

SN - 978-3-030-61361-7

VL - 12476

T3 - Theoretical Computer Science and General Issues (LNCS subseries)

SP - 543

EP - 557

BT - Leveraging Applications of Formal Methods, Verification and Validation

A2 - Margaria, Tiziana

A2 - Steffen, Bernhard

PB - Springer International Publishing AG

Y2 - 20 October 2020 through 30 October 2020

ER -

Pastor Ricos F, Aho PK, Vos TEJ, Torres Boigues I, Calas Blasco E, Martınez Martınez H. Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation. In Margaria T, Steffen B, editors, Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Proceedings. 1 ed. Vol. 12476. Springer International Publishing AG. 2020. p. 543-557. (Theoretical Computer Science and General Issues (LNCS subseries), Vol. 12476). doi: 10.1007/978-3-030-61362-4_31

Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation

Abstract

Publication series

Symposium

Keywords

Access to Document

Fingerprint

Cite this