An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game

Fernando Pastor Ricós; Beatriz Marín; I. S.W.B. Prasetya; Tanja E.J. Vos; Joseph Davidson; Karel Hovorka

doi:10.1007/978-3-031-59465-6_24

An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game

Fernando Pastor Ricós^*, Beatriz Marín, I. S.W.B. Prasetya, Tanja E.J. Vos, Joseph Davidson, Karel Hovorka

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

Abstract

Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers’ work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.

Original language	English
Title of host publication	Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings
Editors	João Araújo, Jose Luis de la Vara, Maribel Yasmina Santos, Saïd Assar
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	393-409
Number of pages	17
ISBN (Electronic)	978-3-031-59465-6
ISBN (Print)	9783031594649
DOIs	https://doi.org/10.1007/978-3-031-59465-6_24
Publication status	Published - 2024
Event	18th International Conference on Research Challenges in Information Science, RCIS 2024. Information Science: Evolution or Revolution? - Guimarães, Portugal Duration: 14 May 2024 → 17 May 2024 https://www.rcis-conf.com/rcis2024/

Publication series

Series	Lecture Notes in Business Information Processing
Volume	513
ISSN	1865-1348

Conference

Conference	18th International Conference on Research Challenges in Information Science, RCIS 2024. Information Science: Evolution or Revolution?
Abbreviated title	RCIS 2024
Country/Territory	Portugal
City	Guimarães
Period	14/05/24 → 17/05/24
Internet address	https://www.rcis-conf.com/rcis2024/

Keywords

Autonomous agents
BDD testing
Industrial game testing

Access to Document

10.1007/978-3-031-59465-6_24

Cite this

Pastor Ricós, F., Marín, B., Prasetya, I. S. W. B., Vos, T. E. J., Davidson, J., & Hovorka, K. (2024). An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. In J. Araújo, J. L. de la Vara, M. Y. Santos, & S. Assar (Eds.), Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings (pp. 393-409). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-59465-6_24

Pastor Ricós, Fernando ; Marín, Beatriz ; Prasetya, I. S.W.B. et al. / An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. editor / João Araújo ; Jose Luis de la Vara ; Maribel Yasmina Santos ; Saïd Assar. Springer Science and Business Media Deutschland GmbH, 2024. pp. 393-409 (Lecture Notes in Business Information Processing, Vol. 513).

@inproceedings{32772de34036474c827df8bb6abcc284,

title = "An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game",

abstract = "Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers{\textquoteright} work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.",

keywords = "Autonomous agents, BDD testing, Industrial game testing",

author = "{Pastor Ric{\'o}s}, Fernando and Beatriz Mar{\'i}n and Prasetya, {I. S.W.B.} and Vos, {Tanja E.J.} and Joseph Davidson and Karel Hovorka",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 18th International Conference on Research Challenges in Information Science, RCIS 2024. Information Science: Evolution or Revolution?, RCIS 2024 ; Conference date: 14-05-2024 Through 17-05-2024",

year = "2024",

doi = "10.1007/978-3-031-59465-6_24",

language = "English",

isbn = "9783031594649",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "393--409",

editor = "Jo{\~a}o Ara{\'u}jo and {de la Vara}, {Jose Luis} and Santos, {Maribel Yasmina} and Sa{\"i}d Assar",

booktitle = "Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings",

address = "Germany",

url = "https://www.rcis-conf.com/rcis2024/",

}

Pastor Ricós, F, Marín, B, Prasetya, ISWB, Vos, TEJ, Davidson, J & Hovorka, K 2024, An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. in J Araújo, JL de la Vara, MY Santos & S Assar (eds), Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. Springer Science and Business Media Deutschland GmbH, Lecture Notes in Business Information Processing, vol. 513, pp. 393-409, 18th International Conference on Research Challenges in Information Science, RCIS 2024. Information Science: Evolution or Revolution?, Guimarães, Portugal, 14/05/24. https://doi.org/10.1007/978-3-031-59465-6_24

An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. / Pastor Ricós, Fernando; Marín, Beatriz; Prasetya, I. S.W.B. et al.
Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. ed. / João Araújo; Jose Luis de la Vara; Maribel Yasmina Santos; Saïd Assar. Springer Science and Business Media Deutschland GmbH, 2024. p. 393-409 (Lecture Notes in Business Information Processing, Vol. 513).

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

TY - GEN

T1 - An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game

AU - Pastor Ricós, Fernando

AU - Marín, Beatriz

AU - Prasetya, I. S.W.B.

AU - Vos, Tanja E.J.

AU - Davidson, Joseph

AU - Hovorka, Karel

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

PY - 2024

Y1 - 2024

N2 - Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers’ work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.

AB - Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers’ work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.

KW - Autonomous agents

KW - BDD testing

KW - Industrial game testing

U2 - 10.1007/978-3-031-59465-6_24

DO - 10.1007/978-3-031-59465-6_24

M3 - Conference Article in proceeding

AN - SCOPUS:85193640837

SN - 9783031594649

T3 - Lecture Notes in Business Information Processing

SP - 393

EP - 409

BT - Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings

A2 - Araújo, João

A2 - de la Vara, Jose Luis

A2 - Santos, Maribel Yasmina

A2 - Assar, Saïd

PB - Springer Science and Business Media Deutschland GmbH

T2 - 18th International Conference on Research Challenges in Information Science, RCIS 2024. Information Science: Evolution or Revolution?

Y2 - 14 May 2024 through 17 May 2024

ER -

Pastor Ricós F, Marín B, Prasetya ISWB, Vos TEJ, Davidson J, Hovorka K. An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. In Araújo J, de la Vara JL, Santos MY, Assar S, editors, Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. Springer Science and Business Media Deutschland GmbH. 2024. p. 393-409. (Lecture Notes in Business Information Processing, Vol. 513). doi: 10.1007/978-3-031-59465-6_24