An agent-based approach to automated game testing: an experience report

I. S. W. B. Prasetya; Fernando Pastor Ricós; Fitsum Meshesha Kifetew; Davide Prandi; Samira Shirzadehhajimahmood; Tanja E. J. Vos; Premysl Paska; Karel Hovorka; Raihana Ferdous; Angelo Susi; Joseph Davidson

doi:10.1145/3548659.3561305

An agent-based approach to automated game testing: an experience report

I. S. W. B. Prasetya, Fernando Pastor Ricós, Fitsum Meshesha Kifetew, Davide Prandi, Samira Shirzadehhajimahmood, Tanja E. J. Vos, Premysl Paska, Karel Hovorka, Raihana Ferdous, Angelo Susi, Joseph Davidson

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

Abstract

Computer games are very challenging to handle for traditional automated testing algorithms. In this paper we will look at intelligent agents as a solution. Agents are suitable for testing games, since they are reactive and able to reason about their environment to decide the action they want to take. This paper presents the experience of using an agent-based automated testing framework called iv4xr to test computer games. Three games will be discussed, including a sophisticated 3D game called Space Engineers. We will show how the framework can be used in different ways, either directly to drive a test agent, or as an intelligent functionality that can be driven by a traditional automated testing algorithm such as a random algorithm or a model based testing algorithm.

Original language	English
Title of host publication	A-TEST 2022
Subtitle of host publication	Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation
Editors	Akos Kiss, Beatriz Marin, Mehrdad Saadatmand
Publisher	ACM Digital Library
Pages	1-8
Number of pages	8
ISBN (Print)	9781450394529
DOIs	https://doi.org/10.1145/3548659.3561305
Publication status	Published - 9 Nov 2022
Event	13th International Workshop on Automating Test Case Design, Selection and Evaluation - Singapore, Singapore Duration: 17 Nov 2022 → 18 Nov 2022 Conference number: 13 https://dl.acm.org/doi/proceedings/10.1145/3548659

Workshop

Workshop	13th International Workshop on Automating Test Case Design, Selection and Evaluation
Abbreviated title	A-TEST '22
Country/Territory	Singapore
City	Singapore
Period	17/11/22 → 18/11/22
Internet address	https://dl.acm.org/doi/proceedings/10.1145/3548659

Keywords

3D game testing
agent-based testing
automated game testing
model-based game testing

Access to Document

10.1145/3548659.3561305

Cite this

Prasetya, I. S. W. B., Ricós, F. P., Kifetew, F. M., Prandi, D., Shirzadehhajimahmood, S., Vos, T. E. J., Paska, P., Hovorka, K., Ferdous, R., Susi, A., & Davidson, J. (2022). An agent-based approach to automated game testing: an experience report. In Akos Kiss, Beatriz Marin, & Mehrdad Saadatmand (Eds.), A-TEST 2022: Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation (pp. 1-8). ACM Digital Library. https://doi.org/10.1145/3548659.3561305

@inproceedings{14a9e6460b844325b2daa17b2116e096,

title = "An agent-based approach to automated game testing: an experience report",

abstract = "Computer games are very challenging to handle for traditional automated testing algorithms. In this paper we will look at intelligent agents as a solution. Agents are suitable for testing games, since they are reactive and able to reason about their environment to decide the action they want to take. This paper presents the experience of using an agent-based automated testing framework called iv4xr to test computer games. Three games will be discussed, including a sophisticated 3D game called Space Engineers. We will show how the framework can be used in different ways, either directly to drive a test agent, or as an intelligent functionality that can be driven by a traditional automated testing algorithm such as a random algorithm or a model based testing algorithm.",

keywords = "3D game testing, agent-based testing, automated game testing, model-based game testing",

author = "Prasetya, {I. S. W. B.} and Ric{\'o}s, {Fernando Pastor} and Kifetew, {Fitsum Meshesha} and Davide Prandi and Samira Shirzadehhajimahmood and Vos, {Tanja E. J.} and Premysl Paska and Karel Hovorka and Raihana Ferdous and Angelo Susi and Joseph Davidson",

note = "DBLP's bibliographic metadata records provided through http://dblp.org/search/publ/api are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.; 13th International Workshop on Automating Test Case Design, Selection and Evaluation, A-TEST '22 ; Conference date: 17-11-2022 Through 18-11-2022",

year = "2022",

month = nov,

day = "9",

doi = "10.1145/3548659.3561305",

language = "English",

isbn = "9781450394529",

pages = "1--8",

editor = "{Akos Kiss} and {Beatriz Marin} and {Mehrdad Saadatmand}",

booktitle = "A-TEST 2022",

publisher = "ACM Digital Library",

url = "https://dl.acm.org/doi/proceedings/10.1145/3548659",

}

Prasetya, ISWB, Ricós, FP, Kifetew, FM, Prandi, D, Shirzadehhajimahmood, S, Vos, TEJ, Paska, P, Hovorka, K, Ferdous, R, Susi, A & Davidson, J 2022, An agent-based approach to automated game testing: an experience report. in Akos Kiss, Beatriz Marin & Mehrdad Saadatmand (eds), A-TEST 2022: Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation. ACM Digital Library, pp. 1-8, 13th International Workshop on Automating Test Case Design, Selection and Evaluation, Singapore, Singapore, 17/11/22. https://doi.org/10.1145/3548659.3561305

An agent-based approach to automated game testing: an experience report. / Prasetya, I. S. W. B.; Ricós, Fernando Pastor; Kifetew, Fitsum Meshesha et al.
A-TEST 2022: Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation. ed. / Akos Kiss; Beatriz Marin; Mehrdad Saadatmand. ACM Digital Library, 2022. p. 1-8.

Research output: Chapter in Book/Report/Conference proceeding › Conference Article in proceeding › Academic › peer-review

TY - GEN

T1 - An agent-based approach to automated game testing

T2 - 13th International Workshop on Automating Test Case Design, Selection and Evaluation

AU - Prasetya, I. S. W. B.

AU - Ricós, Fernando Pastor

AU - Kifetew, Fitsum Meshesha

AU - Prandi, Davide

AU - Shirzadehhajimahmood, Samira

AU - Vos, Tanja E. J.

AU - Paska, Premysl

AU - Hovorka, Karel

AU - Ferdous, Raihana

AU - Susi, Angelo

AU - Davidson, Joseph

N1 - Conference code: 13

PY - 2022/11/9

Y1 - 2022/11/9

N2 - Computer games are very challenging to handle for traditional automated testing algorithms. In this paper we will look at intelligent agents as a solution. Agents are suitable for testing games, since they are reactive and able to reason about their environment to decide the action they want to take. This paper presents the experience of using an agent-based automated testing framework called iv4xr to test computer games. Three games will be discussed, including a sophisticated 3D game called Space Engineers. We will show how the framework can be used in different ways, either directly to drive a test agent, or as an intelligent functionality that can be driven by a traditional automated testing algorithm such as a random algorithm or a model based testing algorithm.

AB - Computer games are very challenging to handle for traditional automated testing algorithms. In this paper we will look at intelligent agents as a solution. Agents are suitable for testing games, since they are reactive and able to reason about their environment to decide the action they want to take. This paper presents the experience of using an agent-based automated testing framework called iv4xr to test computer games. Three games will be discussed, including a sophisticated 3D game called Space Engineers. We will show how the framework can be used in different ways, either directly to drive a test agent, or as an intelligent functionality that can be driven by a traditional automated testing algorithm such as a random algorithm or a model based testing algorithm.

KW - 3D game testing

KW - agent-based testing

KW - automated game testing

KW - model-based game testing

U2 - 10.1145/3548659.3561305

DO - 10.1145/3548659.3561305

M3 - Conference Article in proceeding

SN - 9781450394529

SP - 1

EP - 8

BT - A-TEST 2022

A2 - Akos Kiss,

A2 - Beatriz Marin,

A2 - Mehrdad Saadatmand,

PB - ACM Digital Library

Y2 - 17 November 2022 through 18 November 2022

ER -

Prasetya ISWB, Ricós FP, Kifetew FM, Prandi D, Shirzadehhajimahmood S, Vos TEJ et al. An agent-based approach to automated game testing: an experience report. In Akos Kiss, Beatriz Marin, Mehrdad Saadatmand, editors, A-TEST 2022: Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation. ACM Digital Library. 2022. p. 1-8 doi: 10.1145/3548659.3561305

An agent-based approach to automated game testing: an experience report

Abstract

Workshop

Keywords

Access to Document

Fingerprint

Cite this