Facilitating evaluation support for serious games

Alexander Nussbaumer, Christina Steiner, Matthias Maurer, Dietrich Albert

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

Abstract

This paper describes the evaluation asset, which is a tool that supports the evaluation of applied games. The overall goal is to provide a modular approach to game evaluation that can easily be applied and integrated by game developers in their game projects. The idea of this asset is to utilise game-based user data and translate it into meaningful information about the quality of a game. This asset has added value for various stakeholders – developers, who get an instrument to easily evaluate their software, training providers, who get information about the pedagogical value of games, and the players, who are enabled to provide quick feedback without distraction. Relevant related work from the field of learning and game analytics is summarised. The technical implementation of the asset consists in a client-side and a server-side component for collecting and pre-processing interaction data from games. This data is then analysed in terms of meaningful evaluation variables on which automatic reports and visualisations can be retrieved. The evaluation asset comes with configurable evaluation metrics for translating the data into meaningful information about aspects on usability and game experience. In addition, the evaluation asset may be linked to other assets, to make use of their data for additional information on the quality of a game. The technical implementation of the asset is described, as well as its integration and application in the context of a game. The evaluation asset, as an evaluation instrument complementing more traditional techniques (e.g. questionnaires), will be incorporated in the applied games developed in RAGE and applied in the context of the pilot studies.
Original languageEnglish
Title of host publicationINTED2017 Proceedings
Subtitle of host publication11th International Technology, Education and Development Conference March 6th-8th, 2017 — Valencia, Spain
EditorsL. Gómez Chova, A. López Martínez, I. Candel Torres
PublisherIATED Academy
Pages5887-5896
ISBN (Print)978-84-617-8491-2
DOIs
Publication statusPublished - 2017
Externally publishedYes
Event11th International Technology, Education and Development Conference: INTED2017 - Valencia, Spain
Duration: 6 Mar 20178 Mar 2017
https://iated.org/archive/inted2017

Publication series

Name
ISSN (Print)2340-1079

Conference

Conference11th International Technology, Education and Development Conference: INTED2017
Abbreviated titleINTED2017
CountrySpain
CityValencia
Period6/03/178/03/17
Internet address

Fingerprint

Servers
Visualization
Feedback
Processing
Serious games

Keywords

  • serious games
  • applied games
  • non-invasive evaluation
  • evaluation support

Cite this

Nussbaumer, A., Steiner, C., Maurer, M., & Albert, D. (2017). Facilitating evaluation support for serious games. In L. Gómez Chova, A. López Martínez, & I. Candel Torres (Eds.), INTED2017 Proceedings: 11th International Technology, Education and Development Conference March 6th-8th, 2017 — Valencia, Spain (pp. 5887-5896). IATED Academy. https://doi.org/10.21125/inted.2017.1375
Nussbaumer, Alexander ; Steiner, Christina ; Maurer, Matthias ; Albert, Dietrich. / Facilitating evaluation support for serious games. INTED2017 Proceedings: 11th International Technology, Education and Development Conference March 6th-8th, 2017 — Valencia, Spain. editor / L. Gómez Chova ; A. López Martínez ; I. Candel Torres. IATED Academy, 2017. pp. 5887-5896
@inproceedings{d905af6bdc114485a814c8756017be61,
title = "Facilitating evaluation support for serious games",
abstract = "This paper describes the evaluation asset, which is a tool that supports the evaluation of applied games. The overall goal is to provide a modular approach to game evaluation that can easily be applied and integrated by game developers in their game projects. The idea of this asset is to utilise game-based user data and translate it into meaningful information about the quality of a game. This asset has added value for various stakeholders – developers, who get an instrument to easily evaluate their software, training providers, who get information about the pedagogical value of games, and the players, who are enabled to provide quick feedback without distraction. Relevant related work from the field of learning and game analytics is summarised. The technical implementation of the asset consists in a client-side and a server-side component for collecting and pre-processing interaction data from games. This data is then analysed in terms of meaningful evaluation variables on which automatic reports and visualisations can be retrieved. The evaluation asset comes with configurable evaluation metrics for translating the data into meaningful information about aspects on usability and game experience. In addition, the evaluation asset may be linked to other assets, to make use of their data for additional information on the quality of a game. The technical implementation of the asset is described, as well as its integration and application in the context of a game. The evaluation asset, as an evaluation instrument complementing more traditional techniques (e.g. questionnaires), will be incorporated in the applied games developed in RAGE and applied in the context of the pilot studies.",
keywords = "serious games, applied games, non-invasive evaluation, evaluation support",
author = "Alexander Nussbaumer and Christina Steiner and Matthias Maurer and Dietrich Albert",
year = "2017",
doi = "10.21125/inted.2017.1375",
language = "English",
isbn = "978-84-617-8491-2",
publisher = "IATED Academy",
pages = "5887--5896",
editor = "{G{\'o}mez Chova}, L. and {L{\'o}pez Mart{\'i}nez}, A. and {Candel Torres}, I.",
booktitle = "INTED2017 Proceedings",

}

Nussbaumer, A, Steiner, C, Maurer, M & Albert, D 2017, Facilitating evaluation support for serious games. in L Gómez Chova, A López Martínez & I Candel Torres (eds), INTED2017 Proceedings: 11th International Technology, Education and Development Conference March 6th-8th, 2017 — Valencia, Spain. IATED Academy, pp. 5887-5896, 11th International Technology, Education and Development Conference: INTED2017, Valencia, Spain, 6/03/17. https://doi.org/10.21125/inted.2017.1375

Facilitating evaluation support for serious games. / Nussbaumer, Alexander; Steiner, Christina; Maurer, Matthias; Albert, Dietrich.

INTED2017 Proceedings: 11th International Technology, Education and Development Conference March 6th-8th, 2017 — Valencia, Spain. ed. / L. Gómez Chova; A. López Martínez; I. Candel Torres. IATED Academy, 2017. p. 5887-5896.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

TY - GEN

T1 - Facilitating evaluation support for serious games

AU - Nussbaumer, Alexander

AU - Steiner, Christina

AU - Maurer, Matthias

AU - Albert, Dietrich

PY - 2017

Y1 - 2017

N2 - This paper describes the evaluation asset, which is a tool that supports the evaluation of applied games. The overall goal is to provide a modular approach to game evaluation that can easily be applied and integrated by game developers in their game projects. The idea of this asset is to utilise game-based user data and translate it into meaningful information about the quality of a game. This asset has added value for various stakeholders – developers, who get an instrument to easily evaluate their software, training providers, who get information about the pedagogical value of games, and the players, who are enabled to provide quick feedback without distraction. Relevant related work from the field of learning and game analytics is summarised. The technical implementation of the asset consists in a client-side and a server-side component for collecting and pre-processing interaction data from games. This data is then analysed in terms of meaningful evaluation variables on which automatic reports and visualisations can be retrieved. The evaluation asset comes with configurable evaluation metrics for translating the data into meaningful information about aspects on usability and game experience. In addition, the evaluation asset may be linked to other assets, to make use of their data for additional information on the quality of a game. The technical implementation of the asset is described, as well as its integration and application in the context of a game. The evaluation asset, as an evaluation instrument complementing more traditional techniques (e.g. questionnaires), will be incorporated in the applied games developed in RAGE and applied in the context of the pilot studies.

AB - This paper describes the evaluation asset, which is a tool that supports the evaluation of applied games. The overall goal is to provide a modular approach to game evaluation that can easily be applied and integrated by game developers in their game projects. The idea of this asset is to utilise game-based user data and translate it into meaningful information about the quality of a game. This asset has added value for various stakeholders – developers, who get an instrument to easily evaluate their software, training providers, who get information about the pedagogical value of games, and the players, who are enabled to provide quick feedback without distraction. Relevant related work from the field of learning and game analytics is summarised. The technical implementation of the asset consists in a client-side and a server-side component for collecting and pre-processing interaction data from games. This data is then analysed in terms of meaningful evaluation variables on which automatic reports and visualisations can be retrieved. The evaluation asset comes with configurable evaluation metrics for translating the data into meaningful information about aspects on usability and game experience. In addition, the evaluation asset may be linked to other assets, to make use of their data for additional information on the quality of a game. The technical implementation of the asset is described, as well as its integration and application in the context of a game. The evaluation asset, as an evaluation instrument complementing more traditional techniques (e.g. questionnaires), will be incorporated in the applied games developed in RAGE and applied in the context of the pilot studies.

KW - serious games

KW - applied games

KW - non-invasive evaluation

KW - evaluation support

U2 - 10.21125/inted.2017.1375

DO - 10.21125/inted.2017.1375

M3 - Conference article in proceeding

SN - 978-84-617-8491-2

SP - 5887

EP - 5896

BT - INTED2017 Proceedings

A2 - Gómez Chova, L.

A2 - López Martínez, A.

A2 - Candel Torres, I.

PB - IATED Academy

ER -

Nussbaumer A, Steiner C, Maurer M, Albert D. Facilitating evaluation support for serious games. In Gómez Chova L, López Martínez A, Candel Torres I, editors, INTED2017 Proceedings: 11th International Technology, Education and Development Conference March 6th-8th, 2017 — Valencia, Spain. IATED Academy. 2017. p. 5887-5896 https://doi.org/10.21125/inted.2017.1375