Performance assessment in serious games: Compensating for the effects of randomness

Wim Westera*

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    Abstract

    This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We found large effects both theoretically and practically. In two existing serious games random guess scores were found to explain up to 41% of total scores. Monte Carlo simulation of random game play confirmed the substantial impact of randomness on performance. For valid performance assessments, be it in-game or post-game, the effects of randomness should be included to produce re-calibrated scores that can reasonably be interpreted as the players´ achievements.
    Original languageEnglish
    Pages (from-to)681-697
    Number of pages17
    JournalEducation and Information Technologies
    Volume21
    Issue number3
    Early online date20 Aug 2014
    DOIs
    Publication statusPublished - May 2016

    Keywords

    • serious gaming
    • performance assessment
    • performance
    • assessment
    • cut score
    • computer-assisted lelarning
    • monte carlo
    • randomness
    • serious
    • gaming

    Fingerprint

    Dive into the research topics of 'Performance assessment in serious games: Compensating for the effects of randomness'. Together they form a unique fingerprint.

    Cite this