An Evaluation Framework for Data Competitions in TEL

Hendrik Drachsler, Slavi Stoyanov, Mathieu d'Aquin, Eelco Herder, Marieke Guy, Stefan Dietze

    Research output: Chapter in Book/Report/Conference proceedingConference Article in proceedingAcademicpeer-review


    This paper presents a study describing the development of an Evaluation Framework (EF) for data competitions in TEL. The study applies the Group Concept Method (GCM) to empirically depict criteria and their indicators for evaluating software applications in TEL. A statistical analysis of multidimensional scaling and hierarchical clustering on the GCM data identified the following six evaluation criteria: 1.Educational Innovation, 2.Usability, 3.Data, 4.Performance, 5.Privacy, and 6.Audience. Each of them was operationalized through a set of indicators. The resulting Evaluation Framework (EF) including these criteria was applied to the first data competition of the LinkedUp project. The EF was consequently improved using the results from reviewers’ interviews, which were analysed qualitatively and quantitatively. The outcome of these efforts is a comprehensive EF that can be used for TEL data competitions and for the evaluation of TEL tools in general.
    Original languageEnglish
    Title of host publicationOpen Learning and Teaching in Educational Communities
    Subtitle of host publication9th European Conference on Technology Enhanced Learning, EC-TEL 2014, Graz, Austria, September 16-19, 2014, Proceedings
    EditorsChristoph Rensing, Sara de Freitas, Tobias Ley, Pedro J. Muñoz-Merino
    Place of PublicationCham
    Number of pages14
    ISBN (Electronic)978-3-319-11200-8
    ISBN (Print)978-3-319-11199-5
    Publication statusPublished - 2014
    Event9th European Conference on Technology Enhanced Learning: Open Learning and Teaching in Educational Communities - Graz, Austria
    Duration: 16 Sept 201419 Sept 2014
    Conference number: 9

    Publication series

    SeriesLecture Notes in Computer Science (LNCS)


    Conference9th European Conference on Technology Enhanced Learning
    Abbreviated titleEC-TEL 2014
    Internet address


    • data competition
    • Linked Data
    • evaluation framework


    Dive into the research topics of 'An Evaluation Framework for Data Competitions in TEL'. Together they form a unique fingerprint.

    Cite this