An Evaluation Framework for Data Competitions in TEL

Hendrik Drachsler, Slavi Stoyanov, Mathieu d'Aquin, Eelco Herder, Marieke Guy, Stefan Dietze

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

    Abstract

    This paper presents a study describing the development of an Evaluation Framework (EF) for data competitions in TEL. The study applies the Group Concept Method (GCM) to empirically depict criteria and their indicators for evaluating software applications in TEL. A statistical analysis of multidimensional scaling and hierarchical clustering on the GCM data identified the following six evaluation criteria: 1.Educational Innovation, 2.Usability, 3.Data, 4.Performance, 5.Privacy, and 6.Audience. Each of them was operationalized through a set of indicators. The resulting Evaluation Framework (EF) including these criteria was applied to the first data competition of the LinkedUp project. The EF was consequently improved using the results from reviewers’ interviews, which were analysed qualitatively and quantitatively. The outcome of these efforts is a comprehensive EF that can be used for TEL data competitions and for the evaluation of TEL tools in general.
    Original languageEnglish
    Title of host publicationOpen Learning and Teaching in Educational Communities
    Subtitle of host publication9th European Conference on Technology Enhanced Learning, EC-TEL 2014, Graz, Austria, September 16-19, 2014, Proceedings
    EditorsChristoph Rensing, Sara de Freitas, Tobias Ley, Pedro J. Muñoz-Merino
    Place of PublicationCham
    PublisherSpringer
    Pages70-83
    Number of pages14
    ISBN (Electronic)978-3-319-11200-8
    ISBN (Print)978-3-319-11199-5
    DOIs
    Publication statusPublished - 2014
    Event9th European Conference on Technology Enhanced Learning: Open Learning and Teaching in Educational Communities - Graz, Austria
    Duration: 16 Sep 201419 Sep 2014
    Conference number: 9
    http://ectel2014.httc.de/index.php?id=681

    Publication series

    SeriesLecture Notes in Computer Science (LNCS)
    Volume8719
    ISSN0302-9743

    Conference

    Conference9th European Conference on Technology Enhanced Learning
    Abbreviated titleEC-TEL 2014
    Country/TerritoryAustria
    CityGraz
    Period16/09/1419/09/14
    Internet address

    Keywords

    • data competition
    • Linked Data
    • evaluation framework

    Fingerprint

    Dive into the research topics of 'An Evaluation Framework for Data Competitions in TEL'. Together they form a unique fingerprint.

    Cite this