Feedback Design in Multimodal Dialogue Systems

Peter Van Rosmalen, Dirk Börner, Jan Schneider, Volha Petukhova, Joy van Helvert

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

    Abstract

    This paper discusses the design and development of the instructional aspects of a multimodal dialogue system to train youth parliament members’ presentation and debating skills. Real-time, in-action feedback informs learners on the fly how they perform key skills and enables them to adapt instantly. About-action feedback informs learners after finishing a task how they perform key skills and enables them to monitor their progress and adapt accordingly in subsequent tasks. In- and about-action feedback together support the enhancement of the learners’ metacognitive skills, such as self-monitoring, self-regulation and self-reflection thus reflect in- and about action. We discusses the theoretical considerations of the feedback, the type of data available and different ways to analyse and combine them, the timing of feedback and, finally, provide an instructional design blueprint giving a global outline of a set of tasks with stepwise increasing complexity and the feedback proposed. We conclude with the results of the first experiment with the system focussing on non-verbal communication skills.
    Original languageEnglish
    Title of host publicationCSEDU 2015 Proceedings of the 7th International Computer Supported Education
    EditorsMarkus Helfert, Maria Teresa Restivo, Susan Zvacek, James Uhomoibhi
    Place of PublicationPortugal
    PublisherSCITEPRESS-Science and Technology Publications, Lda.
    Pages209-217
    Number of pages9
    Volume2
    ISBN (Print)978-989-758-108-3
    DOIs
    Publication statusPublished - 2015
    Event7th International Conference on Computer Supported Education - Lisbon, Portugal
    Duration: 23 May 201525 May 2015
    http://www.csedu.org/?y=2015

    Conference

    Conference7th International Conference on Computer Supported Education
    Abbreviated titleCSEDU 2015
    Country/TerritoryPortugal
    CityLisbon
    Period23/05/1525/05/15
    Internet address

    Keywords

    • Feedback
    • Sensors
    • Instructional Design
    • Multimodal Dialogue
    • Reflection Support

    Fingerprint

    Dive into the research topics of 'Feedback Design in Multimodal Dialogue Systems'. Together they form a unique fingerprint.

    Cite this