Opportunities and challenges in using Learning Analytics in Learning Design

Marcel Schmitz, Evelien Van Limbeek, Wolfgang Greller, Peter Sloep, Hendrik Drachsler

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

42 Downloads (Pure)

Abstract

Educational institutions are designing, creating and evaluating courses to optimize learning outcomes for highly diverse student populations. Yet, most of the delivery is still monitored retrospectively with summative evaluation forms. Therefore, improvements to the course design are only implemented at the very end of a course, thus missing to benefit the current cohort. Teachers find it difficult to interpret and plan interventions just-in-time. In this context, Learning Analytics (LA) data streams gathered from ‘authentic’ student learning activities, may provide new opportunities to receive valuable information on the students' learning behaviors and could be utilised to adjust the learning design already "on the fly" during runtime. We presume that Learning Analytics applied within Learning Design (LD) and presented in a learning dashboard provide opportunities that can lead to more personalized learning experiences, if implemented thoughtfully. In this paper, we describe opportunities and challenges for using LA in LD. We identify three key opportunities for using LA in LD: (O1) using on demand indicators for evidence based decisions on learning design; (O2) intervening during the run-time of a course; and, (O3) increasing student learning outcomes and satisfaction. In order to benefit from these opportunities, several challenges have to be overcome. We mapped the identified opportunities and challenges in a conceptual model that considers the interaction of LA in LD.
Original languageEnglish
Title of host publicationData Driven Approaches in Digital Education.
Subtitle of host publication12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings
EditorsÉ. Lavoué, H. Drachsler, K. Verbert, J. Broisin, M. Pérez-Sanagustín
PublisherSpringer
Pages209-223
ISBN (Electronic)978-3-319-66610-5
ISBN (Print)978-3-319-66609-9
DOIs
Publication statusPublished - 1 Sep 2017
EventData Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning: EC-TEL - Tallinn, Estonia
Duration: 12 Sep 201715 Sep 2017
http://ectel2017.httc.de/index.php?id=777

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume10474
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceData Driven Approaches in Digital Education
CountryEstonia
CityTallinn
Period12/09/1715/09/17
Internet address

Fingerprint

Students

Keywords

  • Learning Analytics
  • Learning Design
  • Learning Dashboards
  • meta-cognitive competences
  • feedback
  • reflection
  • run-time
  • Learning Activity

Cite this

Schmitz, M., Van Limbeek, E., Greller, W., Sloep, P., & Drachsler, H. (2017). Opportunities and challenges in using Learning Analytics in Learning Design. In É. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Data Driven Approaches in Digital Education. : 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings (pp. 209-223). (Lecture Notes in Computer Science; Vol. 10474). Springer. https://doi.org/10.1007/978-3-319-66610-5_16
Schmitz, Marcel ; Van Limbeek, Evelien ; Greller, Wolfgang ; Sloep, Peter ; Drachsler, Hendrik. / Opportunities and challenges in using Learning Analytics in Learning Design. Data Driven Approaches in Digital Education. : 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. editor / É. Lavoué ; H. Drachsler ; K. Verbert ; J. Broisin ; M. Pérez-Sanagustín. Springer, 2017. pp. 209-223 (Lecture Notes in Computer Science).
@inproceedings{14273c087ee84e79b24efaa4740bc26f,
title = "Opportunities and challenges in using Learning Analytics in Learning Design",
abstract = "Educational institutions are designing, creating and evaluating courses to optimize learning outcomes for highly diverse student populations. Yet, most of the delivery is still monitored retrospectively with summative evaluation forms. Therefore, improvements to the course design are only implemented at the very end of a course, thus missing to benefit the current cohort. Teachers find it difficult to interpret and plan interventions just-in-time. In this context, Learning Analytics (LA) data streams gathered from ‘authentic’ student learning activities, may provide new opportunities to receive valuable information on the students' learning behaviors and could be utilised to adjust the learning design already {"}on the fly{"} during runtime. We presume that Learning Analytics applied within Learning Design (LD) and presented in a learning dashboard provide opportunities that can lead to more personalized learning experiences, if implemented thoughtfully. In this paper, we describe opportunities and challenges for using LA in LD. We identify three key opportunities for using LA in LD: (O1) using on demand indicators for evidence based decisions on learning design; (O2) intervening during the run-time of a course; and, (O3) increasing student learning outcomes and satisfaction. In order to benefit from these opportunities, several challenges have to be overcome. We mapped the identified opportunities and challenges in a conceptual model that considers the interaction of LA in LD.",
keywords = "Learning Analytics, Learning Design, Learning Dashboards, meta-cognitive competences, feedback, reflection, run-time, Learning Activity",
author = "Marcel Schmitz and {Van Limbeek}, Evelien and Wolfgang Greller and Peter Sloep and Hendrik Drachsler",
year = "2017",
month = "9",
day = "1",
doi = "10.1007/978-3-319-66610-5_16",
language = "English",
isbn = "978-3-319-66609-9",
series = "Lecture Notes in Computer Science",
publisher = "Springer",
pages = "209--223",
editor = "Lavou{\'e}, {{\'E}. } and Drachsler, {H. } and Verbert, {K. } and Broisin, {J. } and P{\'e}rez-Sanagust{\'i}n, {M. }",
booktitle = "Data Driven Approaches in Digital Education.",

}

Schmitz, M, Van Limbeek, E, Greller, W, Sloep, P & Drachsler, H 2017, Opportunities and challenges in using Learning Analytics in Learning Design. in É Lavoué, H Drachsler, K Verbert, J Broisin & M Pérez-Sanagustín (eds), Data Driven Approaches in Digital Education. : 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. Lecture Notes in Computer Science, vol. 10474, Springer, pp. 209-223, Data Driven Approaches in Digital Education, Tallinn, Estonia, 12/09/17. https://doi.org/10.1007/978-3-319-66610-5_16

Opportunities and challenges in using Learning Analytics in Learning Design. / Schmitz, Marcel; Van Limbeek, Evelien; Greller, Wolfgang; Sloep, Peter; Drachsler, Hendrik.

Data Driven Approaches in Digital Education. : 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. ed. / É. Lavoué; H. Drachsler; K. Verbert; J. Broisin; M. Pérez-Sanagustín. Springer, 2017. p. 209-223 (Lecture Notes in Computer Science; Vol. 10474).

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

TY - GEN

T1 - Opportunities and challenges in using Learning Analytics in Learning Design

AU - Schmitz, Marcel

AU - Van Limbeek, Evelien

AU - Greller, Wolfgang

AU - Sloep, Peter

AU - Drachsler, Hendrik

PY - 2017/9/1

Y1 - 2017/9/1

N2 - Educational institutions are designing, creating and evaluating courses to optimize learning outcomes for highly diverse student populations. Yet, most of the delivery is still monitored retrospectively with summative evaluation forms. Therefore, improvements to the course design are only implemented at the very end of a course, thus missing to benefit the current cohort. Teachers find it difficult to interpret and plan interventions just-in-time. In this context, Learning Analytics (LA) data streams gathered from ‘authentic’ student learning activities, may provide new opportunities to receive valuable information on the students' learning behaviors and could be utilised to adjust the learning design already "on the fly" during runtime. We presume that Learning Analytics applied within Learning Design (LD) and presented in a learning dashboard provide opportunities that can lead to more personalized learning experiences, if implemented thoughtfully. In this paper, we describe opportunities and challenges for using LA in LD. We identify three key opportunities for using LA in LD: (O1) using on demand indicators for evidence based decisions on learning design; (O2) intervening during the run-time of a course; and, (O3) increasing student learning outcomes and satisfaction. In order to benefit from these opportunities, several challenges have to be overcome. We mapped the identified opportunities and challenges in a conceptual model that considers the interaction of LA in LD.

AB - Educational institutions are designing, creating and evaluating courses to optimize learning outcomes for highly diverse student populations. Yet, most of the delivery is still monitored retrospectively with summative evaluation forms. Therefore, improvements to the course design are only implemented at the very end of a course, thus missing to benefit the current cohort. Teachers find it difficult to interpret and plan interventions just-in-time. In this context, Learning Analytics (LA) data streams gathered from ‘authentic’ student learning activities, may provide new opportunities to receive valuable information on the students' learning behaviors and could be utilised to adjust the learning design already "on the fly" during runtime. We presume that Learning Analytics applied within Learning Design (LD) and presented in a learning dashboard provide opportunities that can lead to more personalized learning experiences, if implemented thoughtfully. In this paper, we describe opportunities and challenges for using LA in LD. We identify three key opportunities for using LA in LD: (O1) using on demand indicators for evidence based decisions on learning design; (O2) intervening during the run-time of a course; and, (O3) increasing student learning outcomes and satisfaction. In order to benefit from these opportunities, several challenges have to be overcome. We mapped the identified opportunities and challenges in a conceptual model that considers the interaction of LA in LD.

KW - Learning Analytics

KW - Learning Design

KW - Learning Dashboards

KW - meta-cognitive competences

KW - feedback

KW - reflection

KW - run-time

KW - Learning Activity

U2 - 10.1007/978-3-319-66610-5_16

DO - 10.1007/978-3-319-66610-5_16

M3 - Conference article in proceeding

SN - 978-3-319-66609-9

T3 - Lecture Notes in Computer Science

SP - 209

EP - 223

BT - Data Driven Approaches in Digital Education.

A2 - Lavoué, É.

A2 - Drachsler, H.

A2 - Verbert, K.

A2 - Broisin, J.

A2 - Pérez-Sanagustín, M.

PB - Springer

ER -

Schmitz M, Van Limbeek E, Greller W, Sloep P, Drachsler H. Opportunities and challenges in using Learning Analytics in Learning Design. In Lavoué É, Drachsler H, Verbert K, Broisin J, Pérez-Sanagustín M, editors, Data Driven Approaches in Digital Education. : 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. Springer. 2017. p. 209-223. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-319-66610-5_16