Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

22 Downloads (Pure)

Abstract

It has been long argued that learning analytics has the potential to act as a "middle space" between the learning sciences and data analytics, creating technical possibilities for exploring the vast amount of data generated in online learning environments. One common learning analytics intervention is the learning dashboard, a support tool for teachers and learners alike that allows them to gain insight into the learning process. Although several related works have scrutinised the state-of-the-art in the eld of learning dashboards, none have addressed the theoretical foundation that should inform the design of such interventions. In this systematic literature review, we analyse the extent to which theories and models from learning sciences have been integrated into the development of learning dashboards aimed at learners. Our critical examination reveals the most common educational concepts and the context in which they have been applied. We find evidence that current designs foster competition between learners rather than knowledge mastery, offering misguided frames of reference for comparison.
Original languageEnglish
Title of host publicationData Driven Approaches in Digital Education
Subtitle of host publication12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings
EditorsÉlise Lavoué , Hendrik Drachsler , Katrien Verbert , Julien Broisin , Mar Pérez-Sanagustín
Place of PublicationCham
PublisherSpringer International Publishing AG
ISBN (Electronic)978-3-319-66610-5
ISBN (Print)978-3-319-66609-9
DOIs
Publication statusPublished - 1 Sep 2017
EventData Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning: EC-TEL - Tallinn, Estonia
Duration: 12 Sep 201715 Sep 2017
http://ectel2017.httc.de/index.php?id=777

Publication series

NameLecture Notes in Computer Science (LNCS)
PublisherSpringer
Volume10474
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceData Driven Approaches in Digital Education
CountryEstonia
CityTallinn
Period12/09/1715/09/17
Internet address

Fingerprint

educational practice
learning
science
learning process
learning environment
examination
teacher
evidence

Keywords

  • learning dashboards
  • learning theory
  • learning analytics
  • systematic review
  • learning science
  • social comparison
  • competition

Cite this

Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice. In É. L., H. D., K. V., J. B., & M. P-S. (Eds.), Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings (Lecture Notes in Computer Science (LNCS); Vol. 10474). Cham: Springer International Publishing AG. https://doi.org/10.1007/978-3-319-66610-5_7
Jivet, Ioana ; Scheffel, Maren ; Drachsler, Hendrik ; Specht, Marcus. / Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice. Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. editor / Élise Lavoué ; Hendrik Drachsler ; Katrien Verbert ; Julien Broisin ; Mar Pérez-Sanagustín. Cham : Springer International Publishing AG, 2017. (Lecture Notes in Computer Science (LNCS)).
@inproceedings{1bd742025314481487766550210d0218,
title = "Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice",
abstract = "It has been long argued that learning analytics has the potential to act as a {"}middle space{"} between the learning sciences and data analytics, creating technical possibilities for exploring the vast amount of data generated in online learning environments. One common learning analytics intervention is the learning dashboard, a support tool for teachers and learners alike that allows them to gain insight into the learning process. Although several related works have scrutinised the state-of-the-art in the eld of learning dashboards, none have addressed the theoretical foundation that should inform the design of such interventions. In this systematic literature review, we analyse the extent to which theories and models from learning sciences have been integrated into the development of learning dashboards aimed at learners. Our critical examination reveals the most common educational concepts and the context in which they have been applied. We find evidence that current designs foster competition between learners rather than knowledge mastery, offering misguided frames of reference for comparison.",
keywords = "learning dashboards, learning theory, learning analytics, systematic review, learning science, social comparison, competition",
author = "Ioana Jivet and Maren Scheffel and Hendrik Drachsler and Marcus Specht",
note = "DS_Citation:Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness Is Not Enough: Pitfalls of Learning Analytics Dashboards in the Educational Practice. In E. Lavou{\'e}, H. Drachsler, K. Verbert, J. Broisin, & M. P{\'e}rez-Sanagust{\'i}n (Eds.), Data Driven Approaches in Digital Education. EC-TEL 2017. Lecture Notes in Computer Science, vol 10474 (pp. 82-96). Springer, Cham.",
year = "2017",
month = "9",
day = "1",
doi = "10.1007/978-3-319-66610-5_7",
language = "English",
isbn = "978-3-319-66609-9",
series = "Lecture Notes in Computer Science (LNCS)",
publisher = "Springer International Publishing AG",
editor = "{{\'E}lise Lavou{\'e}} and {Hendrik Drachsler} and {Katrien Verbert} and {Julien Broisin} and {Mar P{\'e}rez-Sanagust{\'i}n}",
booktitle = "Data Driven Approaches in Digital Education",
address = "Switzerland",

}

Jivet, I, Scheffel, M, Drachsler, H & Specht, M 2017, Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice. in ÉL, HD, KV, JB & MP-S (eds), Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. Lecture Notes in Computer Science (LNCS), vol. 10474, Springer International Publishing AG, Cham, Data Driven Approaches in Digital Education, Tallinn, Estonia, 12/09/17. https://doi.org/10.1007/978-3-319-66610-5_7

Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice. / Jivet, Ioana; Scheffel, Maren; Drachsler, Hendrik; Specht, Marcus.

Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. ed. / Élise Lavoué; Hendrik Drachsler; Katrien Verbert; Julien Broisin; Mar Pérez-Sanagustín. Cham : Springer International Publishing AG, 2017. (Lecture Notes in Computer Science (LNCS); Vol. 10474).

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

TY - GEN

T1 - Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice

AU - Jivet, Ioana

AU - Scheffel, Maren

AU - Drachsler, Hendrik

AU - Specht, Marcus

N1 - DS_Citation:Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness Is Not Enough: Pitfalls of Learning Analytics Dashboards in the Educational Practice. In E. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Data Driven Approaches in Digital Education. EC-TEL 2017. Lecture Notes in Computer Science, vol 10474 (pp. 82-96). Springer, Cham.

PY - 2017/9/1

Y1 - 2017/9/1

N2 - It has been long argued that learning analytics has the potential to act as a "middle space" between the learning sciences and data analytics, creating technical possibilities for exploring the vast amount of data generated in online learning environments. One common learning analytics intervention is the learning dashboard, a support tool for teachers and learners alike that allows them to gain insight into the learning process. Although several related works have scrutinised the state-of-the-art in the eld of learning dashboards, none have addressed the theoretical foundation that should inform the design of such interventions. In this systematic literature review, we analyse the extent to which theories and models from learning sciences have been integrated into the development of learning dashboards aimed at learners. Our critical examination reveals the most common educational concepts and the context in which they have been applied. We find evidence that current designs foster competition between learners rather than knowledge mastery, offering misguided frames of reference for comparison.

AB - It has been long argued that learning analytics has the potential to act as a "middle space" between the learning sciences and data analytics, creating technical possibilities for exploring the vast amount of data generated in online learning environments. One common learning analytics intervention is the learning dashboard, a support tool for teachers and learners alike that allows them to gain insight into the learning process. Although several related works have scrutinised the state-of-the-art in the eld of learning dashboards, none have addressed the theoretical foundation that should inform the design of such interventions. In this systematic literature review, we analyse the extent to which theories and models from learning sciences have been integrated into the development of learning dashboards aimed at learners. Our critical examination reveals the most common educational concepts and the context in which they have been applied. We find evidence that current designs foster competition between learners rather than knowledge mastery, offering misguided frames of reference for comparison.

KW - learning dashboards

KW - learning theory

KW - learning analytics

KW - systematic review

KW - learning science

KW - social comparison

KW - competition

U2 - 10.1007/978-3-319-66610-5_7

DO - 10.1007/978-3-319-66610-5_7

M3 - Conference article in proceeding

SN - 978-3-319-66609-9

T3 - Lecture Notes in Computer Science (LNCS)

BT - Data Driven Approaches in Digital Education

A2 - , Élise Lavoué

A2 - , Hendrik Drachsler

A2 - , Katrien Verbert

A2 - , Julien Broisin

A2 - , Mar Pérez-Sanagustín

PB - Springer International Publishing AG

CY - Cham

ER -

Jivet I, Scheffel M, Drachsler H, Specht M. Awareness is not enough. Pitfalls of learning analytics dashboards in the educational practice. In ÉL, HD, KV, JB, MP-S, editors, Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12–15, 2017, Proceedings. Cham: Springer International Publishing AG. 2017. (Lecture Notes in Computer Science (LNCS)). https://doi.org/10.1007/978-3-319-66610-5_7