Students’ and Teachers’ Perceptions of the Usability and Usefulness of the first Viewbrics-prototype: a Methodology and Online Tool to Formatively Assess Complex Generic Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

Research output: Contribution to conferencePaperAcademic

Abstract

To learn complex generic (21st century) skills students need to form a mental model of a skill. If students know their current and strived-for mastery level, they can better determine subsequent learning activities towards skills mastery. Rubrics support students in self-assessment of their skills as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models of a complex skill. Video-enhanced rubrics (VER) with video modeling examples have the potential to improve and enrich mental model formation. VER can also be used to improve feedback quality a student receives from teachers, experts and peers while practicing a skill. Both affordances of VER can thus improve students’ performance.
In the Viewbrics-project we therefore develop, through design-based research, a methodology for the formative assessment of complex skills with Video-Enhanced Rubrics (VER), precipitated in an online tool. We implemented this methodology in the online tool for three skills: collaborating, presenting and becoming information literate. This paper describes the features of the first prototype of the online tool and the results of a stakeholder evaluation of its perceived usefulness and usability, by means of a questionnaire and card-sorting exercise, with 7 teachers and 21 students of two secondary schools.
The evaluation of this first prototype showed that both teachers and students evaluated the online tool and formative assessment methodology as handy, usable, helpful and feasible for learning complex skills, although some recommendations were made to further improve the design of the tool.
Original languageEnglish
Number of pages16
Publication statusPublished - 2018
EventInternational Technology Enhanced Assessment Conference - Vrije Universiteit (VU), Amsterdam, Netherlands
Duration: 10 Dec 201811 Dec 2018
https://www.teaconference.org/

Conference

ConferenceInternational Technology Enhanced Assessment Conference
Abbreviated titleTEA 2018
CountryNetherlands
CityAmsterdam
Period10/12/1811/12/18
Internet address

Fingerprint

secondary education
video
methodology
teacher
student
self-assessment
evaluation
learning
performance
secondary school
stakeholder
expert
questionnaire

Keywords

  • Formative assessment
  • Rubrics
  • Video-enhanced rubrics
  • Skills
  • Feedback
  • Reflection
  • Viewbrics

Cite this

@conference{d09df42faef8436cbc4a3f41366b636c,
title = "Students’ and Teachers’ Perceptions of the Usability and Usefulness of the first Viewbrics-prototype: a Methodology and Online Tool to Formatively Assess Complex Generic Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education",
abstract = "To learn complex generic (21st century) skills students need to form a mental model of a skill. If students know their current and strived-for mastery level, they can better determine subsequent learning activities towards skills mastery. Rubrics support students in self-assessment of their skills as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models of a complex skill. Video-enhanced rubrics (VER) with video modeling examples have the potential to improve and enrich mental model formation. VER can also be used to improve feedback quality a student receives from teachers, experts and peers while practicing a skill. Both affordances of VER can thus improve students’ performance.In the Viewbrics-project we therefore develop, through design-based research, a methodology for the formative assessment of complex skills with Video-Enhanced Rubrics (VER), precipitated in an online tool. We implemented this methodology in the online tool for three skills: collaborating, presenting and becoming information literate. This paper describes the features of the first prototype of the online tool and the results of a stakeholder evaluation of its perceived usefulness and usability, by means of a questionnaire and card-sorting exercise, with 7 teachers and 21 students of two secondary schools.The evaluation of this first prototype showed that both teachers and students evaluated the online tool and formative assessment methodology as handy, usable, helpful and feasible for learning complex skills, although some recommendations were made to further improve the design of the tool.",
keywords = "Formative assessment, Rubrics, Video-enhanced rubrics, Skills, Feedback, Reflection, Viewbrics",
author = "Ellen Rusman and R.J. Nadolski and K. Ackermans",
year = "2018",
language = "English",
note = "International Technology Enhanced Assessment Conference, TEA 2018 ; Conference date: 10-12-2018 Through 11-12-2018",
url = "https://www.teaconference.org/",

}

TY - CONF

T1 - Students’ and Teachers’ Perceptions of the Usability and Usefulness of the first Viewbrics-prototype

T2 - a Methodology and Online Tool to Formatively Assess Complex Generic Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

AU - Rusman, Ellen

AU - Nadolski, R.J.

AU - Ackermans, K.

PY - 2018

Y1 - 2018

N2 - To learn complex generic (21st century) skills students need to form a mental model of a skill. If students know their current and strived-for mastery level, they can better determine subsequent learning activities towards skills mastery. Rubrics support students in self-assessment of their skills as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models of a complex skill. Video-enhanced rubrics (VER) with video modeling examples have the potential to improve and enrich mental model formation. VER can also be used to improve feedback quality a student receives from teachers, experts and peers while practicing a skill. Both affordances of VER can thus improve students’ performance.In the Viewbrics-project we therefore develop, through design-based research, a methodology for the formative assessment of complex skills with Video-Enhanced Rubrics (VER), precipitated in an online tool. We implemented this methodology in the online tool for three skills: collaborating, presenting and becoming information literate. This paper describes the features of the first prototype of the online tool and the results of a stakeholder evaluation of its perceived usefulness and usability, by means of a questionnaire and card-sorting exercise, with 7 teachers and 21 students of two secondary schools.The evaluation of this first prototype showed that both teachers and students evaluated the online tool and formative assessment methodology as handy, usable, helpful and feasible for learning complex skills, although some recommendations were made to further improve the design of the tool.

AB - To learn complex generic (21st century) skills students need to form a mental model of a skill. If students know their current and strived-for mastery level, they can better determine subsequent learning activities towards skills mastery. Rubrics support students in self-assessment of their skills as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models of a complex skill. Video-enhanced rubrics (VER) with video modeling examples have the potential to improve and enrich mental model formation. VER can also be used to improve feedback quality a student receives from teachers, experts and peers while practicing a skill. Both affordances of VER can thus improve students’ performance.In the Viewbrics-project we therefore develop, through design-based research, a methodology for the formative assessment of complex skills with Video-Enhanced Rubrics (VER), precipitated in an online tool. We implemented this methodology in the online tool for three skills: collaborating, presenting and becoming information literate. This paper describes the features of the first prototype of the online tool and the results of a stakeholder evaluation of its perceived usefulness and usability, by means of a questionnaire and card-sorting exercise, with 7 teachers and 21 students of two secondary schools.The evaluation of this first prototype showed that both teachers and students evaluated the online tool and formative assessment methodology as handy, usable, helpful and feasible for learning complex skills, although some recommendations were made to further improve the design of the tool.

KW - Formative assessment

KW - Rubrics

KW - Video-enhanced rubrics

KW - Skills

KW - Feedback

KW - Reflection

KW - Viewbrics

M3 - Paper

ER -