TY - GEN
T1 - The Dilemmas of Formulating Theory-Informed Design Guidelines for a Video Enhanced Rubric for the Formative Assessment of Complex Skills
AU - Ackermans, Kevin
AU - Rusman, Ellen
AU - Brand-Gruwel, Saskia
AU - Specht, Marcus
PY - 2017/12/5
Y1 - 2017/12/5
N2 - Learners aiming to master a complex skill may benefit from the combina-tion of abstract information found in a text-based analytical rubric and con-crete information provided by a video modeling example. In this paper, we address the design dilemmas of combining video modeling examples and rubrics into a Video Enhanced Rubric. We propose a model to address these design dilemma's and develop our first prototype based on this model. We review the first prototype through a two-stage international expert valida-tion session. In the first stage, 20 experts are asked to design a user inter-face for the Video Enhanced Rubric. In the second stage, 20 experts are asked to perform an expert appraisal of our first prototype. The preliminary results of the expert validation session are subsequently analyzed using Sauli, Cattaneo and van der Meij’s Framework for Developing Instructional Hypervideo to detect common design suggestions. Following the results of the expert validation, we developed a second prototype of the Video En-hanced Rubric. With the design guidelines of a Video Enhanced Rubric, we aim to improve the formative assessment and mastery of complex skills by fostering learner’s mental model development and the quality (consistency, concreteness) of both given as well as received feedback. On a more general note, we expect the design dilemmas addressed in this paper to inform re-searchers who aim to apply theoretical multimedia design guidelines to formative assessment practices with rubrics.
AB - Learners aiming to master a complex skill may benefit from the combina-tion of abstract information found in a text-based analytical rubric and con-crete information provided by a video modeling example. In this paper, we address the design dilemmas of combining video modeling examples and rubrics into a Video Enhanced Rubric. We propose a model to address these design dilemma's and develop our first prototype based on this model. We review the first prototype through a two-stage international expert valida-tion session. In the first stage, 20 experts are asked to design a user inter-face for the Video Enhanced Rubric. In the second stage, 20 experts are asked to perform an expert appraisal of our first prototype. The preliminary results of the expert validation session are subsequently analyzed using Sauli, Cattaneo and van der Meij’s Framework for Developing Instructional Hypervideo to detect common design suggestions. Following the results of the expert validation, we developed a second prototype of the Video En-hanced Rubric. With the design guidelines of a Video Enhanced Rubric, we aim to improve the formative assessment and mastery of complex skills by fostering learner’s mental model development and the quality (consistency, concreteness) of both given as well as received feedback. On a more general note, we expect the design dilemmas addressed in this paper to inform re-searchers who aim to apply theoretical multimedia design guidelines to formative assessment practices with rubrics.
KW - Video Enhanced Rubrics
KW - Rubrics
KW - Multimedia
U2 - 10.1007/978-3-319-97807-9_10
DO - 10.1007/978-3-319-97807-9_10
M3 - Conference Article in proceeding
VL - 654
T3 - Communications in Computer and Information Science
SP - 123
EP - 136
BT - Technology Enhanced Assessment
A2 - Ras, E.
A2 - Ana, E. G. R.
PB - Springer
CY - Cham, Switserland
T2 - International Technology Enhanced Assessment Conference
Y2 - 5 October 2017 through 6 October 2017
ER -