Premium
An evaluation of multimodal interactions with technology while learning science concepts
Author(s) -
Anastopoulou Stamatina,
Sharples Mike,
Baber Chris
Publication year - 2011
Publication title -
british journal of educational technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.79
H-Index - 95
eISSN - 1467-8535
pISSN - 0007-1013
DOI - 10.1111/j.1467-8535.2009.01017.x
Subject(s) - modalities , movement (music) , kinematics , computer science , construct (python library) , motion (physics) , interpretation (philosophy) , human–computer interaction , artificial intelligence , sociology , aesthetics , physics , social science , philosophy , classical mechanics , programming language
This paper explores the value of employing multiple modalities to facilitate science learning with technology. In particular, it is argued that when multiple modalities are employed, learners construct strong relations between physical movement and visual representations of motion. Body interactions with visual representations, enabled by interactive technologies, can encourage rhythmic cycles of engagement and reflection. A study was carried out to investigate how students interpret distance–time and velocity–time graphs created through hand movement. It explored the dynamic coupling between their body movements and graphs, and their subsequent interpretation and production of graphs on paper. The results show that physical manipulation of kinematics graphs has a significantly greater effect on students' ability to relate graphs to movement than observing the graphs being produced by someone else.