Interaction with Virtual Games through a Vision-based Gesture-recognition Interface and Interpretation of Motion Scenarios

Περίληψη

This paper examines how young children interact with computer games through a vision- and gesture-based interface. The interface enables users to interact with digital objects naturally, without any mechanical devices, and may provide immersive interaction that has the potential of binding together interactivity, engagement, and learning. We use the theory of embodied cognition to examine the role of bodily actions in the conceptualization of motion. In the learning setting we designed we engaged four children aged 5 to 9 in a ping-pong game simulation, using the Sony PlayStation EyeToy application. The learning tasks involved interpretation of motion scenarios before and after interaction with the game. Findings show that the interaction with the game enhanced the children’s conception of motion and enabled them to provide in the post-activity period more detailed interpretation of motion scenarios then during pre-activity. Furthermore, we found that gestures played a major role in the development of concepts about motion. The findings of this pilot study have implications for the possible contribution of bodily interaction with computerized artifacts for learning.