Search

Given the widespread use of touch screen devices, the effect of the users' fingers on information processing and learning is of growing interest. The present study drew on cognitive load theory and embodied cognition perspectives to investigate the effects of pointing and tracing gestures on the surface of a multimedia learning instruction. Learning performance, cognitive load and visual attention were examined in a one‐factorial experimental design with the between‐subject factor pointing and tracing gestures. The pointing and tracing group were instructed to use their fingers during the learning phase to make connections between corresponding text and picture information, whereas the control group was instructed not to use their hands for learning. The results showed a beneficial effect of pointing and tracing gestures on learning performance, a significant shift in visual attention and deeper processing of information by the pointing and tracing group, but no effect on subjective ratings of cognitive load. Implications for future research and practice are discussed. Lay Description: What is currently known about the subject matter? Pointing and tracing gestures enhance learning with multimediaThe effect is true for paper based and digital learning instructionsLess is known about the cause of this effect with regard to complex learningDifferent theoretical explanations are currently discussed What our paper adds to this A detailed analysis of the effect using eye‐tracking and touch screen dataEvidence that the effect of pointing and tracing is mediated by eye‐movementsRelevant information concerning the discussion about theoretical explanations The implications of study findings for practitioners Pointing and tracing gestures can guide the learners' visual focus of attentionPointing and tracing gestures can increase the learners' visual attentionPointing and tracing gestures foster information processing when learning with multimediaLearners can or even should use pointing and tracing gestures to support learning [ABSTRACT FROM AUTHOR]