Influence of multimedia hints on conceptual physics problem solving and visual attention

K-REx Repository

Show simple item record Wu, Xian 2016-08-11T20:40:59Z 2016-08-11T20:40:59Z 2016-08-01 en_US
dc.description.abstract Previous research has showed that visual cues can improve learners' problem solving performance on conceptual physics tasks. In this study we investigated the influence of multimedia hints that included visual, textual, and audio modalities, and all possible combinations thereof, on students' problem solving performance and visual attention. The participants (N = 162) were recruited from conceptual physics classes for this study. Each of them participated in an individual interview, which contained four task sets. Each set contained one initial task, six training tasks, one near transfer task and one far transfer task. We used a 2 (visual hint/no visual hint) x 2 (text hint/no text hint) x 2 (audio hint/no audio hint) between participant quasi-experimental design. Participants were randomly assigned into one of the eight conditions and were provided hints for training tasks, corresponding to the assigned condition. Our results showed that problem solving performance on the training tasks was affected by hint modality. Unlike what was predicted by Mayer's modality principle, we found evidence of a reverse modality effect, in which text hints helped participants solve the physics tasks better than audio hints. Then we studied students’ visual attention as they solved these physics tasks. We found the participants preferentially attended to visual hints over text hints when they were presented simultaneously. This effect was unaffected by the inclusion of audio hints. Text hints also imposed less cognitive load than audio hints, as measured by fixation durations. And presenting visual hints caused more cognitive load while fixating expert-like interest areas than during the time intervals before and after hints. A theoretical model is proposed to explain both problem solving performance and visual attention. According to the model, because visual hints integrated the functions of selection, organization, and integration, this caused a relatively heavy cognitive load yet improved problem solving performance. Furthermore, text hints were a better resource for complex linguistic information than transient audio hints. We also discuss limitations of the current study, which may have led to results contrary to Mayer's modality principle in some respects, but consistent with it in others. en_US
dc.description.sponsorship This study is supported in part by U.S. National Science Foundation grant 1348857. Opinions expressed are those of the authors and not necessarily those of the Foundation. en_US
dc.language.iso en_US en_US
dc.publisher Kansas State University en
dc.subject Science education en_US
dc.subject Physics en_US
dc.subject Multimedia communications en_US
dc.title Influence of multimedia hints on conceptual physics problem solving and visual attention en_US
dc.type Dissertation en_US Doctor of Philosophy en_US
dc.description.level Doctoral en_US
dc.description.department Department of Physics en_US
dc.description.advisor Brett D. DePaola en_US
dc.description.advisor Nobel S. Rebello en_US 2016 en_US August en_US

Files in this item

This item appears in the following Collection(s)

Show simple item record

Search K-REx

Advanced Search


My Account


Center for the

Advancement of Digital


118 Hale Library

Manhattan KS 66506

(785) 532-7444