ISSN 1671-3710
CN 11-4766/R
主办：中国科学院心理研究所
出版：科学出版社

心理科学进展 ›› 2015, Vol. 23 ›› Issue (8): 1361-1370.doi: 10.3724/SP.J.1042.2015.01361

• 研究前沿 • 上一篇    下一篇

多媒体学习中图文加工的认知神经机制

李松清;赵庆柏;周治金;张依   

  1. (青少年网络心理与行为教育部重点实验室(华中师范大学); 人的发展与心理健康湖北省重点实验室; 华中师范大学心理学院, 武汉 430079)
  • 收稿日期:2014-12-29 出版日期:2015-08-15 发布日期:2015-08-15
  • 通讯作者: 赵庆柏, E-mail: zqbznr@mail.ccnu.edu.cn
  • 基金资助:

    国家自然科学基金青年项目(31400875); 国家自然科学基金面上项目(31471000); 教育部人文社会科学研究规划基金项目(14YJA190014); 中央高校基本科研业务费(CCNU15A02041)。

The Cognitive and Neural Mechanism of Text and Picture Processing in Multimedia Learning

LI Songqing; ZHAO Qingbai; ZHOU Zhijin; ZHANG Yi   

  1. (Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China)
  • Received:2014-12-29 Online:2015-08-15 Published:2015-08-15
  • Contact: ZHAO Qingbai, E-mail: zqbznr@mail.ccnu.edu.cn

PDF (PC)

1593

被引次数

2

摘要：

多媒体学习的认知理论和图文理解整合模型指出, 多媒体学习中图片和文字在早期阶段的加工遵循双通道假设, 在晚期不同表征的信息进行整合完成知识建构。理论上的探讨得到了神经科学实证研究的支持。脑成像研究发现, 图、文加工在早期的前语义阶段存在差异, 但晚期的信息整合阶段共享了同一语义系统。事件相关电位研究也发现在早期图片诱发了独特的N300成分, 而晚期图、文均诱发了N400效应。尽管现有研究已经明确了图、文共享同一语义系统, 但是信息是如何在这一系统中进行整合的还需要进一步的研究。

关键词: 多媒体学习, 语义加工, 图文整合, 脑成像, 事件相关电位

Abstract:

According to the cognitive theory of multimedia learning and the integrated theory of text and picture comprehension, text and picture are processed through distinct channels at the early stage, and then integrated into a whole. The theories are supported by empirical researches in neuroscience. Brain imaging studies have shown that the processing of text and picture is different in the semantic pre-process, but shares the same semantic neural system in information integration later. Event-related potential studies have found that only picture evokes a N300 in the early stage, while both picture and text induce the N400 effect later. Although existing studies have provided clear evidence that text and picture share the same semantic system, further research is needed to explore how the information is integrated in this system.

Key words: multimedia learning, semantic processing, text and picture integration, brain imaging, event- related potential