ISSN 1671-3710
CN 11-4766/R
主办：中国科学院心理研究所
出版：科学出版社

心理科学进展 ›› 2017, Vol. 25 ›› Issue (5): 757-768.doi: 10.3724/SP.J.1042.2017.00757

• 研究前沿 • 上一篇    下一篇

早期视听整合加工——来自MMN的证据

辛 昕1 ;任桂琴1; 李金彩2; 唐晓雨1   

  1. (1辽宁师范大学心理学院, 大连 116029) (2上海交通大学外国语学院, 上海 200240)
  • 收稿日期:2016-05-26 出版日期:2017-05-15 发布日期:2017-05-15
  • 通讯作者: 任桂琴, E-mail: renguiqin@126.com
  • 基金资助:

    国家自然科学基金(31471075; 31100732; 31600882), 国家自然科学基金委员会与英国皇家学会合作交流项目(31611130183), 国家留学基金委公派留学项目(201508210098)。

The characteristics and mechanisms of audiovisual integration: Evidence from mismatch negativity

XIN Xin1; REN Gui-Qin1; LI Jin-Cai2; TANG Xiao-Yu1   

  1. (1 College of psychology, Liaoning Normal University, Dalian 116029, China) (2 School of Foreign Languages, Shanghai Jiao Tong University, Shanghai 200240, China)
  • Received:2016-05-26 Online:2017-05-15 Published:2017-05-15
  • Contact: REN Gui-Qin, E-mail: renguiqin@126.com

PDF (PC)

2630

摘要：

视听整合是指当呈现的视觉和听觉信号在时间、空间上大致接近时, 视觉和听觉系统倾向于整合的加工过程。失匹配负波(Mismatch Negativity, MMN)作为反映大脑早期加工的成分, 表征偏差的信息输入与感觉记忆痕迹之间的神经失匹配。以MMN作为探测指标的视听整合加工研究, 主要包括MMN在阅读理解中字母和语音、韵律信息、麦格克效应等方面的视听整合加工, 以及分析跨通道视听整合相互竞争、相互补充的关系。未来研究需聚焦于其他通道的跨通道整合加工, 同时应拓展MMN的诱发范式。

关键词: 听觉, 视觉, 视听整合, MMN, ERP

Abstract:

Audiovisual integration refers to the cognitive process in which auditory and visual events that are presented at the same time and the same location tend to integrate with each other. Mismatch Negativity (MMN), as an index of early cortical processing, is usually used to explore whether there is mismatch between deviant information and traces of sensory memory. Previous studies on audiovisual integration mainly focused on the integration of letters and phonology, integration of non-language visual information and prosodic auditory information, Mcgurk Effect, as well as the mechanisms underlying the integration processing. This paper reviewed those recent studies and analyzed the possible factors that would influence the integration of auditory and visual processing. Future research should focus on the integration of information from multiple modalities.

Key words: auditory, visual, audiovisual integration, MMN, ERP