ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

心理科学进展 ›› 2018, Vol. 26 ›› Issue (11): 1935-1951.doi: 10.3724/SP.J.1042.2018.01935

• 研究前沿 • 上一篇    下一篇

McGurk效应的影响因素与神经基础

罗霄骁1, 康冠兰1, 周晓林1,2,3,4()   

  1. 1 北京大学心理与认知科学学院, 北京 100871
    2 北京大学机器感知与智能教育部重点实验室, 北京 100871
    3 北京大学IDG麦戈文脑科学研究所, 北京 100871
    4 浙江师范大学心理与脑科学研究院, 金华 321004
  • 收稿日期:2018-03-13 出版日期:2018-11-15 发布日期:2018-09-26
  • 通讯作者: 周晓林 E-mail:xz104@pku.edu.cn
  • 基金资助:
    * 国家自然科学基金面上项目(31470976);科技部973项目(2015CB856400);机器感知与智能教育部重点实验室开放课题基金项目(K-2017-05)

The influential factors and neural mechanisms of McGurk effect

LUO Xiaoxiao1, KANG Guanlan1, ZHOU Xiaolin1,2,3,4()   

  1. 1 School of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China
    2 Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 100871, China
    3 PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
    4 Institute of Psychological and Brain Sciences, Zhejiang Normal University, Jinhua 321004, China;
  • Received:2018-03-13 Online:2018-11-15 Published:2018-09-26
  • Contact: ZHOU Xiaolin E-mail:xz104@pku.edu.cn

摘要:

McGurk效应(麦格克效应)是典型的视听整合现象, 该效应受到刺激的物理特征、注意分配、个体视听信息依赖程度、视听整合能力、语言文化差异的影响。引发McGurk效应的关键视觉信息主要来自说话者的嘴部区域。产生McGurk效应的认知过程包含早期的视听整合(与颞上皮层有关)以及晚期的视听不一致冲突(与额下皮层有关)。未来研究应关注面孔社会信息对McGurk效应的影响, McGurk效应中单通道信息加工与视听整合的关系, 结合计算模型探讨其认知神经机制等。

关键词: McGurk效应, 视听言语感知, 视听整合, 多感觉整合

Abstract:

The McGurk effect is a typical audiovisual integration phenomenon, influenced by characteristics of physical stimuli, attentional allocation, the extent that individuals rely on visual or auditory information in processing, the ability of audiovisual integration, and language/culture differences. Key visual information that leads to the McGurk effect is mainly extracted from the mouth area of the talker. The McGurk effect implicates both audiovisual integration (which occurs in the early processing stage and is related to the activation of superior temporal cortex) and the conflict of the incongruent audiovisual stimuli (which occurs in the late processing stage and is related to the activation of inferior frontal cortex). Future studies should further investigate the influence of social factors on the McGurk effect, pay attention to the relationship between unimodal information processing and audiovisual integration in the McGurk effect, and explore the neural mechanisms of McGurk effect with computational modeling.

Key words: McGurk effect, audiovisual speech perception, audiovisual integration, multisensory integration

中图分类号: