ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

Advances in Psychological Science ›› 2018, Vol. 26 ›› Issue (11): 1935-1951.doi: 10.3724/SP.J.1042.2018.01935

• Regular Articles • Previous Articles     Next Articles

The influential factors and neural mechanisms of McGurk effect

LUO Xiaoxiao1, KANG Guanlan1, ZHOU Xiaolin1,2,3,4()   

  1. 1 School of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China
    2 Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 100871, China
    3 PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
    4 Institute of Psychological and Brain Sciences, Zhejiang Normal University, Jinhua 321004, China;
  • Received:2018-03-13 Online:2018-11-15 Published:2018-09-26
  • Contact: ZHOU Xiaolin E-mail:xz104@pku.edu.cn

Abstract:

The McGurk effect is a typical audiovisual integration phenomenon, influenced by characteristics of physical stimuli, attentional allocation, the extent that individuals rely on visual or auditory information in processing, the ability of audiovisual integration, and language/culture differences. Key visual information that leads to the McGurk effect is mainly extracted from the mouth area of the talker. The McGurk effect implicates both audiovisual integration (which occurs in the early processing stage and is related to the activation of superior temporal cortex) and the conflict of the incongruent audiovisual stimuli (which occurs in the late processing stage and is related to the activation of inferior frontal cortex). Future studies should further investigate the influence of social factors on the McGurk effect, pay attention to the relationship between unimodal information processing and audiovisual integration in the McGurk effect, and explore the neural mechanisms of McGurk effect with computational modeling.

Key words: McGurk effect, audiovisual speech perception, audiovisual integration, multisensory integration

CLC Number: