ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

Advances in Psychological Science ›› 2017, Vol. 25 ›› Issue (5): 757-768.doi: 10.3724/SP.J.1042.2017.00757

• Regular Articles • Previous Articles     Next Articles

The characteristics and mechanisms of audiovisual integration: Evidence from mismatch negativity

XIN Xin1; REN Gui-Qin1; LI Jin-Cai2; TANG Xiao-Yu1   

  1. (1 College of psychology, Liaoning Normal University, Dalian 116029, China) (2 School of Foreign Languages, Shanghai Jiao Tong University, Shanghai 200240, China)
  • Received:2016-05-26 Online:2017-05-15 Published:2017-05-15
  • Contact: REN Gui-Qin, E-mail: renguiqin@126.com

Abstract:

Audiovisual integration refers to the cognitive process in which auditory and visual events that are presented at the same time and the same location tend to integrate with each other. Mismatch Negativity (MMN), as an index of early cortical processing, is usually used to explore whether there is mismatch between deviant information and traces of sensory memory. Previous studies on audiovisual integration mainly focused on the integration of letters and phonology, integration of non-language visual information and prosodic auditory information, Mcgurk Effect, as well as the mechanisms underlying the integration processing. This paper reviewed those recent studies and analyzed the possible factors that would influence the integration of auditory and visual processing. Future research should focus on the integration of information from multiple modalities.

Key words: auditory, visual, audiovisual integration, MMN, ERP