ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

Advances in Psychological Science ›› 2019, Vol. 27 ›› Issue (3): 475-489.doi: 10.3724/SP.J.1042.2019.00475

• Regular Articles • Previous Articles     Next Articles

Cross-modal integration of audiovisual information in language processing

HAN Haibin, XU Pingping, QU Qingqing, CHENG Xi, LI Xingshan()   

  1. Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China;University of Chinese Academy of Sciences, Beijing 100049, China
  • Received:2018-02-28 Online:2019-03-15 Published:2019-01-22
  • Contact: LI Xingshan E-mail:lixs@psych.ac.cn

Abstract:

In daily life, the use of language often occurs in a visual context. A large number of cognitive science studies have shown that visual and linguistic information processing modules do not work independently, but have complex interactions. The present paper centers on the impact of visual information on language processing, and first reviews research progress on the impact of visual information on speech comprehension, speech production and verbal communication. Secondly, the mechanism of visual information affecting language processing is discussed. Finally, computational models of visually situated language processing are reviewed, and the future research directions are prospected.

Key words: visual information processing, language processing, speech comprehension, speech production, verbal communication

CLC Number: