ISSN 1671-3710
CN 11-4766/R

心理科学进展 ›› 2019, Vol. 27 ›› Issue (7): 1205-1214.doi: 10.3724/SP.J.1042.2019.01205

• 研究前沿 • 上一篇    下一篇


李萍, 张明明, 李帅霞, 张火垠, 罗文波()   

  1. 辽宁师范大学脑与认知神经科学研究中心, 大连 116029
  • 收稿日期:2018-05-17 出版日期:2019-07-15 发布日期:2019-05-22
  • 通讯作者: 罗文波
  • 基金资助:
    * 国家自然科学基金项目资助(31871106)

The integration of facial expression and vocal emotion and its brain mechanism

LI Ping, ZHANG Mingming, LI Shuaixia, ZHANG Huoyin, LUO Wenbo()   

  1. Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China
  • Received:2018-05-17 Online:2019-07-15 Published:2019-05-22
  • Contact: LUO Wenbo


在现实生活中, 有效的情绪识别往往依赖于不同通道间的信息整合(如, 面孔、声音)。本文梳理相关研究认为, 面孔表情和声音情绪信息在早期知觉阶段即产生交互作用, 且初级感知觉皮层负责两者信息的编码; 而在晚期决策阶段, 杏仁核、颞叶等高级脑区完成对情绪信息内容的认知评估整合; 此外, 神经振荡活动在多个频段上的功能耦合促进了跨通道情绪信息整合。未来研究需要进一步探究两者整合是否与情绪冲突有关, 以及不一致的情绪信息在整合中是否有优势, 探明不同频段的神经振荡如何促进面孔表情和声音情绪信息整合, 以便更深入地了解面孔表情和声音情绪信息整合的神经动力学基础。

关键词: 情绪, 整合效应, ERP, 神经振荡, fMRI


The integration of various emotional information from different modalities (e.g., face and voice) plays an important role in our interpersonal communication. In order to understand its brain mechanism, more and more researchers found that the interaction between facial expression and vocal emotional information begins in the early stage of perception, and the integration of emotional information content occurs in the late decision-making stage. In the early stage, the primary sensory cortex is responsible for encoding information; while in the late stage, the amygdala, temporal lobe and other advanced brain regions are responsible for cognitive evaluation. In addition, the functional coupling of oscillation activities on multiple frequency bands facilitates the integration of emotional information cross channels. Future research needs to explore whether facial expression and vocal emotional information integration is associated with emotional conflict, and whether inconsistent emotional information has advantages. Lastly, we should find out how the neural oscillations of different frequency bands promotes the integration of facial expression and vocal emotional information, so as to further understand its dynamic basis.

Key words: emotion, integration effect, ERP, neural oscillation, fMRI