Please wait a minute...
Advances in Psychological Science    2015, Vol. 23 Issue (7) : 1109-1117     DOI: 10.3724/SP.J.1042.2015.01109
Conceptual Framework |
The Integration of Dynamic Facial and Vocal Emotion and Its Neurophysiological Mechanism
WANG Ping; PAN Zhihui; ZHANG Lijie; CHEN Xuhai
(Shaanxi Province Key Laboratory of Behavior and Cognitive Neuroscience, School of Psychology, Shaanxi Normal University, Xi’an 710062, China)
Download: PDF(203 KB)  
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

The integration of facial-vocal emotion is an important factor for successful communication that intrigue psychologists and neuroscientists in recent years. Previous studies have elaborated on the behavioral performance and the influence factors for facial-vocal emotion integration, as well as “when” and “where” information from the two modes integrated. However, it remains open questions whether the integration of facial-vocal emotion follows the principles of multisensory integration (eg.the principle of inverse effectiveness), and how the bimodal emotional information merges into a coherence emotional object. Therefore, taking “whether facial-vocal emotion integration obeys the principle of inverse effectiveness” as main line, we designed six experiments which manipulated emotional salience of the dynamic facial-vocal emotional stimuli and task demands systematically. Moreover, using multi-dimensional analysis of behavioral and EEG data, especially time-frequency and coherence analysis of EEG data, we aimed to answer the two proposed questions, to further reveal the neurophysiological mechanism of facial-vocal emotion integration.

Keywords facial emotion      vocal emotion      integration      neural oscillation      ERPs     
Corresponding Authors: CHEN Xuhai, E-mail: shiningocean@snnu.edu.cn shiningoceanchan@gmail.com    
Issue Date: 15 July 2015
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
WANG Ping
PAN Zhihui
ZHANG Lijie
CHEN Xuhai
Cite this article:   
WANG Ping,PAN Zhihui,ZHANG Lijie, et al. The Integration of Dynamic Facial and Vocal Emotion and Its Neurophysiological Mechanism[J]. Advances in Psychological Science, 2015, 23(7): 1109-1117.
URL:  
http://journal.psych.ac.cn/xlkxjz/EN/10.3724/SP.J.1042.2015.01109     OR     http://journal.psych.ac.cn/xlkxjz/EN/Y2015/V23/I7/1109
[1] YU Xide, ZHANG Xiaojuan, LU Cheng, ZHU Yiyi, GAO Dingguo.  Sound influence eating or drinking behavior: Empirical progress and theoretical ideas[J]. Advances in Psychological Science, 2017, 25(6): 955-969.
[2] XIN Xin; REN Gui-Qin; LI Jin-Cai; TANG Xiao-Yu. The characteristics and mechanisms of audiovisual integration: Evidence from mismatch negativity[J]. Advances in Psychological Science, 2017, 25(5): 757-768.
[3] SUN Hailong; XING Qiang; LI Aimei. The influence of working memory on perceptual category learning: Problem and conception[J]. Advances in Psychological Science, 2017, 25(3): 424-430.
[4] YANG Wendeng; ZHANG Xiaoyuan. Common factors vs. specific ingredients in psychotherapy: Controversy and integration[J]. Advances in Psychological Science, 2017, 25(2): 253-264.
[5] Cong Zhang; Lin Yang; Mingsha Zhang. Dynamic change of visual receptive field during visually-guided delay saccades in macaque posterior parietal cortex[J]. Advances in Psychological Science, 2016, 24(Suppl.): 16-.
[6] XU Sheng; SONG Xiaolei. Joint Simon effect: Current research, influencing factors and theories[J]. Advances in Psychological Science, 2016, 24(3): 367-378.
[7] LI Songqing; ZHAO Qingbai; ZHOU Zhijin; ZHANG Yi. The Cognitive and Neural Mechanism of Text and Picture Processing in Multimedia Learning[J]. Advances in Psychological Science, 2015, 23(8): 1361-1370.
[8] ZHOU Aibao; ZHANG Yanchi; LIU Peiru; YIN Yulong; ZHANG Fen. Who am I ? ——Enfacement Illusion Based on Interpersonal Multisensory Stimulation[J]. Advances in Psychological Science, 2015, 23(2): 159-167.
[9] PAN Lu; QIAN Xiuying. Rhythm Perception and Interactions between Different Sensory Channels[J]. Advances in Psychological Science, 2015, 23(11): 1910-1919.
[10] LI Dan; YANG Zhongning. Spatial Navigation: The Relationship between Landmark Learning and Path Integration[J]. Advances in Psychological Science, 2015, 23(10): 1755-1762.
[11] ZHOU Lihua;CHEN Jian;LU Dali;LIU Xiaoqun;SU Linyan. Hopelessness and Hopefulness: Risk and Resilience to Hopelessness Depression from the Perspective of Cognitive Style[J]. Advances in Psychological Science, 2014, 22(6): 977-986.
[12] FU Mei;WANG Qiang. The Neural Basis of Intertemporal Choice: Evidences from Voxel-Based Morphometry and Diffusion Tensor Imaging[J]. Advances in Psychological Science, 2014, 22(4): 659-667.
[13] LIU Chenghao; XU Fuming; SHI Yanwei; LI Yan; ZHANG Hui. The Base Rate Neglect in Judgment and Decision-making LIU Chenghao; XU Fuming; SHI Yanwei; LI Yan; ZHANG Hui[J]. Advances in Psychological Science, 2014, 22(10): 1637-1646.
[14] ZHANG Jing;ZHOU Renlai;LI Yongna;WEI Qingwang;HU Ping;LIU Ke. The Neural Mechanism of Automatic Emotion Regulation and Its Plasticity[J]. Advances in Psychological Science, 2014, 22(1): 9-13.
[15] SUN Hailong;XING Qiang. The Influences of Feedback on Perceptual Category Learning and Its’ Cognitive and Neurophysiological Mechanisms[J]. Advances in Psychological Science, 2014, 22(1): 67-74.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Advances in Psychological Science
Support by Beijing Magtech