共情与中国民族音乐情绪识别的关系：来自ERP的证据

doi:10.3724/SP.J.1041.2022.01181

摘要/Abstract

摘要：

音乐情绪识别能力是利用音乐开展情绪调节的基本条件。传统的以五声音阶为基础的具有独特韵味的中国民族音乐反映了中国人独有的情感和价值观念, 在情绪调节和音乐治疗方面具有积极的作用, 是研究音乐情绪识别的有效音乐刺激。本研究采用跨通道情绪启动范式, 通过人际反应指针问卷筛选出高、低共情组被试各36人参加脑电实验, 考察共情能力对中国民族音乐情绪识别的影响。脑电数据显示, 在进行中国民族音乐情绪内隐识别时, 将宫调和羽调音乐作为启动刺激, 诱发了中期的P2、N400以及晚期正成分LPC (Late Positive Component)。低共情组P2和N400成分的波幅大于高共情组, 高共情组LPC成分的波幅大于低共情组。本研究第一次从电生理层面考察了不同共情能力的个体在进行中国民族音乐情绪识别时的神经反应差异。高低共情组在中国民族音乐情绪识别不同阶段的注意投入可能影响了其对音乐刺激的感受, 进而影响音乐情绪识别。

关键词: 音乐情绪识别, 中国民族音乐, 共情, 事件相关电位, 跨通道情绪启动

Abstract:

Musical emotion is an emotional response induced by musical stimulation. Music emotion recognition is a process in which individuals evaluate the emotions contained in or intended to be expressed in music. The ability to recognize musical emotions is one manifestation of the development of social cognition, which is also the premise of music appreciation and the basis of emotional regulation by music. If the emotional recognition ability of music is impaired, the aesthetic, spiritual, and practical values will be reduced, and the individual’s emotional understanding and communication will also be affected. Therefore, the factors related to music emotion recognition and how to improve the ability of individual music emotion recognition have become a concern for researchers in music psychology. The study found that personality’s “empathy” trait may be related to recognizing musical emotions. Empathy is the ability to perceive and experience other people’s emotional states accurately. Individuals with strong empathy are more susceptible to emotional infections and are more sensitive to emotions. Thus, from the perspective of musical psychological localization, this study investigated the possible influence of empathy differences on emotion recognition in Chinese national music. The hypotheses were as follows: first, in the emotional judgment stage, compared with the low empathy group, the high empathy group is more accurate in the recognition of musical emotion, easier to judge the consistency and inconsistency, and the amplitude of the P2 and N400 components are smaller. Second, in the stage of emotional meaning integration, the high empathy group processes the musical emotion more deeply and invests more attention resources, and the amplitude of the late positive component (LPC) is larger.

The cross-channel emotion-priming paradigm was used to study individuals with high and low empathy. The G*Power 3.1.9.2 software was used to calculate the required sample size to achieve sufficient statistical power. The study had a mixed design, with a median effect (f = 0.25) and a significance level α = 0.05, requiring at least 12 participants per class to achieve an 80% statistical power level. In the early stages of the experiment, the Chinese revised Interpersonal Reactivity Index (IRI-C) was distributed online to recruit college students. Based on responses to 522 questionnaires, 72 college students with high and low empathy levels were chosen to participate in the electroencephalogram experiment. Before the experiment, all participants completed a basic information statistics form and signed an informed consent form. After the experiment, they were given course credit and experimental remuneration.

The behavioral results showed no significant difference in the response time and accuracy of emotion recognition between the high and low empathy groups. However, the response time of the high-empathy group was slightly lower than that of the low-empathy group, and the accuracy rate of the high-empathy group was higher than that of the low-empathy group under the emotional consistency condition for Gong-tone music. Contrastingly, there was no difference between the low-empathy groups under the two conditions. The event-related potential results showed that P2, N400, and LPC components were induced in the middle and late stages of Chinese national music emotion recognition. The amplitudes of P2 and N400 in the low-empathy group were more significant than those in the high-empathy group, and the amplitude of the LPC in the high-empathy group was more extensive than that in the low-empathy group.

According to our findings, in the emotion recognition process in Chinese national music, the high- and low-empathy groups showed differences in some electroencephalogram components. This shows that event-related potential technology can explore the differences between the two groups of participants in the time course of music emotion recognition. This study found three main components related to recognizing musical emotions: P2, N400, and LPC. P2 is an indicator of perceptual analysis of musical and emotional stimuli, N400 is more sensitive to the inconsistent effect of musical emotion, and LPC is an indicator of the later evaluation of the emotional significance of musical stimuli. The attentional involvement of high- and low-empathy groups in different stages of Chinese national music emotion recognition may affect the depth of processing emotional stimuli and music emotion recognition. To the best of our knowledge, this is the first study to investigate the difference in neural responses of individuals with different levels of empathy in emotion recognition of Chinese national music from the electrophysiological level, which has important exploratory significance.

Key words: music emotion recognition, Chinese national music, empathy, event-related potential, cross-channel emotion priming paradigm

中图分类号:

B842

杨集梅, 柴洁余, 邱天龙, 全小山, 郑茂平. (2022). 共情与中国民族音乐情绪识别的关系：来自ERP的证据. 心理学报, 54(10), 1181-1192.

YANG Jimei, CHAI Jieyu, QIU Tianlong, QUAN Xiaoshan, ZHENG Maoping. (2022). Relationship between empathy and emotion recognition in Chinese national music: An event-related potential study evidence. Acta Psychologica Sinica, 54(10), 1181-1192.

图/表 6

图1 实验流程图

表1 高、低共情组在情绪一致和不一致条件下的正确率(M ± SD)

条件	宫调		羽调
条件	高共情	低共情	高共情	低共情
情绪一致	0.91 ± 0.10	0.91 ± 0.12	0.84 ± 0.12	0.86 ± 0.09
情绪不一致	0.83 ± 0.14	0.89 ± 0.11	0.82 ± 0.14	0.83 ± 0.12

图2 高低共情组在N170成分上的差异波形图

图3 高低共情组在N400及P2成分上的差异波形图

图4 高低共情组被试在宫调和羽调下N400成分差异波的地形图(不一致减去一致)

图5 高低共情组在LPC成分上的差异波形图

参考文献 58

[1]	Allgood, R., & Heaton, P. (2015). Developmental change and cross-domain links in vocal and musical emotion recognition performance in childhood. British Journal of Developmental Psychology, 33(3), 398-403. doi: 10.1111/bjdp.12097 pmid: 26080754
[2]	Balteș, F. R., & Miu, A. C. (2014). Emotions during live music performance: Links with individual differences in empathy, visual imagery, and mood. Psychomusicology: Music, Mind, and Brain, 24(1), 58-65. doi: 10.1037/pmu0000030 URL
[3]	Bombari, D., Schmid, P. C., Schmid Mast, M., Birri, S., Mast, F. W., & Lobmaier, J. S. (2013). Emotion recognition: The role of featural and configural face information. Quarterly Journal of Experimental Psychology, 66(12), 2426-2442. doi: 10.1080/17470218.2013.789065 URL
[4]	Cheng, Y., Chen, C., & Decety, J. (2014). An EEG/ERP investigation of the development of empathy in early and middle childhood. Developmental Cognitive Neuroscience, 10, 160-169. doi: 10.1016/j.dcn.2014.08.012 pmid: 25261920
[5]	Cui, F., & Luo, Y. (2009). Facial expression processing of people with different empathic abilities: An ERP study. Chinese Journal of Clinical Psychology, 17(4), 390-393.
	[崔芳, 罗跃嘉. (2009). 不同共情能力个体加工情绪面孔的ERP研究. 中国临床心理学杂志, 17(4), 390-393.]
[6]	Daltrozzo, J., & Schön, D. (2009). Conceptual processing in music as revealed by N400 effects on words and musical targets. Journal of Cognitive Neuroscience, 21(10), 1882-1892. doi: 10.1162/jocn.2009.21113 pmid: 18823240
[7]	Ding, X. B., Wang, R., Kang, T. J., Liu, J. Y., & Zhou, J. N. (2020). Consistency between self-reference and mother- reference in emotional perception of others’faces: Evidence from ERP. Acta Psychologica Sinica, 52(6), 694-705. doi: 10.3724/SP.J.1041.2020.00694 URL
	[丁小斌, 王睿, 康铁君, 刘建邑, 周嘉宁. (2020). 他人面孔情绪知觉中自我参照与母亲参照的一致性: 来自ERP的证据. 心理学报, 52(6), 694-705.]
[8]	Eerola, T., Vuoskoski, J. K., & Kautiainen, H. (2016). Being moved by unfamiliar sad music is associated with high empathy. Frontiers in Psychology, 7, 1176. pmid: 27695424
[9]	Egermann, H., & McAdams, S. (2012). Empathy and emotional contagion as a link between recognized and felt emotions in music listening. Music Perception: An Interdisciplinary Journal, 31(2), 139-156.
[10]	Fan, Y., Duncan, N. W., de Greck, M., & Northoff, G. (2011). Is there a core neural network in empathy? An fMRI based quantitative meta-analysis. Neuroscience and Biobehavioral Reviews, 35(3), 903-911. doi: 10.1016/j.neubiorev.2010.10.009 pmid: 20974173
[11]	Feng, L. L, Zong, H., & Zhang, L. L. (2021). Influence of emotional response on state empathy and helping behavior during emotion induction. China Journal of Health Psychology, 29(7), 1085-1091.
	[冯琳琳, 钟浩, 张乐琳. (2021). 大学生诱发情绪时情绪反应对状态共情与助人行为的影响. 中国健康心理学杂志, 29(7), 1085-1091.]
[12]	Giesbrecht, B., Sy, J., Bundesen, C., & Kyllingsbæk, S. (2014). A new perspective on the perceptual selectivity of attention under load. Annals of the New York Academy of Sciences, 1316(1), 71-86.
[13]	Goerlich, K. S., Witteman, J., Aleman, A., & Martens, S. (2011). Hearing feelings: Affective categorization of music and speech in alexithymia, an ERP study. Plos One, 6(5), e19501.
[14]	Gold, C., Voracek, M., & Wigram, T. (2004). Effects of music therapy for children and adolescents with psychopathology: A meta-analysis. Psychotherapy Research, 45(6), 1054-1063.
[15]	Gong, X., Huang, Y. X., Wang, Y., & Luo, Y. J. (2011). Revision of the Chinese facial affective picture system. Chinese Mental Health Journal, 25(1), 40-46.
	[龚栩, 黄宇霞, 王妍, 罗跃嘉. (2011). 中国面孔表情图片系统的修订. 中国心理卫生杂志, 25(1), 40-46.]
[16]	Hajcak, G., Macnamara, A., Foti, D., Ferri, J., & Keil, A. (2013). The dynamic allocation of attention to emotion: Simultaneous and independent evidence from the late positive potential and steady state visual evoked potentials. Biological Psychology, 92(3), 447-455. doi: 10.1016/j.biopsycho.2011.11.012 pmid: 22155660
[17]	Hamm, J. P., Johnson, B. W., & Kirk, I. J. (2002). Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts. Clinical Neurophysiology, 113(8), 1339-1350. pmid: 12140015
[18]	Han, W., Ye, M., & Leng, Y. (2013). Revision and test of interpersonal response indicator scale in Chinese mainland. Journal of Southeast University (Philosophy and Social Science), 15(1), 47-52.
	[韩文超, 叶明, 冷玥. (2013). 中国大陆版人际反应指针量表的修订与检验. 东南大学学报(哲学社会科学版), 15(1), 47-52.]
[19]	Israelashvili, J., Sauter, D., & Fischer, A. (2020). Two facets of affective empathy: Concern and distress have opposite relationships to emotion recognition. Cognition & Emotion, 34(6), 1112-1122.
[20]	Juslin, P. N., & Lindström, E. (2010). Musical expression of emotions: Modelling listeners' judgements of composed and performed features. Music Analysis, 29(1-3), 334-364. doi: 10.1111/j.1468-2249.2011.00323.x URL
[21]	Juslin, P. N., Liljeström, S., Västfjäll, D., & Lundqvist, L.-O. (2010). How does music evoke emotions? Exploring the underlying mechanisms. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion: Theory, research, applications (pp. 605-642). Oxford: Oxford University Press.
[22]	Juslin, P. N., & Västfjäll, D. (2008). Emotional responses to music: The need to consider underlying mechanisms. The Behavioral and Brain sciences, 31(5), 559-621. doi: 10.1017/S0140525X08005293 URL
[23]	Kallinen, K., & Ravaja, N. (2006). Emotion perceived and emotion felt: Same and different. Musicae Scientiae, 10(2), 191-213. doi: 10.1177/102986490601000203 URL
[24]	Kamiyama, K., Abla, D., Iwanaga, K., & Okanoya, K. (2013). Interaction between musical emotion and facial expression as measured by event-related potentials. Neuropsychologia, 51(3), 500-505. doi: 10.1016/j.neuropsychologia.2012.11.031 pmid: 23220447
[25]	Kawakami, A., & Katahira, K. (2015). Influence of trait empathy on the emotion evoked by sad music and on the preference for it. Frontiers in Psychology, 6, 01541.
[26]	Kim, E. J., Son, J.-W., Park, S. K., Chung, S., Ghim, H.-R., Lee, S.,... Lee, J. (2020). Cognitive and emotional empathy in young adolescents: An fMRI study. Journal of the Korean Academy of Child and Adolescent Psychiatry, 31(3), 121-130. doi: 10.5765/jkacap.200020 URL
[27]	Koelsch, S. (2014). Brain correlates of music-evoked emotions. Neuroscience, 15(3), 170-180.
[28]	Kragness, H. E., & Trainor, L. J. (2019). Nonmusicians express emotions in musical productions using conventional cues. Music & Science, 2, 1-13.
[29]	Ladinig, O., & Schellenberg, E. G. (2012). Liking unfamiliar music: Effects of felt emotion and individual differences. Psychology of Aesthetics, Creativity, and the Arts, 6(2), 146-154. doi: 10.1037/a0024671 URL
[30]	Langeslag, S. J. E., & van Strien, J. W. (2010). Comparable modulation of the late positive potential by emotion regulation in younger and older adults. Journal of Psychophysiology, 24(3), 186-197. doi: 10.1027/0269-8803/a000009 URL
[31]	Lavie, N. (2005). Distracted and confused?: Selective attention under load. Trends in Cognitive Sciences, 9(2), 75-82. pmid: 15668100
[32]	Liang, Z. B., Yang, Y., Zhang, G. Z., Yang, Y. K., Zheng, W. M., & Cao, R. X. (2019). The recognition of bodily expression: An event-related potential study. Studies of Psychology and Behavior, 17(3), 318-325.
	[梁宗保, 杨韵, 张光珍, 杨元魁, 郑文明, 曹睿昕. (2019). 身体表情识别的ERP研究. 心理与行为研究, 17(3), 318-325.]
[33]	Liu, X., Liu, Y., Shi, H., Li, L., & Zheng, M. (2021). Regulation of mindfulness-based music listening on negative emotions related to COVID-19: An ERP study. International Journal of Environmental Research and Public Health, 18(13), 07063.
[34]	Liu, Y., Quan, H., Song, S., Zhang, X., Yang, C., & Chen, H. (2019a). Decreased conflict control in overweight chinese females: Behavioral and event-related potentials evidence. Nutrients, 11(7), 1450.
[35]	Liu, Y., Zhao, J., Zhang, X., Gao, X., Xu, W., & Chen, H. (2019b). Overweight adults are more impulsive than normal weight adults: Evidence from ERPs during a chocolate-related delayed discounting task. Neuropsychologia, 133, 107181.
[36]	Maffei, A., Spironelli, C., & Angrilli, A. (2019). Affective and cortical EEG gamma responses to emotional movies in women with high vs low traits of empathy. Neuropsychologia, 133, 107175.
[37]	Mella, N., Studer, J., Gilet, A.-L., & Labouvie-Vief, G. (2012). Empathy for pain from adolescence through adulthood: An event-related brain potential study. Frontiers in Psychology, 3, 00501.
[38]	Miu, A. C., & Balteş, F. R. (2012). Empathy manipulation impacts music-induced emotions: A psychophysiological study on opera. Plos One, 7(1), e30618.
[39]	Mothes-Lasch, M., Mentzel, H.-J., Miltner, W. H., & Straube, T. (2011). Visual attention modulates brain activation to angry voices. Journal of Neuroscience, 31(26), 9594-9598. doi: 10.1523/JNEUROSCI.6665-10.2011 pmid: 21715624
[40]	Naruse, S., Hashimoto, T., Mori, K., Tsuda, Y., Takahara, M., & Kagami, S. (2013). Developmental changes in facial expression recognition in Japanese school-age children. Journal of Medical Investigation, 60(1-2), 114-120. doi: 10.2152/jmi.60.114 URL
[41]	Pu, H. J. (2021). On the “Invisible structure” of modal scale- degree—An analysis of internal structure mechanism related to the auditory psychology of scale-degree. Journal of Xinghai Conservatory of Music, (1), 5-17.
	[蒲亨建. (2021). 调式音级“隐形结构”论——与音级听觉心理相关的音级内在结构机理分析. 星海音乐学院学报, (1), 5-17.]
[42]	Shamay-Tsoory, S. G. (2011). The neural bases for empathy. Neuroscientist, 17(1), 18-24. doi: 10.1177/1073858410379268 pmid: 21071616
[43]	Sittler, M. C., Cooper, A. J., & Montag, C. (2019). Is empathy involved in our emotional response to music? The role of the PRL gene, empathy, and arousal in response to happy and sad music. Psychomusicology: Music, Mind, and Brain, 29(1), 10-21. doi: 10.1037/pmu0000230 URL
[44]	Steele, J. R. (2019). The relationship between music aptitude, empathy, and sensitivity to emotional prosody: An ERP investigation (Unpublished master’s thesis). Middle Tennessee State University, Ann Arbor.
[45]	Steinbeis, N., & Koelsch, S. (2008). Comparing the processing of music and language meaning using EEG and fMRI provides evidence for similar and distinct neural representations. Plos One, 3(5), e2226. doi: 10.1371/journal.pone.0002226 URL
[46]	Sun, B., Zeng, X. Q., Xu, K. Y., Xie, Y. T., & Fu, S. M. (2022). Neural correlates of consciousness of emotional faces and the unconscious automatic processing: Evidence from event-related potentials (ERPs). Acta Psychologica Sinica, 54(8), 867-880. doi: 10.3724/SP.J.1041.2022.00867 URL
	[孙博, 曾宪卿, 许恺煜, 谢韵婷, 傅世敏. (2022). 情绪面孔的意识神经相关物及其无意识自动加工: 来自事件相关电位的证据. 心理学报, 54(8), 867-880.]
[47]	Trehub, S. E., Becker, J., & Morley, I. (2015). Cross-cultural perspectives on music and musicality. Philosophical Transactions of the Royal Society B: Biological Sciences, 370(1664), 20140096.
[48]	Võ, M. L.-H., & Wolfe, J. M. (2013). Differential electrophysiological signatures of semantic and syntactic scene processing. Psychological Science, 24(9), 1816-1823. doi: 10.1177/0956797613476955 pmid: 23842954
[49]	Vuilleumier, P. (2005). How brains beware: Neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585-594. doi: 10.1016/j.tics.2005.10.011 pmid: 16289871
[50]	Vuoskoski, J. K., & Eerola, T. (2011). Measuring music-induced emotion: A comparison of emotion models, personality biases, and intensity of experiences. Musicae Scientiae, 15(2), 159-173. doi: 10.1177/1029864911403367 URL
[51]	Wallmark, Z., Deblieck, C., & Iacoboni, M. (2018). Neurophysiological effects of trait empathy in music listening. Frontiers in Behavioral Neuroscience, 12, 66. doi: 10.3389/fnbeh.2018.00066 pmid: 29681804
[52]	Webster, G. D., & Weir, C. G. (2005). Emotional responses to music: Interactive effects of mode, texture, and tempo. Motivation and Emotion, 29(1), 19-39. doi: 10.1007/s11031-005-4414-0 URL
[53]	Wöllner, C. (2012). Is empathy related to the perception of emotional expression in music? A multimodal time-series analysis. Psychology of Aesthetics, Creativity, and the Arts, 6(3), 214-223. doi: 10.1037/a0027392 URL
[54]	Yuan, J. (2009). Emotional valence intensity effect and its neural correlates(Unpublished doctorial dissertation). Southwest University, Chongqing, China.
	[袁加锦. (2009). 情绪效价强度效应及神经机制研究 (博士学位论文). 西南大学, 重庆.]
[55]	Zentner, M., Grandjean, D., & Scherer, K. R. (2008). Emotions evoked by the sound of music: Characterization, classification, and measurement. Emotion, 8(4), 494-521. doi: 10.1037/1528-3542.8.4.494 pmid: 18729581
[56]	Zhang, Q., Li, X., Gold, B. T., & Jiang, Y. (2010). Neural correlates of cross-domain affective priming. Brain Research, 1329, 142-151. doi: 10.1016/j.brainres.2010.03.021 pmid: 20298681
[57]	Zhao, H. Y., Jiang, J., Zhou, L. S., & Jiang, C. M. (2019). Role of the human mirror system in automatic processing of musical emotion: Evidence from EEG. Acta Psychologica Sinica, 51(7), 795-804. doi: 10.3724/SP.J.1041.2019.00795 URL
	[赵怀阳, 江俊, 周临舒, 蒋存梅. (2019). 人类镜像系统参与音乐情绪的自动加工: 来自EEG的证据. 心理学报, 51(7), 795-804.]
[58]	Zhu, J., Wang, X. Q., He, X., Hu, Y.-Y., Li, F., Liu, M.-F., & Ye, B. (2019). Affective and cognitive empathy in pre-teachers with strong or weak professional identity: An ERP study. Frontiers in Human Neuroscience, 13, 00175. doi: 10.3389/fnhum.2019.00175 URL