心理科学进展 ›› 2025, Vol. 33 ›› Issue (1): 1-10.doi: 10.3724/SP.J.1042.2025.0001
• 研究构想 • 下一篇
收稿日期:
2024-05-28
出版日期:
2025-01-15
发布日期:
2024-10-28
通讯作者:
方霞, E-mail: x.fang@zju.edu.cn基金资助:
Received:
2024-05-28
Online:
2025-01-15
Published:
2024-10-28
摘要:
现实生活中, 面部表情通常随时间推移呈动态变化, 个体对任一表情的解读都可能受其所处的动态序列情境的影响。尽管近年来有研究表明同时呈现的情境信息会对目标表情的知觉产生影响, 但对于序列变化的表情信息如何影响目标表情知觉却知之甚少。本研究拟通过行为实验和眼动技术, 借助人工合成和真人表演的动态表情, 考察序列变化的表情信息(即动态序列情境)对初始表情和最终表情的知觉的影响及其作用机制。研究成果有助于揭示生态化情境下的面部表情加工机制, 为基于人工智能的动态表情识别提供参考。
中图分类号:
方霞, 潘之禾. (2025). 动态序列情境对面部表情知觉的影响和作用机制. 心理科学进展 , 33(1), 1-10.
FANG Xia, PAN Zhihe. (2025). The impact of dynamic sequential context on facial expression perception and the underlying mechanisms. Advances in Psychological Science, 33(1), 1-10.
图1 本研究项目的框架示意 注: 实线框表示本研究中拟考察的机制, 而点状虚线框表示未在本研究中探讨但可能导致动态序列效应的其他可能机制。其中, “参照信息使用方式”指的是参照信息(即初始表情)是用于构建评估对象(即最终表情)的心理表征, 从而产生同化效应, 还是用于构建评估标准, 从而产生对比效应(Bless & Schwarz, 2010)。这种参照信息使用方式可能受到初始表情和最终表情相似度的调节(Hsu & Yang, 2013)。“未来情绪状态预期”则指观察者基于即时感知历史对表达者未来情绪状态的有意或无意的预期, 可能会影响观察者对表达者最终情绪状态的判断(Jellema et al., 2011; Palumbo & Jellema, 2013)。这两种可能机制的详细描述将在理论建构部分进一步阐述。
[1] |
Adolphs, R. (2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1(1), 21-62. https://doi.org/10.1177/1534582302001001003
URL pmid: 17715585 |
[2] |
Aviezer, H., Ensenberg, N., & Hassin, R. R. (2017). The inherently contextualized nature of facial emotion perception. Current Opinion in Psychology, 17, 47-54. https://doi.org/10.1016/j.copsyc.2017.06.006
doi: S2352-250X(17)30043-X URL pmid: 28950972 |
[3] |
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019). Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological Science in the Public Interest, 20(1), 1-68. https://doi.org/10.1177/1529100619832930
doi: 10.1177/1529100619832930 URL pmid: 31313636 |
[4] | Beaudry, O., Roy-Charland, A., Perron, M., Cormier, I., & Tapp, R. (2014). Featural processing in recognition of emotional facial expressions. Cognition and Emotion, 28(3), 416-432. https://doi.org/10.1080/02699931.2013.833500 |
[5] | Bless, H., & Schwarz, N. (2010). Mental construal and the emergence of assimilation and contrast effects:The inclusion/exclusion model. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 42, pp. 319-373). Academic Press. https://doi.org/10.1016/S0065-2601(10)42006-7 |
[6] | Bould, E., Morris, N., & Wink, B. (2008). Recognising subtle emotional expressions: The role of facial movements. Cognition and Emotion, 22(8), 1569-1587. https://doi.org/10.1080/02699930801921156 |
[7] | Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26(2), 527-551. https://doi.org/10.1037/0096-1523.26.2.527 |
[8] | Chen, C., Garrod, O. G. B., Ince, R. A. A., Schyns, P. G., & Jack, R. E. (2021). Facial expressions reveal cross-cultural variance in emotion signaling. Journal of Vision, 21(9), 2500. https://doi.org/10.1167/jov.21.9.2500 |
[9] | Chen, C., Messinger, D. S., Chen, C., Yan, H., Duan, Y., Ince, R. A. A., Garrod, O. G. B., Schyns, P. G., & Jack, R. E. (2024). Cultural facial expressions dynamically convey emotion category and intensity information. Current Biology, 34(1), 213-223.e5. https://doi.org/10.1016/j.cub.2023.12.001 |
[10] | Chen, L. F., & Yen, Y. S. (2007). Taiwanese facial expression image database. Brain Mapping Laboratory, Institute of Brain Science, “National” Yang-Ming University, Taipei, Taiwan, China. |
[11] |
Cordaro, D. T., Sun, R., Keltner, D., Kamble, S., Huddar, N., & McNeil, G. (2018). Universals and cultural variations in 22 emotional expressions across five cultures. Emotion, 18(1), 75-93. https://doi.org/10.1037/emo0000302
doi: 10.1037/emo0000302 URL pmid: 28604039 |
[12] | Cosker, D., Krumhuber, E., & Hilton, A. (2015). Perceived emotionality of linear and non-linear AUs synthesised using a 3D dynamic morphable facial model. Proceedings of the Facial Analysis and Animation, 1. https://doi.org/10.1145/2813852.2813859 |
[13] | Cowen, A. S., Keltner, D., Schroff, F., Jou, B., Adam, H., & Prasad, G. (2021). Sixteen facial expressions occur in similar contexts worldwide. Nature, 589(7841), 251-257. https://doi.org/10.1038/s41586-020-3037-7 |
[14] |
Dobs, K., Bülthoff, I., Breidt, M., Vuong, Q. C., Curio, C., & Schultz, J. (2014). Quantifying human sensitivity to spatio-temporal information in dynamic faces. Vision Research, 100, 78-87. https://doi.org/10.1016/j.visres.2014.04.009
doi: 10.1016/j.visres.2014.04.009 URL pmid: 24784699 |
[15] |
Eisenbarth, H., & Alpers, G. W. (2011). Happy mouth and sad eyes: Scanning emotional facial expressions. Emotion, 11(4), 860-865. https://doi.org/10.1037/a0022758
doi: 10.1037/a0022758 URL pmid: 21859204 |
[16] | Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6(3-4), 169-200. https://doi.org/10.1080/02699939208411068 |
[17] | Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial action coding system (2nd ed.). Salt Lake City, UT: Research Nexus eBook. |
[18] |
Elfenbein, H. A., Beaupré, M., Lévesque, M., & Hess, U. (2007). Toward a dialect theory: Cultural differences in the expression and recognition of posed facial expressions. Emotion, 7(1), 131-146. https://doi.org/10.1037/1528-3542.7.1.131
doi: 10.1037/1528-3542.7.1.131 URL pmid: 17352569 |
[19] | Fang, X., Liu, W., & Kawakami, K. (2024). Evaluating past emotions in changing facial expressions: The role of current emotions and culture. Emotion, 24(1), 213-224. https://doi.org/10.1037/emo0001263 |
[20] | Fang, X., Sauter, D. A., Heerdink, M. W., & Van Kleef, G. A. (2022). Culture shapes the distinctiveness of posed and spontaneous facial expressions of anger and disgust. Journal of Cross-Cultural Psychology, 53(5), 471-487. https://doi.org/10.1177/00220221221095208 |
[21] |
Fang, X., Sauter, D. A., & Van Kleef, G. A. (2018). Seeing mixed emotions: The specificity of emotion perception from static and dynamic facial expressions across cultures. Journal of Cross-Cultural Psychology, 49(1), 130-148. https://doi.org/10.1177/0022022117736270
doi: 10.1177/0022022117736270 URL pmid: 29386689 |
[22] | Fang, X., Van Kleef, G. A., Kawakami, K., & Sauter, D. A. (2021). Cultural differences in perceiving transitions in emotional facial expressions: Easterners show greater contrast effects than westerners. Journal of Experimental Social Psychology, 95, 104143. https://doi.org/10.1016/j.jesp.2021.104143 |
[23] | Fang, X., Van Kleef, G. A., & Sauter, D. A. (2018). Person perception from changing emotional expressions: Primacy, recency, or averaging effect? Cognition and Emotion, 32(8), 1597-1610. https://doi.org/10.1080/02699931.2018.1432476 |
[24] |
Fang, X., Van Kleef, G. A., & Sauter, D. A. (2019). Revisiting cultural differences in emotion perception between easterners and westerners: Chinese perceivers are accurate, but see additional non-intended emotions in negative facial expressions. Journal of Experimental Social Psychology, 82, 152-159. https://doi.org/10.1016/j.jesp.2019.02.003
doi: 10.1016/j.jesp.2019.02.003 URL |
[25] |
Gendron, M., Crivelli, C., & Barrett, L. F. (2018). Universality reconsidered: Diversity in making meaning of facial expressions. Current Directions in Psychological Science, 27(4), 211-219. https://doi.org/10.1177/0963721417746794
doi: 10.1177/0963721417746794 URL pmid: 30166776 |
[26] | Hassin, R. R., Aviezer, H., & Bentin, S. (2013). Inherently ambiguous: Facial expressions of emotions, in context. Emotion Review, 5(1), 60-65. https://doi.org/10.1177/1754073912451331 |
[27] | Herr, P. M., Sherman, S. J., & Fazio, R. H. (1983). On the consequences of priming: Assimilation and contrast effects. Journal of Experimental Social Psychology, 19(4), 323-340. https://doi.org/10.1016/0022-1031(83)90026-4 |
[28] | Hess, U., & Kleck, R. E. (1990). Differentiating emotion elicited and deliberate emotional facial expressions. European Journal of Social Psychology, 20(5), 369-385. https://doi.org/10.1002/ejsp.2420200502 |
[29] | Hsu, S.-M., & Wu, Z.-R. (2020). The roles of preceding stimuli and preceding responses on assimilative and contrastive sequential effects during facial expression perception. Cognition and Emotion, 34(5), 890-905. https://doi.org/10.1080/02699931.2019.1696752 |
[30] | Hsu, S.-M., & Yang, L.-X. (2013). Sequential effects in facial expression categorization. Emotion, 13(3), 573-586. https://doi.org/10.1037/a0027285 |
[31] | Hsu, S.-M., & Young, A. W. (2004). Adaptation effects in facial expression recognition. Visual Cognition, 11(7), 871-899. https://doi.org/10.1080/13506280444000030 |
[32] | Hubbard, T. L. (2005). Representational momentum and related displacements in spatial memory: A review of the findings. Psychonomic Bulletin & Review, 12(5), 822-851. https://doi.org/10.3758/BF03196775 |
[33] |
Jack, R. E., Garrod, O. G. B., & Schyns, P. G. (2014). Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time. Current Biology, 24(2), 187-192. https://doi.org/10.1016/j.cub.2013.11.064
doi: 10.1016/j.cub.2013.11.064 URL pmid: 24388852 |
[34] | Jack, R. E., Sun, W., Delis, I., Garrod, O. G. B., & Schyns, P. G. (2016). Four not six: Revealing culturally common facial expressions of emotion. Journal of Experimental Psychology: General, 145(6), 708-730. https://doi.org/10.1037/xge0000162 |
[35] | Jellema, T., Pecchinenda, A., Palumbo, L., & Tan, E. G. (2011). Biases in the perception and affective valence of neutral facial expressions induced by the immediate perceptual history. Visual Cognition, 19(5), 616-634. https://doi.org/10.1080/13506285.2011.569775 |
[36] | Johnson, M. K., & Sherman, S. J. (1990). Constructing and reconstructing the past and the future in the present. In R. M. Sorrentino & E. T. Higgins (Eds.), Handbook of motivation and cognition: Foundations of social behavior (Vol. 2, pp. 482-526). The Guilford Press. |
[37] |
Keltner, D., Tracy, J. L., Sauter, D., & Cowen, A. (2019). What basic emotion theory really says for the twenty-first century study of emotion. Journal of Nonverbal Behavior, 43(2), 195-201. https://doi.org/10.1007/s10919-019-00298-y
doi: 10.1007/s10919-019-00298-y URL pmid: 31404243 |
[38] | Krejtz, K., Wisiecka, K., Krejtz, I., Holas, P., Olszanowski, M., & Duchowski, A. T. (2018). Dynamics of emotional facial expression recognition in individuals with social anxiety. Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications, 1-9. https://doi.org/10.1145/3204493.3204533 |
[39] | Krumhuber, E. G., Kappas, A., & Manstead, A. S. R. (2013). Effects of dynamic aspects of facial expressions: A review. Emotion Review, 5(1), 41-46. https://doi.org/10.1177/1754073912451349 |
[40] |
Krumhuber, E. G., & Scherer, K. R. (2011). Affect bursts: Dynamic patterns of facial expression. Emotion, 11(4), 825-841. https://doi.org/10.1037/a0023856
doi: 10.1037/a0023856 URL pmid: 21707163 |
[41] | Krumhuber, E. G., & Scherer, K. R. (2016). The look of fear from the eyes varies with the dynamic sequence of facial actions. Swiss Journal of Psychology, 75(1), 5-14. https://doi.org/10.1024/1421-0185/a000166 |
[42] | Krumhuber, E. G., Skora, L. I., Hill, H. C. H., & Lander, K. (2023). The role of facial movements in emotion recognition. Nature Reviews Psychology, 2, 283-296. https://doi.org/10.1038/s44159-023-00172-1 |
[43] | Levine, L. J. (1997). Reconstructing memory for emotions. Journal of Experimental Psychology: General, 126(2), 165-177. https://doi.org/10.1037/0096-3445.126.2.165 |
[44] | Levine, L. J., Lench, H. C., Karnaze, M. M., & Carlson, S. J. (2018). Bias in predicted and remembered emotion. Current Opinion in Behavioral Sciences, 19, 73-77. https://doi.org/10.1016/j.cobeha.2017.10.008 |
[45] | Levine, L. J., & Safer, M. A. (2002). Sources of bias in memory for emotions. Current Directions in Psychological Science, 11(5), 169-173. https://doi.org/10.1111/1467-8721.00193 |
[46] | Liu, M., Duan, Y., Ince, R. A. A., Chen, C., Garrod, O. G. B., Schyns, P. G., & Jack, R. E. (2022). Facial expressions elicit multiplexed perceptions of emotion categories and dimensions. Current Biology, 32(1), 200-209.e6. https://doi.org/10.1016/j.cub.2021.10.035 |
[47] |
Maringer, M., Krumhuber, E. G., Fischer, A. H., & Niedenthal, P. M. (2011). Beyond smile dynamics: Mimicry and beliefs in judgments of smiles. Emotion, 11(1), 181-187. https://doi.org/10.1037/a0022596
doi: 10.1037/a0022596 URL pmid: 21401238 |
[48] |
McClure, E. B., Pope, K., Hoberman, A. J., Pine, D. S., & Leibenluft, E. (2003). Facial expression recognition in adolescents with mood and anxiety disorders. American Journal of Psychiatry, 160(6), 1172-1174. https://doi.org/10.1176/appi.ajp.160.6.1172
URL pmid: 12777278 |
[49] |
Nelson, N. L., & Russell, J. A. (2014). Dynamic facial expressions allow differentiation of displays intended to convey positive and hubristic pride. Emotion, 14(5), 857-864. https://doi.org/10.1037/a0036789
doi: 10.1037/a0036789 URL pmid: 24866524 |
[50] | Palumbo, L., & Jellema, T. (2013). Beyond face value: Does involuntary emotional anticipation shape the perception of dynamic facial expressions? PLoS ONE, 8(2), e56003. https://doi.org/10.1371/journal.pone.0056003 |
[51] | Porter-Vignola, E., Booij, L., Bossé-Chartier, G., Garel, P., & Herba, C. M. (2021). Emotional facial expression recognition and depression in adolescent girls: Associations with clinical features. Psychiatry Research, 298, 113777. https://doi.org/10.1016/j.psychres.2021.113777 |
[52] | Prigent, E., Amorim, M.-A., & de Oliveira, A. M. (2018). Representational momentum in dynamic facial expressions is modulated by the level of expressed pain: Amplitude and direction effects. Attention, Perception, & Psychophysics, 80(1), 82-93. https://doi.org/10.3758/s13414-017-1422-6 |
[53] | Ross, M., McFarland, C., & Fletcher, G. J. (1981). The effect of attitude on the recall of personal histories. Journal of Personality and Social Psychology, 40(4), 627-634. https://doi.org/10.1037/0022-3514.40.4.627 |
[54] | Russell, J. A., & Fehr, B. (1987). Relativity in the perception of emotion in facial expressions. Journal of Experimental Psychology: General, 116(3), 223-237. https://doi.org/10.1037/0096-3445.116.3.223 |
[55] |
Rychlowska, M., Jack, R. E., Garrod, O. G. B., Schyns, P. G., Martin, J. D., & Niedenthal, P. M. (2017). Functional smiles: Tools for love, sympathy, and war. Psychological Science, 28(9), 1259-1270. https://doi.org/10.1177/0956797617706082
doi: 10.1177/0956797617706082 URL pmid: 28741981 |
[56] | Rychlowska, M., Miyamoto, Y., Matsumoto, D., Hess, U., Gilboa-Schechtman, E., Kamble, S., … Niedenthal, P. M. (2015). Heterogeneity of long-history migration explains cultural differences in reports of emotional expressivity and the functions of smiles. Proceedings of the National Academy of Sciences, 112(19), E2429-E2436. https://doi.org/10.1073/pnas.1413661112 |
[57] |
Safer, M. A., & Keuler, D. J. (2002). Individual differences in misremembering pre-psychotherapy distress: Personality and memory distortion. Emotion, 2(2), 162-178. https://doi.org/10.1037/1528-3542.2.2.162
URL pmid: 12899189 |
[58] |
Senior, C., Hassel, S., Waheed, A., & Ridout, N. (2020). Naming emotions in motion: Alexithymic traits impact the perception of implied motion in facial displays of affect. Emotion, 20(2), 311-316. https://doi.org/10.1037/emo0000546
doi: 10.1037/emo0000546 URL pmid: 30604977 |
[59] |
Sowden, S., Schuster, B. A., Keating, C. T., Fraser, D. S., & Cook, J. L. (2021). The role of movement kinematics in facial emotion expression production and recognition. Emotion, 21(5), 1041-1061. https://doi.org/10.1037/emo0000835
doi: 10.1037/emo0000835 URL pmid: 33661668 |
[60] | Thornton, I. M. (2014). Representational momentum and the human face: An empirical note. Xjenza Online, 2(2), 101-110. https://doi.org/10.7423/XJENZA.2014.2.09 |
[61] | Uono, S., Sato, W., & Toichi, M. (2014). Reduced representational momentum for subtle dynamic facial expressions in individuals with autism spectrum disorders. Research in Autism Spectrum Disorders, 8(9), 1090-1099. https://doi.org/10.1016/j.rasd.2014.05.018 |
[62] | Van Boven, L., White, K., & Huber, M. (2009). Immediacy bias in emotion perception: Current emotions seem more intense than previous emotions. Journal of Experimental Psychology: General, 138(3), 368-382. https://doi.org/10.1037/a0016074 |
[63] | Webster, M. A., Kaping, D., Mizokami, Y., & Duhamel, P. (2004). Adaptation to natural facial categories. Nature, 428(6982), 557-561. https://doi.org/10.1038/nature02420 |
[64] | Webster, M. A., & MacLeod, D. I. A. (2011). Visual adaptation and face perception. Philosophical Transactions of the Royal Society B: Biological Sciences, 366(1571), 1702-1725. https://doi.org/10.1098/rstb.2010.0360 |
[65] | Wincenciak, J., Palumbo, L., Epihova, G., Barraclough, N. E., & Jellema, T. (2022). Are adaptation aftereffects for facial emotional expressions affected by prior knowledge about the emotion? Cognition and Emotion, 36(4), 602-615. https://doi.org/10.1080/02699931.2022.2031907 |
[66] |
Ying, H., & Xu, H. (2017). Adaptation reveals that facial expression averaging occurs during rapid serial presentation. Journal of Vision, 17(1), 15. https://doi.org/10.1167/17.1.15
doi: 10.1167/17.1.15 URL pmid: 28114490 |
[67] | Yitzhak, N., Pertzov, Y., Guy, N., & Aviezer, H. (2022). Many ways to see your feelings: Successful facial expression recognition occurs with diverse patterns of fixation distributions. Emotion, 22(5), 844-860. https://doi.org/10.1037/emo0000812 |
[68] | Yoshikawa, S., & Sato, W. (2008). Dynamic facial expressions of emotion induce representational momentum. Cognitive, Affective, & Behavioral Neuroscience, 8(1), 25-31. https://doi.org/10.3758/CABN.8.1.25 |
[69] | Zheng, Y., & Hsiao, J. H. (2023). Differential audiovisual information processing in emotion recognition: An eye-tracking study. Emotion, 23(4), 1028-1039. https://doi.org/10.1037/emo0001144 |
[1] | 朱丽雅, 莫凡, 张志豪, 赵科, 傅小兰. 同步与否:婴儿基本面部表情识别的发展特点[J]. 心理科学进展, 2023, 31(9): 1688-1697. |
[2] | 谢志鹏, 赵晶, 汪涛. 消费者一定偏爱“笑脸”吗?产品外观中的表情元素对消费者的影响[J]. 心理科学进展, 2020, 28(8): 1256-1272. |
[3] | 丁小斌, 刘建邑, 王亚鹏, 康铁君, 党宸. 情绪变化的自动化加工:来自EMMN的启示[J]. 心理科学进展, 2020, 28(1): 85-97. |
[4] | 张倩, 陈林林, 杨群. 审判决策过程中的面孔特征效应[J]. 心理科学进展, 2018, 26(4): 698-709. |
[5] | 丁小斌, 康铁君, 赵鑫, 付军军. 躯体表情与面部表情加工进程比较[J]. 心理科学进展, 2018, 26(3): 423-432. |
[6] | 曲方炳; 傅小兰. 面部表情的自我觉察[J]. 心理科学进展, 2016, 24(Suppl.): 88-. |
[7] | 张琪;尹天子;冉光明. 动态面孔表情优势效应的心理机制及神经基础[J]. 心理科学进展, 2015, 23(9): 1514-1522. |
[8] | 邱方晖;罗跃嘉;贾世伟. 面部表情的类别知觉及其个体差异[J]. 心理科学进展, 2015, 23(6): 946-958. |
[9] | 徐展;李灿举. 情绪面孔搜索不对称性:情绪观与知觉观的争议[J]. 心理科学进展, 2014, 22(2): 259-268. |
[10] | 侠牧;李雪榴;叶春; 李红. 面部表情加工的ERP成分[J]. 心理科学进展, 2014, 22(10): 1556-1563. |
[11] | 刘宏艳;胡治国. 社交焦虑者的面部表情加工[J]. 心理科学进展, 2013, 21(11): 1927-1938. |
[12] | 雷婕;丁亚平. 面部表情:一些争论[J]. 心理科学进展, 2013, 21(10): 1749-1754. |
[13] | 韦程耀;赵冬梅. 面部表情的跨文化表达与识别研究述评[J]. 心理科学进展, 2012, 20(10): 1614-1622. |
[14] | 杨昭宁;侯书伟. 基于候选人面孔的特质推理与投票决策[J]. 心理科学进展, 2011, 19(7): 1047-1053. |
[15] | 张秋颖;陈建文;于全磊;辛鹏. 情绪识别中的群内优势效应[J]. 心理科学进展, 2011, 19(2): 209-216. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||