ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

心理科学进展 ›› 2025, Vol. 33 ›› Issue (1): 1-10.doi: 10.3724/SP.J.1042.2025.0001

• 研究构想 •    下一篇

动态序列情境对面部表情知觉的影响和作用机制

方霞, 潘之禾   

  1. 浙江大学心理与行为科学系, 杭州 310058
  • 收稿日期:2024-05-28 出版日期:2025-01-15 发布日期:2024-10-28
  • 基金资助:
    * 国家自然科学基金青年项目(32300908)资助

The impact of dynamic sequential context on facial expression perception and the underlying mechanisms

FANG Xia, PAN Zhihe   

  1. Department of Psychology and Behavioral Science, Zhejiang University, Hangzhou 310058, China
  • Received:2024-05-28 Online:2025-01-15 Published:2024-10-28

摘要: 现实生活中, 面部表情通常随时间推移呈动态变化, 个体对任一表情的解读都可能受其所处的动态序列情境的影响。尽管近年来有研究表明同时呈现的情境信息会对目标表情的知觉产生影响, 但对于序列变化的表情信息如何影响目标表情知觉却知之甚少。本研究拟通过行为实验和眼动技术, 借助人工合成和真人表演的动态表情, 考察序列变化的表情信息(即动态序列情境)对初始表情和最终表情的知觉的影响及其作用机制。研究成果有助于揭示生态化情境下的面部表情加工机制, 为基于人工智能的动态表情识别提供参考。

关键词: 面部表情, 情绪知觉, 动态序列情境

Abstract: In real-life situations, facial expressions often change dynamically over time. An individual's interpretation of a facial expression may be influenced by its dynamic sequential context. While previous research has shown that simultaneously presented contextual information affects the perception of target expressions, little is known about the effect of sequential changes in facial expressions. The present research aims to systematically investigate how dynamic sequential context shapes the perception of current and past expressions, from both phenomenological and mechanistic perspectives, thereby providing new insights for facial expression processing.
Existing evidence suggests that when dynamic facial expressions transition from a past to a current expression, the perception of the current expression tends to shift in the opposite direction of the valence of the past expression (i.e., a contrast effect; Fang et al., 2021; Hsu & Young, 2004; Russell & Fehr, 1987). However, these studies have primarily used ambiguous current expressions (e.g., neutral faces) or morphed dynamic expressions. It remains unclear whether the past expression would still influence the perception of current expressions that convey clear emotional meaning (e.g., prototypical sad expressions) or when using authentic, human-performed dynamic expressions.
On the other hand, the dynamic sequential context might also influence how individuals perceive the past expression in a dynamic display. Previous research indicates that individuals tend to reconstruct past emotional experiences based on their current emotion state (Levine, 1997; Levine et al., 2018; Levine & Safer, 2002; Van Boven et al., 2009). Yet, little is known about whether similar phenomena occur in the perception of past expressions of a dynamic display (but see Fang et al., 2024). We propose that current expressions might serve as a “recall filter” for the reconstruction of past expressions, such that individuals use the emotional features of the current expression to interpret the past expression, leading to an assimilation effect.
Furthermore, the present research aims to examine the underlying mechanisms of these dynamic sequential effects. We hypothesize that the magnitude of the contrast and assimilation effects may be correlated with the attention individuals allocate to the emotional features of the past and current expressions, respectively. Specifically, we propose that increased attention to the emotional features of the past expression may strengthen the adaptation aftereffects, thereby enhancing the contrast effect in the perception of current expressions. Conversely, increased attention to the emotional features of the current expression may strengthen the "recall filter," leading to a stronger assimilation effect in the perception of the past expression. In addition, the dynamic sequential effects may be related to representational momentum, such that faster changing speeds might enhance representational momentum, thereby increasing the contrast effect when perceiving current expressions and the assimilation effect when perceiving past expressions.
To investigate these issues, the present research will consist of a series of studies. Study 1a will explore the generalizability of dynamic sequential effects on the perception of current expressions by manipulating the emotional ambiguity of current expressions and using both artificially synthesized and human-performed dynamic facial expressions. Studies 1b~1d will investigate the roles of adaptation aftereffects and representational momentum in the dynamic sequential effects when perceiving current expressions. Study 2a will examine how current expressions influence the perception of past expressions, using facial stimuli with varying emotional ambiguity and authenticity. Studies 2b~2d will examine the roles of recall filter and representational momentum in the dynamic sequential effects when perceiving past expressions. The findings of this research will contribute to our understanding of facial expression processing in ecological contexts and provide insights for AI-based dynamic facial expression recognition systems.

Key words: facial expression, emotion perception, dynamic sequential context

中图分类号: