ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

心理科学进展 ›› 2022, Vol. 30 ›› Issue (7): 1524-1535.doi: 10.3724/SP.J.1042.2022.01524

• 研究前沿 • 上一篇    下一篇

情感代理能否提高多媒体学习的效果?

王燕青, 龚少英(), 姜甜甜, 吴亚男   

  1. 青少年网络心理与行为教育部重点实验室, 华中师范大学心理学院, 武汉 430079
  • 收稿日期:2021-08-24 出版日期:2022-07-15 发布日期:2022-05-17
  • 通讯作者: 龚少英 E-mail:gongsy@ccnu.edu.cn
  • 基金资助:
    国家自然科学基金面上项目(#61877025);青少年网络心理与行为教育部重点实验室/人的发展与心理健康湖北省重点实验室开放课题(#2019B04)

Can affective pedagogical agent facilitate multimedia learning?

WANG Yanqing, GONG Shaoying(), JIANG Tiantian, Wu Yanan   

  1. Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education;School of Psychology, Central China Normal University, Wuhan 430079, China
  • Received:2021-08-24 Online:2022-07-15 Published:2022-05-17
  • Contact: GONG Shaoying E-mail:gongsy@ccnu.edu.cn

摘要:

近年来,情感代理如何影响学习受到了研究者们的高度重视。情感代理是可以通过面部表情、声音、肢体动作和言语信息等影响学习者情感体验的教学代理。以往研究主要关注两种类型的情感代理:表达型情感代理和移情型情感代理。表达型情感代理是仅通过自身的情绪表达(如:使用微笑的面部表情和热情的声音)以影响学习者情绪体验的代理。移情型情感代理则是能根据学习者的学习表现或情绪状态给予情感反馈(如;点头、鼓励和共情)的代理,其目的是为了调节学习者的情绪、激励其继续努力。虽然不同的研究者对情感代理的具体操作有所不同,但无论哪种类型的情感代理均是为了增加学习者的积极情绪,提高内部动机,最终促进学习。关于情感代理的潜在作用,研究者基于不同的理论观点给出了不同的解释。情绪感染理论认为一个人的情绪状态容易受到另一个人情绪表达的影响,因此界面代理的情绪会直接影响学习者的情绪和动机。情绪反应理论认为如果教师的言语和非言语线索诱发了积极的情绪,学习者就会产生趋近学习的行为(例如,制定相应的学习计划)。多媒体学习认知情感理论强调了学习过程中情感和动机的重要性。基于多媒体学习认知情感理论,情感代理能唤起学习者的积极情绪,增加学习动机,进而提高学习成绩。而认知负荷理论和干扰理论却认为情感代理丰富的面部表情和手势动作可能会增加学习者的外部认知负荷,吸引学习者的注意力,减少对关键信息的注意,因此干扰学习效果。在上述理论的指导下,研究者们对情感代理的效果进行了探究,结果发现,情感代理可以有效地唤起学习者的积极情绪(d积极情绪= 0.45),提高学习动机(d内部动机= 0.52)。但不一定能影响认知负荷(d内部认知负荷 = -0.01;d外部认知负荷 = 0.09;d相关认知负荷 = 0.08),并且在学习效果上的作用也比较微弱(d保持 = 0.18;d理解 = 0.32;d迁移 = 0.14;d联合 = 0.32)。情感代理在学习效果上的作用不稳健的原因可能是受到了潜在调节因素的影响。例如,学习者的个体特征(如,工作记忆能力和年级水平)、情感代理的类型、任务特征和测验时间等。总之,尽管目前关于情感代理的研究结果存在不一致,但整体而言,在积极情感代理条件下,学习者更加快乐,更有动力。因此,在教育实践中,教学设计者可以考虑为学习者呈现一个积极的教学代理以帮助他们更加快乐地学习。未来关于情感代理的研究需要继续关注情感代理的操纵和评定方法;探究影响情感代理效果的边界条件;考察情感代理影响学习背后的神经机制;提高情感代理研究的生态效度等。

关键词: 情感代理, 情绪, 内部动机, 学习结果, 多媒体学习

Abstract:

In recent years, with the development of computer technology and intelligent tutoring systems, educational psychologists have paid much attention to the effect of adding an affective pedagogical agent (PA) to multimedia learning. Affective PA is a type of agent that is designed to elicit certain affective experiences in learners through multiple modalities such as facial expressions, voices, and gestures. Previous studies mainly focused on two types of affective PA: expressive affective PA and empathic affective PA. Expressive affective PAs are agents that affect learners' emotional experiences only through emotional expression (e.g., using smiling facial expressions and enthusiastic voices). Empathic emotional agents are agents with the goal to encourage and persuade learners to make greater effort by giving emotional feedback (such as nodding, encouragement, and additional remarks) according to the learner's emotional states. Although previous studies differed in the specific manipulation of affective PAs, no matter what type of affective PA is designed to increase the positive emotions in learners, improve internal motivation, and ultimately promote learning. Five theories were used to explain the effectiveness of affective PAs in multimedia learning environments. Emotional contagion theory holds that the emotional state of one person is automatically affected by another person's emotional expression. When learning with a smiling pedagogical agent, students are more likely to experience more positive emotions and higher motivation. Emotional response theory proposes that pedagogical agents with enthusiastic voices, smiling faces, and expressive gestures could elicit positive emotional responses in learners and promote them to engage in learning-related activities. The cognitive affective theory of learning with media (CATLM) emphasizes the importance of emotions and motivation in the learning process. Based on the CATLM, the cognitive-affective model of learning with instructional video states that when pedagogical agents display positive emotions during online learning, learners may experience four key steps: (1) the learners first need to recognize the PA’s positive emotions; (2) the learners respond to the PA’s affective stances (such as feeling the same emotions as the affective PAs); (3) the learners’ positive emotions improve the level of motivation to engage in deep cognitive processing; (4) the motivational states lead to better learning outcomes. However, cognitive load theory and interference theory hold the opposite opinion that affective agents may increase external cognitive load and distract learners from relevant information. Accordingly, learners no longer focus their full attention on the learning content and become distracted by the presence of the affective PAs, which may interfere learning. Guided by previous theories, a large number of studies have examined the role of affective pedagogical agents in multimedia learning. Most empirical studies found that affective pedagogical agents positively affect the learners’ emotions (d positive emotions = 0.45) and motivations (d intrinsic motivation = 0.52). Nevertheless, affective pedagogical agents have weak effects on cognitive load(d intrinsic cognitive load = -0.01;d external cognitive load = 0.09;d germane cognitive load = 0.08)and learning performance (d retention = 0.18, d comprehension = 0.32, d transfer = 0.14,d unite = 0.32). Previous studies showed that adding affective PA to multimedia lessons does not lead to stable improvement in learning performance, which may be due to the potential moderating variables. In the current study, we identified several potential factors that may moderate the effects of affective PA, such as learners’ individual characteristics (e.g., learner’s working memory and grade levels), the types of affective PAs, learning domain, and the way of tests. In conclusion, adding affective PA is regarded as a promising approach for education because of its potential to help students keep motivated during learning. Therefore, in educational practice, instructional designers can consider presenting a positive affective PA for learners to help them learn more happily. Further research should focus on the manipulation and evaluation methods, boundary conditions, underlying mechanisms, and ecological validity, etc.

Key words: affective pedagogical agent, positive emotions, motivation, learning performance, multimedia learning

中图分类号: