心理科学进展 ›› 2022, Vol. 30 ›› Issue (7): 1524-1535.doi: 10.3724/SP.J.1042.2022.01524
收稿日期:
2021-08-24
出版日期:
2022-07-15
发布日期:
2022-05-17
通讯作者:
龚少英
E-mail:gongsy@ccnu.edu.cn
基金资助:
WANG Yanqing, GONG Shaoying(), JIANG Tiantian, Wu Yanan
Received:
2021-08-24
Online:
2022-07-15
Published:
2022-05-17
Contact:
GONG Shaoying
E-mail:gongsy@ccnu.edu.cn
摘要:
近年来,情感代理如何影响学习受到了研究者们的高度重视。情感代理是可以通过面部表情、声音、肢体动作和言语信息等影响学习者情感体验的教学代理。以往研究主要关注两种类型的情感代理:表达型情感代理和移情型情感代理。表达型情感代理是仅通过自身的情绪表达(如:使用微笑的面部表情和热情的声音)以影响学习者情绪体验的代理。移情型情感代理则是能根据学习者的学习表现或情绪状态给予情感反馈(如;点头、鼓励和共情)的代理,其目的是为了调节学习者的情绪、激励其继续努力。虽然不同的研究者对情感代理的具体操作有所不同,但无论哪种类型的情感代理均是为了增加学习者的积极情绪,提高内部动机,最终促进学习。关于情感代理的潜在作用,研究者基于不同的理论观点给出了不同的解释。情绪感染理论认为一个人的情绪状态容易受到另一个人情绪表达的影响,因此界面代理的情绪会直接影响学习者的情绪和动机。情绪反应理论认为如果教师的言语和非言语线索诱发了积极的情绪,学习者就会产生趋近学习的行为(例如,制定相应的学习计划)。多媒体学习认知情感理论强调了学习过程中情感和动机的重要性。基于多媒体学习认知情感理论,情感代理能唤起学习者的积极情绪,增加学习动机,进而提高学习成绩。而认知负荷理论和干扰理论却认为情感代理丰富的面部表情和手势动作可能会增加学习者的外部认知负荷,吸引学习者的注意力,减少对关键信息的注意,因此干扰学习效果。在上述理论的指导下,研究者们对情感代理的效果进行了探究,结果发现,情感代理可以有效地唤起学习者的积极情绪(d积极情绪= 0.45),提高学习动机(d内部动机= 0.52)。但不一定能影响认知负荷(d内部认知负荷 = -0.01;d外部认知负荷 = 0.09;d相关认知负荷 = 0.08),并且在学习效果上的作用也比较微弱(d保持 = 0.18;d理解 = 0.32;d迁移 = 0.14;d联合 = 0.32)。情感代理在学习效果上的作用不稳健的原因可能是受到了潜在调节因素的影响。例如,学习者的个体特征(如,工作记忆能力和年级水平)、情感代理的类型、任务特征和测验时间等。总之,尽管目前关于情感代理的研究结果存在不一致,但整体而言,在积极情感代理条件下,学习者更加快乐,更有动力。因此,在教育实践中,教学设计者可以考虑为学习者呈现一个积极的教学代理以帮助他们更加快乐地学习。未来关于情感代理的研究需要继续关注情感代理的操纵和评定方法;探究影响情感代理效果的边界条件;考察情感代理影响学习背后的神经机制;提高情感代理研究的生态效度等。
中图分类号:
王燕青, 龚少英, 姜甜甜, 吴亚男. (2022). 情感代理能否提高多媒体学习的效果?. 心理科学进展 , 30(7), 1524-1535.
WANG Yanqing, GONG Shaoying, JIANG Tiantian, Wu Yanan. (2022). Can affective pedagogical agent facilitate multimedia learning?. Advances in Psychological Science, 30(7), 1524-1535.
图1 基于情绪感染理论、情绪反应理论和CATLM视角下情感代理促进学习的加工过程(注:箭头表示可能的因果关系方向) 注:参考Hatfield et al., 1994; Horan et al., 2012; Horovitz & Mayer, 2021; Lawson et al., 2021; Moreno & Mayer, 2007制作
[1] | 封晓伟. (2020). 情感代理对多媒体学习的影响: 学习者个体特征的调节作用 (硕士论文). 华中师范大学, 武汉. |
[2] | 龚少英, 上官晨雨, 翟奎虎, 郭雅薇. (2017). 情绪设计对多媒体学习的影响. 心理学报, 49(6), 771-782. |
[3] | 谢科. (2020). 代理的情绪反馈和认知反馈对形成性评估的影响 (硕士论文). 华中师范大学, 武汉. |
[4] | Arroyo, I., Woolf, B. P., Royer, J. M., & Tai, M. (2009). Affective gendered learning companions. In Dimitrova, V. et al., (Eds.). Proc. 2009 Conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling (pp.41-48). IOS Press. |
[5] | Ba, S., Stein, D., Liu, Q., Long, T., Xie, K., & Wu, L. (2021). Examining the effects of a pedagogical agent with dual-channel emotional cues on learner emotions, cognitive load, and knowledge transfer performance. Journal of Educational Computing Research. https://doi.org/10.1177/0735633121992421 |
[6] |
Baumeister, R. F. (2014). Self-regulation, ego depletion, and inhibition. Neuropsychologia, 65, 313-319.
doi: 10.1016/j.neuropsychologia.2014.08.012 pmid: 25149821 |
[7] |
Baylor, A. L., & Kim, S. (2009). Designing nonverbal communication for pedagogical agents: When less is more. Computers in Human Behavior, 25(2), 450-457.
doi: 10.1016/j.chb.2008.10.008 URL |
[8] |
Baylor, A. L., & Ryu, J. (2003). The effects of image and animation in enhancing pedagogical agent persona. Journal of Educational Computing Research, 28(4), 373-394.
doi: 10.2190/V0WQ-NWGN-JB54-FAT4 URL |
[9] |
Beege, M., Schneider, S., Nebel, S., & Rey, G. D. (2017). Look into my eyes! Exploring the effect of addressing in educational videos. Learning and Instruction, 49, 113-120.
doi: 10.1016/j.learninstruc.2017.01.004 URL |
[10] |
Beege, M., Schneider, S., Nebel, S., & Rey, G. D. (2020). Does the effect of enthusiasm in a pedagogical agent's voice depend on mental load in the learner's working memory?. Computers in Human Behavior, 112, 106483. https://doi.org/10.1016/j.chb.2020.106483
doi: 10.1016/j.chb.2020.106483 URL |
[11] |
Bringula, R. P., Fosgate Jr, I. C. O., Garcia, N. P. R., & Yorobe, J. L. M. (2018). Effects of pedagogical agents on students’ mathematics performance: A comparison between two versions. Journal of Educational Computing Research, 56(5), 701-722.
doi: 10.1177/0735633117722494 URL |
[12] | Chen, G.-D., Lee, J.-H., Wang, C.-Y., Chao, P.-Y., Li, L.-Y., & Lee, T.-Y. (2012). An empathic avatar in a computer-aided learning program to encourage and persuade learners. Journal of Educational Technology & Society, 15(2), 62-72. |
[13] |
Davis, R. O., Vincent, J., & Park, T. (2019). Reconsidering the voice principle with non-native language speakers. Computers & Education, 140, 103605. https://doi.org/10.1016/j.compedu.2019.103605
doi: 10.1016/j.compedu.2019.103605 URL |
[14] |
de Koning, B., Hoogerheide, V., & Boucheix, J.-M. (2018). Developments and trends in learning with instructional video. Computers in Human Behavior, 89, 395-398.
doi: 10.1016/j.chb.2018.08.055 URL |
[15] |
Endres, T., Weyreter, S., Renkl, A., & Eitel, A. (2020). When and why does emotional design foster learning? Evidence for situational interest as a mediator of increased persistence. Journal of Computer Assisted Learning, 36(4), 514-525.
doi: 10.1111/jcal.12418 URL |
[16] | Fiorella, L., & Mayer, R. E. (2015). Learning as a generative activity: Eight learning strategies that promote understanding. New York, NY: Cambridge University Press. |
[17] |
Fiorella, L., Stull, A. T., Kuhlmann, S., & Mayer, R. E. (2020). Fostering generative learning from video lessons: Benefits of instructor-generated drawings and learner- generated explanations. Journal of Educational Psychology, 112(5), 895-906.
doi: 10.1037/edu0000408 URL |
[18] |
Frechette, C., & Moreno, R. (2010). The roles of animated pedagogical agents’ presence and nonverbal communication in multimedia learning environments. Journal of Media Psychology, 22(2), 61-72.
doi: 10.1027/1864-1105/a000009 URL |
[19] |
Graziano, P. A., Reavis, R. D., Keane, S. P., & Calkins, S. D. (2007). The role of emotion regulation and children's early academic success. Journal of School Psychology, 45(1), 3-19.
doi: 10.1016/j.jsp.2006.09.002 pmid: 21179384 |
[20] |
Guo, Y. R., & Goh, D. H.-L. (2015). Affect in embodied pedagogical agents: Meta-analytic review. Journal of Educational Computing Research, 53(1), 124-149.
doi: 10.1177/0735633115588774 URL |
[21] |
Guo, Y. R., & Goh, D. H.-L. (2016). Evaluation of affective embodied agents in an information literacy game. Computers & Education, 103, 59-75.
doi: 10.1016/j.compedu.2016.09.013 URL |
[22] | Guo, Y. R., Goh, D. H.-L., & Luyt, B. (2014). Using affective embodied agents in information literacy education. Paper presented at the Digital Libraries, London. |
[23] |
Guo, Y. R., Goh, D. H.-L., Luyt, B., Sin, S.-C. J., & Ang, R. P. (2015). The effectiveness and acceptance of an affective information literacy tutorial. Computers & Education, 87, 368-384.
doi: 10.1016/j.compedu.2015.07.015 URL |
[24] | Hatfield, E., Cacioppo, J. T., & Rapson, R. L. (1994). Emotional contagion. Cambridge, UK: Cambridge University Press. |
[25] | Hernández, Y., Sucar, L. E., & Conati, C. (2009). Incorporating an affective behavior model into an educational game. Paper presented at the FLAIRS Conference, Sanibel Island, Florida. |
[26] |
Horan, S. M., Martin, M. M., & Weber, K. (2012). Understanding emotional response theory: The role of instructor power and justice messages. Communication Quarterly, 60(2), 210-233.
doi: 10.1080/01463373.2012.669323 URL |
[27] |
Horovitz, T., & Mayer, R. E. (2021). Learning with human and virtual instructors who display happy or bored emotions in video lectures. Computers in Human Behavior, 119, 106724. https://doi.org/10.1016/j.chb.2021.106724
doi: 10.1016/j.chb.2021.106724 URL |
[28] | Jaques, P. A., Lehmann, M., & Pesty, S. (2009). Evaluating the affective tactics of an emotional pedagogical agent. In Proceedings of the 2009 ACM symposium on Applied Computing, Honolulu, Hawaii, 9-12 March 2009 (pp.104-109). New York: ACM Press. |
[29] |
Kim, Y., Baylor, A. L., & Shen, E. (2007). Pedagogical agents as learning companions: The impact of agent emotion and gender. Journal of Computer Assisted Learning, 23(3), 220-234.
doi: 10.1111/j.1365-2729.2006.00210.x URL |
[30] |
Krämer, N., Kopp, S., Becker-Asano, C., & Sommer, N. (2013). Smile and the world will smile with you—The effects of a virtual agent’s smile on users’ evaluation and behavior. International Journal of Human-Computer Studies, 71(3), 335-349.
doi: 10.1016/j.ijhcs.2012.09.006 URL |
[31] | Ku, J., Jang, H. J., Kim, K. U., Kim, J. H., Park, S. H., Lee, J. H.,... Kim, S. I. (2005). Experimental results of affective valence and arousal to avatar's facial expressions. Cyber Psychology & Behavior, 8(5), 493-503. |
[32] |
Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114, 106554. https://doi.org/10.1016/j.chb.2020.106554
doi: 10.1016/j.chb.2020.106554 URL |
[33] |
Lee, J. Y., Donkers, J., Jarodzka, H., Sellenraad, G., & van Merrienboer, J. J. (2020). Different effects of pausing on cognitive load in a medical simulation game. Computers in Human Behavior, 110, 106385.
doi: 10.1016/j.chb.2020.106385 URL |
[34] |
Liew, T. W., Tan, S.-M., Tan, T. M., & Kew, S. N. (2020). Does speaker’s voice enthusiasm affect social cue, cognitive load and transfer in multimedia learning?. Information and Learning Sciences, 121(3), 117-135.
doi: 10.1108/ILS-11-2019-0124 URL |
[35] |
Liew, T. W., Zin, N. A. M., & Sahari, N. (2017). Exploring the affective, motivational and cognitive effects of pedagogical agent enthusiasm in a multimedia learning environment. Human-centric Computing and Information Sciences, 7(1), 1-21.
doi: 10.1186/s13673-016-0083-0 URL |
[36] | Liew, T. W., Zin, N. A. M., Sahari, N., & Tan, S.-M. (2016). The effects of a pedagogical agent’s smiling expression on the learner’s emotions and motivation in a virtual learning environment. The International Review of Research in Open and Distributed Learning, 17(5), 249-266. |
[37] | Mayer, R. E. (2009). Multimedia learning (2nd ed). New York: Cambridge University Press. |
[38] | Mayer, R. E.(Ed.), (2014). The Cambridge handbook of multimedia learning (2nd ed.). New York, NY: Cambridge University Press. |
[39] | Mayer, R. E. (2020). Cognitive theory of multimedia learning. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge handbook of multimedia learning (3rd ed.). New York, NY: Cambridge University Press. |
[40] | Merkt, M., Lux, S., Hoogerheide, V., van Gog, T., & Schwan, S. (2020). A change of scenery: Does the setting of an instructional video affect learning?. Journal of Educationa Psychology, 112(6), 1273-1283. |
[41] |
Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309-326.
doi: 10.1007/s10648-007-9047-2 URL |
[42] |
Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001). The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction, 19(2), 177-213.
doi: 10.1207/S1532690XCI1902_02 URL |
[43] |
Oker, A., Pecune, F., & Declercq, C. (2020). Virtual tutor and pupil interaction: A study of empathic feedback as extrinsic motivation for learning. Education and Information Technologies, 25, 3643-3658.
doi: 10.1007/s10639-020-10123-5 URL |
[44] |
Park, B., Knörzer, L., Plass, J. L., & Brünken, R. (2015). Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms. Computers & Education, 86, 30-42.
doi: 10.1016/j.compedu.2015.02.016 URL |
[45] |
Pi, Z., Zhang, Y., Zhou, W., Xu, K., Chen, Y., Yang, J., & Zhao, Q. (2021). Learning by explaining to oneself and a peer enhances learners’ theta and alpha oscillations while watching video lectures. British Journal of Educational Technology, 52(2), 659-679.
doi: 10.1111/bjet.13048 URL |
[46] |
Plass, J. L., Heidig, S., Hayward, E. O., Homer, B. D., & Um, E. (2014). Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction, 29, 128-140.
doi: 10.1016/j.learninstruc.2013.02.006 URL |
[47] |
Roselyn Lee, J.-E., Nass, C., Brave, S. B., Morishima, Y., Nakajima, H., & Yamada, R. (2007). The case for caring colearners: The effects of a computer-mediated colearner agent on trust and learning. Journal of Communication, 57(2), 183-204.
doi: 10.1111/j.1460-2466.2007.00339.x URL |
[48] | Saerbeck, M., Schut, T., Bartneck, C., & Janse, M. D. (2010, April). Expressive robots in education: Varying the degree of social supportive behavior of a robotic tutor. In Proceedings of the SIGCHI conference on human factors in computing systems (CHI) (pp.1613-1622). Atlanta, GA. |
[49] |
Schneider, S., Krieglstein, F., Beege, M., & Rey, G. D. (2022). The impact of video lecturers’ nonverbal communication on learning-An experiment on gestures and facial expressions of pedagogical agents. Computers & Education, 176, 104350. https://doi.org/10.1016/j.compedu.2021.104350
doi: 10.1016/j.compedu.2021.104350 URL |
[50] |
Shangguan, C., Gong, S., Guo, Y., Wang, X., & Lu, J. (2020). The effects of emotional design on middle school students’ multimedia learning: The role of learners’ prior knowledge. Educational Psychology, 40(9), 1076-1093.
doi: 10.1080/01443410.2020.1714548 URL |
[51] | Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 19-30). New York: Cambridge University Press. |
[52] |
Terzis, V., Moridis, C. N., & Economides, A. A. (2012). The effect of emotional feedback on behavioral intention to use computer-based assessment. Computers & Education, 59(2), 710-721.
doi: 10.1016/j.compedu.2012.03.003 URL |
[53] | Tsai, J., Bowring, E., Marsella, S., Wood, W., & Tambe, M. (2012). A study of emotional contagion with virtual characters. In Y. Nakano, M. Neff, A. Paiva, & M. Walker (Eds.), Intelligent Virtual Agents (pp. 81-88). Berlin Heidelberg: Springer. |
[54] |
Um, E. R., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485-498.
doi: 10.1037/a0026609 URL |
[55] |
Uzun, A. M., & Yıldırım, Z. (2018). Exploring the effect of using different levels of emotional design features in multimedia science learning. Computers & Education, 119, 112-128.
doi: 10.1016/j.compedu.2018.01.002 URL |
[56] |
van der Meij, H. (2013). Motivating agents in software tutorials. Computers in Human Behavior, 29(3), 845-857.
doi: 10.1016/j.chb.2012.10.018 URL |
[57] |
van der Meij, H., van der Meij, J., & Harmsen, R. (2015). Animated pedagogical agents effects on enhancing student motivation and learning in a science inquiry learning environment. Educational Technology Research and Development, 63(3), 381-403.
doi: 10.1007/s11423-015-9378-5 URL |
[58] |
Veletsianos, G. (2009). The impact and implications of virtual character expressiveness on learning and agent-learner interactions. Journal of Computer Assisted Learning, 25(4), 345-357.
doi: 10.1111/j.1365-2729.2009.00317.x URL |
[59] |
Wang, Y., Liu, Q., Chen, W., Wang, Q., & Stein, D. (2019). Effects of instructor's facial expressions on students' learning with video lectures. British Journal of Educational Technology, 50(3), 1381-1395.
doi: 10.1111/bjet.12633 URL |
[1] | 叶舒琪, 尹俊婷, 李招贤, 罗俊龙. 情绪对直觉与分析加工的影响机制[J]. 心理科学进展, 2023, 31(5): 736-746. |
[2] | 郭理, 加锁锁, 李圭泉, 李蔓林. 高处不胜寒?领导工作场所孤独感的多层次双刃剑效应[J]. 心理科学进展, 2023, 31(4): 582-596. |
[3] | 杨智超, 王艇. 消费决策中的零:零价格效应和零比较效应[J]. 心理科学进展, 2023, 31(3): 492-506. |
[4] | 陈念劬. 从好奇发生到满足:好奇反馈循环的神经生理机制[J]. 心理科学进展, 2023, 31(2): 256-273. |
[5] | 马原啸, 陈旭. 焦虑易感群体焦虑识别与消退中催产素的作用[J]. 心理科学进展, 2023, 31(1): 10-19. |
[6] | 肖婷炜, 董洁, 梁飞, 王福顺, 李洋. 厌恶情绪与自杀行为的关系[J]. 心理科学进展, 2023, 31(1): 87-98. |
[7] | 寇东晓, 王晓玉. 权力对人际敏感性的影响[J]. 心理科学进展, 2023, 31(1): 108-115. |
[8] | 邹迪, 李红, 王福顺. 唤醒定义探析及其认知神经生理基础[J]. 心理科学进展, 2022, 30(9): 2020-2033. |
[9] | 刘薇, 沈晓玲. 团队行动中反思与团队创新关系研究的动态视角——认知与情绪的双元路径[J]. 心理科学进展, 2022, 30(8): 1759-1769. |
[10] | 梁飞, 江瑶, 肖婷炜, 董洁, 王福顺. 基本情绪的神经基础:来自fMRI与机器视觉技术研究的证据[J]. 心理科学进展, 2022, 30(8): 1832-1843. |
[11] | 杨倩. 负性情绪在冲突适应中的作用机制:分离与整合视角[J]. 心理科学进展, 2022, 30(8): 1844-1855. |
[12] | 刘春晓, 刘立志, 王丹, 陈文锋. 集体仪式促进群体情绪感染的机制[J]. 心理科学进展, 2022, 30(8): 1870-1882. |
[13] | 简云龙, 刘源. 动机的结构与效应:基于动机连续体的视角[J]. 心理科学进展, 2022, 30(7): 1589-1603. |
[14] | 武晓菲, 肖风, 罗劲. 创造性认知重评在情绪调节中的迁移效应及其神经基础[J]. 心理科学进展, 2022, 30(3): 477-485. |
[15] | 刘俊材, 冉光明, 张琪. 不同情绪载体的神经活动及其异同——脑成像研究的ALE元分析[J]. 心理科学进展, 2022, 30(3): 536-555. |
阅读次数 | ||||||
全文 |
|
|||||
摘要 |
|
|||||