奖励和惩罚在注意控制过程中的优化和分离：眼动研究

doi:10.3724/SP.J.1041.2019.01207

摘要/Abstract

摘要：

通过两个眼动实验考察金钱奖励和惩罚引起的动机对个体在不同空间线索条件下注意控制加工的影响。实验1采用朝向/反向眼跳范式, 被试通过内源性线索提供心理准备的情况下做出简单的朝向眼跳以及需要抑制优势反应的反向眼跳。结果发现, 相比无奖惩条件, 奖励条件下朝向眼跳任务的正确率更高, 惩罚条件下反向眼跳任务的正确率更高; 两种眼跳任务中有奖惩条件下的眼跳峰速度均比无奖惩条件高。实验2采用Go/No-go任务, 进一步探讨了由副中央凹加工外源性边缘线索从而不能提供充分心理准备的情况下奖励和惩罚对注意控制的影响。结果发现, 奖励条件下Go反应的眼跳潜伏期更短, 惩罚条件下No-go反应正确率更高, 眼跳峰速度在两种条件下均比无奖惩条件高。以上结果表明, 奖励和惩罚均能够促进个体的注意控制, 但二者的加工过程是分离的, 奖励能够改善趋近行为, 惩罚则能够显著促进抑制控制行为, 且奖励和惩罚在注意控制加工过程中具有不同的作用模式, 奖励能够更早唤醒注意控制系统从而更快地促进行为的发生与执行, 惩罚则能够通过调节注意资源促进以目标为导向的行为中对优势反应的抑制。

关键词: 注意控制, 奖励, 惩罚, 动机, 眼跳

Abstract:

A wealth of research shows that positive and negative reinforcement critically influence behavior. While it is well established that rewards and penalties can strongly influence mechanisms of executive control, it is unclear whether these two factors exert symmetric or qualitatively distinct behavioral effects. In the current research, we conducted two eye-movement experiments to investigate the influence of monetary reward or punishment on attentional control. We employed these cues in Pro/Anti-saccade tasks in Experiment 1 and Go/No-go tasks in Experiment 2. Crucially, we investigated how either a reward (also referred to as “gain”) or penalty (also referred to as “loss”) influenced inhibitory control in the following trial.

In Experiment 1, participants were instructed to produce simple pro-saccades or more difficult anti-saccades, in conditions in which they received a reward for correct responses or a punishment for incorrect responses or either a reward or punishment. The results showed that, while the accuracy of the pro-saccades was facilitated by reward, the accuracy of the anti-saccades was facilitated by punishment. And the velocity of pro-saccades and anti-saccades were significantly improved by both reward and punishment. In Experiment 2, we further adopted the Go/No-go tasks to explore how reward and punishment affect attentional control via exogenous parafoveal visual cues. This showed essentially the same pattern of effects as Experiment 1. For the Go task, saccade latency significantly decreased when rewards were given relative to punishment or no motivation conditions. And for the No-go task, accuracy increased more in the punishment condition compared to the reward or no motivation conditions. An increase in saccade velocity was observed in the no motivation condition, similarly to in Experiment 1.

In sum, the overall results suggest that both reward and punishment can facilitate the oculomotor control, although the findings reveal a striking asymmetry in the effects of the reward and punishment on behavior. Specifically, positive reinforcement appears to improve approach behaviors, while punishment influences inhibitory behavior. These findings suggest that the two forms of reinforcement are distinct in their influence on behavior.

Key words: control attention, reward, punishment, motivation, saccade

中图分类号:

B842

张阔, 何立媛, 赵莹, 王敬欣. (2019). 奖励和惩罚在注意控制过程中的优化和分离：眼动研究. 心理学报, 51(11), 1207-1219.

ZHANG Kuo, ZHAO Ying, WANG Jingxin, . (2019). Optimization and asymmetry effects of reward and punishment on control attention: Evidence from eye movements. Acta Psychologica Sinica, 51(11), 1207-1219.

图/表 4

图1 实验流程注：图中的反馈阶段所呈现出的反馈信息是反向眼跳反应正确和错误的试次举例

图2 奖惩条件下眼跳实验结果 (A区为首次眼跳正确率; B区为首次正确眼跳峰速度)

图3 实验流程(以奖励线索为例) 注：每个试次开始时, 被试在线索阶段可以看到“+”、“-”和“O”三种线索中的任意一个(分别表示奖励、惩罚和无奖惩)。流程图左侧呈现的是奖励条件下Go任务的正确反应示例; 右侧呈现的是奖励条件下No-go任务的错误反应示例。

图4 Go/No-go任务实验结果(A区为反应正确率, B区为正确Go反应的眼跳潜伏期)

参考文献 52

[1]	Aarts, E., van Holstein, M., Hoogman, M., Onnink, M., Kan, C., Franke, B., … Cools, R . (2015). Reward modulation of cognitive function in adult attention-deficit/hyperactivity disorder: A pilot study on the role of striatal dopamine. Behavioural Pharmacology, 26(1&2), 227-240.
[2]	Anderson, B. A., Laurent, P. A., & Yantis, S . (2011). Value-driven attentional capture. Proceedings of the National Academy of Sciences of the United States of America, 108(25), 10367-10371.
[3]	Arnett,P. A., & Newman, J., , P . (2000). Gray's three-arousal model: An empirical investigation. Personality and Individual Differences, 28(6), 1171-1189.
[4]	Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D . (2001). Bad is stronger than good. Review of General Psychology, 5(4), 323-370.
[5]	Becker, S. P., Fite, P. J., Garner, A. A., Greening, L., Stoppelbein, L., & Luebbe, A. M . (2013). Reward and punishment sensitivity are differentially associated with ADHD and sluggish cognitive tempo symptoms in children. Journal of Research in Personality, 47(6), 719-727.
[6]	Berridge, K. C., Robinson, T. E., & Aldridge, J. W . (2009). Dissecting components of reward: ‘liking’, ‘wanting’, and learning. Current opinion in Pharmacology, 9(1), 65-73.
[7]	Braem, S., Hickey, C., Duthoo, W., & Notebaert, W . (2014). Reward determines the context-sensitivity of cognitive control. Journal of Experimental Psychology: Human Perception & Performance, 40(5), 1769-1778.
[8]	Bucker, B., Silvis, J. D., Donk, M., & Theeuwes, J . (2015). Reward modulates oculomotor competition between differently valued stimuli. Vision Research, 108, 103-112.
[9]	Chambers, C. D., Garavan, H., & Bellgrove, M. A . (2009). Insights into the neural basis of response inhibition from cognitive and clinical neuroscience. Neuroscience & Biobehavioral Reviews, 33(5), 631-646.
[10]	Chelazzi, L., Perlato, A., Santandrea, E., & Libera, C. D . (2013). Rewards teach visual selective attention. Vision Research, 85(24), 58-72.
[11]	Corr, P. J . (2001). Testing problems in J. A. Gray’s personality theory: A commentary on Matthews and Gilliland (1999). Personality and Individual Differences, 30(2), 333-352.
[12]	Dafoe, J. M., Armstrong, I. T., & Munoz, D. P . (2007). The influence of stimulus direction and eccentricity on pro- and anti-saccades in humans. Experimental Brain Research, 179(4), 563-570.
[13]	Derakshan, N., Ansari, T. L., Hansard, M., Shoker, L., & Eysenck, M. W . (2009). Anxiety, inhibition, efficiency, and effectiveness: An investigation using the antisaccade task. Experimental Psychology, 56(1), 48-55.
[14]	de Pascalis, V. . (2014). Neurocognitive components of behavioral inhibition and behavioral activation systems: Relation of EEG-alpha asymmetry, BIS/BAS and optimism. Personality and Individual Differences, 60, S4.
[15]	Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135-168.
[16]	Eliana, V., Massimo, S., Boehler, C. N., Eric, A., Wim, F., & Tom, V . (2014). Overlapping neural systems represent cognitive effort and reward anticipation. Plos One, 9(3), e91008.
[17]	Engelmann, J. B., Damaraju, E., Padmala, S., & Pessoa, L . (2009). Combined effects of attention and motivation on visual task performance: Transient and sustained motivational effects. Frontiers in Human Neuroscience, 3(4), 1-17.
[18]	Engelmann, J. B., & Pessoa, L. (2007). Motivation sharpens exogenous spatial attention. Emotion, 7(3), 668-674.
[19]	Freeman, S. M., & Aron, A. R . (2016). Withholding a reward-driven action: Studies of the rise and fall of motor activation and the effect of cognitive depletion. Journal of Cognitive Neuroscience, 28(2), 237-251.
[20]	Geier, C. F., & Luna, B. (2012). Developmental effects of incentives on response inhibition. Child Development, 83(4), 1262-1274.
[21]	Gray, J. A. (1987). The psychology of fear and stress. New York: Cambridge University Press.
[22]	Gu, L., Bai, X. J., & Wang, Q . (2015). Impact of reward/punishment conditions on behavioral inhibition and automatic physiological responses in the stages. Acta Psychologica Sinica, 47 (1), 39-49.
[23]	[ 谷莉, 白学军, 王芹 . (2015). 奖惩对行为抑制及程序阶段中自主生理反应的影响. 心理学报, 47(1), 39-49.]
[24]	Hardin, M. G., Schroth, E., & Ernst, M . (2007). Incentive- related modulation of cognitive control in healthy, anxious, and depressed adolescents: Development and psychopathology related differences. Journal of Child Psychology and Psychiatry, 48(5), 446-454.
[25]	Hauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S . (2015). Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development. Neurolmage, 104, 347-354.
[26]	Herrera, P. M., Speranza, M., Hampshire, A., & Bekinschtein, T. A . (2014). Monetary rewards modulate inhibitory control. Frontiers in Human Neuroscience, 8(4), 442-449.
[27]	Heym, N., Kantini, E., Checkley, H. L. R., & Cassaday, H. J . (2015). Gray’s revised reinforcement sensitivity theory in relation to attention-deficit/hyperactivity and tourette-like behaviors in the general population. Personality and Individual Differences, 78, 24-28.
[28]	Jazbec, S., Hardin, M. G., Schroth, E., McClure, E., Pine, D. S., & Ernst, M . (2006). Age-related influence of contingencies on a saccade task. Experimental Brain Research, 174(4), 754-762.
[29]	Ji, L. Y., Chen, N. X., Ding, J. H., & Wei, P . (2015). Monetary incentive modulates the localized attentional interference effect. Acta Psychologica Sinica, 47(6), 721-733.
[30]	[ 纪丽燕, 陈宁轩, 丁锦红, 魏萍 . (2015). 奖赏预期调节局部注意干扰效应. 心理学报, 47(6), 721-733.]
[31]	Kilpeläinen, M., & Theeuwes, J. (2016). Efficient avoidance of the penalty zone in human eye movements. Plos One, 11(12), 1-15.
[32]	Kubanek, J., Snyder, L. H., & Abrams, R. A . (2015). Reward and punishment act as distinct factors in guiding behavior. Cognition, 139, 154-167.
[33]	Machado, H., & Rafal, R. D . (2000). Strategic control over saccadic eye movements: Studies of the fixation offset effect. Perception & Psychophysics, 62(6), 1236-1242.
[34]	Masui, K., & Nomura, M. (2011). The effects of reward and punishment on response inhibition in non-clinical psychopathy. Personality and Individual Differences, 50(1), 69-73.
[35]	Munoz, D., P., & Everling, S. (2004). Look away: The anti- saccade task and the voluntary control of eye movement. Nature Reviews Neuroscience, 5(3), 218-228.
[36]	Murty, V. P., LaBar, K. S., & Adcock, R. A . (2016). Distinct medial temporal networks encode surprise during motivation by reward versus punishment. Neurobiology of Learning and Memory, 134, 55-64.
[37]	Padmala, S., & Pessoa, L. (2010). Interactions between cognition and motivation during response inhibition. Neuropsychologia, 48(2), 558-565.
[38]	Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., & Gottlieb, J . (2009). Reward modulates attention independently of action value in posterior parietal cortex. The Journal of Neuroscience, 29(36), 11182-11191.
[39]	Pekny, S. E., Izawa, J., & Shadmehr, R . (2015). Reward- dependent modulation of movement variability. The Journal of Neuroscience, 35(9), 4015-4024.
[40]	Pessoa, L. (2009). How do emotion and motivation direct executive control? Trends in Cognitive Sciences, 13(4), 160-166.
[41]	Ross, M., Lanyon, L. J., Viswanathan, J., Manoach, D. S Barton, J. J. S.& (2011). Human prosaccades and antisaccades under risk: Effects of penalties and rewards on visual selection and the value of actions. Neuroscience, 196, 168-177.
[42]	Schmitt, H., Ferdinand, N. K., & Kray, J . (2015). The influence of monetary incentives on context processing in younger and older adults: An event-related potential study. Cognitive, Affective, & Behavioral Neuroscience, 15(2), 416-434
[43]	Sommer, M. A., & Wurtz, R. H . (2001). Frontal eye field sends delay activity related to movement, memory, and vision to the superior colliculus. Journal of Neurophysiology, 85(4), 1673-1685.
[44]	Spear, L. P . (2011). Rewards, aversions and affect in adolescence: Emerging convergences across laboratory animal and human data. Developmental Cognitive Neuroscience, 1(4), 390-403.
[45]	Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5(4), 297-323.
[46]	van Steenbergen, H., Band, G. P. H., & Hommel, B . (2012). Reward valence modulates conflict-driven attentional adaptation: Electrophysiological evidence. Biological Psychology, 90(3), 234-241.
[47]	Wang, Y. Q., Chen, A. T., Hu, X. P., & Yin, S. H . (2019). Reward improves cognitive control by enhancing signal monitoring. Acta Psychologica Sinica, 51(1), 48-57.
[48]	[ 王宴庆, 陈安涛, 胡学平, 尹首航 . (2019). 奖赏通过增强信号监测提升认知控制. 心理学报, 51(1), 48-57.]
[49]	Wolf, C., Heuer, A., Schubö, A., & Schütz, A. C . (2017). The necessity to choose causes the effects of reward on saccade preparation. Scientific Reports, 7(1), 16966. DOI: 10.1038/s41598-017-17164-w.
[50]	Yechiam, E., & Hochman, G. (2013). Loss-aversion or loss- attention: The impact of losses on cognitive performance. Cognitive Psychology, 66(2), 212-231.
[51]	Zhang, X. W., Xuan, Y. M., & Fu, X. L . (2012). The effect of emotional valences on approach and avoidance responses. Advances in Psychological Science, 20(7), 1023-1030.
[52]	[ 张晓雯, 禤宇明, 傅小兰 . (2012). 情绪效价对趋避反应的作用. 心理科学进展, 20(7), 1023-1030.]