The effect of feedback interval on feedback processing: A perspective of integrating behavioral and electrophysiological researches

doi:10.3724/SP.J.1042.2020.00230

Abstract

Abstract:

Feedback plays a crucial role in real life. Learning from the informative feedback, human being could master general skills and knowledge for adapting to the environment. As an important factor of feedback processing, feedback interval means the duration between initiation of behavior and the appearance of feedback stimulus. However, the prior research about how the feedback interval modulated feedback processing did not reach consistent viewpoint. Introduced both the behavioral and ERP studies about how feedback interval affects feedback processing, and analyzed the reasons for the results discrepancies among these studies. Finally, we propose the necessity to standardize the definition of feedback interval and the combination of the behavioral and electrophysiological methods in further research.

Key words: feedback interval, feedback processing, feedback-related negativity, delayed feedback, immediate feedback

CLC Number:

B842

WAN Nan, ZHU Shuqing, JIA Shiwei. The effect of feedback interval on feedback processing: A perspective of integrating behavioral and electrophysiological researches[J]. Advances in Psychological Science, 2020, 28(2): 230-239.

References 51

[1]	冯霞, 冯文锋, 冯成志 . ( 2018). 反馈类型和反馈时间对动作技能获得的影响. 心理科学, 41( 3), 533-539.
[2]	金亚虹, 章建成, 孙耀华, 任杰 . ( 2001). 延迟结果反馈对追踪任务技能学习的影响. 心理科学, 24( 6), 739-740.
[3]	刘志雅, 莫雷, 张娟 . ( 2007). 基于规则的类别学习和信息整合的类别学习. 心理科学, 30( 6), 1429-1432.
[4]	孙海龙, 邢强 . ( 2014). 反馈对知觉类别学习的影响及其认知神经生理机制. 心理科学进展, 22( 1), 67-74.
[5]	邢强, 王家慰, 黄秀青 . ( 2018). 反馈时间、反馈类型和掩蔽类型对概率类别学习的影响. 心理学探新, 38( 5), 26-32.
[6]	张奇, 刘万伦 . ( 2007). 类别学习多重系统理论的研究与展望. 心理科学进展, 15( 1), 78-87.
[7]	Arbel, Y., Hong, L., Baker, T. E., & Holroyd, C. B . ( 2017). It's all about timing: An electrophysiological examination of feedback-based learning with immediate and delayed feedback. Neuropsychologia, 99, 179-186.
[8]	Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M . ( 1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105( 3), 442-481.
[9]	Ashby, F. G., Queller, S., & Berretty, P. M . ( 1999). On the dominance of unidimensional rules in unsupervised categorization. Perception & Psychophysics, 61( 6), 1178-99.
[10]	Bourne, L. E . ( 1957). Effects of delay of information feedback and task complexity on the identification of concepts. Journal of Experimental Psychology, 54( 3), 201-207.
[11]	Butler, A. C., Karpicke, J. D., & Roediger, H. L . ( 2007). The effect of type and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied, 13( 4), 273-281.
[12]	Carpenter, S. K., & Vul, E . ( 2011). Delaying feedback by three seconds benefits retention of face-name pairs: The role of active anticipatory processing. Memory & Cognition, 39( 7), 1211-1221.
[13]	Davachi, L . ( 2006). Item, context and relational episodic encoding in humans. Current Opinion in Neurobiology, 16( 6), 693-700.
[14]	Dickerson, K. C., & Delgado, M. R . ( 2015). Contributions of the hippocampus to feedback learning. Cognitive Affective & Behavioral Neuroscience, 15( 4), 861-877.
[15]	Ferdinand, N. K., Mecklinger, A., Kray, J., & Gehring, W. J . ( 2012). The processing of unexpected positive response outcomes in the mediofrontal cortex. Journal of Neuroscience, 32( 35), 12087-12092.
[16]	Foerde, K., Race, E., Verfaellie, M., & Shohamy, D . ( 2013). A role for the medial temporal lobe in feedback-driven learning: Evidence from amnesia. Journal of Neuroscience, 33( 13), 5698-5704.
[17]	Foerde, K., & Shohamy, D . ( 2011). Feedback timing modulates brain systems for learning in humans. Journal of Neuroscience, 31( 37), 13157-13167.
[18]	Gabrieli, J. D . ( 1998). Cognitive neuroscience of human memory. Annual Review of Psychology, 49( 49), 87-115.
[19]	Gehring, W. J., & Willoughby, A. R . ( 2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295( 5563), 2279-2282.
[20]	Guthrie, J. T . ( 1971). Feedback and sentence learning. Journal of Verbal Learning and Verbal Behavior, 10( 1), 23-28.
[21]	Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F . ( 2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71( 2), 148-154.
[22]	Holroyd, C. B., Krigolson, O. E., Baker, R., Lee, S., & Gibson, J . ( 2009). When is an error not a prediction error? An electrophysiological investigation. Cognitive, Affective & Behavioral Neuroscience, 9( 1), 59-70.
[23]	Kim, S., & Arbel, Y . ( 2019). Immediate and delayed auditory feedback in declarative learning: An examination of the feedback related event related potentials. Neuropsychologia, 129, 255-262.
[24]	Kulhavy, R. W . ( 1977). Feedback in written instruction. Review of Educational Research, 47( 2), 211-232.
[25]	Kulhavy, R. W., & Stock, W. A . ( 1989). Feedback in written instruction: The place of response certitude. Educational Psychology Review, 1( 4), 279-308.
[26]	Lee, T. D., Swinnen, S. P., & Serrien, D. J . ( 1994). Cognitive effort and motor learning. Quest, 46( 3), 328-344.
[27]	Luft, C. D . ( 2014). Learning from feedback: The neural mechanisms of feedback processing facilitating better performance . Behavioural Brain Research, 261( 6), 356-368.
[28]	Maddox, W. T., & Ashby, F. G . ( 2004). Dissociating explicit and procedural-learning based systems of perceptual category learning. Behavioral Processes, 66( 3), 309-332.
[29]	Maddox, W. T., Ashby, F. G., & Bohil, C. J . ( 2003). Delayed feedback effects on rule-based and information-integration category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29( 4), 650-662.
[30]	Miltner, W. H., Braun, C. H., & Coles, M. G . ( 1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a ‘‘generic’’ neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798.
[31]	Mory, E. H . ( 2004). Feedback research revisited. Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers.
[32]	Mullaney, K. M., Carpenter, S. K., Grotenhuis, C., & Burianek, S . ( 2014). Waiting for feedback helps if you want to know the answer: The role of curiosity in the delay-of-feedback benefit. Memory & Cognition, 42( 8), 1273-1284.
[33]	Oliveira, F. T., Mcdonald, J. J., & Goodman, D . ( 2007). Performance monitoring in the anterior cingulate is not all error related: Expectancy deviation and the representation of action-outcome associations. Journal of Cognitive Neuroscience, 19, 1994-2004.
[34]	Opitz, B., Ferdinand, N. K., & Mecklinger, A . ( 2011). Timing matters: The impact of immediate and delayed feedback on artificial language learning. Frontiers in Human Neuroscience, 5, 8.
[35]	Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D . ( 2005). When does feedback facilitate learning of words? Journal of Experimental Psychology: Learning, Memory, and Cognition, 31( 1), 3-8.
[36]	Peterburs, J., Kobza, S., & Bellebaum, C . ( 2016). Feedback delay gradually affects amplitude and valence specificity of the feedback-related negativity (FRN). Psychophysiology, 53( 2), 209-215.
[37]	Proudfit, G. H . ( 2015). The reward positivity: From basic research on reward to a biomarker for depression. Psychophysiology, 52( 4), 449-459.
[38]	Salmoni, A. W., Schmidt, R. A., & Walter, C. B . ( 1984). Knowledge of results and motor learning: A review and critical reappraisal. Psychological Bulletin, 95( 3), 355-386.
[39]	Saltzman, I. J . ( 1951). Delay of reward and human verbal learning. Journal of Experimental Psychology, 41( 6), 437-439.
[40]	Sambrook, T. D., & Goslin, J . ( 2015). A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages. Psychological Bulletin, 141( 1), 213-235.
[41]	Sinha, N., & Glass, A. L . ( 2015). Delayed, but not immediate, feedback after multiple-choice questions increases performance on a subsequent short-answer, but not multiple-choice, exam: Evidence for the dual-process theory of memory. The Journal of General Psychology, 142( 2), 118-134.
[42]	Smith, T. A . ( 2007). Spacing and the delay-retention effect: An alternative explanation of the effects of feedback timing on semantic learning (Unpublished master’s thesis). University of Texas at Arlington.
[43]	Smith, T. A., & Kimball, D. R . ( 2010). Learning from feedback: Spacing and the delay-retention effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36( 1), 80-95.
[44]	Staresina, B. P., & Davachi, L . ( 2009). Mind the gap: Binding experiences across space and time in the human hippocampus. Neuron, 63( 2), 267-276.
[45]	Walsh, M. M., & Anderson, J. R . ( 2012). Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neuroscience & Biobehavioral Reviews, 36( 8), 1870-1884.
[46]	Wang, J., Chen, J., Lei, Y., & Li, P . ( 2014). P300, not feedback error-related negativity, manifests the waiting cost of receiving reward information. Neuroreport, 25( 13), 1044-1048.
[47]	Weinberg, A., Luhmann, C. C., Bress, J. N., & Hajcak, G . ( 2012). Better late than never? The effect of feedback delay on ERP indices of reward processing. Cognitive Affective & Behavioral Neuroscience, 12( 4), 671-677.
[48]	Weismuller, B., & Bellebaum, C . ( 2016). Expectancy affects the feedback-related negativity (FRN) for delayed feedback in probabilistic learning. Psychophysiology, 53( 11), 1739-1750.
[49]	Worthy, D. A., Markman, A. B., & Maddox, W. T . ( 2013). Feedback and stimulus-offset timing effects in perceptual category learning. Brain and Cognition, 81( 2), 283-293.
[50]	Zhang, X., Lei, Y., Yin, H., Li, P., & Li, H . ( 2018). Slow is also fast: Feedback delay affects anxiety and outcome evaluation. Frontiers in Human Neuroscience, 12, 20.
[51]	Yin, H., Wang, Y., Zhang, X., & Li, P . ( 2018). Feedback delay impaired reinforcement learning: Principal components analysis of reward positivity. Neuroscience Letters, 685, 179-184.