视觉工作记忆的巩固加工：时程、模式及机制

doi:10.3724/SP.J.1042.2019.01404

摘要/Abstract

摘要：

在视觉工作记忆加工过程中, 对记忆项目的维持及操作需要将转瞬即逝的感觉输入转换为稳定的记忆表征, 这一加工过程被定义为视觉工作记忆巩固。鉴于巩固在视觉工作记忆中所起到的“门控”作用, 研究者们已经发展出多种研究范式对其可能涉及的运作机制进行探讨。然而, 在不同范式下所观察到的巩固时程存在较大差异, 其所遵循的巩固模式也尚不清晰。此外, 对于巩固所涉及的理论及神经机制亦存在不同的观点。通过对比不同范式的差异性及梳理各方的观点, 可以有效推动这些问题的解决。未来研究除了可以在多种范式下对巩固模式进行验证, 还可以探究注意在巩固中的作用, 以及项目熟悉性等因素会对巩固加工产生何种影响。

关键词: 视觉工作记忆巩固, 巩固时程, 巩固模式

Abstract:

In the process of visual working memory, the maintenance and manipulation of the memory items require transforming a fleeting sensory input into a durable working memory representation, which is defined as the visual working memory consolidation. In light of the “gating” role of the consolidation, the researchers have developed a variety of research paradigms to explore the mechanisms that may be involved. However, the time course and the patterns of consolidation observed under different paradigms is quite different. Moreover, there are also different views on the theoretical and neural mechanism involved in consolidation. By comparing the differences among different paradigms and sorting out the views of various parties, the solutions to these problems can be effectively promoted. In addition to verifying the consolidation model in a variety of paradigms, future researches can also explore the role of attention in consolidation and how factors such as project familiarity affect consolidation processing.

Key words: visual working memory consolidation, the time course of consolidation, the pattern of consolidation

中图分类号:

B842

龙芳芳, 李昱辰, 陈晓宇, 李子媛, 梁腾飞, 刘强. (2019). 视觉工作记忆的巩固加工：时程、模式及机制. 心理科学进展 , 27(8), 1404-1416.

LONG Fangfang, LI Yuchen, CHEN Xiaoyu, LI Ziyuan, LIANG Tengfei, LIU Qiang. (2019). Consolidation processing of visual working memory: Time course, pattern and mechanism. Advances in Psychological Science, 27(8), 1404-1416.

图/表 2

图1 同时/序列呈现范式(李腾飞, 马楠, 胡中华, 刘强, 2017) 注：项目呈现时间(mt)是通过测量阈限时间以确定每名被试巩固一项记忆色块的最小时间。具体的操作方式是先让被试只进行序列呈现条件的实验, 呈现时间共有8种可能(8 ms、16 ms、33 ms、66 ms、133 ms、266 ms、533 ms和800 ms等概率随机呈现), 每种呈现时间各18次。分别计算被试在8种呈现时间条件下的反应正确率, 通过参数拟合, 选取能够使被试达到80%正确率所对应的时间作为正式实验中的记忆色块呈现时间。此外, 为了防止被试在测量阈限阶段对序列呈现存在练习效应, 同时要求被试完成相同试次的同时呈现任务, 其他条件与序列呈现条件相同, 但不进行统计分析。

图2 eSTST模型(Wyble, Bowman, & Nieuwenstein, 2009)

参考文献 79

[1]	李腾飞, 马楠, 胡中华, 刘强 . (2017). 空间距离对视觉工作记忆巩固的影响. 心理学报, 49( 6), 711-722.
[2]	孙慧明, 傅小兰 . (2011). 视觉工作记忆巩固机制: 固化抑或衰退. 心理科学进展, 19( 11), 1605-1614.
[3]	Akyürek E. G., Leszczyński M., & Schubö A . (2010). The temporal locus of the interaction between working memory consolidation and the attentional blink. Psychophysiology, 47( 6), 1134-1141.
[4]	Awh E., Barton B., & Vogel E. K . (2007). Visual working memory represents a fixed number of items regardless of complexity. Psychological Science, 18( 7), 622-628.
[5]	Baddeley A., Cocchini G., Sala S. D., Logie R. H., & Spinnler H . (1999). Working memory and vigilance: Evidence from normal aging and Alzheimer’s disease. Brain & Cognition, 41( 1), 87-108.
[6]	Ballard D. H., Hayhoe M. M., & Pelz J. B . (1995). Memory representations in natural tasks.(Author Abstract). Journal of Cognitive Neuroscience, 7( 1), 66-80.
[7]	Bayliss D. M., Bogdanovs J., & Jarrold C . (2015). Consolidating working memory: Distinguishing the effects of consolidation, rehearsal and attentional refreshing in a working memory span task. Journal of Memory and Language, 81, 34-50.
[8]	Bays P.., &Husain M., (2008). Response to comment on “Dynamic shifts of limited working memory resources in human vision.” Science, 321( 5890), 851-854.
[9]	Beck D.., &Kastner S., (2005). Stimulus context modulates competition in human extrastriate cortex. Nature Neuroscience, 8( 8), 1110-1116.
[10]	Britten K.., &Newsome W.T . (1998). Tuning bandwidths for near-threshold stimuli in area mt. Journal of neurophysiology,80(2), 762-770.
[11]	Blalock L. . (2013). Mask similarity impacts short-term consolidation in visual working memory. Psychonomic Bulletin & Review, 20( 6), 1290-1295.
[12]	Blalock L. . (2015). Stimulus familiarity improves consolidation of visual working memory representations. Attention Perception & Psychophysics, 77( 4), 1143-1158.
[13]	Becker M. W., Miller J. R., & Liu T . (2013). A severe capacity limit in the consolidation of orientation information into visual short-term memory. Attention,Perception, & Psychophysics, 75(3), 415-425.
[14]	Chen H. &Wyble B., (2015). Amnesia for object attributes: Failure to report attended information that had just reached conscious awareness. Psychological Science,26(2), 203-210.
[15]	Chen H. &Wyble B., (2016). Attribute amnesia reflects a lack of memory consolidation for attended information. Journal of Experimental Psychology: Human Perception and Performance,42(2), 225-234.
[16]	Chun M.., &Potter M.C . (1995). A two-stage model for multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance,21(1), 109-127.
[17]	Cowan N., Li D., Moffitt A., Becker T. M., Martin E. A., Saults J. S., & Christ S. E . (2011). A neural region of abstract working memory. Journal of Cognitive Neuroscience, 23( 10), 2852-2863.
[18]	Dell’Acqua R., Dux P. E., Wyble B., & Jolicœur P . (2012). Sparing from the attentional blink is not spared from structural limitations. Psychonomic Bulletin & Review, 19( 2), 232-238.
[19]	DiCarlo J. J., Zoccolan D., & Rust N. C . (2012). How does the brain solve visual object recognition?(Report). Neuron, 73( 3), 415-434.
[20]	Droll J. A., Hayhoe M. M., Triesch J., & Sullivan B. T . (2005). Task demands control acquisition and storage of visual information. Journal of Experimental Psychology: Human Perception and Performance, 31( 6), 1416-1438.
[21]	Duncan J. (1983). Perceptual selection based on alphanumeric class: Evidence from partial reports. Perception & Psychophysics, 33( 6), 533-547.
[22]	Eckstein M. P., Thomas J. P., Palmer J., & Shimozaki S. S . (2000). A signal detection model predicts the effects of set size on visual search accuracy for feature, conjunction, triple conjunction, and disjunction displays. Perception & Psychophysics, 62( 3), 425-451.
[23]	Emrich S. M., Riggall A. C., Larocque J. J., & Postle B. R . (2013). Distributed patterns of activity in sensory cortex reflect the precision of multiple items maintained in visual short-term memory. Journal of Neuroscience the Official Journal of the Society for Neuroscience, 33( 15), 6516-6523.
[24]	Engle R.., &Kane M.J . (2004). Executive attention, working memory capacity, and a two-factor theory of cognitive control. Psychology of Learning & Motivation, 44( 3), 145-199.
[25]	Ester E. F., Anderson D. E., Serences J. T., & Awh E . (2013). A neural measure of precision in visual working memory. Journal of Cognitive Neuroscience, 25( 5), 754-761.
[26]	Gegenfurtner K.., Sperling, & George . (1993). Information transfer in iconic memory experiments. Journal of Experimental Psychology: Human Perception and Performance,19(4), 845-866.
[27]	Giesbrecht B. &Di L.V . (1998). Beyond the attentional blink: visual masking by object substitution. Journal of Experimental Psychology: Human Perception and Performance,24(5), 1454-1466.
[28]	Hao R., Becker M. W., Ye C., Liu Q., & Liu T . (2018). The bandwidth of VWM consolidation varies with the stimulus feature: Evidence from event-related potentials. Journal of Experimental Psychology: Human Perception and Performance,44(5), 767-777.
[29]	Haskell C. &Anderson B., (2016). Attentional effects on orientation judgements are dependent on memory consolidation processes. Quarterly Journal of Experimental Psychology, 69( 11), 2147-2165.
[30]	Hembrook-Short J. R., Mock V. L., & Briggs F . (2017). Attentional modulation of neuronal activity depends on neuronal feature selectivity. Current Biology, 27( 13), 1878-1887.
[31]	Huang L., Treisman A., & Pashler H . (2007). Characterizing the limits of human visual awareness. Science, 317( 5839), 823-825.
[32]	Hüttermann S., Memmert D., & Simons D. J . (2014). The size and shape of the attentional “spotlight” varies with differences in sports expertise. Journal of Experimental Psychology: Human Perception and Performance,20(2), 147-157.
[33]	Isaak M. I., Shapiro K. L., & Martin J . (1999). The attentional blink reflects retrieval competition among multiple rapid serial visual presentation items: tests of an interference model. Journal of Experimental Psychology: Human Perception and Performance,25(6), 1774-1792.
[34]	Jolicœur P. &Acqua R.D . (1998). The Demonstration of Short-Term Consolidation, Cognitive Psychology,36(2), 138-202.
[35]	Kastner S., Weerd P. De., Pinsk M. A., Elizondo M. I., Desimone R., & Ungerleider L. G . (2001). Modulation of sensory suppression: Implications for receptive field sizes in the human visual cortex. Journal of Neurophysiology, 86( 3), 1398-1411.
[36]	Lamsweerde A. &Johnson J., (2017). Assessing the effect of early visual cortex transcranial magnetic stimulation on working memory consolidation. Journal of Cognitive Neuroscience,29(7), 1226-1238.
[37]	Larocque J. J., Lewispeacock J. A., & Postle B. R . (2014). Multiple neural states of representation in short-term memory? It’s a matter of attention. Frontiers in Human Neuroscience, 8, 5.
[38]	Lehle C. &Hübner R., (2009). Strategic capacity sharing between two tasks: evidence from tasks with the same and with different task sets. Psychological Research, 73( 5), 707-726.
[39]	Lisman J.., &Jensen O., (2013). The theta-gamma neural code. Neuron, 77( 6), 1002-1016.
[40]	Liu T. &Becker M.W . (2013). Serial consolidation of orientation information into visual short-term memory. Psychological Science,24(6), 1044-1050.
[41]	Luck S.., &Vogel E.K . (1997). The capacity of visual working memory for features and conjunctions. Nature, 390( 6657), 279-281.
[42]	Ma W. J., Husain M., & Bays P. M . (2014). Changing concepts of working memory. Nature Neuroscience, 17( 3), 347-356.
[43]	Makovski T. &Lavidor M., (2014). Stimulating occipital cortex enhances visual working memory consolidation. Behavioural Brain Research, 275, 84-87.
[44]	Malcolm G.., &Shomstein S., (2015). Object-based attention in real-world scenes. Journal of Experimental Psychology: General, 144( 2), 257-263.
[45]	Mance I., Becker M. W., & Liu T . (2012). Parallel consolidation of simple features into visual short-term memory. Journal of Experimental Psychology: Human Perception and Performance, 38( 2), 429-438.
[46]	Marti S., Sigman M., & Dehaene S . (2012). A shared cortical bottleneck underlying attentional blink and psychological refractory period. Neuroimage, 59( 3), 2883-2898.
[47]	Miller J. R., Becker M. W., & Liu T . (2014). The bandwidth of consolidation into visual short-term memory depends on the visual feature. Visual Cognition, 22( 7), 920-947.
[48]	Nieuwenstein M. &Wyble B., (2014). Beyond a mask and against the bottleneck: Retroactive dual-task interference during working memory consolidation of a masked visual target. Journal of Experimental Psychology: General,143(3), 1409-1427.
[49]	Palmer J., Verghese P., & Pavel M . (2000). The psychophysics of visual search. Vision Research, 40( 10), 1227-1268.
[50]	Pinto Y., Sligte I. G., Shapiro K. L., & Lamme V. A. F .(2013). Fragile visual short-term memory is an object-based and location-specific store. Psychonomic Bulletin & Review, 20( 4), 732-739.
[51]	Ricker T. . (2015). The role of short-term consolidation in memory persistence. AIMS Neuroscience, 2( 4), 259-279.
[52]	Ricker T.., &Hardman K.O . (2017). The nature of short- term consolidation in visual working memory. Journal of Experimental Psychology: General,146(11), 1551-1573.
[53]	Ricker T. J., Nieuwenstein M. R., Bayliss D. M., & Barrouillet P . (2018). Working memory consolidation: insights from studies on attention and working memory. Annals of the New York Academy of Sciences, 1424( 1), 8-18.
[54]	Rideaux R., Apthorp D., & Edwards M . (2015). Evidence for parallel consolidation of motion direction and orientation into visual short-term memory. Journal of Vision, 15( 2), 17-17.
[55]	Rideaux R. &Edwards M., (2016). The cost of parallel consolidation into visual working memory. Journal of Vision, 16( 6), 1-14. doi: 10.1167/16.6.1
[56]	Saults J.., &Cowan N., (2007). A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory. Journal of Experimental Psychology: General, 136( 4), 663-684.
[57]	Scharff A., Palmer J., & Moore C. M . (2011). Extending the simultaneous-sequential paradigm to measure perceptual capacity for features and words. Journal of Experimental Psychology :Human Perception and Performance, 37( 3), 813-833.
[58]	Siemann J., Herrmann M., & Galashan D . (2018). The effect of feature-based attention on flanker interference processing: An fMRI-constrained source analysis. Scientific Reports,8(1), 1580.
[59]	Sligte I. G., Scholte H. S., & Lamme V. A . (2008). Are there multiple visual short-term memory stores? Plos One, 3( 2), e1699.
[60]	Snyder H. R., Banich M. T., & Munakata Y . (2014). All competition is not alike: neural mechanisms for resolving underdetermined and prepotent competition. Journal of Cognitive Neuroscience, 26( 11), 2608-2623.
[61]	Stevanovski B. &Jolicœur P., (2011). Consolidation of multifeature items in visual working memory: Central capacity requirements for visual consolidation. Attention,Perception, & Psychophysics,73(4), 1108-1119.
[62]	Stevanovski B. &Jolicœur P., (2007). Visual short-term memory: Central capacity limitations in short-term consolidation. Visual Cognition,15(5), 532-563.
[63]	Sullivan L. . (1896). The tall office building artistically considered.Lippincott’s Magazine, March.
[64]	Todd J. J., Han S. W., Harrison S., & Marois R . (2011). The neural correlates of visual working memory encoding: A time-resolved fMRI study. Neuropsychologia, 49( 6), 1527-1536.
[65]	Todd J.., &Marois R., (2004). Capacity limit of visual short-term memory in human posterior parietal cortex. Nature, 428( 6984), 751-754.
[66]	Triesch J., Ballard D. H., Hayhoe M. M., & Sullivan B. T . (2003). What you see is what you need. Journal of Vision, 3( 1), 86-94.
[67]	Vogel E.., &Luck S.J . (2002). Delayed working memory consolidation during the attentional blink. Psychonomic Bulletin & Review, 9( 4), 739-743.
[68]	Vogel E. K., Woodman G. F., & Luck S. J . (2001). Storage of features, conjunctions, and objects in visual working memory. Journal of Experimental Psychology: Human Perception and Performance,27(1), 92-114.
[69]	Vogel E. K., Woodman G. F., & Luck S. J . (2006). The time course of consolidation in visual working memory. Journal of Experimental Psychology: Human Perception and Performance, 32( 6), 1436-1451.
[70]	Wang J. J., Xu F. Y., & Ma A. J . (2012). Research of safe speed at snow on freeway based on braking model of stopping sight distance. Applied Mechanics & Materials, 209-211, 837-840.
[71]	West G. L., Pun C., Pratt J., & Ferber S . (2010). Capacity limits during perceptual encoding. Journal of Vision,10(2), 14.1-12.
[72]	Wilken P. &Ma W.J . (2004). A detection theory account of change detection. Journal of Vision,4(12), 1120-1135.
[73]	Wyble B., Bowman H., & Nieuwenstein M . (2009). The attentional blink provides episodic distinctiveness: Sparing at a cost. Journal of Experimental Psychology: Human Perception and Performance, 35( 3), 787-807.
[74]	Wyble B., Potter M. C., Bowman H., & Nieuwenstein M . (2011). Attentional episodes in visual perception. Journal of Experimental Psychology: General,140(3), 488-505.
[75]	Xie W. &Zhang W., (2017). Familiarity speeds up visual short-term memory consolidation. Journal of Experimental Psychology: Human Perception and Performance, 43( 6), 1207-1221.
[76]	Xu Y. &Chun M.M . (2006). Dissociable neural mechanisms supporting visual short-term memory for objects. Nature, 440( 7080), 91-95.
[77]	Ye C., Zhang L., Liu T., Li H., & Liu Q . (2014). Visual working memory capacity for color is independent of representation resolution. PloS One, 9( 3), e91681.
[78]	Zhang W. &Luck S.J . (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453( 7192), 233-235.
[79]	Zylberberg A., Slezak D. F., Roelfsema P. R., Dehaene S., & Sigman M . (2010). The brain’s router: A cortical network model of serial processing in the primate brain. Psychological Science,6(4), e1000765.