Consolidation processing of visual working memory: Time course, pattern and mechanism

doi:10.3724/SP.J.1042.2019.01404

Abstract

Abstract:

In the process of visual working memory, the maintenance and manipulation of the memory items require transforming a fleeting sensory input into a durable working memory representation, which is defined as the visual working memory consolidation. In light of the “gating” role of the consolidation, the researchers have developed a variety of research paradigms to explore the mechanisms that may be involved. However, the time course and the patterns of consolidation observed under different paradigms is quite different. Moreover, there are also different views on the theoretical and neural mechanism involved in consolidation. By comparing the differences among different paradigms and sorting out the views of various parties, the solutions to these problems can be effectively promoted. In addition to verifying the consolidation model in a variety of paradigms, future researches can also explore the role of attention in consolidation and how factors such as project familiarity affect consolidation processing.

Key words: visual working memory consolidation, the time course of consolidation, the pattern of consolidation

CLC Number:

B842

LONG Fangfang, LI Yuchen, CHEN Xiaoyu, LI Ziyuan, LIANG Tengfei, LIU Qiang. Consolidation processing of visual working memory: Time course, pattern and mechanism[J]. Advances in Psychological Science, 2019, 27(8): 1404-1416.

Figures/Tables 2

References 79

[1]	李腾飞, 马楠, 胡中华, 刘强 . (2017). 空间距离对视觉工作记忆巩固的影响. 心理学报, 49( 6), 711-722.
[2]	孙慧明, 傅小兰 . (2011). 视觉工作记忆巩固机制: 固化抑或衰退. 心理科学进展, 19( 11), 1605-1614.
[3]	Akyürek E. G., Leszczyński M., & Schubö A . (2010). The temporal locus of the interaction between working memory consolidation and the attentional blink. Psychophysiology, 47( 6), 1134-1141.
[4]	Awh E., Barton B., & Vogel E. K . (2007). Visual working memory represents a fixed number of items regardless of complexity. Psychological Science, 18( 7), 622-628.
[5]	Baddeley A., Cocchini G., Sala S. D., Logie R. H., & Spinnler H . (1999). Working memory and vigilance: Evidence from normal aging and Alzheimer’s disease. Brain & Cognition, 41( 1), 87-108.
[6]	Ballard D. H., Hayhoe M. M., & Pelz J. B . (1995). Memory representations in natural tasks.(Author Abstract). Journal of Cognitive Neuroscience, 7( 1), 66-80.
[7]	Bayliss D. M., Bogdanovs J., & Jarrold C . (2015). Consolidating working memory: Distinguishing the effects of consolidation, rehearsal and attentional refreshing in a working memory span task. Journal of Memory and Language, 81, 34-50.
[8]	Bays P.., &Husain M., (2008). Response to comment on “Dynamic shifts of limited working memory resources in human vision.” Science, 321( 5890), 851-854.
[9]	Beck D.., &Kastner S., (2005). Stimulus context modulates competition in human extrastriate cortex. Nature Neuroscience, 8( 8), 1110-1116.
[10]	Britten K.., &Newsome W.T . (1998). Tuning bandwidths for near-threshold stimuli in area mt. Journal of neurophysiology,80(2), 762-770.
[11]	Blalock L. . (2013). Mask similarity impacts short-term consolidation in visual working memory. Psychonomic Bulletin & Review, 20( 6), 1290-1295.
[12]	Blalock L. . (2015). Stimulus familiarity improves consolidation of visual working memory representations. Attention Perception & Psychophysics, 77( 4), 1143-1158.
[13]	Becker M. W., Miller J. R., & Liu T . (2013). A severe capacity limit in the consolidation of orientation information into visual short-term memory. Attention,Perception, & Psychophysics, 75(3), 415-425.
[14]	Chen H. &Wyble B., (2015). Amnesia for object attributes: Failure to report attended information that had just reached conscious awareness. Psychological Science,26(2), 203-210.
[15]	Chen H. &Wyble B., (2016). Attribute amnesia reflects a lack of memory consolidation for attended information. Journal of Experimental Psychology: Human Perception and Performance,42(2), 225-234.
[16]	Chun M.., &Potter M.C . (1995). A two-stage model for multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance,21(1), 109-127.
[17]	Cowan N., Li D., Moffitt A., Becker T. M., Martin E. A., Saults J. S., & Christ S. E . (2011). A neural region of abstract working memory. Journal of Cognitive Neuroscience, 23( 10), 2852-2863.
[18]	Dell’Acqua R., Dux P. E., Wyble B., & Jolicœur P . (2012). Sparing from the attentional blink is not spared from structural limitations. Psychonomic Bulletin & Review, 19( 2), 232-238.
[19]	DiCarlo J. J., Zoccolan D., & Rust N. C . (2012). How does the brain solve visual object recognition?(Report). Neuron, 73( 3), 415-434.
[20]	Droll J. A., Hayhoe M. M., Triesch J., & Sullivan B. T . (2005). Task demands control acquisition and storage of visual information. Journal of Experimental Psychology: Human Perception and Performance, 31( 6), 1416-1438.
[21]	Duncan J. (1983). Perceptual selection based on alphanumeric class: Evidence from partial reports. Perception & Psychophysics, 33( 6), 533-547.
[22]	Eckstein M. P., Thomas J. P., Palmer J., & Shimozaki S. S . (2000). A signal detection model predicts the effects of set size on visual search accuracy for feature, conjunction, triple conjunction, and disjunction displays. Perception & Psychophysics, 62( 3), 425-451.
[23]	Emrich S. M., Riggall A. C., Larocque J. J., & Postle B. R . (2013). Distributed patterns of activity in sensory cortex reflect the precision of multiple items maintained in visual short-term memory. Journal of Neuroscience the Official Journal of the Society for Neuroscience, 33( 15), 6516-6523.
[24]	Engle R.., &Kane M.J . (2004). Executive attention, working memory capacity, and a two-factor theory of cognitive control. Psychology of Learning & Motivation, 44( 3), 145-199.
[25]	Ester E. F., Anderson D. E., Serences J. T., & Awh E . (2013). A neural measure of precision in visual working memory. Journal of Cognitive Neuroscience, 25( 5), 754-761.
[26]	Gegenfurtner K.., Sperling, & George . (1993). Information transfer in iconic memory experiments. Journal of Experimental Psychology: Human Perception and Performance,19(4), 845-866.
[27]	Giesbrecht B. &Di L.V . (1998). Beyond the attentional blink: visual masking by object substitution. Journal of Experimental Psychology: Human Perception and Performance,24(5), 1454-1466.
[28]	Hao R., Becker M. W., Ye C., Liu Q., & Liu T . (2018). The bandwidth of VWM consolidation varies with the stimulus feature: Evidence from event-related potentials. Journal of Experimental Psychology: Human Perception and Performance,44(5), 767-777.
[29]	Haskell C. &Anderson B., (2016). Attentional effects on orientation judgements are dependent on memory consolidation processes. Quarterly Journal of Experimental Psychology, 69( 11), 2147-2165.
[30]	Hembrook-Short J. R., Mock V. L., & Briggs F . (2017). Attentional modulation of neuronal activity depends on neuronal feature selectivity. Current Biology, 27( 13), 1878-1887.
[31]	Huang L., Treisman A., & Pashler H . (2007). Characterizing the limits of human visual awareness. Science, 317( 5839), 823-825.
[32]	Hüttermann S., Memmert D., & Simons D. J . (2014). The size and shape of the attentional “spotlight” varies with differences in sports expertise. Journal of Experimental Psychology: Human Perception and Performance,20(2), 147-157.
[33]	Isaak M. I., Shapiro K. L., & Martin J . (1999). The attentional blink reflects retrieval competition among multiple rapid serial visual presentation items: tests of an interference model. Journal of Experimental Psychology: Human Perception and Performance,25(6), 1774-1792.
[34]	Jolicœur P. &Acqua R.D . (1998). The Demonstration of Short-Term Consolidation, Cognitive Psychology,36(2), 138-202.
[35]	Kastner S., Weerd P. De., Pinsk M. A., Elizondo M. I., Desimone R., & Ungerleider L. G . (2001). Modulation of sensory suppression: Implications for receptive field sizes in the human visual cortex. Journal of Neurophysiology, 86( 3), 1398-1411.
[36]	Lamsweerde A. &Johnson J., (2017). Assessing the effect of early visual cortex transcranial magnetic stimulation on working memory consolidation. Journal of Cognitive Neuroscience,29(7), 1226-1238.
[37]	Larocque J. J., Lewispeacock J. A., & Postle B. R . (2014). Multiple neural states of representation in short-term memory? It’s a matter of attention. Frontiers in Human Neuroscience, 8, 5.
[38]	Lehle C. &Hübner R., (2009). Strategic capacity sharing between two tasks: evidence from tasks with the same and with different task sets. Psychological Research, 73( 5), 707-726.
[39]	Lisman J.., &Jensen O., (2013). The theta-gamma neural code. Neuron, 77( 6), 1002-1016.
[40]	Liu T. &Becker M.W . (2013). Serial consolidation of orientation information into visual short-term memory. Psychological Science,24(6), 1044-1050.
[41]	Luck S.., &Vogel E.K . (1997). The capacity of visual working memory for features and conjunctions. Nature, 390( 6657), 279-281.
[42]	Ma W. J., Husain M., & Bays P. M . (2014). Changing concepts of working memory. Nature Neuroscience, 17( 3), 347-356.
[43]	Makovski T. &Lavidor M., (2014). Stimulating occipital cortex enhances visual working memory consolidation. Behavioural Brain Research, 275, 84-87.
[44]	Malcolm G.., &Shomstein S., (2015). Object-based attention in real-world scenes. Journal of Experimental Psychology: General, 144( 2), 257-263.
[45]	Mance I., Becker M. W., & Liu T . (2012). Parallel consolidation of simple features into visual short-term memory. Journal of Experimental Psychology: Human Perception and Performance, 38( 2), 429-438.
[46]	Marti S., Sigman M., & Dehaene S . (2012). A shared cortical bottleneck underlying attentional blink and psychological refractory period. Neuroimage, 59( 3), 2883-2898.
[47]	Miller J. R., Becker M. W., & Liu T . (2014). The bandwidth of consolidation into visual short-term memory depends on the visual feature. Visual Cognition, 22( 7), 920-947.
[48]	Nieuwenstein M. &Wyble B., (2014). Beyond a mask and against the bottleneck: Retroactive dual-task interference during working memory consolidation of a masked visual target. Journal of Experimental Psychology: General,143(3), 1409-1427.
[49]	Palmer J., Verghese P., & Pavel M . (2000). The psychophysics of visual search. Vision Research, 40( 10), 1227-1268.
[50]	Pinto Y., Sligte I. G., Shapiro K. L., & Lamme V. A. F .(2013). Fragile visual short-term memory is an object-based and location-specific store. Psychonomic Bulletin & Review, 20( 4), 732-739.
[51]	Ricker T. . (2015). The role of short-term consolidation in memory persistence. AIMS Neuroscience, 2( 4), 259-279.
[52]	Ricker T.., &Hardman K.O . (2017). The nature of short- term consolidation in visual working memory. Journal of Experimental Psychology: General,146(11), 1551-1573.
[53]	Ricker T. J., Nieuwenstein M. R., Bayliss D. M., & Barrouillet P . (2018). Working memory consolidation: insights from studies on attention and working memory. Annals of the New York Academy of Sciences, 1424( 1), 8-18.
[54]	Rideaux R., Apthorp D., & Edwards M . (2015). Evidence for parallel consolidation of motion direction and orientation into visual short-term memory. Journal of Vision, 15( 2), 17-17.
[55]	Rideaux R. &Edwards M., (2016). The cost of parallel consolidation into visual working memory. Journal of Vision, 16( 6), 1-14. doi: 10.1167/16.6.1
[56]	Saults J.., &Cowan N., (2007). A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory. Journal of Experimental Psychology: General, 136( 4), 663-684.
[57]	Scharff A., Palmer J., & Moore C. M . (2011). Extending the simultaneous-sequential paradigm to measure perceptual capacity for features and words. Journal of Experimental Psychology :Human Perception and Performance, 37( 3), 813-833.
[58]	Siemann J., Herrmann M., & Galashan D . (2018). The effect of feature-based attention on flanker interference processing: An fMRI-constrained source analysis. Scientific Reports,8(1), 1580.
[59]	Sligte I. G., Scholte H. S., & Lamme V. A . (2008). Are there multiple visual short-term memory stores? Plos One, 3( 2), e1699.
[60]	Snyder H. R., Banich M. T., & Munakata Y . (2014). All competition is not alike: neural mechanisms for resolving underdetermined and prepotent competition. Journal of Cognitive Neuroscience, 26( 11), 2608-2623.
[61]	Stevanovski B. &Jolicœur P., (2011). Consolidation of multifeature items in visual working memory: Central capacity requirements for visual consolidation. Attention,Perception, & Psychophysics,73(4), 1108-1119.
[62]	Stevanovski B. &Jolicœur P., (2007). Visual short-term memory: Central capacity limitations in short-term consolidation. Visual Cognition,15(5), 532-563.
[63]	Sullivan L. . (1896). The tall office building artistically considered.Lippincott’s Magazine, March.
[64]	Todd J. J., Han S. W., Harrison S., & Marois R . (2011). The neural correlates of visual working memory encoding: A time-resolved fMRI study. Neuropsychologia, 49( 6), 1527-1536.
[65]	Todd J.., &Marois R., (2004). Capacity limit of visual short-term memory in human posterior parietal cortex. Nature, 428( 6984), 751-754.
[66]	Triesch J., Ballard D. H., Hayhoe M. M., & Sullivan B. T . (2003). What you see is what you need. Journal of Vision, 3( 1), 86-94.
[67]	Vogel E.., &Luck S.J . (2002). Delayed working memory consolidation during the attentional blink. Psychonomic Bulletin & Review, 9( 4), 739-743.
[68]	Vogel E. K., Woodman G. F., & Luck S. J . (2001). Storage of features, conjunctions, and objects in visual working memory. Journal of Experimental Psychology: Human Perception and Performance,27(1), 92-114.
[69]	Vogel E. K., Woodman G. F., & Luck S. J . (2006). The time course of consolidation in visual working memory. Journal of Experimental Psychology: Human Perception and Performance, 32( 6), 1436-1451.
[70]	Wang J. J., Xu F. Y., & Ma A. J . (2012). Research of safe speed at snow on freeway based on braking model of stopping sight distance. Applied Mechanics & Materials, 209-211, 837-840.
[71]	West G. L., Pun C., Pratt J., & Ferber S . (2010). Capacity limits during perceptual encoding. Journal of Vision,10(2), 14.1-12.
[72]	Wilken P. &Ma W.J . (2004). A detection theory account of change detection. Journal of Vision,4(12), 1120-1135.
[73]	Wyble B., Bowman H., & Nieuwenstein M . (2009). The attentional blink provides episodic distinctiveness: Sparing at a cost. Journal of Experimental Psychology: Human Perception and Performance, 35( 3), 787-807.
[74]	Wyble B., Potter M. C., Bowman H., & Nieuwenstein M . (2011). Attentional episodes in visual perception. Journal of Experimental Psychology: General,140(3), 488-505.
[75]	Xie W. &Zhang W., (2017). Familiarity speeds up visual short-term memory consolidation. Journal of Experimental Psychology: Human Perception and Performance, 43( 6), 1207-1221.
[76]	Xu Y. &Chun M.M . (2006). Dissociable neural mechanisms supporting visual short-term memory for objects. Nature, 440( 7080), 91-95.
[77]	Ye C., Zhang L., Liu T., Li H., & Liu Q . (2014). Visual working memory capacity for color is independent of representation resolution. PloS One, 9( 3), e91681.
[78]	Zhang W. &Luck S.J . (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453( 7192), 233-235.
[79]	Zylberberg A., Slezak D. F., Roelfsema P. R., Dehaene S., & Sigman M . (2010). The brain’s router: A cortical network model of serial processing in the primate brain. Psychological Science,6(4), e1000765.