The influential factors and neural mechanisms of audiovisual integration in older adults

doi:10.3724/SP.J.1042.2020.00790

Abstract

Abstract:

There is still much debate over whether older adults have enhanced or attenuated audiovisual integration. Research on the neural mechanism of audiovisual integration in older adults is needed to provide a scientific brain-health programme based on crossmodal integration. Here, we summarized two parts based on previous studies. First, audiovisual integration ability in older adults is influenced by the characteristics of the physical stimuli, the spatial and temporal relationships of the stimuli, and the attentional allocation. Second, audiovisual integration effects are observed in older adults. On the one hand, older adults showed higher functional connectivity, network efficiency and enhanced audiovisual integration effects, such as stronger activity in the posterior parietal lobe, medial prefrontal lobe, left prefrontal lobe, and the super-additive amplitude of P2 observed in the central prefrontal region. In addition, audiovisual integration in older adults occurred earlier and extended longer than that in younger adults. On the other hand, older adults have slower response times and smaller amplitudes to audiovisual stimuli in the superior temporal gyrus than younger adults, which shows a weaker integration facilitation effect in older adults. The study of audiovisual integration in older adults induced by simple stimuli provides a reliable basis for further revealing the integration mechanism, but the processing mechanism of audiovisual integration for complex situations remains to be explored.

Key words: audiovisual integration, older adults, multisensory integration, compensation mechanism, facilitation effect

CLC Number:

B844
B842

YANG Weiping, LI Shengnan, LI Zimo, GUO Ao, REN Yanna. The influential factors and neural mechanisms of audiovisual integration in older adults[J]. Advances in Psychological Science, 2020, 28(5): 790-799.

References 77

1	罗霄骁, 康冠兰, 周晓林 . ( 2018). McGurk效应的影响因素与神经基础. 心理科学进展, 26( 11), 1935-1951.
2	彭姓, 常若松, 任桂琴, 王爱君, 唐晓雨 . ( 2018). 外源性注意与多感觉整合的交互关系. 心理科学进展, 26( 12), 2129-2140.
3	于薇, 王爱君, 张明 . ( 2017). 集中和分散注意对多感觉整合中听觉主导效应的影响. 心理学报, 49( 2), 164-173.
4	Baum S. H., &Beauchamp M. S . ( 2014). Greater bold variability in older compared with younger adults during audiovisual speech perception. PLoS One, 9( 10), e111121.
5	Bedard G. &Barnett-Cowan M. , ( 2016). Impaired timing of audiovisual events in the elderly. Experimental Brain Research, 234( 1), 331-340.
6	Boer-Schellekens L. &Vroomen J. , ( 2014). Multisensory integration compensates loss of sensitivity of visual temporal order in the elderly. Experimental Brain Research, 232( 1), 253-262.
7	Bolognini N., Frassinetti F., Serino A., & Làdavas E . ( 2005). “Acoustical vision” of below threshold stimuli: Interaction among spatially converging audiovisual inputs. Experimental Brain Research,160( 3), 273-282.
8	Cecere R., Gross J., Thut G., & Molholm S . ( 2016). Behavioural evidence for separate mechanisms of audiovisual temporal binding as a function of leading sensory modality. European Journal of Neuroscience, 43( 12), 1561-1568.
9	Chaby L., Boullay V. L., Chetouani M., & Plaza M . ( 2015). Compensating for age limits through emotional crossmodal integration. Frontiers in Psychology, 6, 12.
10	Cienkowski K. M., &Carney A. E . ( 2002). Auditory-visual speech perception and aging. Ear and Hearing, 23( 5), 439-449.
11	Couth S., Gowen E., & Poliakoff E . ( 2018). Using race model violation to explore multisensory responses in older adults: Enhanced multisensory integration or slower unisensory processing? Multisensory Research, 31( 3-4), 151-174.
12	Deloss D. J., Pierce R. S., & Andersen G. J . ( 2013). Multisensory integration, aging, and the sound-induced flash illusion. Psychology and Aging, 28( 3), 802-812.
13	de Niear M. A., Gupta P. B., Baum S. H., & Wallace M. T . ( 2018). Perceptual training enhances temporal acuity for multisensory speech. Neurobiology of Learning and Memory, 147, 9-17.
14	Diaconescu A. O., Hasher L., & McIntosh A. R . ( 2013). Visual dominance and multisensory integration changes with age. Neurolmage, 65, 152-166.
15	Diederich A. &Colonius H. , ( 2015). The time window of multisensory integration: Relating reaction times and judgments of temporal order. Psychological Review, 122( 2), 232-241.
16	Diederich A., Colonius H., & Schomburg A . ( 2008). Assessing age-related multisensory enhancement with the time-window-of-integration model. Neuropsychologia, 46( 10), 2556-2562.
17	Dieter K. C., Melnick M. D., & Tadin D . ( 2016). Perceptual training profoundly alters binocular rivalry through both sensory and attentional enhancements. Proceedings of the National Academy of Sciences, 113( 45), 12874-12879.
18	Frassinetti F., Bolognini N., & Ladavas E . ( 2002). Enhancement of visual perception by crossmodal visuo- auditory interaction. Experimental Brain Research, 147( 3), 332-343.
19	Freiherr J., Lundstrom J. N., Habel U., & Reetz K . ( 2013). Multisensory integration mechanisms during aging. Frontiers in Human Neuroscience, 7( 863), 1-6.
20	Giard M. H., &Peronnet F. , ( 1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11( 5), 473-490.
21	Gibney K. D., Aligbe E., Eggleston B. A., Nunes S. R., Kerkhoff W. G., Dean C. L., & Kwakye L. D . ( 2017). Visual distractors disrupt audiovisual integration regardless of stimulus complexity. Frontiers in Integrative Neuroscience, 11( 1), 1-17.
22	Grady, C. ( 2012). The cognitive neuroscience of ageing. Nature Reviews Neuroscience, 13( 7), 491-505.
23	Grasso P. A., Benassi M., Ladavas E., & Bertini C . ( 2016). Audio-visual multisensory training enhances visual processing of motion stimuli in healthy participants: An electrophysiological study. European Journal of Neuroscience, 44( 10), 2748-2758.
24	Gutchess, A. ( 2014). Plasticity of the aging brain: New directions in cognitive neuroscience. Science, 346( 6209), 579-582.
25	Hairston W. D., Wallace M. T., Vaughan J. W., Stein B. E., Norris J. L., & Schirillo J. A . ( 2003). Visual localization ability influences cross-modal bias. Journal of Cognitive Neuroscience, 15( 1), 20-29.
26	Hugenschmidt C. E., Mozolic J. L., & Laurienti P. J . ( 2009). Suppression of multisensory integration by modality-specific attention in aging. Neuroreport, 20( 4), 349-353.
27	Hugenschmidt C. E., Peiffer A. M., McCoy T. P., Hayasaka S., & Laurienti P. J . ( 2009). Preservation of crossmodal selective attention in healthy aging. Experimental Brain Research, 198( 2-3), 273-285.
28	Hunter E. M., Phillips L. H., & Macpherson S. E . ( 2010). Effects of age on cross-modal emotion perception. Psychology and Aging, 25( 4), 779-787.
29	Jones S. A., Beierholm U., Meijer D., & Noppeney U . ( 2019). Older adults sacrifice response speed to preserve multisensory integration performance. Neurobiology of Aging, 84, 148-157.
30	Kaganovich N. &Schumaker J. , ( 2016). Electrophysiological correlates of individual differences in perception of audiovisual temporal asynchrony. Neuropsychologia, 86, 119-130.
31	Koelewijn T., Bronkhorst A., & Theeuwes J . ( 2010). Attention and the multiple stages of multisensory integration: A review of audiovisual studies. Acta Psychologica, 134( 3), 372-384.
32	Krueger J., Stevenson R., Nidiffer A., Barnett Z., & Wallace M . ( 2016). Stimulus intensity modulates multisensory temporal processing. Neuropsychologia, 88, 92-100.
33	Laurienti P. J., Burdette J. H., Maldjian J. A., & Wallace M. T . ( 2006). Enhanced multisensory integration in older adults. Neurobiology of Aging, 27( 8), 1155-1163.
34	Li Q., Wu J., & Touge T . ( 2010). Audiovisual interaction enhances auditory detection in late stage: An event-related potential study. Neuroreport, 21( 3), 173-178.
35	Li Q., Yang H., Sun F., & Wu J . ( 2015). Spatiotemporal relationships among audiovisual stimuli modulate auditory facilitation of visual target discrimination. Perception, 44( 3), 232-242.
36	Li Y., Long J., Huang B., Yu T., Wu W., Liu Y., .. Sun P . ( 2015). Crossmodal integration enhances neural representation of task-relevant features in audiovisual face perception. Cerebral Cortex, 25( 2), 384-395.
37	Mahoney J. R., Li P. C., Oh-Park M., Verghese J., & Holtzer R . ( 2011). Multisensory integration across the senses in young and old adults. Brain Research, 1426, 43-53.
38	Mcgurk H. &Macdonald J. , ( 1976). Hearing lips and seeing voices. Nature, 264( 5588), 746-748.
39	Mishra J. &Gazzaley A. , ( 2013). Preserved discrimination performance and neural processing during crossmodal attention in aging. PLoS One, 8( 11), e81894.
40	Morís Fernández L., Visser M., Ventura-Campos N., Ávila C., & Soto-Faraco S . ( 2015). Top-down attention regulates the neural expression of audiovisual integration. Neurolmage, 119, 272-285.
41	Mozolic J. L., Hugenschmidt C. E., Peiffer A. M. , &Laurienti, P. J.( 2012). Multisensory integration and aging. Florida, MA: Boca Raton (FL), CRC Press.
42	Mozolic J. L., Long A. B., Morgan A. R., Rawley-Payne M., & Laurienti P. J . ( 2009). A cognitive training intervention improves modality-specific attention in a randomized controlled trial of healthy older adults. Neurobiology of Aging, 32( 4), 655-668.
43	Noesselt T., Tyll S., Boehler C. N., Budinger E., Heinze H. J., & Driver J . ( 2010). Sound-induced enhancement of low-intensity vision: Multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. Journal of Neuroscience, 30( 41), 13609-13623.
44	Parker J. L., &Robinson C. W . ( 2018). Changes in multisensory integration across the lifespan. Psychology and Aging, 33( 3), 545-588.
45	Peiffer A. M., Mozolic J. L., Hugenschmidt C. E., & Laurienti P. J . ( 2007). Age-related multisensory enhancement in a simple audiovisual detection task. Neuroreport, 18( 10), 1077-1081.
46	Poliakoff E., Shore D. I., Lowe C., & Spence C . ( 2006). Visuotactile temporal order judgments in ageing. Neuroscience Letters, 396( 3), 207-211.
47	Powers A. R., 3rd, Hillock A. R., & Wallace M. T . ( 2009). Perceptual training narrows the temporal window of multisensory binding. Journal of Neuroscience, 29( 39), 12265-12274.
48	Regenbogen C., Seubert J., Johansson E., Finkelmeyer A., Andersson P., & Lundström J. N . ( 2017). The intraparietal sulcus governs multisensory integration of audiovisual information based on task difficulty. Human Brain Mapping, 39( 3), 1313-1326.
49	Ren Y., Ren Y., Yang W., Tang X., Wu F., Wu Q., .. Wu J . ( 2018). Comparison for younger and older adults: Stimulus temporal asynchrony modulates audiovisual integration. International Journal of Psychophysiology, 124, 1-11.
50	Ren Y., Suzuki K., Yang W., Ren Y., Wu F., Yang J., .. Hirata K . ( 2018). Absent audiovisual integration elicited by peripheral stimuli in parkinson's disease. Parkinson's Disease,( 1), 1-10.
51	Ren Y., Yang W., Nakahashi K., Takahashi S., & Wu J . ( 2017). Audiovisual integration delayed by stimulus onset asynchrony between auditory and visual stimuli in older adults. Perception, 46( 2), 205-218.
52	Ruffman T., Henry J., Livingstone V., & Phillips L . ( 2008). A meta-analytic review of emotion recognition and aging: Implications for neuropsychological models of aging. Neuroscience and Biobehavioral Reviews, 32( 4), 863-881.
53	Sekiyama K., Soshi T., & Sakamoto S . ( 2014). Enhanced audiovisual integration with aging in speech perception: A heightened McGurk effect in older adults. Frontiers in Psychology, 5, 323.
54	Senkowski D., Saint-Amour D., Hofle M., & Foxe J. J . ( 2011). Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness. Neurolmage, 56( 4), 2200-2208.
55	Setti A., Burke K. E., Kenny R. A., & Newell F. N . ( 2011). Is inefficient multisensory processing associated with falls in older people? Experimental Brain Research, 209( 3), 375-384.
56	Setti A., Stapleton J., Leahy D., Walsh C., Kenny R. A., & Newell F. N . ( 2014). Improving the efficiency of multisensory integration in older adults: Audio-visual temporal discrimination training reduces susceptibility to the sound-induced flash illusion. Neuropsychologia, 61, 259-268.
57	Stein B. E. ,& Meredith, M. A.( 1993) . The merging of the senses. Cambridge, MA: Massachusetts Institute of Technology (MIT) Press.
58	Shams L., Kamitani Y., & Shimojo S . ( 2000). What you see is what you hear. Nature, 408( 6814), 788-788.
59	Stephen J. M., Knoefel J. E., Adair J., Hart B., & Aine C. J . ( 2010). Aging-related changes in auditory and visual integration measured with MEG. Neuroscience Letters, 484( 1), 76-80.
60	Stevenson R. A., Fister J. K., Barnett Z. P., Nidiffer A. R., & Wallace M. T . ( 2012). Interactions between the spatial and temporal stimulus factors that influence multisensory integration in human performance. Experimental Brain Research, 219( 1), 121-137.
61	Talsma D., Senkowski D., Soto-Faraco S., & Woldorff M. G . ( 2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14( 9), 400-410.
62	Talsma D. &Woldorff M. G . ( 2005). Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience, 17( 7), 1098-1114.
63	Tang X., Wu J., & Shen Y . ( 2016). The interactions of multisensory integration with endogenous and exogenous attention. Neuroscience and Biobehavioral Reviews, 61, 208-224.
64	Tye-Murray N., Spehar B., Myerson J., Sommers M. S., & Hale S . ( 2011). Cross-modal enhancement of speech detection in young and older adults: Does signal content matter? Ear and Hearing, 32( 5), 650-655.
65	Wang B., Li P., Li D., Niu Y., Yan T., Li T., .. Xiang J . ( 2018). Increased functional brain network efficiency during audiovisual temporal asynchrony integration task in aging. Frontiers in Aging Neuroscience, 10( 316), 1-15.
66	Wang L., Wang W., Yan T., Song J., Yang W., Wang B., .. Wu J . ( 2017). Beta-band functional connectivity influences audiovisual integration in older age: An EEG study. Frontiers in Aging Neuroscience, 9( 239), 1-11.
67	Winneke A. H., &Phillips N. A . ( 2011). Does audiovisual speech offer a fountain of youth for old ears? An event-related brain potential study of age differences in audiovisual speech perception. Psychology and Aging, 26( 2), 427-438.
68	Wu J., Li Q., Bai O., & Touge T . ( 2009). Multisensory interactions elicited by audiovisual stimuli presented peripherally in a visual attention task: A behavioral and event-related potential study in humans. Journal of Clinical Neurophysiology, 26( 6), 407-413.
69	Wu J., Yang W., Gao Y., & Kimura T . ( 2012). Age-related multisensory integration elicited by peripherally presented audiovisual stimuli. Neuroreport, 23( 10), 616-620.
70	Yan T., Bi X., Zhang M., Wang W., Yao Z., Yang W., & Wu J . ( 2016). Age-related oscillatory theta modulation of multisensory integration in frontocentral regions. Neuroreport, 27( 11), 796-801.
71	Yang W., Chu B., Yang J., Yu Y., Wu J., & Yu S . ( 2014). Elevated audiovisual temporal interaction in patients with migraine without aura. The Journal of Headache and Pain, 15( 44), 1-10.
72	Yang W., Guo A., Li Y., Qiu J., Li S., Yin S., .. Ren Y . ( 2018). Audio-visual spatiotemporal perceptual training enhances the P300 component in healthy older adults. Frontiers in Psychology, 9( 2537).
73	Yang W., Li Q., Ochi T., Yang J., Gao Y., Tang X., .. Wu J . ( 2013). Effects of auditory stimuli in the horizontal plane on audiovisual integration: An event-related potential study. PLoS One, 8( 6), e66402.
74	Yang W. &Ren Y. , ( 2017). Attenuated audiovisual integration in middle-aged adults in a discrimination task. Cognitive Processing, 19 ( 1), 41-45.
75	Yu M. C., Pianta M. J., Bode S., & Mckendrick A. M . ( 2017). Spatio-temporal patterns of event-related potentials related to audiovisual synchrony judgments in older adults. Neurobiology of Aging, 55, 38-48.
76	Zendel B. R., &Alain C. , ( 2014). Enhanced attention- dependent activity in the auditory cortex of older musicians. Neurobiology of Aging, 35( 1), 55-63.
77	Zou Z., Chau B. K. H., Ting K. H &Chan C. C. H. , ( 2017). Aging effect on audiovisual integrative processing in spatial discrimination task. Frontiers in Aging Neuroscience, 9, 374.

[1]	GUAN Lei, LUO Wenpei, HAN Jiahui. The modality shifting effects in the multisensory integration paradigm [J]. Advances in Psychological Science, 2022, 30(5): 1018-1027.
[2]	GU Lijia, GONG Wenxiao, ZHANG Jing, CHEN Wei, GUO Jianyou. The influence of body ownership illusion on pain and its potential mechanisms [J]. Advances in Psychological Science, 2022, 30(11): 2518-2528.
[3]	CHEN Haobin, WANG Fengyan. Wisdom in old age [J]. Advances in Psychological Science, 2021, 29(5): 885-893.
[4]	ZHANG Jing, CHEN Wei. Sense of body ownership and its plasticity: Based on the perspectives from the studies of interoception and exteroception [J]. Advances in Psychological Science, 2020, 28(2): 305-315.
[5]	WANG Aijun, HUANG Jie, LU Feifei, HE Jiaying, TANG Xiaoyu, ZHANG Ming. Sound-induced flash illusion in multisensory integration [J]. Advances in Psychological Science, 2020, 28(10): 1662-1677.
[6]	Ya-xuan Ang, Fang-fang Wang, Yong-na Li. The Positivity Effect in Facial Trustworthiness Judgment in Older Adults: Age Difference and the Effects of Cognitive Declines [J]. Advances in Psychological Science, 2019, 27(suppl.): 11-11.
[7]	ZHAO Peiqiong, CHEN Wei, ZHANG Jing, PING Xianjie. The rubber hand illusion (RHI): The experimental paradigm of sense of ownership and its application [J]. Advances in Psychological Science, 2019, 27(1): 37-50.
[8]	PENG Xing, CHANG Ruosong, REN Guiqin, WANG Aijun, TANG Xiaoyu. The interaction between exogenous attention and multisensory integration [J]. Advances in Psychological Science, 2018, 26(12): 2129-2140.
[9]	LUO Xiaoxiao, KANG Guanlan, ZHOU Xiaolin. The influential factors and neural mechanisms of McGurk effect [J]. Advances in Psychological Science, 2018, 26(11): 1935-1951.
[10]	WANG Chen-Xi, CHEN Tian-Yong, HAN Bu-Xin. Plasticity of the prefrontal cortex in old age and underlying mechanisms [J]. Advances in Psychological Science, 2018, 26(11): 2003-2012.
[11]	XIN Xin; REN Gui-Qin; LI Jin-Cai; TANG Xiao-Yu. The characteristics and mechanisms of audiovisual integration: Evidence from mismatch negativity [J]. Advances in Psychological Science, 2017, 25(5): 757-768.
[12]	QIAN Haoyue; ZHU Min; GAO Xiangping. Configural processing of faces in old adulthood [J]. Advances in Psychological Science, 2017, 25(2): 230-236.
[13]	HAN Xiao; SHI Daiqing; ZHOU Xiaowen; YANG Yinghua; ZHU Zude. The training and transfer effect of cognitive training in old adults [J]. Advances in Psychological Science, 2016, 24(6): 909-922.
[14]	WANG Huifang; JIANG Jingchuan. Framing effect in elderly adults [J]. Advances in Psychological Science, 2016, 24(4): 612-621.
[15]	ZHOU Aibao; ZHANG Yanchi; LIU Peiru; YIN Yulong; ZHANG Fen. Who am I ? ——Enfacement Illusion Based on Interpersonal Multisensory Stimulation [J]. Advances in Psychological Science, 2015, 23(2): 159-167.