基于通道的内源性注意对声音诱发闪光错觉的影响

doi:10.3724/SP.J.1041.2018.01212

摘要/Abstract

摘要：

声音诱发闪光错觉是指当视觉闪光伴随不相等数量的听觉声音在100 ms内相继或同时呈现时, 个体会错觉性地知觉到视觉闪光的个数与听觉声音的数量相等。研究采用经典的声音诱发闪光错觉范式, 将注意以内源性的方式指向视觉通道或者听觉通道, 考察了基于通道的内源性注意对声音诱发闪光错觉的影响。结果发现, 当注意内源性地指向视觉通道时, 相对于基线条件, 裂变错觉的量显著减小; 当注意内源性地指向听觉通道时, 相对于基线条件, 裂变错觉的量存在增大的趋势。说明了基于通道的内源性注意可以影响声音诱发闪光错觉中的裂变错觉, 但不影响融合错觉。

关键词: 内源性注意, 声音诱发闪光错觉, 听觉主导效应, 视觉和听觉通道

Abstract:

The sound-induced flash illusion (SIFI) is an auditory-dominant phenomenon in multisensory integration in which the perception of brief visual flashes may be qualitatively altered by concurrent brief sounds. It has been well documented how attention modulates this illusion. It remains unknown, however, how modal-based endogenous attention interferes with the SIFI. In the present study, we adopted the classical paradigm of the SIFI and directed the endogenous attention to the visual modal or the auditory modal to investigate the effect of modal-based endogenous attention on SIFI.

Experiment 1 asked the participants to conduct the classical task of the SIFI as the baseline. In experiment 2, the ratio of the visual modal, the auditory modal, and the audio-visual modal was 3:1:1; that is, the endogenous attention was directed to the visual modal. In experiment 3, the ratio of the visual modal, auditory modal and audio-visual modal was 1:3:1; that is, the endogenous attention was directed to the auditory modal. In the present study, we asked the participants to judge the number of flashes, and we focused mainly on the occurrence of fission illusions (when a single visual flash is accompanied by two auditory bleeps and is perceived incorrectly as two flashes) and fusion illusions (when two visual flashes are accompanied by a single bleep and are perceived incorrectly as a single flash). The hypothesis was that directing endogenous attention to the visual or auditory modal could affect the auditory dominance.

A repeated measures ANOVA was analyzed for fission and fusion illusions separately, and the results showed that there were significant differences among the three experiments, F (1, 2) = 5.11, p < 0.01, η ²= 0.23. The occurrence of fission illusions was decreased when endogenous attention was directed to the visual modal (50%) and was increased when endogenous attention was directed to the auditory modal (71%). However, regardless of whether endogenous attention was directed to the auditory or visual modal, fusion illusion was not affected by attention (ps > 0.05). In addition, we also pooled the response counts across all of the participants and for both fission and fusion stimuli. The results showed that the odds ratio for fission was greater than that for fusion, and there was a difference among the three experiments for fission (17.5 vs. 9 vs. 21.95), and no effect for fusion (4.95 vs. 3.15 vs. 4.13).

The results indicated that modal-based endogenous attention can affect the occurrence of fission illusions but does not affect the occurrence of fusion illusions. The present study provides insight into the top-down factors that can modulate sound-induced flash illusions.

Key words: endogenous attention, auditory dominance, sound-induced flash illusion, visual and auditory modals

中图分类号:

B842

张明, 唐晓雨, 于薇, 宁波, 王智楠, 王爱君. (2018). 基于通道的内源性注意对声音诱发闪光错觉的影响. 心理学报, 50(11), 1212-1221.

ZHANG Ming, TANG Xiaoyu, YU Wei, NING Bo, WANG Zhinan, WANG Aijun. (2018). The Effects of modal-based endogenous attention on sound-induced flash illusion. Acta Psychologica Sinica, 50(11), 1212-1221.

图/表 6

参考文献 27

[1]	Abadi, R. V., & Murphy, J. S . (2014). Phenomenology of the sound-induced flash illusion. Experimental Brain Research, 232( 7), 2207-2220. doi: 10.1007/s00221-014-3912-2 URL pmid: 24691756
[2]	Andersen T. S., Tiippana K., & Sams M . (2004). Factors influencing audiovisual fission and fusion illusions. Cognitive Brain Research, 21( 3), 301-308. doi: 10.1016/j.cogbrainres.2004.06.004 URL
[3]	Cecere R., Rees G., & Romei V . (2015). Individual differences in alpha frequency drive crossmodal illusory perception. Current Biology, 25( 2), 231-235. doi: 10.1016/j.cub.2014.11.034 URL pmid: 4300399
[4]	Degerman A., Rinne T., Pekkola J., Autti T., Jaaskelainen I.P., Sams M., & Alho K . (2007). Human brain activity associated with audiovisual perception and attention. Neurolmage, 34( 4), 1683-1691. doi: 10.1016/j.neuroimage.2006.11.019 URL
[5]	Gu, J. Y., & Lv, Y. ( 2016). The different effects of selective attention and divided attention on multisensory integration. Studies of Psychology and Behavior, 14( 2), 202-206.
	[ 顾吉有, 吕勇 . ( 2016). 选择性注意和分配性注意对多感觉整合的不同影响. 心理与行为研究, 14( 2), 202-206.]
[6]	Kamke M. R., Vieth H. E., Cottrell D., & Mattingley J. B . (2012). Parietal disruption alters audiovisual binding in the sound-induced flash illusion. Neurolmage, 62( 3), 1334-1341.
[7]	Kumpik D. P., Roberts H. E., King A. J., & Bizley J. K . (2014). Visual sensitivity is a stronger determinant of illusory processes than auditory cue parameters in the sound-induced flash illusion. Journal of Vision, 14( 7), 60-65.
[8]	Lavie, N. (2005). Distracted and confused? Selective attention under load. Trends in Cognitive Sciences, 9( 2), 75-82.
[9]	Mishra J., Martínez A., & Hillyard S. A . (2010). Effect of attention on early cortical processes associated with the sound-induced extra flash illusion. Journal of Cognitive Neuroscience, 22( 8), 1714-1729. doi: 10.1162/jocn.2009.21295 URL
[10]	Mishra J., Martínez A., Sejnowski T. J., & Hillyard S. A . (2007). Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. Journal of Neuroscience, 27( 15), 4120-4131. doi: 10.1523/JNEUROSCI.4912-06.2007 URL
[11]	Posner M. I., Nissen M. J., & Klein R. M . (1976). Visual dominance: An information-processing account of its origins and significance. Psychological Review, 83( 2), 157-171. doi: 10.1037/0033-295X.83.2.157 URL
[12]	Santangelo V., Fagioli S., & Macaluso E . (2010). The costs of monitoring simultaneously two sensory modalities decrease when dividing attention in space. Neurolmage, 49( 3), 2717-2727. doi: 10.1016/j.neuroimage.2009.10.061 URL
[13]	Shams L., Kamitani Y., & Shimojo S . (2000). Illusions: What you see is what you hear. Nature, 408( 6814), 788. doi: 10.1038/35048669 URL
[14]	Shams L., Kamitani Y., & Shimojo S . (2002). Visual illusion induced by sound. Cognitive Brain Research, 14( 1), 147-152. doi: 10.1016/S0926-6410(02)00069-1 URL
[15]	Shams L., Ma W. J., & Beierholm U . (2005). Sound-induced flash illusion as an optimal percept. Neuroreport, 16( 17), 1923-1927. doi: 10.1097/01.wnr.0000187634.68504.bb URL pmid: 16272880
[16]	Sinnett S., Spence C., & Soto-Faraco S . (2007). Visual dominance and attention: The Colavita effect revisited. Attention, Perception, & Psychophysics, 69( 5), 673-686.
[17]	Spence, C. (2011). Crossmodal correspondences: a tutorial review. Attention, Perception, & Psychophysics, 73( 4), 971-995.
[18]	Sun Y-L., Hu Z-H., Zhang R-L., Xun M-M., Liu Q., & Zhang Q-L . ( 2011). An investigation on the effect factors in the paradigm of multisensory integration. Acta Psychologica Sinica, 43( 11), 1239-1246.
	[ 孙远路, 胡中华, 张瑞玲, 寻茫茫, 刘强, 张庆林 . ( 2011). 多感觉整合测量范式中存在的影响因素探讨. 心理学报, 43 ( 11), 1239-1246.]
[19]	Talsma, D. (2015). Predictive coding and multisensory integration: An attentional account of the multisensory mind. Frontiers in Integrative Neuroscience, 9, 19. doi: 10.3389/fnint.2015.00019 URL pmid: 4374459
[20]	Tang X. Y., Wu J. L., & Shen Y . (2016). The interactions of multisensory integration with endogenous and exogenous attention. Neuroscience & Biobehavioral Reviews, 61, 208-224.
[21]	Turatto M., Benso F., Galfano G., & Umiltá C . (2002). Nonspatial attentional shifts between audition and vision. Journal of Experimental Psychology: Human Perception & Performance, 28( 3), 628-639. doi: 10.1037//0096-1523.28.3.628 URL pmid: 12075893
[22]	Van Erp, J. B. F. V., Philippi T. G., & Werkhoven P . (2013). Observers can reliably identify illusory flashes in the illusory flash paradigm. Experimental Brain Research, 226( 1), 73-79. doi: 10.1007/s00221-013-3413-8 URL
[23]	Watkins S., Shams L., Josephs O., & Rees G . (2007). Activity in human V1 follows multisensory perception. NeuroImage, 37( 2), 572-578. doi: 10.1016/j.neuroimage.2007.05.027 URL
[24]	Watkins S., Shams L., Tanaka S., Haynes J.-D., & Rees G . (2006). Sound alters activity in human V1 in association with illusory visual perception. NeuroImage, 31( 3), 1247-1256. doi: 10.1016/j.neuroimage.2006.01.016 URL
[25]	Wozny D. R., Beierholm U. R., & Shams L . (2008). Human trimodal perception follows optimal statistical inference. Journal of Vision, 8( 3), 1-11.
[26]	Whittingham K. M., Mcdonald J. S ., & Clifford, C. W. G. (2014). Synesthetes show normal sound-induced flash fission and fusion illusions. Vision Research, 105, 1-9. doi: 10.1016/j.visres.2014.08.010 URL pmid: 25173429
[27]	Yu W., Wang A. J., & Zhang M . ( 2017). Effect of selective and divided attentions on auditory dominance in multisensory integration. Acta Psychologica Sinica, 49( 2), 164-173.
	[ 于薇, 王爱君, 张明 . ( 2017). 集中和分散注意对多感觉整合中听觉主导效应的影响. 心理学报, 49( 2), 164-173.]

实验	F1	F1B1	F1B2	F2	F2B1	F2B2
实验1	90 ± 8	94 ± 8	34 ± 24	89 ± 6	62 ± 21	92 ± 9
实验2	90 ± 6	92 ± 6	50 ± 22	87 ± 7	68 ± 23	96 ± 4
实验3	90 ± 7	94 ± 6	29 ± 26	88 ± 8	64 ± 25	97 ± 3

实验	F1	F1B1	F1B2	F2	F2B1	F2B2
实验1	90 ± 8	94 ± 8	34 ± 24	89 ± 6	62 ± 21	92 ± 9
实验2	90 ± 6	92 ± 6	50 ± 22	87 ± 7	68 ± 23	96 ± 4
实验3	90 ± 7	94 ± 6	29 ± 26	88 ± 8	64 ± 25	97 ± 3

刺激类型	实验1			实验2			实验3
刺激类型	裂变错觉	无裂变	总数	裂变错觉	无裂变	总数	裂变错觉	无裂变	总数
视听刺激	972	500	1472	800	800	1600	1091	445	1536
视觉刺激	147	1325	1472	480	4320	4800	154	1382	1536
比值比率	17.5			9			21.95

刺激类型	实验1			实验2			实验3
刺激类型	裂变错觉	无裂变	总数	裂变错觉	无裂变	总数	裂变错觉	无裂变	总数
视听刺激	972	500	1472	800	800	1600	1091	445	1536
视觉刺激	147	1325	1472	480	4320	4800	154	1382	1536
比值比率	17.5			9			21.95

刺激类型	实验1			实验2			实验3
刺激类型	融合错觉	无裂变	总数	融合错觉	无裂变	总数	融合错觉	无裂变	总数
视听刺激	559	913	1472	512	1088	1600	553	983	1536
视觉刺激	162	1310	1472	624	4176	4800	184	1352	1536
比值比率	4.95			3.15			4.13