Please wait a minute...
Acta Psychologica Sinica    2018, Vol. 50 Issue (11) : 1212-1221     DOI: 10.3724/SP.J.1041.2018.01212
|
The Effects of modal-based endogenous attention on sound-induced flash illusion
Ming ZHANG1(),Xiaoyu TANG2,Wei YU3,Bo NING1,Zhinan WANG1,Aijun WANG1()
1 Department of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou 215000, China)
2 School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian 116029, China
3 Admission and Employment Office, Changchun University of Chinese Medicine, Changchun 130117, China
Download: PDF(536 KB)   HTML Review File (1 KB) 
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks     Supporting Info
Guide   
Abstract  

The sound-induced flash illusion (SIFI) is an auditory-dominant phenomenon in multisensory integration in which the perception of brief visual flashes may be qualitatively altered by concurrent brief sounds. It has been well documented how attention modulates this illusion. It remains unknown, however, how modal-based endogenous attention interferes with the SIFI. In the present study, we adopted the classical paradigm of the SIFI and directed the endogenous attention to the visual modal or the auditory modal to investigate the effect of modal-based endogenous attention on SIFI.

Experiment 1 asked the participants to conduct the classical task of the SIFI as the baseline. In experiment 2, the ratio of the visual modal, the auditory modal, and the audio-visual modal was 3:1:1; that is, the endogenous attention was directed to the visual modal. In experiment 3, the ratio of the visual modal, auditory modal and audio-visual modal was 1:3:1; that is, the endogenous attention was directed to the auditory modal. In the present study, we asked the participants to judge the number of flashes, and we focused mainly on the occurrence of fission illusions (when a single visual flash is accompanied by two auditory bleeps and is perceived incorrectly as two flashes) and fusion illusions (when two visual flashes are accompanied by a single bleep and are perceived incorrectly as a single flash). The hypothesis was that directing endogenous attention to the visual or auditory modal could affect the auditory dominance.

A repeated measures ANOVA was analyzed for fission and fusion illusions separately, and the results showed that there were significant differences among the three experiments, F (1, 2) = 5.11, p < 0.01, η 2= 0.23. The occurrence of fission illusions was decreased when endogenous attention was directed to the visual modal (50%) and was increased when endogenous attention was directed to the auditory modal (71%). However, regardless of whether endogenous attention was directed to the auditory or visual modal, fusion illusion was not affected by attention (ps > 0.05). In addition, we also pooled the response counts across all of the participants and for both fission and fusion stimuli. The results showed that the odds ratio for fission was greater than that for fusion, and there was a difference among the three experiments for fission (17.5 vs. 9 vs. 21.95), and no effect for fusion (4.95 vs. 3.15 vs. 4.13).

The results indicated that modal-based endogenous attention can affect the occurrence of fission illusions but does not affect the occurrence of fusion illusions. The present study provides insight into the top-down factors that can modulate sound-induced flash illusions.

Keywords endogenous attention      auditory dominance      sound-induced flash illusion      visual and auditory modals     
ZTFLH:  B842  
Corresponding Authors: Ming ZHANG,Aijun WANG     E-mail: psyzm@suda.edu.cn;ajwang@suda.edu.cn
Issue Date: 25 September 2018
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
Ming ZHANG
Xiaoyu TANG
Wei YU
Bo NING
Zhinan WANG
Aijun WANG
Cite this article:   
Ming ZHANG,Xiaoyu TANG,Wei YU, et al. The Effects of modal-based endogenous attention on sound-induced flash illusion[J]. Acta Psychologica Sinica, 2018, 50(11): 1212-1221.
URL:  
http://journal.psych.ac.cn/xlxb/EN/10.3724/SP.J.1041.2018.01212     OR     http://journal.psych.ac.cn/xlxb/EN/Y2018/V50/I11/1212
  
实验 F1 F1B1 F1B2 F2 F2B1 F2B2
实验1 90 ± 8 94 ± 8 34 ± 24 89 ± 6 62 ± 21 92 ± 9
实验2 90 ± 6 92 ± 6 50 ± 22 87 ± 7 68 ± 23 96 ± 4
实验3 90 ± 7 94 ± 6 29 ± 26 88 ± 8 64 ± 25 97 ± 3
  
  
刺激类型 实验1 实验2 实验3
裂变错觉 无裂变 总数 裂变错觉 无裂变 总数 裂变错觉 无裂变 总数
视听刺激 972 500 1472 800 800 1600 1091 445 1536
视觉刺激 147 1325 1472 480 4320 4800 154 1382 1536
比值比率 17.5 9 21.95
  
刺激类型 实验1 实验2 实验3
融合错觉 无裂变 总数 融合错觉 无裂变 总数 融合错觉 无裂变 总数
视听刺激 559 913 1472 512 1088 1600 553 983 1536
视觉刺激 162 1310 1472 624 4176 4800 184 1352 1536
比值比率 4.95 3.15 4.13
  
实验 F1B2_R F1B2_W F2B1_R F2B1_W
实验1 889 ± 90 839 ± 70 757 ± 83 762 ± 92
实验2 798 ± 95 710 ± 108 640 ± 104 639 ± 88
实验3 732 ± 89 707 ± 76 581 ± 86 613 ± 99
  
[1] Abadi, R. V., & Murphy, J. S . (2014). Phenomenology of the sound-induced flash illusion. Experimental Brain Research, 232( 7), 2207-2220.
pmid: 24691756 url: http://link.springer.com/10.1007/s00221-014-3912-2
[2] Andersen T. S., Tiippana K., & Sams M . (2004). Factors influencing audiovisual fission and fusion illusions. Cognitive Brain Research, 21( 3), 301-308.
url: http://linkinghub.elsevier.com/retrieve/pii/S0926641004001636
[3] Cecere R., Rees G., & Romei V . (2015). Individual differences in alpha frequency drive crossmodal illusory perception. Current Biology, 25( 2), 231-235.
pmid: 4300399 url: https://linkinghub.elsevier.com/retrieve/pii/S096098221401495X
[4] Degerman A., Rinne T., Pekkola J., Autti T., Jaaskelainen I.P., Sams M., & Alho K . (2007). Human brain activity associated with audiovisual perception and attention. Neurolmage, 34( 4), 1683-1691.
url: http://linkinghub.elsevier.com/retrieve/pii/S105381190601130X
[5] Gu, J. Y., & Lv, Y. ( 2016). The different effects of selective attention and divided attention on multisensory integration. Studies of Psychology and Behavior, 14( 2), 202-206.
[5] [ 顾吉有, 吕勇 . ( 2016). 选择性注意和分配性注意对多感觉整合的不同影响. 心理与行为研究, 14( 2), 202-206.]
[6] Kamke M. R., Vieth H. E., Cottrell D., & Mattingley J. B . (2012). Parietal disruption alters audiovisual binding in the sound-induced flash illusion. Neurolmage, 62( 3), 1334-1341.
[7] Kumpik D. P., Roberts H. E., King A. J., & Bizley J. K . (2014). Visual sensitivity is a stronger determinant of illusory processes than auditory cue parameters in the sound-induced flash illusion. Journal of Vision, 14( 7), 60-65.
[8] Lavie, N. (2005). Distracted and confused? Selective attention under load. Trends in Cognitive Sciences, 9( 2), 75-82.
[9] Mishra J., Martínez A., & Hillyard S. A . (2010). Effect of attention on early cortical processes associated with the sound-induced extra flash illusion. Journal of Cognitive Neuroscience, 22( 8), 1714-1729.
url: http://www.mitpressjournals.org/doi/10.1162/jocn.2009.21295
[10] Mishra J., Martínez A., Sejnowski T. J., & Hillyard S. A . (2007). Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. Journal of Neuroscience, 27( 15), 4120-4131.
url: http://www.jneurosci.org/cgi/doi/10.1523/JNEUROSCI.4912-06.2007
[11] Posner M. I., Nissen M. J., & Klein R. M . (1976). Visual dominance: An information-processing account of its origins and significance. Psychological Review, 83( 2), 157-171.
url: http://doi.apa.org/getdoi.cfm?doi=10.1037/0033-295X.83.2.157
[12] Santangelo V., Fagioli S., & Macaluso E . (2010). The costs of monitoring simultaneously two sensory modalities decrease when dividing attention in space. Neurolmage, 49( 3), 2717-2727.
url: http://linkinghub.elsevier.com/retrieve/pii/S105381190901132X
[13] Shams L., Kamitani Y., & Shimojo S . (2000). Illusions: What you see is what you hear. Nature, 408( 6814), 788.
url: http://www.nature.com/articles/35048669
[14] Shams L., Kamitani Y., & Shimojo S . (2002). Visual illusion induced by sound. Cognitive Brain Research, 14( 1), 147-152.
url: http://linkinghub.elsevier.com/retrieve/pii/S0926641002000691
[15] Shams L., Ma W. J., & Beierholm U . (2005). Sound-induced flash illusion as an optimal percept. Neuroreport, 16( 17), 1923-1927.
pmid: 16272880 url: https://insights.ovid.com/crossref?an=00001756-200511280-00011
[16] Sinnett S., Spence C., & Soto-Faraco S . (2007). Visual dominance and attention: The Colavita effect revisited. Attention, Perception, & Psychophysics, 69( 5), 673-686.
[17] Spence, C. (2011). Crossmodal correspondences: a tutorial review. Attention, Perception, & Psychophysics, 73( 4), 971-995.
[18] Sun Y-L., Hu Z-H., Zhang R-L., Xun M-M., Liu Q., & Zhang Q-L . ( 2011). An investigation on the effect factors in the paradigm of multisensory integration. Acta Psychologica Sinica, 43( 11), 1239-1246.
[18] [ 孙远路, 胡中华, 张瑞玲, 寻茫茫, 刘强, 张庆林 . ( 2011). 多感觉整合测量范式中存在的影响因素探讨. 心理学报, 43 ( 11), 1239-1246.]
[19] Talsma, D. (2015). Predictive coding and multisensory integration: An attentional account of the multisensory mind. Frontiers in Integrative Neuroscience, 9, 19.
pmid: 4374459 url: http://pubmedcentralcanada.ca/pmcc/articles/PMC4374459/
[20] Tang X. Y., Wu J. L., & Shen Y . (2016). The interactions of multisensory integration with endogenous and exogenous attention. Neuroscience & Biobehavioral Reviews, 61, 208-224.
[21] Turatto M., Benso F., Galfano G., & Umiltá C . (2002). Nonspatial attentional shifts between audition and vision. Journal of Experimental Psychology: Human Perception & Performance, 28( 3), 628-639.
pmid: 12075893 url: http://europepmc.org/abstract/med/12075893
[22] Van Erp, J. B. F. V., Philippi T. G., & Werkhoven P . (2013). Observers can reliably identify illusory flashes in the illusory flash paradigm. Experimental Brain Research, 226( 1), 73-79.
url: http://link.springer.com/10.1007/s00221-013-3413-8
[23] Watkins S., Shams L., Josephs O., & Rees G . (2007). Activity in human V1 follows multisensory perception. NeuroImage, 37( 2), 572-578.
url: http://linkinghub.elsevier.com/retrieve/pii/S1053811907004326
[24] Watkins S., Shams L., Tanaka S., Haynes J.-D., & Rees G . (2006). Sound alters activity in human V1 in association with illusory visual perception. NeuroImage, 31( 3), 1247-1256.
url: http://linkinghub.elsevier.com/retrieve/pii/S1053811906000450
[25] Wozny D. R., Beierholm U. R., & Shams L . (2008). Human trimodal perception follows optimal statistical inference. Journal of Vision, 8( 3), 1-11.
[26] Whittingham K. M., Mcdonald J. S ., & Clifford, C. W. G. (2014). Synesthetes show normal sound-induced flash fission and fusion illusions. Vision Research, 105, 1-9.
pmid: 25173429 url: https://linkinghub.elsevier.com/retrieve/pii/S0042698914001898
[27] Yu W., Wang A. J., & Zhang M . ( 2017). Effect of selective and divided attentions on auditory dominance in multisensory integration. Acta Psychologica Sinica, 49( 2), 164-173.
[27] [ 于薇, 王爱君, 张明 . ( 2017). 集中和分散注意对多感觉整合中听觉主导效应的影响. 心理学报, 49( 2), 164-173.]
[1] YU Wei; WANG Aijun; ZHANG Ming. Effect of selective and divided attentions on auditory dominance in multisensory integration[J]. Acta Psychologica Sinica, 2017, 49(2): 164-173.
[2] ZHAO Ya-Jun, ZHANG Zhi-Jun. Eyes Gaze Cueing Effect: Endogenous or Exogenous Processing Mechanism?[J]. , 2009, 41(12): 1133-1142.
[3] Liu Chao,Mai Xiaoqin,Fu Xiaolan. THE INFLUENCE OF ENDOGENOUS AND EXOGENOUS ATTENTION ON NUMBER PROCESSING[J]. , 2005, 37(02): 167-177.
[4] Liu Chao,Mai Xiaoqin, Fu Xiaolan. THE SPATIAL NUMERICAL ASSOCIATION OF RESPONSE CODES EFFECT OF NUMBER PROCESSING IN DIFFERENT ATTENTION CONDITIONS[J]. , 2004, 36(06): 671-680.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech