听觉刺激对虚拟环境中空间压缩的影响

doi:10.3724/SP.J.1041.2023.00001

摘要/Abstract

摘要：

人们往往会低估虚拟环境中空间的距离(空间压缩)。早期研究发现视听刺激的不一致会改善空间压缩, 但听觉刺激在其中的作用及其影响效果需进一步研究。本研究首先探究了听觉刺激的有无对空间压缩的影响, 接着操控视听刺激之间的物物距离进一步探究其对空间压缩的影响和改善。研究发现听觉刺激以两种方式影响空间压缩：听觉刺激的存在可以改善空间压缩; 空间压缩与视听刺激的物物距离负相关。研究建议为了改善空间压缩, 视听刺激应当同时呈现且物物距离至少为1 m。

关键词: 虚拟现实, 空间压缩, 视听刺激, 物我距离, 物物距离

Abstract:

Distance compression in virtual reality (VR), which will lead to a distortion of fine manipulation in practical application, depicts that people tend to underestimate the spatial distance of visual stimuli in virtual environments. The apparent perceived differences between virtual and real environments break the immersive experiences and lower users' acceptance. Therefore, it is crucial to ameliorate the distance compression to increase the fidelity and ultimately promote the wider application of VR. Capitalizing on the fact that distance compression is a multiple modality phenomenon and occurs for auditory and visual stimuli, researchers reported that the distance judgment in VR would get more accurate when the positions of auditory and visual stimuli were incongruent. However, it is unclear to what extent the incongruency is to get effective amelioration. In this study, we aimed to completely examine the effect of the auditory stimulus on distance compression in VR. We presumed that the larger the incongruency was, the better amelioration obtained.

We used the HTC Vive Pro to render the virtual environment and the build-in headphone to present auditory stimulus. Thirty participants were recruited to perform a distance judgment task. We first controlled the presence or absence of the auditory stimulus. We also varied the egocentric distance of visual stimulus (3 m, 4 m, 5 m). Then, we controlled the incongruency of the audio-visual condition, that is, the exocentric distance between auditory and visual stimuli (0.5 m, 1 m, 1.5 m, 2 m). Each block consisted of 30 consecutive trials, wherein the reference visual stimulus was presented at the beginning 5 s. Participants were asked to judge whether the following adjust stimulus was nearer or farther than the reference stimulus. The egocentric distance would be adjusted according to the response of the prior trial. The egocentric distance of the adjust stimulus in the last trial was referred to as the ultimate distance judgment for the initial reference stimulus.

We found that the auditory stimulus affected the distance compression in two ways. First, the distance compression under the audio-visual condition was smaller than that under the visual-only condition (F(1, 29) = 4.05, p = 0.054, η_p² = 0.12), especially when the egocentric distance of the visual stimulus was large (4 m: difference = 1.8%, t = ?1.59, df= 29, p = 0.062; 5 m: difference = 1.6%, t = ?1.85, df = 29, p = 0.037). Second, we formulated the relationship between the exocentric distance between auditory and visual stimuli and the distance compression rate, which was calculated by subtracting the perceived egocentric distance from the physical egocentric distance and then dividing it by the physical egocentric distance.: distance compression rate = ?0.024 × exocentric distance + 0.056. The slope was significant (p = 0.008), indicating the distance compression rate was negatively correlated with the exocentric distance and could be ameliorated at a pace of 2.4% for every 1 m. The adjusted R² was 90.7%.

We reported the effect of auditory stimulus on the distance compression in VR. Based on our results, we highly recommended presenting the auditory and visual stimuli simultaneously in the time domain and a minimum of 1 m apart in the space domain to ameliorate the distance compression in VR.

Key words: virtual reality, distance compression, auditory and visual stimuli, egocentric distance, exocentric distance

中图分类号:

B842

胡晓斐, 汪嘉维, 刘涵宇, 宋晓蕾. (2023). 听觉刺激对虚拟环境中空间压缩的影响. 心理学报, 55(1), 1-8.

HU Xiaofei, WANG Jiawei, LIU Hanyu, SONG Xiaolei. (2023). Effect of auditory stimulus on distance compression in virtual reality. Acta Psychologica Sinica, 55(1), 1-8.

图/表 5

图1 实验1空间压缩率的结果。横轴代表参考刺激的物我距离; 纵轴代表空间压缩率。深色条和灰色条分别表示视听和纯视觉条件。可达到显著水平的事后统计结果呈现在相应的位置。黑色的误差线代表30名受试者的平均值的标准误差。注：*** p < 0.001; ** p < 0.01; * p < 0.05; + p < 0.1。

表1 实验1空间压缩率的描述性统计(M ± SE)

听觉刺激的存在	实际距离
听觉刺激的存在	3 m	4 m	5 m
纯视觉条件	7.22% ± 1.21%	7.00% ± 0.80%	6.20% ± 0.79%
视听条件	6.44% ± 0.98%	5.17% ± 1.04%	4.60% ± 0.60%
视听?纯视觉	t = ?0.51,	t = ?1.59,	t = ?1.85, ^*

表2 实验2空间压缩率的描述性统计(M±SE)

物物距离(m)	实际距离
物物距离(m)	3 m	4 m	5 m
0	6.44% ± 0.98%	5.17% ± 1.04%	4.60% ± 0.60%
0.5	4.44% ± 1.43%	4.33% ± 0.71%	3.67% ± 0.67%
1	3.44% ± 1.06%	3.25% ± 1.01%	2.47% ± 0.73%
1.5	2.00% ± 1.95%	2.25% ± 1.73%	1.13% ± 0.99%
2	0.78% ± 1.23%	0.58% ± 0.80%	0.67% ± 0.63%

表3 实验2空间压缩率的事后检验结果

物物距离(m)	Z值	p值
0.5 ~ 0	?1.38	0.648
1 ~ 0	?2.56⁺	0.078
1.5 ~ 0	?3.93^***	<0.001
2 ~ 0	?5.15^***	<0.001
1 ~ 0.5	?1.19	0.756
1.5 ~ 0.5	?2.58⁺	0.077
2 ~ 0.5	?3.80^**	0.002
1.5 ~ 1	?1.37	0.645
2 ~ 1	?2.59⁺	0.072
2 ~ 1.5	?1.22	0.740

图2 实验2空间压缩率的结果。横轴代表视听刺激的物物距离; 纵轴代表空间压缩率。可达到显著水平的事后统计结果呈现在相应的位置。黑色的误差线代表30名受试者的平均值的标准误差。注：*** p < 0.001; ** p < 0.01; * p < 0.05; + p < 0.1。

参考文献 28

[1]	Alais D., & Burr D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14(3), 257-262. doi: 10.1016/j.cub.2004.01.029 pmid: 14761661
[2]	Anderson P. W., & Zahorik P. (2014). Auditory/visual distance estimation: Accuracy and variability. Frontiers in Psychology, 5, 1097. https://doi.org/10.3389/fpsyg.2014.01097 doi: 10.3389/fpsyg.2014.01097 URL pmid: 25339924
[3]	Armbrüster C., Wolter M., Kuhlen T., Spijkers W., & Fimm B. (2008). Depth perception in virtual reality: Distance estimations in peri-and extrapersonal space. Cyberpsychology & Behavior, 11(1), 9-15.
[4]	Berry J. S., Roberts D. A., & Holliman N. S. (2014, February). 3D sound and 3D image interactions:A review of audio- visual depth perception. In B. E. Rogowitz, T. N. Pappas, & H. D. Ridder (Eds.), Proceedings of SPIE - The International Society for Optical Engineering: Vol. 9014: Human Vision and Electronic Imaging XIX (pp.33-48). SPIE.
[5]	Bruns P. (2019). The ventriloquist illusion as a tool to study multisensory processing: An update. Frontiers in Integrative Neuroscience, 13, 51. https://doi.org/10.3389/fnint.2019.00051 doi: 10.3389/fnint.2019.00051 URL pmid: 31572136
[6]	Buck L., Paris R., & Bodenheimer B. (2021). Distance compression in the htc vive pro: A quick revisitation of resolution. Frontiers in Virtual Reality, 2, Article 728667. https://doi.org/10.3389/frvir.2021.728667
[7]	Buck L. E., Young M. K., & Bodenheimer B. (2018). A comparison of distance estimation in HMD-Based virtual environments with different HMD-Based conditions. ACM Transactions on Applied Perception, 15(3), 1-15.
[8]	Ellis S. R., & Menges B. M. (1998). Localization of virtual objects in the near visual field. Human Factors, 40(3), 415-431. pmid: 11536894
[9]	Ernst M. O., & Banks M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429-433. doi: 10.1038/415429a URL
[10]	Finnegan D. J., O’Neill E., & Proulx M. J. (2016, May). Compensating for distance compression in audiovisual virtual environments using incongruence. In K. Jofish, & D. Allison (Eds.), CHI'16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 200-212). Association for Computing Machinery.
[11]	Gorzel M., Corrigan D., Squires J., Boland F., & Kearney G. (2012, March). Distance perception in virtual audio-visual environments. Paper presented at UK 25th Conference: Spatial Audio in Today’s 3D World. York, UK. http://www.aes.org/e-lib/browse.cfm?elib=18119
[12]	Henry D., & Furness T. (1993,, September). Spatial perception in virtual environments: Evaluating an architectural application. Paper presented at IEEE Virtual Reality Annual International Symposium. Seattle, Washington, USA: IEEE. https://doi.org/10.1109/VRAIS.1993.380801
[13]	Huang Y. H., Venkatakrishnan R., Venkatakrishnan R., Babu S. V., & Lin W. C. (2021, September).Using audio reverberation to compensate distance compression in virtual reality. Paper presented at SAP '21: ACM Symposium on Applied Perception 2021, New York, USA: ACM, 1-10. https://doi.org/10.1145/3474451.3476236
[14]	Interrante V., Ries B., & Anderson L. (2006, March). Distance perception in immersive virtual environments, revisited. Paper presented at IEEE Virtual Reality Conference (VR 2006). Alexandria, Virginia, USA: IEEE. https://doi.org/10.1109/VR.2006.52
[15]	Interrante V., Ries B., Lindquist J., Kaeding M., & Anderson L. (2008). Elucidating factors that can facilitate veridical spatial perception in immersive virtual environments. Presence: Teleoperators and Virtual Environments, 17(2), 176-198. doi: 10.1162/pres.17.2.176 URL
[16]	Kelly J. W., Hammel W. W., Siegel Z. D., & Sjolund L. A. (2014). Recalibration of perceived distance in virtual environments occurs rapidly and transfers asymmetrically across scale. IEEE Transactions on Visualization and Computer Graphics, 20(4), 588-595. doi: 10.1109/TVCG.2014.36 URL
[17]	Klein E., Swan J. E., Schmidt G. S., Livingston M. A., & Staadt O. G. (2009, March). Measurement protocols for Medium-Field distance perception in Large-Screen immersive displays. Paper presented at 2009 IEEE Virtual Reality Conference, Lafayette, Louisiana, USA: IEEE. https://doi.org/10.1109/VR.2009.4811007
[18]	Li Z., Phillips J., & Durgin F. H. (2011). The underestimation of egocentric distance: Evidence from frontal matching tasks. Attention, Perception & Psychophysics, 73(7), 2205-2217. doi: 10.3758/s13414-011-0170-2 URL
[19]	Maruhn P., Schneider S., & Bengler K. (2019). Measuring egocentric distance perception in virtual reality: Influence of methodologies, locomotion and translation gains. PloS One, 14(10), Article e0224651. https://doi.org/10.1371/jounal.pone.0224651
[20]	Naceri A., Chellali R., Dionnet F., & Toma S. (2009, November). Depth perception within virtual environments: A comparative study between wide screen stereoscopic displays and head mounted devices. Paper presented at 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns (COMPUTATIONWORLD). Athens, Greece: IEEE. https://doi.org/10.1109/ComputationWorld.2009.91
[21]	Pan X., & Hamilton A. F. de C. (2018). Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology, 109(3), 395-417. doi: 10.1111/bjop.12290 pmid: 29504117
[22]	Rand K. M., Tarampi M. R., Creem-Regehr S. H., & Thompson W. B. (2011). The importance of a visual horizon for distance judgments under severely degraded vision. Perception, 40(2), 143-154. pmid: 21650089
[23]	Rébillat M., Boutillon X., Corteel É., & Katz B. F. (2012). Audio, visual, and audio-visual egocentric distance perception by moving subjects in virtual environments. ACM Transactions on Applied Perception, 9(4), 1-17.
[24]	Renner R. S., Velichkovsky B. M., & Helmert J. R. (2013). The perception of egocentric distances in virtual environments-a review. ACM Computing Surveys, 46(2), 1-40.
[25]	Saghafian M., Laumann K., Akhtar R. S., & Skogstad M. R. (2020). The evaluation of virtual reality fire extinguisher training. Frontiers in Psychology, 11(10), Article 593466. https://doi.org/10.3389/fpsyg.2020.593466
[26]	Turner A., Berry J., & Holliman N. (2011, February). Can the perception of depth in stereoscopic images be influenced by 3D sound? Paper presented at Stereoscopic Displays and Applications XXII. San Francisco Airport, California, USA: SPIE. https://doi.org/10.1117/12.871960
[27]	Wu B., Ooi T. L., & He Z. J. (2004). Perceiving distance accurately by a directional process of integrating ground information. Nature, 428(6978), 73-77. doi: 10.1038/nature02350 URL
[28]	Zahorik P., Brungart D. S., & Bronkhorst A. W. (2005). Auditory distance perception in humans: A summary of past and present research. Acta Acustica United with Acustica, 91(3), 409-420.