使用3D音效系統以增強虛擬實境體驗之研究

Study of Using a 3D sound system to enhance the virtual reality experience

10.6285/MIC.201909_8(2).0006

王琦(Chi Wang)；鄭建文(Chien-Wen Cheng)

虛擬實境 ； 感知體驗 ； 聲音定位 ； 3D音效 ； Virtual Reality ； Perceived Experience ； Sound Localization ； Ambisonic

管理資訊計算

8卷2期（2019 / 09 / 01）

56 - 68

繁體中文

虛擬實境（Virtual Reality，VR）體驗主要是透過對人體五種感官的刺激，讓使用者全心投入於虛擬的世界當中，進而讓使用者認為這個虛擬的世界是真實的。從1968年Ivan Edward Sutherland創造出史上第一台頭戴式顯示器開始，虛擬實境的技術皆是以頭戴式顯示器的樣貌出現，而虛擬實境的發展之所以會圍繞在頭戴式顯示器的開發，其原因是因為視覺的感官刺激佔據人類感知的比例達87%。虛擬實境的體驗和電視電影的體驗相同的是，透過視覺給予使用者精彩的內容，並藉由聽覺給予使用者生動的效果，讓使用者擁有良好的視聽體驗，但不同的是由於在虛擬實境的體驗過程中，使用者會因為不斷的轉動身體而沒有固定的體驗方向，因此和電視電影的視聽體驗有很大的不同，此情形將導致喇叭位置固定的揚聲系統不適用於虛擬實境，所以虛擬實境的聲音播放系統往往是透過雙聲道耳機作為標準配置。在配置耳機的虛擬實境體驗當中，為了讓使用者在虛擬的世界當中，模擬人在真實世界聽到的聲音，因此需要高度的三維立體聲技術作為聲音設計的基礎。有鑑於上述，本研究透過Ambisonic的3D聲音系統作為聲音設計的基礎，並建立一個虛擬實境的聽覺實驗，透過實驗評估使用者在虛擬實境體驗中對於聲音定位的準確度，並聚焦於驗證聲音對於虛擬實境體驗的重要性，以及探討只有聽覺的虛擬實境是否可以作為一種虛擬實境體驗的方式，並提出以聲音為主之虛擬實境體驗的設計建議。

By the stimulation of the five senses of a human body, virtual reality (VR) allows users to become fully engaged in the virtual world, and thereby makes them believe that the virtual world is real. Since Ivan Edward Sutherland created the first head-mounted display in 1968, various VR technologies have been introduced with head-mounted displays. Concurrently, the development of VR relies on that of the head-mounted displays because visual sensory stimulation accounts for up to 87% of human perception. VR experiences are similar to television and movie experiences in some aspects. Both of them provide users with remarkable content visually and make the content intense by auditory stimulation. This allows the users to have phenomenal audio-visual experiences. However, during VR experiences, users turn their bodies constantly, and so, there are no fixed directions for their experiences. Thus, VR experiences differ significantly from their television and movie counterparts. This makes loudspeaker systems with fixed positioning unsuitable for VR. Hence, two-channel headphones are generally used for VR audio playing. In VR experiences using headphones for the users to become fully engaged in the virtual world, sounds that people hear in the real world need to be simulated. Therefore, three-dimensional stereophonic sound technologies have to be employed as the basis for the sound design. Thus, this research adopts a three-dimensional sound system based on Ambisonics for sound design and constructs a VR auditory experiment. By the experiment, the accuracy with which the users can locate sounds during VR experiences is assessed. The importance of sounds in VR experiences is also verified. Furthermore, consideration of VR experiences with only auditory stimulation as a type of VR experiences is discussed. Design recommendations are made for VR experiences mainly based on sounds.

1. Resonance Audio -. (n.d.). Retrieved July 8, 2019, from https://resonance-audio.github.io/resonance-audio/
2. Localization and the Human Auditory System. (n.d.). Retrieved July 8, 2019, from https://developer.oculus.com/documentation/audiosdk/latest/concepts/audio-intro-localization/
3. Ando, Y.(2002).Correlation factors describing primary and spatial sensations of sound fields.Journal of Sound and Vibration - J SOUND VIB,258,405-417.
4. Burdea, G. C.,Coiffet, P.(2003).Virtual Reality Technology.John Wiley & Sons.
5. Butler, R. A.,Humanski, R. A.(1992).Localization of sound in the vertical plane with and without high-frequency spectral cues.Perception & Psychophysics,51(2),182-186.
6. Coleman, P. D.(1962).Failure to Localize the Source Distance of an Unfamiliar Sound.The Journal of the Acoustical Society of America,34(3),345-346.
7. Gerzon, M. A.(1973).Periphony: With-Height Sound Reproduction.Journal of the Audio Engineering Society,21(1),2-10.
8. Middlebrooks, J. C.,Green, D. M.(1991).Sound Localization by Human Listeners.Annual Review of Psychology,42(1),135-159.
9. Sutherland, I. E.(1968).A Head-mounted Three Dimensional Display.Proceedings of the December 9-11, 1968, Fall Joint Computer Conference, Part I
10. Valin, J.,Michaud, F.,Rouat, J.(2006).Robust 3D Localization and Tracking of Sound Sources Using Beamforming and Particle Filtering.2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings
11. 伍永康,歐陽明(1998)。虛擬實境以及其在娛樂上的應用。光訊，71，4-6。

1. 林怡秀,李昇原(2022)。運動產業的數位化浪潮：虛擬實境應用探討。休閒運動健康評論，11(2)，95-108。
2. (2024)。沉浸式虛擬實境運動之臨場感影響持續使用意願之研究。休閒運動健康評論，13(2)，89-105。