Valerie Gaveau
ABSTRACT
In everyday life, localizing a sound source entails more than the sole extraction of auditory cues to define its three-dimensions: spatial hearing also takes into account the available visual information (e.g. cues to sound position) and resolves perceptual ambiguities through active listening behavior (e.g. exploring the auditory environment with head movements). We introduce a novel approach to sound localization in 3D named SPHERE which exploits a commercially available Virtual Reality Head-mounted display system with real- time kinematic tracking to combine all of these elements (controlled positioning of a real sound source, recording of participants’ responses in 3D, controlled visual stimulations and active listening behavior). SPHERE allows accurate sampling of 3D spatial hearing abilities, and allows detection and quantification of the contribution of active listening.
Supplemental Material
- Piotr Majdak, Matthew J. Goupell and Bernhard Laback. 2011. Two-Dimensional Localization of Virtual Sound Sources in Cochlear-Implant Listeners. Ear Hearing 32 (2): 198-208. DOI: 10.1097/AUD.0b013e3181f4dfe9.Google Scholar
Cross Ref
- Kazuhiro Lida. 2019. Head-Related Transfer Functions Ans Acoustic Virtual Reality. Springer Singapore. Biomedical Sciences.Google Scholar
- Hans Wallach. 1940. The Role of Head Movements and Vestibular and Visual Cues in Sound Localization. Journal Experimental Psychology 27 (4): 339-68. DOI: 0.1037/h0054629.Google ScholarCross Ref
- Chiara Valzolgher, Grégoire Verdelet, Romeo Salemme, Luigi Lombardi, Alessandro Farnè, Francesco Pavani. 2020. Reaching to sounds in virtual reality: A multisensory-motor approach to promote adaptation to altered auditory cues. Neuropsychologie149:107665. DOI:10.1016/j.neuropsychologia.2020.107665Google Scholar
- Aurélie Coudert, Valérie Gaveau, Julie Gatel, Grégoire Verdelet, Romeo Salemme, Alessandro Farnè, Francesco Pavani, Eric Truy. 2022. Spatial Hearing Difficulties in Reaching Space in Bilateral Cochlear Implant Children Improve With Head Movements. Ear Hearing. 43(1):192-205. DOI: https://doi.org/10.1097/AUD.0000000000001090%3c/bib>Google ScholarCross Ref
- Chiara Valzolgher, Michaela Todeschini, Grégoire Verdelet, Julie Gatel, Romeo Salemme, Valérie Gaveau, Eric Truy, Alessandro Farnè, Francesco Pavani. Adapting to altered auditory cues: Generalization from manual reaching to head pointing. (2022).PloSone17(4), e0263509. DOI:10.1371/journal.pone.0263509Google Scholar
- Romeo Salemme, Valérie Gaveau, Alessandro Farnè, Francesco Pavani, Eric Koun, Anaël Belle. Method and apparatus for acquiring a spatial map of auditory perception of a subject. (2021). Patent No. 11176727, Filed May 26th., 2017. Issued Nov. 16th., 2021.Google Scholar
Recommendations
Active binaural localization of multiple sound sources
Sound source localization serves as a significant capability of autonomous robots that conduct missions such as search and rescue, and target tracking in challenging environments. However, localization of multiple sound sources and static sound source ...
Acoustic sound localisation: visualisations of a 1st order ambisonic microphone array
OzCHI '18: Proceedings of the 30th Australian Conference on Computer-Human InteractionThis paper reports on preliminary design and testing of an acoustic spatial localisation system capable of creating detailed two dimensional noise visualisations (heat-maps). The work has developed alongside a range of 360 Ambisonic audio projects ...
An integrated approach of 3D sound rendering techniques for sound externalization
PCM'10: Proceedings of the Advances in multimedia information processing, and 11th Pacific Rim conference on Multimedia: Part IIIn this paper, a sound externalization method is proposed for out-of the head localization in headphone listening environments. Several externalization methods have been proposed that use either a head-related transfer function (HRTF) or early ...
Comments