Instant sound scattering

ABSTRACT

Real-time sound rendering engines often render occlusion and early sound reflection effects using geometrical techniques such as ray or beam tracing. They can only achieve interactive rendering for environments of low local complexity resulting in crude effects which can degrade the sense of immersion. However, surface detail or complex dynamic geometry has a strong influence on sound propagation and the resulting auditory perception. This paper focuses on high-quality modeling of first-order sound scattering. Based on a surface-integral formulation and the Kirchhoff approximation, we propose an efficient evaluation of scattering effects, including both diffraction and reflection, that leverages programmable graphics hardware for dense sampling of complex surfaces. We evaluate possible surface simplification techniques and show that combined normal and displacement maps can be successfully used for audio scattering calculations. We present an auralization framework that can render scattering effects interactively thus providing a more compelling experience. We demonstrate that, while only considering first order phenomena, our approach can provide realistic results for a number of practical interactive applications. It can also process highly detailed models containing millions of unorganized triangles in minutes, generating high-quality scattering filters. Resulting simulations compare well with on-site recordings showing that the Kirchhoff approximation can be used for complex scattering problems.

References

1. BABOUD L., DÉCORET X.: Rendering geometry with relief textures. In Graphics Interface '06 (2006).
2. BERANEK L. L.: Concert and Opera Halls: How They Sound. Published for the Acoustical Society of America through the American Institute of Physics, 1996.
3. BILSEN F. A.: Repetition pitch glide from the step pyramid at Chichen Itza. J. of the Acoustical Society of America, 120 (2006), 594.
4. COOK R. L., CARPENTER L., CATMULL E.: The reyes image rendering architecture. SIGGRAPH Comput. Graph. 21, 4 (1987), 95-102.
5. COX T., DALENBACK B., D'ANTONIO P., EMBRECHTS J., JEON J., MOMMERTZ E., VÖRLANDER M.: A tutorial on scattering and diffusion coefficients for room acoustic surfaces. Acta Acustica united with Acustica (Jul 2006), 1-15.
6. CHEN J., ISHIMARU A.: Numerical simulation of the second-order Kirchhoff approximation from very rough surfaces and a study of backscattering enhancement. J. Acous. Soc. of America, 4 (Oct 1990), 1846- 1850.
7. COX T., LAM Y.: Evaluations of methods for predicting the scattering from simple rigid panels. Applied Acoustics 40 (1993), 123-140.
8. COHEN J., OLANO M., MANOCHA D.: Appearance-preserving simplification. In SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1998), ACM Press, pp. 115-122.
9. CHRISTENSEN C., RINDEL J.: A new scattering method that combines roughness and diffraction effects. Forum Acousticum, Budapest, Hungary (2005).
10. CALAMIA P., SVENSSON U.: Fast timedomain edge-diffraction for interactive acoustic simulations. EURASIP Journal on Applied Signal Processing, special issue on Spatial Sound and Virtual Acoustics (2007).
11. DARVE E.: The fast multipole method: numerical implementation. J. Comp. Physics 160 (2000), 195-240.
12. DECLERCQ N. F., DEGRIECK J., BRIERS R., LEROY O.: A theoretical study of special acoustic effects caused by the staircase of the El Castillo pyramid at the maya ruins of Chichen-Itza in Mexico. J. of the Acoustical Society of America, 116 (2004), 3328.
13. DACHSBACHER C., STAMMINGER M.: Reflective shadow map. Proceedings of I3D'05 (2005).
14. EMBRECHTS J., D. ARCHAMBEAU, STAN G.: Determination of the scattering coefficient of random rough diffusing surfaces for room acoustics applications. Acta Acustica united with Acustica 87 (June 2001), 482- 494.
15. EMBRECHTS J.: Simulation of first and secondorder scattering by rough surfaces with a sound-ray formalism. J. of Sound and Vibration 229, 1 (June 2000), 65-87.
16. FUNKHOUSER T., CARLBOM I., ELKO G., PINGALI G., SONDHI M., WEST J.: A beam tracing approach to acoustic modeling for interactive virtual environments. ACM Computer Graphics, SIGGRAPH'98 Proceedings (July 1998), 21-32.
17. FILIPPI P., HABAULT D., LEFEVRE J., BERGASSOLI A.: Acoustics, basic physics, theory and methods. Academic Press, 1999.
18. FUNKHOUSER T., JOT J., TSINGOS N.: Sounds good to me ! Computational sound for Graphics, VR, and Interactive systems. Siggraph 2002 course #45 (2002).
19. HALMRAST T.: Sound coloration from (very) early reflections. ASA, Acoustical Society of America Meeting, Chicago (June 2001).
20. HECHT E.: Optics, Chapter 10, pp. 501-507. 3rd edition, Addison Wesley, 1998.
21. HIRCHE J., EHLERT A., GUTHE S., DOGGETT M.: Hardware accelerated per-pixel displacement mapping. Proc. of Graphics Interface'04. Canadian Human-Computer Communications Society (2004), 153-158.
22. ISO: Acoustics - Attenuation of sound during propagation outdoors - Part 1: Calculation of the absorption of sound by the atmosphere. International Organization for Standardization, ISO 9613-1 (1993).
23. ISO: Acoustics - Sound-scattering properties of surfaces - Part 1: Measurement of the random-incidence scattering coefficient in a reverberation room. International Organization for Standardization, ISO 17497-1 (2004).
24. JAMES D. L., BARBIČ J., PAI D. K.: Precomputed acoustic transfer: Output-sensitive, accurate sound generation for geometrically complex vibration sources. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3 (Aug. 2006).
25. JEBSEN G., MEDWIN H.: On the failure of the Kirchhoff assumption in backscatter. J. Acous. Soc. of America, 5 (Nov 1982), 1607-1611.
26. JOSLIN C., MAGNENAT-THALMANN N.: Significant fact retreival for real-time 3D sound rendering in complex virtual environments. Proc. of VRTST 2003 (October 2003).
27. KEIFFER R., NOVARINI J.: A time-domain rough surface scattering model based on wedge diffraction: Application to low-frequency backscattering from twodimensional sea surfaces. J. Acous. Soc. of America, 1 (Jan 2000), 27-39.
28. LENTZ T., SCHRÖDER D., VORLÄNDER M., ASSENMACHER I.: Virtual reality system with integrated sound field simulation and reproduction. EURASIP Journal on Advances in Signal Processing 2007 (2007), Article ID 70540, 19 pages. doi:10.1155/2007/70540.
29. MOORE B. C.: An introduction to the psychology of hearing. Academic Press, 4th edition, 1997.
30. MCNAMARA D., PISTORIUS C., MALHERBE J.: Introduction to the Uniform Geometrical Theory of Diffraction. Artech House, 1990.
31. NORTON G., NOVARINI J., KEIFFER R.: An evaluation of the Kirchhoff approximation in predicting the axial impulse response of hard and soft disks. J. Acous. Soc. of America, 6 (June 1993), 3094-3056.
32. PIERCE A.: Acoustics. An introduction to its physical principles and applications. 3rd edition, pp. 107-111, American Institute of Physics, 1984.
33. RINDEL J., SHIOKAWA H., CHRISTENSEN C., GADE A. C.: Comparisons between computer simulations of room acoustical parameters and those measured in concert halls. Joint meeting of the Acoustical Society of America and the European Acoustics Association, Berlin, 14-19 March (1999).
34. SVENSSON U. P., FRED R. I., VANDERKOOY J.: Analytic secondary source model of edge diffraction impulse responses. J. Acoust. Soc. Am. 106 (1999), 2331- 2344.
35. SILTANEN S.: Geometry reduction in room acoustics modeling. Master Thesis, Helsinki University Of Technology, Department of Computer Science Telecommunications Software and Multimedia Laboratory (September 2005).
36. SAKURAI Y., NAGATA K.: Sound reflections of a rigid plane panel and of the "live-end" composed by those panels. J. Acous. Soc. of Japan, 1 (Jan 1981), 5-14.
37. SAVIOJA L., RINNE T., TAKALA T.: Simulation of room acoustics with a 3D finite difference mesh. Proceedings of Intl. Computer Music Conf. (ICMC94) (Sept. 1994), 463-466.
38. TSINGOS N., FUNKHOUSER T., NGAN A., CARLBOM I.: Modeling acoustics in virtual environments using the uniform theory of diffraction. ACM Computer Graphics, SIGGRAPH'01 Proceedings (Aug. 2001), 545- 552.
39. TSINGOS N., GASCUEL J.: A general model for the simulation of room acoustics based on hierarchical radiosity. Technical sketch, in visual proceedings of SIGGRAPH' 97, Los Angeles, USA (Aug. 1997).
40. TSINGOS N., GASCUEL J.-D.: Soundtracks for computer animation: sound rendering in dynamic environments with occlusions. Proceedings of Graphics Interface' 97 (May 1997), 9-16.
41. TSINGOS N., GASCUEL J.-D.: Fast rendering of sound occlusion and diffraction effects for virtual acoustic environments. Proc. 104th Audio Engineering Society Convention, preprint 4699 (May 1998).
42. THORSOS E.: The validity of the Kirchhoff approximation for rough surface scattering using a gaussian roughness spectrum. J. Acous. Soc. of America, 1 (Jan 1987), 78-92.
43. WANG L., RATHSAM J., RYHERD S.: Interactions of model detail level and scattering coefficients in room acoustic computer simulation. Intl. Symp. on Room Acoustics, a satelite symposium of ICA, Kyoto, Japan (2004).
44. ZENG X., CHRISTENSEN C., RINDEL J.: Practical methods to define scattering coefficients in a room acoustics computer model. Applied Acoustics (2006).

Index Terms

• Applied computing

  • Arts and humanities

    • Sound and music computing

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation

    • Image manipulation

    • Rendering

• Information systems

  • Information retrieval

    • Specialized information retrieval

      • Multimedia and multimodal retrieval

        • Music retrieval