Precomputed acoustic transfer: output-sensitive, accurate sound generation for geometrically complex vibration sources

ABSTRACT

Simulating sounds produced by realistic vibrating objects is challenging because sound radiation involves complex diffraction and interreflection effects that are very perceptible and important. These wave phenomena are well understood, but have been largely ignored in computer graphics due to the high cost and complexity of computing them at audio rates.We describe a new algorithm for real-time synthesis of realistic sound radiation from rigid objects. We start by precomputing the linear vibration modes of an object, and then relate each mode to its sound pressure field, or acoustic transfer function, using standard methods from numerical acoustics. Each transfer function is then approximated to a specified accuracy using low-order multi-pole sources placed near the object. We provide a low-memory, multilevel, randomized algorithm for optimized source placement that is suitable for complex geometries. At runtime, we can simulate new interaction sounds by quickly summing contributions from each mode's equivalent multipole sources. We can efficiently simulate global effects such as interreflection and changes in sound due to listener location. The simulation costs can be dynamically traded-off for sound quality. We present several examples of sound generation from physically based animations.

References

1. Abramowitz, M., and Stegun, I. A. 1964. Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. Dover, New York.
2. Barbič, J., and James, D. 2005. Real-Time Subspace Integration for St. Venant-Kirchhoff Deformable Models. ACM Transactions on Graphics 24, 3 (Aug.), 982--990.
3. Cardle, M., Brooks, S., Bar-Joseph, Z., and Robinson, P. 2003. Sound-by-Numbers: Motion-Driven Sound Synthesis. In 2003 ACM SIGGRAPH / Eurographics Symp. on Computer Animation, 349--356.
4. Ciscowski, R. D., and Brebbia, C. A. 1991. Boundary Element methods in acoustics. Computational Mechanics Publications and Elsevier Applied Science, Southampton.
5. Cook, P. 2002. Real Sound Synthesis for Interactive Applications. A. K. Peters.
6. Cremer, L., Heckl, M., and Ungar, E. 1990. Structure Borne Sound: Structural Vibrations and Sound Radiation at Audio Frequencies, 2nd ed. Springer, January.
7. Cunefare, K. A., and Currey, M. N. 1994. On the exterior acoustic radiation modes of structures. The Journal of the Acoustical Society of America 96, 4 (October), 2302--2312.
8. Desmet, W. 2002. Mid-frequency vibro-acoustic modelling: challenges and potential solutions. In Proceedings of ISMA 2002, vol. II.
9. Dobashi, Y., Yamamoto, T., and Nishita, T. 2003. Real-Time Rendering of Aerodynamic Sound Using Sound Textures Based on Computational Fluid Dynamics. ACM Trans. on Graphics 22, 3 (July), 732--740.
10. Funkhouser, T., Carlbom, I., Elko, G., Pingali, G., Sondhi, M., and West, J. 1998. A Beam Tracing Approach to Acoustic Modeling for Interactive Virtual Environments. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 21--32.
11. Funkhouser, T. A., Min, P., and Carlbom, I. 1999. Real-Time Acoustic Modeling for Distributed Virtual Environments. In Proceedings of SIGGRAPH 99, 365--374.
12. Golub, G., and Van Loan, C. 1996. Matrix Computations, third ed. The Johns Hopkins University Press, Baltimore.
13. Gounot, Y., Musafir, R. E., and Slama, J. G. 2005. A Comparative Study of Two Variants of the Equivalent Sources Method in Scattering Problems. Acta Acustica united with Acustica 91, 5, 860--872.
14. Gumerov, N., and Duraiswami, R. 2005. Fast Multipole Methods for the Helmholtz Equation in Three Dimensions. Elsevier Series in Electromagnetism. Elsevier Science, March.
15. James, D. L., and Fatahalian, K. 2003. Precomputing Interactive Dynamic Deformable Scenes. ACM Trans. on Graphics 22, 3, 879--887.
16. James, D. L., and Pai, D. K. 2002. DyRT: Dynamic Response Textures for Real Time Deformation Simulation With Graphics Hardware. ACM Transactions on Graphics 21, 3 (July), 582--585.
17. Johnson, M. E., Lalime, A. L., Grosveld, F. W., Rizzi, S. A., and Sullivan, B. M. 2003. Development of an efficient binaural simulation for the analysis of structural acoustic data. In 8th Intl. Conf. on Recent Advances in Structural Dynamics.
18. Kita, E., and Kamiya, N. 1995. Trefftz method: An overview. Advances in Engineering Software 24, 89--96.
19. Lewiner, T., Lopes, H., Vieira, A. W., and Tavares, G. 2003. Efficient implementation of Marching Cubes' cases with topological guarantees. Journal of Graphics Tools 8, 2, 1--15.
20. Lokki, T., Savioja, L., Väänänen, R., Huopaniemi, J., and Takala, T. 2002. Creating Interactive Virtual Auditory Environments. IEEE Computer Graphics & Applications 22, 4 (July-August), 49--57.
21. Magalhães, M. B. S., and Tenenbaum, R. A. 2004. Sound Sources Reconstruction Techniques: A Review of Their Evolution and New Trends. Acta Acustica united with Acustica 90, 199--220.
22. O'Brien, J. F., Cook, P. R., and Essl, G. 2001. Synthesizing Sounds From Physically Based Motion. In Proceedings of ACM SIGGRAPH 2001, 529--536.
23. O'Brien, J. F., Shen, C., and Gatchalian, C. M. 2002. Synthesizing Sounds from Rigid-Body Simulations. In ACM SIGGRAPH Symposium on Computer Animation, 175--181.
24. Ochmann, M. 1995. The Source Simulation Technique for Acoustic Radiation Problems. Acustica 81.
25. Ochmann, M. 1999. The full-field equations for acoustic radiation and scattering. Journal of the Acoustical Society of America 105, 5 (May).
26. Pai, D. K., van den Doel, K., James, D. L., Lang, J., Lloyd, J. E., Richmond, J. L., and Yau, S. H. 2001. Scanning Physical Interaction Behavior of 3D Objects. In Proc. of ACM SIGGRAPH 2001, 87--96.
27. Pavić, G. 2005. An Engineering Technique for the Computation of Sound Radiation by Vibrating Bodies Using Substitute Sources. Acta Acustica united with Acustica 91, 1, 1--16.
28. Pavić, G. 2006. A Technique for the Computation of Sound Radiation by Vibrating Bodies Using Multipole Substitute Sources. Acta Acustica united with Acustica 92, 1, 112--126.
29. Raghuvanshi, N., and Lin, M. C. 2006. Interactive Sound Synthesis for Large Scale Environments. In SI3D '06: Proceedings of the 2006 symposium on Interactive 3D graphics and games, ACM Press, New York, NY, USA, 101--108.
30. Shabana, A. A. 1990. Theory of Vibration, Volume II: Discrete and Continuous Systems, first ed. Springer-Verlag, New York, NY.
31. Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments. ACM Transactions on Graphics 21, 3 (July), 527--536.
32. Sloan, P.-P., Hall, J., Hart, J., and Snyder, J. 2003. Clustered Principal Components for Precomputed Radiance Transfer. ACM Transactions on Graphics 22, 3 (July), 382--391.
33. Sloan, P.-P., Luna, B., and Snyder, J. 2005. Local, Deformable Precomputed Radiance Transfer. ACM Transactions on Graphics 24, 3 (Aug.), 1216--1224.
34. Stam, J. 1999. Diffraction Shaders. In Proceedings of SIGGRAPH 99, Computer Graphics Proceedings, Annual Conference Series, 101--110.
35. Stettner, A., and Greenberg, D. P. 1989. Computer Graphics Visualization For Acoustic Simulation. In Computer Graphics (Proceedings of SIGGRAPH 89), vol. 23, 195--206.
36. Takala, T., and Hahn, J. 1992. Sound rendering. In Computer Graphics (Proceedings of SIGGRAPH 92), vol. 26, 211--220.
37. Tsingos, N., Funkhouser, T., Ngan, A., and Carlbom, I. 2001. Modeling Acoustics in Virtual Environments Using the Uniform Theory of Diffraction. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 545--552.
38. Tsingos, N., Carlbom, I., Elbo, G., Kubli, R., and Funkhouser, T. 2002. Validating Acoustical Simulations in Bell Labs Box. IEEE Computer Graphics & Applications 22, 4 (July-August), 28--37.
39. Tsingos, N., Gallo, E., and Drettakis, G. 2004. Perceptual Audio Rendering of Complex Virtual Environments. ACM Transactions on Graphics 23, 3 (Aug.), 249--258.
40. van den Doel, K., and Pai, D. K. 1996. Synthesis of shape dependent sounds with physical modeling. In Intl Conf. on Auditory Display.
41. van den Doel, K., Kry, P. G., and Pai, D. K. 2001. FoleyAutomatic: Physically-Based Sound Effects for Interactive Simulation and Animation. In Proceedings of ACM SIGGRAPH 2001, 537--544.
42. van den Doel, K., Pai, D. K., Adam, T., Kortchmar, L., and Pichora-Fuller, K. 2002. Measurements of Perceptual Quality of Contact Sound Models. In Intl. Conf. on Auditory Display, 345--349.
43. von Estorff, O., Ed. 2000. Boundary Elements in Acoustics: Advances and Applications. WIT Press, Southhampton, UK.
44. von Estorff, O. 2003. Efforts to Reduce Computation Time in Numerical Acoustics -- An Overview. Acta Acustica united with Acustica 89, 1--13.
45. Wand, M., and Strasser, W. 2004. Multi-resolution sound rendering. In 2004 Eurographics Symp. on Point-Based Graphics, Eurographics.
46. Wu, T. W., Ed. 2000. Boundary Element Acoustics: Fundamentals and Computer Codes. WIT Press, Southhampton, UK.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation

      • Physical simulation

    • Shape modeling

  • Modeling and simulation

    • Simulation types and techniques

      • Simulation by animation

• Mathematics of computing

  • Continuous mathematics

    • Topology

      • Geometric topology