skip to main content
research-article

Data-Driven Particle-Based Liquid Simulation with Deep Learning Utilizing Sub-Pixel Convolution

Published:28 April 2021Publication History
Skip Abstract Section

Abstract

In recent years, the performance of neural network inference has been drastically improved. This rapid change has paved the way for research projects focusing on accelerating physics-based simulations by replacing solver with its approximation. In this paper, we propose several efficient architectures of neural networks, which can be used to exploit this idea. The purpose of our research was to specifically target a liquid simulation problem. The central challenge for us was to create an efficient solution capable of approximating Position Based Fluid [Macklin and Müller 2013] solver. It requires the network to produce an accurate output at particles located in a continuous space and be significantly faster than the GPU based simulation. We achieved this by using modern sub-pixel convolution techniques originally used for image super-resolution. In our experiments, our method runs up to 200 times faster than the reference GPU simulation.

Skip Supplemental Material Section

Supplemental Material

References

  1. Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Caglar Gulcehre, Francis Song, Andrew Ballard, Justin Gilmer, George Dahl, Ashish Vaswani, Kelsey Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matt Botvinick, Oriol Vinyals, Yujia Li, and Razvan Pascanu. 2018. Relational inductive biases, deep learning, and graph networks. arXiv:1806.01261 [cs.LG]Google ScholarGoogle Scholar
  2. Markus Becker and Matthias Teschner. 2007. Weakly Compressible SPH for Free Surface Flows. In Proceedings of the 2007 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, California) (SCA '07). Eurographics Association, Goslar, DEU, 209--217.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jan Bender and Dan Koschier. 2015. Divergence-Free Smoothed Particle Hydrodynamics. In Proceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation (Los Angeles, California) (SCA '15). Association for Computing Machinery, New York, NY, USA, 147--155.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Blender Online Community. 2018. Blender - a 3D modelling and rendering package. Blender Foundation, Stichting Blender Foundation, Amsterdam. http://www.blender.orgGoogle ScholarGoogle Scholar
  5. Douglas Enright, Stephen Marschner, and Ronald Fedkiw. 2002. Animation and rendering of complex water surfaces. ACM Trans. Graph. 21, 3 (July 2002), 736--744.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Nick Foster and Ronald Fedkiw. 2001. Practical Animation of Liquids. In Proc. SIGGRAPH. 23--30.Google ScholarGoogle ScholarCross RefCross Ref
  7. Nick Foster and Dimitri Metaxas. 1996. Realistic animation of liquids. Graph. Models Image Process. 58, 5 (1996), 471--483.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Chuyuan Fu, Qi Guo, Theodore Gast, Chenfanfu Jiang, and Joseph Teran. 2017. A Polynomial Particle-in-Cell Method. ACM Trans. Graph. 36, 6, Article 222 (Nov. 2017), 12 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. K. Fukushima. 1980. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 36 (1980), 193--202.Google ScholarGoogle ScholarCross RefCross Ref
  10. Robert A Gingold and Joseph J Monaghan. 1977. Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly notices of the royal astronomical society 181, 3 (1977), 375--389.Google ScholarGoogle Scholar
  11. Yuanming Hu, Yu Fang, Ziheng Ge, Ziyin Qu, Yixin Zhu, Andre Pradhana, and Chenfanfu Jiang. 2018. A Moving Least Squares Material Point Method with Displacement Discontinuity and Two-Way Rigid Body Coupling. ACM Trans. Graph. 37, 4, Article 150 (July 2018), 14 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Ihmsen, J. Cornelis, B. Solenthaler, C. Horvath, and M. Teschner. 2014. Implicit Incompressible SPH. IEEE Transactions on Visualization and Computer Graphics 20, 3 (2014), 426--435.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. S. Ji, W. Xu, M. Yang, and K. Yu. 2013. 3D Convolutional Neural Networks for Human Action Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 1 (2013), 221--231.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Chenfanfu Jiang, Craig Schroeder, Andrew Selle, Joseph Teran, and Alexey Stomakhin. 2015. The Affine Particle-in-Cell Method. ACM Trans. Graph. 34, 4, Article 51 (July 2015), 10 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Asifullah Khan, Anabia Sohail, Umme Zahoora, and Aqsa Saeed Qureshi. 2020. A survey of the recent architectures of deep convolutional neural networks. Artificial Intelligence Review (Apr 2020).Google ScholarGoogle Scholar
  16. L'ubor Ladicky, SoHyeon Jeong, Barbara Solenthaler, Marc Pollefeys, and Markus Gross. 2015. Data-driven fluid simulations using regression forests. ACM Transactions on Graphics (TOG) 34, 6 (2015), 1--9.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Miles Macklin and Matthias Müller. 2013. Position based fluids. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1--12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Miles Macklin, Matthias Müller, and Richard Tonge. 2017. Nvidia FleX. https://docs.nvidia.com/gameworks/content/gameworkslibrary/physx/flex/index.html.Google ScholarGoogle Scholar
  19. Matthias Müller, David Charypar, and Markus Gross. 2003. Particle-Based Fluid Simulation for Interactive Applications. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, California) (SCA '03). Eurographics Association, Goslar, DEU, 154--159.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Simon Premžoe, Tolga Tasdizen, James Bigler, Aaron Lefohn, and Ross T. Whitaker. 2003. Particle-Based Simulation of Fluids. Computer Graphics Forum 22, 3 (2003), 401--410.Google ScholarGoogle ScholarCross RefCross Ref
  21. Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, and Peter W. Battaglia. 2020. Learning to Simulate Complex Physics with Graph Networks. arXiv:2002.09405 [cs.LG]Google ScholarGoogle Scholar
  22. Lin Shi and Yizhou Yu. 2004. Inviscid and Incompressible Fluid Simulation of Triangle Meshes. Computer Animation and Virtual Worlds 15, 3--4 (2004), 173--181.Google ScholarGoogle ScholarCross RefCross Ref
  23. Wenzhe Shi, Jose Caballero, Ferenc Huszár, Johannes Totz, Andrew P Aitken, Rob Bishop, Daniel Rueckert, and Zehan Wang. 2016. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1874--1883.Google ScholarGoogle ScholarCross RefCross Ref
  24. Ilia Sivkov, Patrick Seewald, Alfio Lazzaro, and Juerg Hutter. 2019. DBCSR: A Blocked Sparse Tensor Algebra Library. arXiv:1910.13555 [cs.DC]Google ScholarGoogle Scholar
  25. B. Solenthaler and R. Pajarola. 2009. Predictive-Corrective Incompressible SPH. In ACM SIGGRAPH 2009 Papers (New Orleans, Louisiana) (SIGGRAPH '09). Association for Computing Machinery, New York, NY, USA, Article 40, 6 pages.Google ScholarGoogle Scholar
  26. J. Stam. 1999. Stable Fluids. In Proc. SIGGRAPH. 121--128.Google ScholarGoogle Scholar
  27. Alexey Stomakhin, Craig Schroeder, Lawrence Chai, Joseph Teran, and Andrew Selle. 2013. A Material Point Method for Snow Simulation. ACM Trans. Graph. 32, 4, Article 102 (July 2013), 10 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. A. Stomakhin, C. Schroeder, Chenfanfu Jiang, Lawrence Chai, J. Teran, and A. Selle. 2014. Augmented MPM for phase-change and varied materials. ACM Trans. Graph. 33 (2014), 138:1--138:11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. D. Sulsky, Z. Chen, and H.L. Schreyer. 1994. A particle method for history-dependent materials. Computer Methods in Applied Mechanics and Engineering 118, 1 (1994), 179--196.Google ScholarGoogle ScholarCross RefCross Ref
  30. Jonathan Tompson, Kristofer Schlachter, Pablo Sprechmann, and Ken Perlin. 2017. Accelerating eulerian fluid simulation with convolutional networks. In Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org, 3424--3433.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Benjamin Ummenhofer, Lukas Prantl, Nils Thürey, and Vladlen Koltun. 2020. Lagrangian fluid simulation with continuous convolutions. In International Conference on Learning Representations.Google ScholarGoogle Scholar
  32. Marcel Weiler, Dan Koschier, and Jan Bender. 2016. Projective Fluids. In Proceedings of the 9th International Conference on Motion in Games (Burlingame, California) (MIG '16). Association for Computing Machinery, New York, NY, USA, 79--84.Google ScholarGoogle Scholar
  33. Steffen Wiewel, Moritz Becher, and Nils Thuerey. 2019. Latent space physics: Towards learning the temporal evolution of fluid flow. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 71--82.Google ScholarGoogle Scholar
  34. Matthew D Zeiler, Dilip Krishnan, Graham W Taylor, and Rob Fergus. 2010. Deconvolutional networks. In 2010 IEEE Computer Society Conference on computer vision and pattern recognition. IEEE, 2528--2535.Google ScholarGoogle ScholarCross RefCross Ref
  35. Yongning Zhu and Robert Bridson. 2005. Animating Sand as a Fluid. In the Proceedings of ACM SIGGRAPH 2005. 965--972.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Data-Driven Particle-Based Liquid Simulation with Deep Learning Utilizing Sub-Pixel Convolution

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!