Abstract
In recent years, the performance of neural network inference has been drastically improved. This rapid change has paved the way for research projects focusing on accelerating physics-based simulations by replacing solver with its approximation. In this paper, we propose several efficient architectures of neural networks, which can be used to exploit this idea. The purpose of our research was to specifically target a liquid simulation problem. The central challenge for us was to create an efficient solution capable of approximating Position Based Fluid [Macklin and Müller 2013] solver. It requires the network to produce an accurate output at particles located in a continuous space and be significantly faster than the GPU based simulation. We achieved this by using modern sub-pixel convolution techniques originally used for image super-resolution. In our experiments, our method runs up to 200 times faster than the reference GPU simulation.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Data-Driven Particle-Based Liquid Simulation with Deep Learning Utilizing Sub-Pixel Convolution
- Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Caglar Gulcehre, Francis Song, Andrew Ballard, Justin Gilmer, George Dahl, Ashish Vaswani, Kelsey Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matt Botvinick, Oriol Vinyals, Yujia Li, and Razvan Pascanu. 2018. Relational inductive biases, deep learning, and graph networks. arXiv:1806.01261 [cs.LG]Google Scholar
- Markus Becker and Matthias Teschner. 2007. Weakly Compressible SPH for Free Surface Flows. In Proceedings of the 2007 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, California) (SCA '07). Eurographics Association, Goslar, DEU, 209--217.Google Scholar
Digital Library
- Jan Bender and Dan Koschier. 2015. Divergence-Free Smoothed Particle Hydrodynamics. In Proceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation (Los Angeles, California) (SCA '15). Association for Computing Machinery, New York, NY, USA, 147--155.Google Scholar
Digital Library
- Blender Online Community. 2018. Blender - a 3D modelling and rendering package. Blender Foundation, Stichting Blender Foundation, Amsterdam. http://www.blender.orgGoogle Scholar
- Douglas Enright, Stephen Marschner, and Ronald Fedkiw. 2002. Animation and rendering of complex water surfaces. ACM Trans. Graph. 21, 3 (July 2002), 736--744.Google Scholar
Digital Library
- Nick Foster and Ronald Fedkiw. 2001. Practical Animation of Liquids. In Proc. SIGGRAPH. 23--30.Google Scholar
Cross Ref
- Nick Foster and Dimitri Metaxas. 1996. Realistic animation of liquids. Graph. Models Image Process. 58, 5 (1996), 471--483.Google Scholar
Digital Library
- Chuyuan Fu, Qi Guo, Theodore Gast, Chenfanfu Jiang, and Joseph Teran. 2017. A Polynomial Particle-in-Cell Method. ACM Trans. Graph. 36, 6, Article 222 (Nov. 2017), 12 pages.Google Scholar
Digital Library
- K. Fukushima. 1980. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 36 (1980), 193--202.Google Scholar
Cross Ref
- Robert A Gingold and Joseph J Monaghan. 1977. Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly notices of the royal astronomical society 181, 3 (1977), 375--389.Google Scholar
- Yuanming Hu, Yu Fang, Ziheng Ge, Ziyin Qu, Yixin Zhu, Andre Pradhana, and Chenfanfu Jiang. 2018. A Moving Least Squares Material Point Method with Displacement Discontinuity and Two-Way Rigid Body Coupling. ACM Trans. Graph. 37, 4, Article 150 (July 2018), 14 pages.Google Scholar
Digital Library
- M. Ihmsen, J. Cornelis, B. Solenthaler, C. Horvath, and M. Teschner. 2014. Implicit Incompressible SPH. IEEE Transactions on Visualization and Computer Graphics 20, 3 (2014), 426--435.Google Scholar
Digital Library
- S. Ji, W. Xu, M. Yang, and K. Yu. 2013. 3D Convolutional Neural Networks for Human Action Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 1 (2013), 221--231.Google Scholar
Digital Library
- Chenfanfu Jiang, Craig Schroeder, Andrew Selle, Joseph Teran, and Alexey Stomakhin. 2015. The Affine Particle-in-Cell Method. ACM Trans. Graph. 34, 4, Article 51 (July 2015), 10 pages.Google Scholar
Digital Library
- Asifullah Khan, Anabia Sohail, Umme Zahoora, and Aqsa Saeed Qureshi. 2020. A survey of the recent architectures of deep convolutional neural networks. Artificial Intelligence Review (Apr 2020).Google Scholar
- L'ubor Ladicky, SoHyeon Jeong, Barbara Solenthaler, Marc Pollefeys, and Markus Gross. 2015. Data-driven fluid simulations using regression forests. ACM Transactions on Graphics (TOG) 34, 6 (2015), 1--9.Google Scholar
Digital Library
- Miles Macklin and Matthias Müller. 2013. Position based fluids. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1--12.Google Scholar
Digital Library
- Miles Macklin, Matthias Müller, and Richard Tonge. 2017. Nvidia FleX. https://docs.nvidia.com/gameworks/content/gameworkslibrary/physx/flex/index.html.Google Scholar
- Matthias Müller, David Charypar, and Markus Gross. 2003. Particle-Based Fluid Simulation for Interactive Applications. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, California) (SCA '03). Eurographics Association, Goslar, DEU, 154--159.Google Scholar
Digital Library
- Simon Premžoe, Tolga Tasdizen, James Bigler, Aaron Lefohn, and Ross T. Whitaker. 2003. Particle-Based Simulation of Fluids. Computer Graphics Forum 22, 3 (2003), 401--410.Google Scholar
Cross Ref
- Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, and Peter W. Battaglia. 2020. Learning to Simulate Complex Physics with Graph Networks. arXiv:2002.09405 [cs.LG]Google Scholar
- Lin Shi and Yizhou Yu. 2004. Inviscid and Incompressible Fluid Simulation of Triangle Meshes. Computer Animation and Virtual Worlds 15, 3--4 (2004), 173--181.Google Scholar
Cross Ref
- Wenzhe Shi, Jose Caballero, Ferenc Huszár, Johannes Totz, Andrew P Aitken, Rob Bishop, Daniel Rueckert, and Zehan Wang. 2016. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1874--1883.Google Scholar
Cross Ref
- Ilia Sivkov, Patrick Seewald, Alfio Lazzaro, and Juerg Hutter. 2019. DBCSR: A Blocked Sparse Tensor Algebra Library. arXiv:1910.13555 [cs.DC]Google Scholar
- B. Solenthaler and R. Pajarola. 2009. Predictive-Corrective Incompressible SPH. In ACM SIGGRAPH 2009 Papers (New Orleans, Louisiana) (SIGGRAPH '09). Association for Computing Machinery, New York, NY, USA, Article 40, 6 pages.Google Scholar
- J. Stam. 1999. Stable Fluids. In Proc. SIGGRAPH. 121--128.Google Scholar
- Alexey Stomakhin, Craig Schroeder, Lawrence Chai, Joseph Teran, and Andrew Selle. 2013. A Material Point Method for Snow Simulation. ACM Trans. Graph. 32, 4, Article 102 (July 2013), 10 pages.Google Scholar
Digital Library
- A. Stomakhin, C. Schroeder, Chenfanfu Jiang, Lawrence Chai, J. Teran, and A. Selle. 2014. Augmented MPM for phase-change and varied materials. ACM Trans. Graph. 33 (2014), 138:1--138:11.Google Scholar
Digital Library
- D. Sulsky, Z. Chen, and H.L. Schreyer. 1994. A particle method for history-dependent materials. Computer Methods in Applied Mechanics and Engineering 118, 1 (1994), 179--196.Google Scholar
Cross Ref
- Jonathan Tompson, Kristofer Schlachter, Pablo Sprechmann, and Ken Perlin. 2017. Accelerating eulerian fluid simulation with convolutional networks. In Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org, 3424--3433.Google Scholar
Digital Library
- Benjamin Ummenhofer, Lukas Prantl, Nils Thürey, and Vladlen Koltun. 2020. Lagrangian fluid simulation with continuous convolutions. In International Conference on Learning Representations.Google Scholar
- Marcel Weiler, Dan Koschier, and Jan Bender. 2016. Projective Fluids. In Proceedings of the 9th International Conference on Motion in Games (Burlingame, California) (MIG '16). Association for Computing Machinery, New York, NY, USA, 79--84.Google Scholar
- Steffen Wiewel, Moritz Becher, and Nils Thuerey. 2019. Latent space physics: Towards learning the temporal evolution of fluid flow. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 71--82.Google Scholar
- Matthew D Zeiler, Dilip Krishnan, Graham W Taylor, and Rob Fergus. 2010. Deconvolutional networks. In 2010 IEEE Computer Society Conference on computer vision and pattern recognition. IEEE, 2528--2535.Google Scholar
Cross Ref
- Yongning Zhu and Robert Bridson. 2005. Animating Sand as a Fluid. In the Proceedings of ACM SIGGRAPH 2005. 965--972.Google Scholar
Digital Library
Index Terms
Data-Driven Particle-Based Liquid Simulation with Deep Learning Utilizing Sub-Pixel Convolution






Comments