skip to main content
research-article

Spatio-temporal Segmentation Based Adaptive Compression of Dynamic Mesh Sequences

Published:04 March 2020Publication History
Skip Abstract Section

Abstract

With the recent advances in data acquisition techniques, the compression of various dynamic mesh sequence data has become an important topic in the computer graphics community. In this article, we present a new spatio-temporal segmentation-based approach for the adaptive compression of the dynamic mesh sequences. Given an input dynamic mesh sequence, we first compute an initial temporal cut to obtain a small subsequence by detecting the temporal boundary of dynamic behavior. Then, we apply a two-stage vertex clustering on the resulting subsequence to classify the vertices into groups with optimal intra-affinities. After that, we design a temporal segmentation step based on the variations of the principal components within each vertex group prior to performing a PCA-based compression. Furthermore, we apply an extra step on the lossless compression of the PCA bases and coefficients to gain more storage saving. Our approach can adaptively determine the temporal and spatial segmentation boundaries to exploit both temporal and spatial redundancies. We have conducted extensive experiments on different types of 3D mesh animations with various segmentation configurations. Our comparative studies show the advantages of our approach for the compression of 3D mesh animations.

References

  1. Andreas A. Vasilakis and Ioannis Fudos. 2014. Pose partitioning for multi-resolution segmentation of arbitrary mesh animations. Comput. Graph. For., Vol. 33. Wiley Online Library, 293--302.Google ScholarGoogle Scholar
  2. Marc Alexa and Wolfgang Müller. 2000. Representing animations by principal components. Comput. Graph. For. 19, 3 (2000), 411--418.Google ScholarGoogle Scholar
  3. Oscar Kin-Chung Au, Chiew-Lan Tai, Hung-Kuo Chu, Daniel Cohen-Or, and Tong-Yee Lee. 2008. Skeleton extraction by mesh contraction. ACM Trans. Graph., Vol. 27. 44.Google ScholarGoogle Scholar
  4. Jernej Barbic, Alla Safonova, Jiayu Pan, Christos Faloutsos, Jessica K. Hodgins, and Nancy S. Pollard. 2004. Segmenting motion capture data into distinct behaviors. In Proceedings of Graphics Interface 2004 (GI'04). Canadian Human-Computer Communications Society, Waterloo, CAN, 185--194.Google ScholarGoogle Scholar
  5. Philippe Beaudoin, Pierre Poulin, and Michiel van de Panne. 2007. Adapting wavelet compression to human motion capture clips. In Proceedings of the Graphics Interface Conference. 313--318.Google ScholarGoogle Scholar
  6. Siddhartha Chattopadhyay, Suchendra M. Bhandarkar, and Kang Li. 2007. Human motion capture data compression by model-based indexing: A power aware approach. IEEE Trans. Vis. Comput. Graph. 13, 1 (2007), 5--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chengju Chen, Qing Xia, Shuai Li, Hong Qin, and Aimin Hao. 2018. High-fidelity compression of dynamic meshes with fine details using piece-wise manifold harmonic bases. In Proceedings of the Computer Graphics Conference. 23--32.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Jiong Chen, Yicun Zheng, Ying Song, Hanqiu Sun, Hujun Bao, and Jin Huang. 2017. Cloth compression using local cylindrical coordinates. Vis. Comput. 33, 6–8 (2017), 801--810.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Xiaobai Chen, Aleksey Golovinskiy, and Thomas A. Funkhouser. 2009. A benchmark for 3D mesh segmentation. In ACM Trans. Graph., Vol. 28. 73.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Frederic Cordier and Nadia Magnenatthalmann. 2005. A data-driven approach for real-time clothes simulation. Comput. Graph. For. 24, 2 (2005), 173--183.Google ScholarGoogle Scholar
  11. Edilson de Aguiar, Christian Theobalt, Sebastian Thrun, and Hans-Peter Seidel. 2008. Automatic conversion of mesh animations into skeleton-based animations. Comput. Graph. For. 27, 2 (2008), 389--397.Google ScholarGoogle Scholar
  12. Peter Deutsch and Jean-Loup Gailly. 1996. ZLIB compressed data format specification version 3.3. RFC 1950 (1996), 1--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Amirhossein Firouzmanesh, Irene Cheng, and Anup Basu. 2011. Perceptually guided fast compression of 3-D motion capture data. IEEE Trans. Multimedia 13, 4 (2011), 829--834.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. David George, Xianghua Xie, Yu-Kun Lai, and Gary K. L. Tam. 2018. A deep learning driven active framework for segmentation of large 3D shape collections. arXiv preprint arXiv:1807.06551 (2018).Google ScholarGoogle Scholar
  15. David George, Xianghua Xie, and Gary K. L. Tam. 2018. 3D mesh segmentation via multi-branch 1D convolutional neural networks. Graphical Models 96 (2018), 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  16. Dian Gong, Gérard Medioni, Sikai Zhu, and Xuemei Zhao. 2012. Kernelized temporal cut for online temporal segmentation and recognition. In Proceedings of the European Conference on Computer Vision. Springer, 229--243.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Qin Gu, Jingliang Peng, and Zhigang Deng. 2009. Compression of human motion capture data using motion pattern indexing. Comput. Graph. For. 28, 1 (2009), 1--12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Igor Guskov and Andrei Khodakovsky. 2004. Wavelet compression of parametrically coherent mesh sequences. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 183--192.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Mohammadali Hajizadeh and Hossein Ebrahimnezhad. 2016. Predictive compression of animated 3D models by optimized weighted blending of key-frames. Comput. Anim. Virt. Worlds 27, 6 (2016), 556--576.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Toshiki Hijiri, Kazuhiro Nishitani, Tim Cornish, Toshiya Naka, and Shigeo Asahara. 2000. A spatial hierarchical compression method for 3D streaming animation. In Proceedings of the Symposium on Virtual Reality Modeling Language. 95--101.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Thomas Hofmann, Bernhard Scholkopf, and Alexander J. Smola. 2008. Kernel methods in machine learning. Ann. Statist. 36, 3 (2008), 1171--1220.Google ScholarGoogle ScholarCross RefCross Ref
  22. Junhui Hou, Lap Pui Chau, Nadia Magnenat-Thalmann, and Ying He. 2017. Sparse low-rank matrix approximation for data compression. IEEE Trans. Circ. Syst. Video Technol. 27, 5 (2017), 1043--1054.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. David A. Huffman. 1952. A method for the construction of minimum-redundancy codes. Proc. IRE 40, 9 (1952), 1098--1101.Google ScholarGoogle ScholarCross RefCross Ref
  24. Doug L. James and Christopher D. Twigg. 2005. Skinning mesh animations. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques 24, 3 (2005), 399--407.Google ScholarGoogle Scholar
  25. Evangelos Kalogerakis, Aaron Hertzmann, and Karan Singh. 2010. Learning 3D mesh segmentation and labeling. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques 29, 4 (2010), 102.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Zachi Karni and Craig Gotsman. 2004. Compression of soft-body animation sequences. Comput. Graph. 28, 1 (2004), 25--34.Google ScholarGoogle ScholarCross RefCross Ref
  27. Ladislav Kavan, Peter-Pike J. Sloan, and Carol O’Sullivan. 2010. Fast and efficient skinning of animated meshes. Comput. Graph. For. 29, 2 (2010), 327--336.Google ScholarGoogle Scholar
  28. Murtaza Ali Khan. 2016. An efficient algorithm for compression of motion capture signal using multidimensional quadratic Bézier curve break-and-fit method. Multidimen. Syst. Sig. Proc. 27, 1 (2016), 121--143.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Choong-Hoon Kwak and Ivan V. Bajic. 2011. Hybrid low-delay compression of motion capture data. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1--6.Google ScholarGoogle Scholar
  30. Aris S. Lalos, Andreas A. Vasilakis, Anastasios Dimas, and Konstantinos Moustakas. 2017. Adaptive compression of animated meshes by exploiting orthogonal iterations. Vis. Comput. 33, 6–8 (2017), 1--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Binh Huy Le and Zhigang Deng. 2014. Robust and accurate skeletal rigging from mesh sequences. ACM Trans. Graph. 33, 4 (2014), 1--10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Pai-Feng Lee, Chi-Kang Kao, Juin-Ling Tseng, Bin-Shyan Jong, and Tsong-Wuu Lin. 2007. 3D animation compression using affine transformation matrix and principal component analysis. IEICE Trans. Inf. Syst. 90, 7 (2007), 1073--1084.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Tong-Yee Lee, Yu-Shuen Wang, and Tai-Guang Chen. 2006. Segmenting a deforming mesh into near-rigid components. Vis. Comput. 22, 9 (24 Aug. 2006), 729. DOI:https://doi.org/10.1007/s00371-006-0059-6Google ScholarGoogle Scholar
  34. Tong Yee Lee, Yu Shuen Wang, and Tai Guang Chen. 2006. Segmenting a deforming mesh into near-rigid components. Vis. Comput. 22, 9–11 (2006), 729.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Xin Liu, Zaiwen Wen, and Yin Zhang. 2012. Limited memory block Krylov subspace optimization for computing dominant singular value decompositions. Siam J. Sci. Comput. 35, 3 (2012), 1641--1668.Google ScholarGoogle ScholarCross RefCross Ref
  36. Guoliang Luo, Frederic Cordier, and Hyewon Seo. 2013. Compression of 3D mesh sequences by temporal segmentation. Comput. Anim. Virt. Worlds 24, 3–4 (2013), 365--375.Google ScholarGoogle ScholarCross RefCross Ref
  37. Guoliang Luo, Zhigang Deng, Xiaogang Jin, Xin Zhao, Wei Zeng, Wenqiang Xie, and Hyewon Seo. 2019. 3D mesh animation compression based on adaptive spatio-temporal segmentation. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. 10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Guoliang Luo, Gang Lei, Yuanlong Cao, Qinghua Liu, and Hyewon Seo. 2017. Joint entropy-based motion segmentation for 3D animations. Vis. Comput. 33, 10 (2017), 1279--1289.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Adrien Maglo, Guillaume Lavoué, Florent Dupont, and Céline Hudelot. 2015. 3D mesh compression: Survey, comparisons, and emerging trends. Comput. Surv. 47, 3 (2015), 44.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. K. Mamou, T. Zaharia, F. Preteux, N. Stefanoski, and J. Ostermann. 2008. Frame-based compression of animated meshes in MPEG-4. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1121--1124.Google ScholarGoogle Scholar
  41. Frédéric Payan and Marc Antonini. 2007. Temporal wavelet-based compression for 3D animated models. Comput. Graph. 31, 1 (2007), 77--88.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Subramanian Ramanathan, Ashraf A. Kassim, and Tiow Seng Tan. 2008. Impact of vertex clustering on registration-based 3D dynamic mesh coding. Image Vis. Comput. 26, 7 (2008), 1012--1026.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Zhile Ren and Gregory Shakhnarovich. 2013. Image segmentation by cascaded region agglomeration. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2011--2018.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Mirko Sattler, Ralf Sarlette, and Reinhard Klein. 2005. Simple and efficient compression of animation sequences. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 209--217.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Alex Smola, Arthur Gretton, Le Song, and Bernhard Schölkopf. 2007. A Hilbert space embedding for distributions. In Proceedings of the 18th International Conference on Algorithmic Learning Theory. Springer-Verlag, 13--31.Google ScholarGoogle Scholar
  46. Nikolce Stefanoski, Xiaoliang Liu, Patrick Klie, and Jorn Ostermann. 2007. Scalable linear predictive coding of time-consistent 3D mesh sequences. In Proceedings of the 3DTV Conference. 1--4.Google ScholarGoogle ScholarCross RefCross Ref
  47. Nikolče Stefanoski and Jörn Ostermann. 2010. SPC: Fast and efficient scalable predictive coding of animated meshes. In Comput. Graph. For., Vol. 29. Wiley Online Library, 101--116.Google ScholarGoogle Scholar
  48. Robert W. Sumner and Jovan Popovic. 2004. Deformation transfer for triangle meshes. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques 23, 3 (2004), 399--405.Google ScholarGoogle Scholar
  49. Art Tevs, Alexander Berner, Michael Wand, Ivo Ihrke, Martin Bokeloh, Jens Kerber, and Hans-Peter Seidel. 2012. Animation cartography—Intrinsic reconstruction of shape and motion. ACM Trans. Graph. 31, 2 (Apr. 2012).Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Shoichi Tsuchie, Tikara Hosino, and Masatake Higashi. 2014. High-quality vertex clustering for surface mesh segmentation using Student-t mixture model. Comput.-aided Des. 46 (2014), 69--78.Google ScholarGoogle Scholar
  51. Steven Van Vaerenbergh. 2010. Kernel Methods for Nonlinear Identification, Equalization and Separation of Signals. Ph.D. Dissertation. University of Cantabria. Retrieved from https://github.com/steven2358/kmbox.Google ScholarGoogle Scholar
  52. Libor Váša and Guido Brunnett. 2013. Exploiting connectivity to improve the tangential part of geometry prediction. IEEE Trans. Vis. Comput. Graph. 19, 9 (2013), 1467--1475.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Libor Váša, Stefano Marras, Kai Hormann, and Guido Brunnett. 2014. Compressing dynamic meshes with geometric Laplacians. Comput. Graph. For. 33, 2 (2014), 145--154.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Libor Váša and Vaclav Skala. 2009. COBRA: Compression of the basis for PCA represented animations. Comput. Graph. For. 28, 6 (2009), 1529--1540.Google ScholarGoogle Scholar
  55. Libor Váša and Vaclav Skala. 2011. A perception correlated comparison method for dynamic meshes. IEEE Trans. Vis. Comput. Graph. 17, 2 (2011), 220--30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Daniel Vlasic, Ilya Baran, Wojciech Matusik, and Jovan Popovic. 2008. Articulated mesh animation from multi-view silhouettes. In Proceedings of the International Conference on Computer Graphics and Interactive Techniques 27, 3 (2008), 97.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Pengjie Wang, Zhigeng Pan, Mingmin Zhang, Rynson W. H. Lau, and Haiyu Song. 2013. The alpha parallelogram predictor: A lossless compression method for motion capture data. Inf. Sci. 232 (2013), 1--10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Stefanie Wuhrer and Alan Brunton. 2010. Segmenting animated objects into near-rigid components. Vis. Comput. 26, 2 (2010), 147--155.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Bailin Yang, Zhaoyi Jiang, Jiantao Shangguan, Frederick W. B. Li, Chao Song, Yibo Guo, and Mingliang Xu. 2018. Compressed dynamic mesh sequence for progressive streaming. Computer Animation and Virtual Worlds 30, 6 (2018).Google ScholarGoogle Scholar
  60. Bailin Yang, Luhong Zhang, W. B. Frederick Li, Xiaoheng Jiang, Zhigang Deng, Meng Wang, and Mingliang Xu. 2018. Motion-aware compression and transmission of mesh animation sequences. ACM Trans. Intell. Syst. Technol. 10, 3 (2018).Google ScholarGoogle Scholar
  61. Jeong Hyu Yang, Chang Su Kim, and Sang Uk Lee. 2002. Compression of 3-D triangle mesh sequences based on vertex-wise motion vector prediction. IEEE Trans. Circ. Syst. Video Technol. 12, 12 (2002), 1178--1184.Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Yazhou Yuan, Yu Zhang, Zhixin Liu, and Xinping Guan. 2017. Lossless coding scheme for data acquisition under limited communication bandwidth. Dig. Sig. Proc. 69 (2017), 204--211.Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Mingyang Zhu, Huaijiang Sun, and Zhigang Deng. 2012. Quaternion space sparse decomposition for motion compression and retrieval. In Proceedings of the 11th ACM SIGGRAPH/Eurographics Conference on Computer Animation. Eurographics Association, 183--192.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Jacob Ziv and Abraham Lempel. 1977. A universal algorithm for sequential data compression. IEEE Trans. Inf. Theor. 23, 3 (1977), 337--343.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Spatio-temporal Segmentation Based Adaptive Compression of Dynamic Mesh Sequences

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!