Gradient-domain processing within a texture atlas

Abstract

Processing signals on surfaces often involves resampling the signal over the vertices of a dense mesh and applying mesh-based filtering operators. We present a framework to process a signal directly in a texture atlas domain. The benefits are twofold: avoiding resampling degradation and exploiting the regularity of the texture image grid. The main challenges are to preserve continuity across atlas chart boundaries and to adapt differential operators to the non-uniform parameterization. We introduce a novel function space and multigrid solver that jointly enable robust, interactive, and geometry-aware signal processing. We demonstrate our approach using several applications including smoothing and sharpening, multiview stitching, geodesic distance computation, and line integral convolution.

References

1. Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala, Steven Drucker, Alex Colburn, Brian Curless, David Salesin, and Michael Cohen. 2004. Interactive digital photomontage. ACM Trans. Graphics 23 (2004), 294--302.
2. Marc Alexa and Max Wardetzky. 2011. Discrete Laplacians on general polygonal meshes. ACM Trans. Graphics 30 (2011), 102:1--102:10.
3. Chandrajit Bajaj and Guoliang Xu. 2003. Anisotropic diffusion of surfaces and functions on surfaces. ACM Trans. Graphics 22 (2003), 4--32.
4. Marcelo Bertalmio, Li-Tien Cheng, Stanley Osher, and Guillermo Sapiro. 2001. Variational problems and partial differential equations on implicit surfaces. J. Computational Physics 174 (2001), 759--780.
5. Pravin Bhat, Brian Curless, Michael Cohen, and Lawrence Zitnick. 2008. Fourier analysis of the 2D screened Poisson equation for gradient domain problems. In 10th European Conf. Computer Vision. 114--128.
6. Alain Bossavit. 1988. Whitney forms: a class of finite elements for three-dimensional computations in electromagnetism. IEE Proc. A (Physical Science, Measurement and Instrumentation, Management and Education, Reviews) 135 (1988), 493--500.
7. William Briggs, Van Emden Henson, and Steve McCormick. 2000. A multigrid tutorial (2nd ed.). Society for Industrial and Applied Mathematics.
8. Brian Cabral and Leith Casey Leedom. 1993. Imaging vector fields using line integral convolution. In 20th Annual Conf. Computer Graphics and Interactive Techniques. 263--270.
9. Nathan Carr and John Hart. 2002. Meshed atlases for real-time procedural solid texturing. ACM Trans. Graphics 21 (2002), 106--131.
10. Nathan Carr and John C. Hart. 2004. Painting detail. ACM Trans. Graphics 23 (2004), 845--852.
11. Yanqing Chen, Timothy Davis, William W Hager, and Sivasankaran Rajamanickam. 2008. Algorithm 887: CHOLMOD, supernodal sparse Cholesky factorization and update/downdate. ACM Trans. Math. Softw. 35 (2008), 22:1--22:14.
12. Ming Chuang, Linjie Luo, Benedict Brown, Szymon Rusinkiewicz, and Misha Kazhdan. 2009. Estimating the Laplace-Beltrami operator by restricting 3D functions. Computer Graphics Forum (SGP '09) (2009), 1475--1484.
13. Ming Chuang, Szymon Rusinkiewicz, and Michael Kazhdan. 2016. Gradient-domain processing of meshes. J. Computer Graphics Techniques 5 (2016), 44--55.
14. Ulrich Clarenz, Udo Diewald, and Martin Rumpf. 2000. Anisotropic geometric diffusion in surface processing. In Conf. Visualization '00. 397--405.
15. Keenan Crane, Fernando de Goes, Mathieu Desbrun, and Peter Schröder. 2013a. Digital Geometry Processing with Discrete Exterior Calculus. In ACM SIGGRAPH 2013 Courses. 7:1--7:126.
16. Keenan Crane, Clarisse Weischedel, and Max Wardetzky. 2013b. Geodesies in heat: A new approach to computing distance based on heat flow. ACM Trans. Graphics 32 (2013), 152:1--152:11.
17. David Day and Mark Taylor. 2007. A new 11 point degree 6 cubature formula for the triangle. Sixth International Congress on Industrial Applied Mathematics (ICIAM07) and GAMM Annual Meeting 7 (2007), 1022501--1022502.
18. Mathieu Desbrun, Mark Meyer, Peter Schröder, and Alan Barr. 1999. Implicit fairing of irregular meshes using diffusion and curvature flow. In ACM SIGGRAPH Conf. Proc. 317--324.
19. Gerhard Dziuk. 1988. Finite elements for the Beltrami operator on arbitrary surfaces. Springer, 142--155.
20. Raanan Fattal, Dani Lischinski, and Michael Werman. 2002. Gradient domain high dynamic range compression. ACM Trans. Graphics 21 (2002), 249--256.
21. Francisco González and Gustavo Patow. 2009. Continuity mapping for multi-chart textures. ACM Trans. Graphics 28 (2009), 109:1--109:8.
22. Paul Heckbert. 1993. Introduction to finite element methods. In ACM SIGGRAPH 1993 Courses.
23. Sylvain Lefebvre and Hugues Hoppe. 2006. Appearance-space texture synthesis. ACM Trans. Graphics 25 (2006), 541--548.
24. Anat Levin, Assaf Zomet, Shmuel Peleg, and Yair Weiss. 2003. Seamless image stitching in the gradient domain. In European Conf. Computer Vision. 377--389.
25. Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least Squares Conformal Maps for Automatic Texture Atlas Generation. ACM Trans. Graph. 21 (2002), 362--371.
26. Ligang Liu, Lei Zhang, Yin Xu, Craig Gotsman, and Steven Gortler. 2008. A Local/Global Approach to Mesh Parameterization. In Symposium on Geometry Processing. 1495--1504.
27. Songrun Liu, Zachary Ferguson, Alec Jacobson, and Yotam Gingold. 2017. Seamless: Seam Erasure and Seam-aware Decoupling of Shape from Mesh Resolution. ACM Trans. Graph. 36 (2017), 216:1--216:15.
28. Lok Lui, Yalin Wang, and Tony Chan. 2005. Solving PDEs on Manifolds with Global Conformal Parameterization. In Proc. Third Int. Conf. on Variational, Geometric, and Level Set Methods in Computer Vision. 307--319.
29. Microsoft. 2018. UVAtlas: isochart texture atlasing https://github.com/Microsoft/UVAtlas. (2018).
30. Stanley Osher and James Sethian. 1988. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations. J. Computational Physics 79 (1988), 12--49.
31. Jonathan Palacios and Eugene Zhang. 2011. Interactive Visualization of Rotational Symmetry Fields on Surfaces. IEEE Trans. Visualization and Computer Graphics 17 (2011), 947--955.
32. Patrick Pérez, Michel Gangnet, and Andrew Blake. 2003. Poisson image editing. ACM Trans. Graphics 22 (2003), 313--318.
33. Pietro Perona and Jitendra Malik. 1990. Scale-space and edge detection using anisotropic diffusion. Trans. on Pattern Analysis and Machine Intelligence 12 (1990), 629--639.
34. Cosmin Petra, Olaf Schenk, and Mihai Anitescu. 2014a. Real-time stochastic optimization of complex energy systems on high-performance computers. Computing in Science & Engineering 16, 5 (2014), 32--42.
35. Cosmin G. Petra, Olaf Schenk, Miles Lubin, and Klaus Gäertner. 2014b. An augmented incomplete factorization approach for computing the Schur complement in stochastic optimization. SIAM J. on Scientific Computing 36 (2014), C139--C162.
36. Ulrich Pinkall and Konrad Polthier. 1993. Computing discrete minimal surfaces and their conjugates. Experimental Mathematics 2, 15--36.
37. Roi Poranne, Marco Tarini, Sandro Huber, Daniele Panozzo, and Olga Sorkine-Hornung. 2017. Autocuts: Simultaneous Distortion and Cut Optimization for UV Mapping. ACM Trans. Graph. 36 (2017), 215:1--215:11.
38. Pedro Sander, Steven Gortler, John Snyder, and Hugues Hoppe. 2002. Signal-specialized Parametrization. In Proc. 13th Eurographics Workshop on Rendering. 87--98.
39. Pedro Sander, John Snyder, Steven Gortler, and Hugues Hoppe. 2001. Texture Mapping Progressive Meshes. In Proc. 28th Annual Conf. on Computer Graphics and Interactive Techniques. 409--416.
40. Alla Sheffer and John Hart. 2002. Seamster: Inconspicuous Low-distortion Texture Seam Layout. In Proc. Conf. on Visualization '02. 291--298.
41. Barry Smith, Petter Bjørstad, and William Gropp. 1996. Domain decomposition: Parallel multilevel methods for elliptic partial differential equations. Cambridge Univ. Press.
42. Jason Smith and Scott Schaefer. 2015. Bijective Parameterization with Free Boundaries. ACM Trans. Graph. 34 (2015), 70:1--70:9.
43. Olga Sorkine, Daniel Cohen-Or, Yaron Lipman, Marc Alexa, Christian Rossi, and Hand-Peter Seidel. 2004. Laplacian surface editing. In Symposium on Geometry Processing. 175--184.
44. Jos Stam. 2003. Flows on surfaces of arbitrary topology. ACM Trans. Graphics (SIGGRAPH '03) 22 (2003), 724--731.
45. Tolga Tasdizen, Ross Whitaker, Paul Burchard, and Stanley Osher. 2002. Geometric surface smoothing via anisotropic diffusion of normals. In Conf. Visualization '02. 125--132.
46. Gabriel Taubin. 1995. A signal processing approach to fair surface design. In ACM SIGGRAPH Conf. Proc. 351--358.
47. Christian Teitzel, Roberto Grosso, and Thomas Ertl. 1997. Line Integral Convolution on Triangulated Surfaces. In Conf. World Society for Computer Graphics 1997. 572--581.
48. Christian Weiss, Wolfgang Karl, Markus Kowarschik, and Ulrich Rüde. 1999. Memory characteristics of iterative methods. In 1999 ACM/IEEE Conf. Supercomputing.
49. Tim Weyrich, Jia Deng, Connelly Barnes, Szymon Rusinkiewicz, and Adam Finkelstein. 2007. Digital bas-relief from 3D scenes. ACM Trans. Graphics 26 (2007), 32:1--32:7.
50. Andrew Witkin and Michael Kass. 1991. Reaction-diffusion textures. In ACM SIGGRAPH Conf. Proc. 299--308.
51. Yizhou Yu, Kun Zhou, Dong Xu, Xiaohan Shi, Hujun Bao, Baining Guo, and Heung-Yeung Shum. 2004. Mesh editing with Poisson-based gradient field manipulation. ACM Trans. Graphics 23 (2004), 644--651.
52. Cem Yuksel. 2017. Mesh color textures. In High Performance Graphics. 17:1--17:11.
53. Eugene Zhang, Konstantin Mischaikow, and Greg Turk. 2005. Feature-based Surface Parameterization and Texture Mapping. ACM Trans. Graph. 24 (2005), 1--27.
54. Kun Zhou, John Synder, Baining Guo, and Heung-Yeung Shum. 2004. Iso-charts: Stretch-driven Mesh Parameterization Using Spectral Analysis. In Symposium on Geometry Processing. 45--54.

Index Terms

• Computing methodologies

  • Computer graphics