Abstract
From a single still image, a looping video could be generated by imparting subtle motion to objects in the image. The results are a hybrid of photography and video. They contain gentle motion in some objects, while the rest of the image remains still. Existing techniques are successful in animating such images. However, there are still some drawbacks that need to be investigated, such as too-large computation time necessary to retrieve the matched videos or the challenges of controlling the desired motion not only in terms of a single region but also in terms of consistency in regions. In this work, we address these issues by proposing an interactive system with a novel warping method. The key idea of our approach is to utilize user’s annotations to impart motion to certain objects. With two proposed phases in terms of preserve-curve-warping and cycle warping, a looping video is generated. We demonstrate the effectiveness of our method via various experimental challenging results and evaluations. We show that with a simple and lightweight method, our system is able to deal with animating a still image’s problems and results in realistic motion and appealing videos. In addition, using our proposed system, it is easy to create plausible animation using simple user annotations without referencing the video database or machine learning models and allows ordinary users with minimal expertise to produce compelling results.
- [1] Adobe Photoshop. 2004. Retrieved from https://www.adobe.com/products/photoshop.html.Google Scholar
- [2] . 1999. Mathematical Methods for Physicists: A Comprehensive Guide. Academic Press.Google Scholar
- [3] . 2004. Flow-based video synthesis and editing. In ACM SIGGRAPH 2004 Papers. 360–363.Google Scholar
- [4] . 2005. Animating pictures with stochastic motion textures. In ACM SIGGRAPH 2005 Papers. 853–860.Google Scholar
- [5] . 2019. Animating landscape: Self-supervised learning of decoupled motion and appearance for single-image video synthesis. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–19.Google Scholar
Digital Library
- [6] . 1996. Qt GUI Toolkit: Porting graphics to multiple platforms using a GUI toolkit. Linux J. 1996, 31es (1996), 2–es.Google Scholar
- [7] . 1991. Motion without movement. ACM Siggraph Comput. Graph. 25, 4 (1991), 27–30.Google Scholar
Digital Library
- [8] . 2018. Im2flow: Motion hallucination from static images for action recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5937–5947.Google Scholar
Cross Ref
- [9] . 2010. Shared sampling for real-time alpha matting. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 575–584.Google Scholar
- [10] . 2010. Eigen v3. Retrieved from http://eigen.tuxfamily.org.Google Scholar
- [11] . 2012. Preserving global features of fluid animation from a single image using video examples. J. Zhejiang Univ. Sci. C 13, 7 (2012), 510–519.Google Scholar
Cross Ref
- [12] . 2020. Animating pictures with eulerian motion fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 5810–5819.Google Scholar
- [13] . 2019. Instance-level future motion estimation in a single image based on ordinal regression. In Proceedings of the IEEE International Conference on Computer Vision. 273–282.Google Scholar
Cross Ref
- [14] . 2012. Activity forecasting. In Proceedings of the European Conference on Computer Vision. Springer, 201–214.Google Scholar
Digital Library
- [15] . 2016. Data-driven npr illustrations of natural flows in chinese painting. IEEE Trans. Vis. Comput. Graph. 23, 12 (2016), 2535–2549.Google Scholar
Cross Ref
- [16] . 2013. Automated video looping with progressive dynamism. ACM Trans Graph. 32, 4 (2013), 1–10.Google Scholar
Digital Library
- [17] . 2019. Creating waterfall animation on a single image. Multimedia Tools Appl. 78, 6 (2019), 6637–6653.Google Scholar
Digital Library
- [18] . 2020. Deeplandscape: Adversarial modeling of landscape videos. In Proceedings of the European Conference on Computer Vision. Springer, 256–272.Google Scholar
Digital Library
- [19] . 2017. Forecasting interactive dynamics of pedestrians with fictitious play. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 774–782.Google Scholar
Cross Ref
- [20] . 1995. Intelligent scissors for image composition. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques. 191–198.Google Scholar
Digital Library
- [21] . 2016. Newtonian scene understanding: Unfolding the dynamics of objects in static images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3521–3529.Google Scholar
- [22] . 2009. Animating pictures of fluid using video examples. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 677–686.Google Scholar
- [23] . 2011. Creating fluid animation from a single image using video database. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 1973–1982.Google Scholar
- [24] . 2018. Animating pictures of water scenes using video retrieval. Vis. Comput. 34, 3 (2018), 347–358.Google Scholar
Digital Library
- [25] Pixaloop 2021. Retrieved from https://www.pixaloopapp.com/.Google Scholar
- [26] Plotagraph 2017. Retrieved from https://plotaverseapps.com/.Google Scholar
- [27] . 2017. A phase-based approach for animating images using video examples. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 303–311.Google Scholar
- [28] . 1989. Numerical Recipes in Pascal: The Art of Scientific Computing. Vol. 1. Cambridge University Press.Google Scholar
Digital Library
- [29] . 2000. Video textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 489–498.Google Scholar
Digital Library
- [30] . 2005. Moore neighborhood. In From MathWorld—A Wolfram Web Resource.Google Scholar
- [31] . 2020. Linear interpolation. Retrieved January 8, 2021 from https://en.wikipedia.org/w/index.php?title=Linear_interpolation&oldid=986522475.Google Scholar
- [32] . 2018. Future person localization in first-person videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7593–7602.Google Scholar
Cross Ref
- [33] . 2007. Visualization for Information Retrieval. Vol. 23. Springer Science & Business Media.Google Scholar
Index Terms
Animating Still Natural Images Using Warping
Recommendations
Animated feather coats using field lines
AFRIGRAPH '07: Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in AfricaThe tedious task of manually placing feathers on computer animated objects involves aligning feathers, ensuring that they do not insect each other or penetrate the surface, deforming every feather to match the local surface features, and ensuring that ...
An art-directed wrinkle system for CG character clothing and skin
We present a kinematic system for creating art-directed clothing and skin wrinkles on CG characters used in the production of computer-animated feature films. This system employs a curve-based method for generating wrinkles on reference poses, which are ...
A Simple Method to Animate Vegetation in Images Using Simulation-Guided Grid-Based Warping
CADGRAPHICS '13: Proceedings of the 2013 International Conference on Computer-Aided Design and Computer GraphicsIn this paper, we propose a simple method to animate vegetation in images. The proposed method enables users to interactively animate vegetation in real-time. It can be used to enhance a vegetation photograph or painting with animated motions as well as ...






Comments