Abstract
There has been related research for sprite or mosaic generation for over 15 years. In this article, we try to understand the methodologies for sprite generation and identify what has not actually been covered for sprite generation. We first identify issues and focus on the domain of videos for sprite generation. We introduce a novel sprite fusion method that blends two sprites. Sprite fusion method produces good results for tracking videos and does not require object segmentation. We present sample results of our experiments.
- Alzoubi, H. and Pan, W. D. 2008. Fast and accurate global motion estimation algorithm using pixel subsampling. Inf. Sci. 178, 17, 3415--3425. Google Scholar
Digital Library
- Asif, M. and Soraghan, J. J. 2008. MPEG-7 Motion Descriptor Extraction for Panning Camera Using Sprite Generated. In Proceedings of the 5th International Conference on Advanced Video and Signal Based Surveillance. IEEE Computer Society, Los Alamitos, CA, 60--66. Google Scholar
Digital Library
- Atrey, P. K., Hossain, M. A., Saddik A. E., and Kankahalli, M. S. 2010. Multimodal fusion for multimedia analysis: Survey. Multimedia Syst. 16, 345--379.Google Scholar
Digital Library
- Aygün, R. S. and Zhang, A. 2002. Reducing blurring-effect in high resolution mosaic generation. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '02). IEEE Computer Society, Los Alamitos, CA, 537--540.Google Scholar
- Aygün, R. S. and Zhang, A. 2004. Integrating virtual camera controls into digital video. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '04). IEEE Computer Society, Los Alamitos, CA,1503--1506.Google Scholar
- Azzari, P., Di Stefano, L., and Bevilacqua, A. 2005. An effective real-time mosaicing algorithm apt to detect motion through background subtraction using a PTZ camera. In Proceedings of the IEEE Conference on Advanced Video and Signal-Based Surveillance. 511--516.Google Scholar
- Chen, L., Lai, Y., and Liao, H. 2006. Video Scene Extraction Using Mosaic Technique. In Proceedings of the 18th International Conference on Pattern Recognition. IEEE Computer Society, Los Alamitos, CA, 723--726. Google Scholar
Digital Library
- Chen, S. Y., Chen, C. Y., Huang, Y. W., and Chen, L. G. 2002. Multiple sprites and frame skipping techniques for sprite generation with high subjective quality and fast speed. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '02). IEEE Computer Society, Los Alamitos, CA, 785--788.Google Scholar
- Chen, Y. and Aygün, R. S. 2010. Synthetic video generation for evaluation of the sprite generation. Int. J. Multimedia Data Engin. Manage. 2, 34--61. Google Scholar
Digital Library
- Cherng, D.-C. and Chien S.-Y. 2007. Video Segmentation with model-based sprite generation for panning surveillance cameras. In Proceedings of the IEEE International Symposium on Circuits and Systems. IEEE Computer Society, Los Alamitos, CA, 27--30.Google Scholar
- Cheung, H.-K. and Siu, W.-C. 2002. Fast global motion estimation for sprite generation. In Proceedings of the IEEE International Symposium on Circuits and Systems. IEEE Computer Society, Los Alamitos, CA.Google Scholar
- Cheung, H.-K. and Siu, W.-C. 2007. Robust global motion estimation and novel updating strategy for sprite generation. IET Image Process. 1, 1, 13--20.Google Scholar
Cross Ref
- Cheung, H.-K., Siu, W.-C., and Feng, D. 2008. New block-based motion estimation for sequences with brightness variation and its application to static sprite generation for video compression. IEEE Trans Circ. Syst. Video Technol. 18, 522--527. Google Scholar
Digital Library
- Coorg, S. and Teller, S. 2000. Spherical mosaics with quaternions and dense correlation. Int. J. Comput. Vision 37, 3, 259--273. Google Scholar
Digital Library
- Dasu, A. R. and Panchanathan, S. 2004. A wavelet-based sprite codec. IEEE Trans Circ. Syst. Video Technol. 14, 2, 244--255. Google Scholar
Digital Library
- Deshpande, A. and Aygün, R. S. 2009. Motion-based video classification for sprite generation. In Proceedings of the International Workshop on Database and Expert Systems Applications. 231--235. Google Scholar
Digital Library
- Dufaux, F. and Konrad, J. 2000. Efficient, robust, and fast global motion estimation for video coding. IEEE Trans. Image Process. 9, 3, 497--501. Google Scholar
Digital Library
- Farin, D. and de With, P. H. N. 2006. Enabling arbitrary rotational camera motion using multisprites with minimum coding cost. IEEE Trans. Circ. Syst. Video Technol. 16, 4, 492--506. Google Scholar
Digital Library
- Fraunhaufer. 2009. http://www.iis.fraunhofer.de/amm/download/mpeg4.Google Scholar
- Geys, H. and Van Gool, L. 2006. On-line, interactive view synthesis and augmentation. Signal Process.Image Comm. 21, 9, 709--723.Google Scholar
Cross Ref
- Grammalidis, N., Beletsiotis, D., and Strintzis, M. G. 1999. Multi View sprite generation and coding. InProceedings of the International Conference on Image Processing (ICIP '99). IEEE Computer Society, Los Alamitos, CA, 477--481. Google Scholar
Digital Library
- H264. Iso/iec 14496-10:2003. information technology: Coding of audio-visual objects - part 2, also itu-t recommendation h.264 advanced video coding for generic audiovisual services.Google Scholar
- H265. 2009. http://www.h265.net.Google Scholar
- Hsu, C.-T. and Tsan Y.-C. 2004. Mosaics of video sequences with moving objects. Signal Process.Image Comm. 19, 1, 81--98.Google Scholar
Cross Ref
- Irani, M. and Anandan, P. 1998. Video indexing based on mosaic representations. Proc. IEEE, 905--921.Google Scholar
- Krutz, A., Frater, M., Kunter, M., and Sikora, T. 2006. Windowed image registration for robust mosaicing of scenes with large background occlusions. In Proceedings of the International Conference on Image Processing (ICIP '06). 353--356.Google Scholar
- Krutz, A., Glantz, A., Sikora, T., Nunes, P., and Pereira, F. 2008. Automatic object segmentation algorithms for sprite coding using MPEG-4. In Proceedings of the 50th International ELMAR Symposium. 459--462.Google Scholar
- Krutz, A., Glantz, A., Haller, M., Droese, M., and Sikora, T. 2008. Multiple background sprite generation using camera motion characterization for object-based video coding. In Proceedings of the 5th International Conference on Advanced Video and Signal Based Surveillance. IEEE Computer Society, Los Alamitos, CA, 313--316.Google Scholar
- Kunter, M., Krey, P., Krutz, A., and Sikora, T. 2008. Extending H.264/AVC with a background sprite prediction mode. In Proceedings of the International Conference on Image Processing (ICIP'08).Google Scholar
- Lai, J., Kao, C., and Chien, S. 2009. Super-resolution sprite with foreground removal. In Proceedings of the IEEE International Conference on Multimedia and Expo. Google Scholar
Digital Library
- Lee, M.-C., Chen, W.-G., Lin, C.-B., Chuang, G., Markoc, T., Zabinsky, S. I., and Szeliski, R. 1997. A layered video object coding system using sprite and affine motion model. IEEE Trans. Circ. Syst. Video Technol. 7, 1, 130--145. Google Scholar
Digital Library
- Lu, Y., Gao, W., and Wu, F. 2001a. Fast and robust sprite generation for MPEG-4 video coding. In Proceedings of the 2nd IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia information Processing. H. Shum, M. Liao, and S. Chang, Eds., Lecture Notes In Computer Science, vol. 2195, Springer, 118--125. Google Scholar
Digital Library
- Lu, Y., Gao, W., and Wu, F. 2001b. Sprite generation for frame-based video coding. In Proceedings of the International Conference on Image Processing. 473--476.Google Scholar
- Lu, Y., Gao, W., and Wu, F. 2003. Efficient background video coding with static sprite generation and arbitrary-shape spatial prediction techniques. IEEE Trans. Circ. Syst. Video Technol. 13, 5, 394--405. Google Scholar
Digital Library
- Marzotto, R., Fusiello, A., and Murino, V. 2004. High resolution video mosaicing with global alignment. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 692--698.Google Scholar
- MPEG4 Software. Iso/iec 14496-7:2001. Information technology: Coding of audio-visual objects - part 7: Optimized software for mpeg-4 visual tools.Google Scholar
- MPEG4-2, Iso/iec 14496-2:2004. Information technology: Coding of audio-visual objects: part 2.Google Scholar
- Nagaraj, R. C., Dasu, A. R., and Panchanathan, S. 2001. Complexity analysis of sprites in MPEG. In Proceedings of SPIE, vol. 4313, 69--73.Google Scholar
- Ostermann, J., Bormans, J., List, P., Marpe, D., Narroschke, M., Perreira, F., Stockhammer, T., and Wedi, T. 2004. Video coding with h.264/avc: tools, performance, and complexity. IEEE Circ. Syst. Mag. 4, 1, 7--28.Google Scholar
Cross Ref
- Parikh, P. and Jawahar, C. V. 2007. Enhanced video mosaicing using camera motion properties. In Proceedings of the IEEE Workshop on Motion and Video Computing. IEEE Computer Society, Los Alamitos, CA, 26. Google Scholar
Digital Library
- Peleg, S., Rousso, B., Ravacha, A., and Zomet, A. 2000. Mosaicing on adaptive methods. IEEE Trans. Pattern Anal. Mach. Intell. 22, 10, 1144--1154. Google Scholar
Digital Library
- Prodys. 2009. http://www.prodys.com/.Google Scholar
- Richter, H., Smolic, A., Stabernack, B., and Müller, E., Real time global motion estimation for an MPEG-4 video encoder. In Proceedings of the Picture Coding Symposium.Google Scholar
- Salembier, P., Pujol, O., and Garrido, L. 1998. Connected operators for sprite creation and layered representation of image sequences. In Proceedings of the European Signal Processing Conference. 2105--2108.Google Scholar
- Shen, Y. and Zhang, L. 2004. A Novel Method of Sprite Generation Based on Pixel Similarity. In Proceedings of the 3rd International Conference on Image and Graphics. IEEE Computer Society, Los Alamitos, CA, 560-- 563. Google Scholar
Digital Library
- Sikora, T. 1997. The MPEG-4 video standard verification model. IEEE Trans. Circ. Syst. Video Technol. 7, 19--31. Google Scholar
Digital Library
- Smolic, A. and Ohm, J.-R. 2000. Robust global motion estimation using a simplified m-estimator approach. In Proceedings of the IEEE International Conference on Image Processing.Google Scholar
- Smolic, A., Sikora, T., and Ohm, J.-R. 1999. Long-term global motion estimation and its application for sprite coding, content description and segmentation. IEEE Trans. Circ. Syst. Video Technol. 9, 8, 1227--1242. Google Scholar
Digital Library
- Snoek, C. G., Worring, M., and Smeulders, A. W. 2005. Early versus late fusion in semantic video analysis. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05). ACM, New York, NY, 399--402. Google Scholar
Digital Library
- Steedly, D., Pal, C., and Szeliski, R. 2005. Efficiently registering video into panoramic mosaics. In Proceedings of the 10th International Conference on Computer Vision. 1300--1307. Google Scholar
Digital Library
- Szeliski, R. 2006. Image alignment and stitching: a tutorial. Found. Trends. Comput. Graph. Vision 2, 1, 1--104. Google Scholar
Digital Library
- Szeliski, R. and Shum, H.-Y. 1997. Creating full view panoramic image mosaics and environment maps. In Proceedings of ACM SIGGRAPH. 251--258. Google Scholar
Digital Library
- Taubman, D. and Marcellin, M. 2002. JPEG2000: Image Compression Fundamentals, Standards and Practice. Kluwer Academic Publishers, chapter 10. Google Scholar
Digital Library
- Teodosio, L. and Bender, W. 1993. Salient video stills: content and context preserved. In Proceedings of the 1st ACM International Conference on Multimedia (MULTIMEDIA '93). ACM, New York, NY, 39--46. Google Scholar
Digital Library
- Teodosio, L. and Bender, W. 2005. Salient stills. ACM Trans. Multimedia Comput. Comm. Appl. 1, 1, 16--36. Google Scholar
Digital Library
- To, L. T. 2005. Video object segmentation using phase-based detection of moving object buondaries, Ph.D. thesis, University of New South Wales (2005).Google Scholar
- Ye, G., Pickering, M., Frater, M., and Arnold, J. 2005. A robust approach to super-resolution sprite generation. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society, Los Alamitos, CA, 11--14.Google Scholar
- Ye, G., Wang, Y., Xu, J., Herman, G., and Zhang, B. 2008. A practical approach to multiple super-resolution sprite generation. In Proceedings of the IEEE 10th Workshop on Multimedia Signal Processing. IEEE Computer Society, Los Alamitos, CA, 70--75, 8-10.Google Scholar
- Zhu, Z., Xu, G., Riseman, E. M., and Hanson, A. R. 1999. Fast generation of dynamic and multi-resolution 360-degree panorama from video sequences. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems. IEEE Computer Society, Los Alamitos, CA. Google Scholar
Digital Library
- Zoghlami, I., Faugeras, O., and Deriche, R. 1997. Using geometric corners to build a 2d mosaic from a set of images. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. 420--425. Google Scholar
Digital Library
Index Terms
Sprite generation using sprite fusion
Recommendations
Sprite-from-Sprite: Cartoon Animation Decomposition with Self-supervised Sprite Estimation
We present an approach to decompose cartoon animation videos into a set of "sprites" --- the basic units of digital cartoons that depict the contents and transforms of each animated object. The sprites in real-world cartoons are unique: artists may draw ...
Synthetic Video Generation for Evaluation of Sprite Generation
Sprite generation is the process of aligning, warping, and blending of pixels that belong to an object in a video. The evaluation of the correctness of a sprite is usually accomplished by a combination of objective and subjective evaluations. ...
Synthetic Video Generation with Camera Motion Patterns to Evaluate Sprite Generation
MMEDIA '09: Proceedings of the 2009 First International Conference on Advances in MultimediaThere is no proper objective method of evaluating sprite generation methods due to absence of the ground truth sprite images. In this paper, we propose several camera motion patterns to generate synthetic videos from original image. Our camera motion ...






Comments