skip to main content
survey

A Survey on Content-Aware Image and Video Retargeting

Published:24 July 2018Publication History
Skip Abstract Section

Abstract

This survey introduces the current state of the art in image and video retargeting and describes important ideas and technologies that have influenced the recent work. Retargeting is the process of adapting an image or video from one screen resolution to another to fit different displays, for example, when watching a wide screen movie on a normal television screen or a mobile device. As there has been considerable work done in this field already, this survey provides an overview of the techniques. It is meant to be a starting point for new research in the field. We include explanations of basic terms and operators, as well as the basic workflow of the different methods.

Skip Supplemental Material Section

Supplemental Material

References

  1. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk. 2009. Frequency-tuned salient region detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). 1597--1604.Google ScholarGoogle Scholar
  2. S. Avidan and A. Shamir. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. T. Dekel Basha, Y. Moses, and S. Avidan. 2013. Stereo seam carving a geometrically consistent approach. IEEE Trans. Pattern Anal. Mach. Intell. 35, 10 (Oct 2013), 2513--2525. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J. Bhatt, D. Pappusetty, H. Kalva, and M. Naik. 2016. Image retargeting for wearable devices. In Proceedings of the IEEE International Conference on Consumer Electronics (ICCE’16). 55--57.Google ScholarGoogle Scholar
  5. A. Carlier, V. Charvillat, W. T. Ooi, R. Grigoras, and G. Morin. 2010. Crowdsourced automatic zoom and scroll for video retargeting. In Proceedings of the 18th ACM International Conference on Multimedia (MM’10). ACM, New York, NY, 201--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Yanxiang Chen, Yifei Pan, Minglong Song, and Meng Wang. 2015. Improved seam carving combining with 3D saliency for image retargeting. Neurocomputing 151, Part 2 (2015), 645--653.Google ScholarGoogle ScholarCross RefCross Ref
  7. W.-H. Cheng, C.-W. Wang, and J.-L. Wu. 2007. Video adaptation for small display based on content recomposition. IEEE Trans. Circ. Syst. Video Technol. 17, 1 (Jan. 2007), 43 --58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. C.-K. Chiang, S.-F. Wang, Y.-L. Chen, and S.-H. Lai. 2009. Fast JND-based video carving with GPU acceleration for real-time video retargeting. IEEE Trans. Circ. Syst. Video Technol. 19, 11 (2009), 1588--1597. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jiwon Choi and Changick Kim. 2015. Sparse seam-carving for structure preserving image retargeting. J. Signal Process. Syst. (2015), 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Meir Johnathan Dahan, Nir Chen, Ariel Shamir, and Daniel Cohen-Or. 2012. Combining color and depth for enhanced image segmentation and retargeting. Visual Comput. 28, 12 (2012), 1181--1193.Google ScholarGoogle ScholarCross RefCross Ref
  11. Torben Dittrich, Stephan Kopf, Philipp Schaber, Benjamin Guthier, and Wolfgang Effelsberg. 2013. Saliency detection for stereoscopic video. In Proceedings of the ACM Multimedia Systems Conference (MMSYS’13). 12--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Weiming Dong, Guanbo Bao, Xiaopeng Zhang, and Jean-Claude Paul. 2012. Fast multi-operator image resizing and evaluation. J. Comput. Sci. Technol. 27, 1 (2012), 121--134.Google ScholarGoogle ScholarCross RefCross Ref
  13. W. Dong, F. Wu, Y. Kong, X. Mei, T. Y. Lee, and X. Zhang. 2016. Image retargeting by texture-aware synthesis. IEEE Trans. Visual. Comput. Graph. 22, 2 (Feb 2016), 1088--1101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Weiming Dong, Ning Zhou, Tong-Yee Lee, Fuzhang Wu, Yan Kong, and Xiaopeng Zhang. 2014. Summarization-based image resizing by intelligent object carving. IEEE Trans. Visual. Comput. Graph. 20, 1 (2014), 111--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Huan Du, Zhi Liu, Jian Wang, Lin Mei, and Ying He. 2014. Video Retargeting Based on Spatiotemporal Saliency Model. Springer, Berlin, 397--402.Google ScholarGoogle Scholar
  16. U. Engelke, J. Wang, and P. Marendy. 2015. Perceptual relevance based image retargeting. IEEE Signal Process. Lett. 22, 6 (June 2015), 705--708.Google ScholarGoogle ScholarCross RefCross Ref
  17. Simone Frintrop, Erich Rome, and Henrik I. Christensen. 2010. Computational visual attention systems and their cognitive foundations: A survey. ACM Trans. Appl. Percept. 7, 1 (2010), 1--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. R. Furuta, I. Tsubaki, and T. Yamasaki. 2017. Fast volume seam carving with multi-pass dynamic programming. IEEE Trans. Circ. Syst. Video Technol. (2017).Google ScholarGoogle Scholar
  19. R. Gal, O. Sorkine, and D. Cohen-Or. 2006. Feature-aware texturing. In Proceedings of the 17th Eurographics Conference on Rendering Techniques (EGSR’06). Eurographics Association, 297--303. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. R. Gallea, E. Ardizzone, and R. Pirrone. 2014. Physical metaphor for streaming media retargeting. IEEE Trans. Multimedia 16, 4 (June 2014), 971--979. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. R. Gao, Q. Tu, C. Li, M. Zhao, G. Fu, and B. Yang. 2015. Graph based spatiotemporal saliency detection incorporating low- and high-level features. In Proceedings of the Conference on Visual Communications and Image Processing (VCIP’15). 1--4.Google ScholarGoogle Scholar
  22. S. Goferman, L. Zelnik-Manor, and A. Tal. 2012. Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34, 10 (Oct 2012), 1915--1926. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. M. Grundmann, V. Kwatra, M. Han, and I. Essa. 2010. Discontinuous seam-carving for video retargeting. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 569--576.Google ScholarGoogle Scholar
  24. Yanwen Guo, Feng Liu, Zhi-Hua Zhou, and Michael Gleicher. 2009. Image retargeting using mesh parameterization. IEEE Trans. Multimedia 11, 5 (2009), 856--867. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. B. Guthier, J. Kiess, S. Kopf, and W. Effelsberg. 2013. Seam carving for stereoscopic video. In Proceedings of the 2013 IEEE 11th IVMSP Workshop: 3D Image/Video Technologies and Applications. 1--4.Google ScholarGoogle Scholar
  26. Dongfeng Han, X. Wu, and M. Sonka. 2009. Optimal multiple surfaces searching for video/image resizing—A graph-theoretic approach. In Proceedings of the IEEE 12th International Conference on Computer Vision. 1026--1033.Google ScholarGoogle Scholar
  27. J. Han, S. He, X. Qian, D. Wang, L. Guo, and T. Liu. 2013. An object-oriented visual saliency detection framework based on sparse coding representations. IEEE Trans. Circ. Syst. Video Technol. 23, 12, 2009--2021. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. J.-W. Han, K.-S. Choi, T.-S. Wang, S.-H. Cheon, and S.-J. Ko. 2009. Improved seam carving using a modified energy function based on wavelet decomposition. In Proceedings of the IEEE 13th International Symposium on Consumer Electronics. 38--41.Google ScholarGoogle Scholar
  29. C. C. Hsu, C. W. Lin, Y. Fang, and W. Lin. 2014. Objective quality assessment for image retargeting based on perceptual geometric distortion and information loss. IEEE J. Select. Topics Signal Process. 8, 3 (2014), 377--389.Google ScholarGoogle ScholarCross RefCross Ref
  30. W. Hu, Z. Luo, and X. Fan. 2014. Image retargeting via adaptive scaling with geometry preservation. IEEE J. Emerg. Select. Topics Circ. Syst. 4, 1 (March 2014), 70--81.Google ScholarGoogle ScholarCross RefCross Ref
  31. Daw-Sen Hwang and Shao-Yi Chien. 2008. Content-aware image resizing using perceptual seam carving with human attention model. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1029--1032.Google ScholarGoogle Scholar
  32. Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa. 2017. Globally and locally consistent image completion. ACM Trans. Graph. 36, 4 (2017), 107:1--107:14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Laurent Itti, Christof Koch, and Ernst Niebur. 1999. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 11 (1999), 1254--1259. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. W. C. Jhou, Y. H. Lin, and J. L. Wu. 2014. Seam carving for color-plus-depth 3D image. In Proceedings of the IEEE International Symposium on Multimedia (ISM’14). 82--85. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. J. Kiess, R. Garcia, S. Kopf, and W. Effelsberg. 2012. Improved image retargeting by distinguishing between faces in focus and out of focus. In Proceedings of the IEEE International Conference on Multimedia and Expo Workshops. 145--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Johannes Kiess, Daniel Gritzner, Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2014. GPU video retargeting with parallelized SeamCrop. In Proceedings of the 5th ACM Multimedia Systems Conference (MMSys’14). ACM, New York, NY, 139--147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Johannes Kiess, Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2012. SeamCrop: Changing the size and aspect ratio of videos. In Proceedings of the 4th Workshop on Mobile Video (MoVid’12). ACM, New York, NY, 13--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Johannes Kiess, Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2012. SeamCrop for image retargeting. Proc. SPIE 8304 (2012), 83040K--83040K--8.Google ScholarGoogle ScholarCross RefCross Ref
  39. Johannes Kiess, Stephan Kopf, Benjamin Guthier, and Wolfgang Effelsberg. 2010. Seam carving with improved edge preservation. Proc. SPIE 7542 (2010), 75420G--75420G--11.Google ScholarGoogle ScholarCross RefCross Ref
  40. W. Kim and C. Kim. 2014. Spatiotemporal saliency detection using textural contrast and its applications. IEEE Trans. Circ. Syst. Video Technol. 24, 4 (Apr. 2014), 646--659.Google ScholarGoogle Scholar
  41. Y. Kong, W. Dong, X. Mei, C. Ma, T.-L. Lee, S. Lyu, F. Huang, and X. Zhang. 2016. Measuring and predicting visual importance of similar objects. IEEE Trans. Visual. Comput. Graph. 22, 12 (2016), 2564--2578. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. S. Kopf, B. Guthier, C. Hipp, J. Kiess, and W. Effelsberg. 2014. Warping-based video retargeting for stereoscopic video. In Proceedings of the IEEE International Conference on Image Processing (ICIP). 2898--2902.Google ScholarGoogle Scholar
  43. Stephan Kopf, Benjamin Guthier, Hendrik Lemelson, and Wolfgang Effelsberg. 2009. Adaptation of web pages and images for mobile applications. Proc. SPIE 7256 (2009), 72560C--72560C--12.Google ScholarGoogle ScholarCross RefCross Ref
  44. Stephan Kopf, Thomas Haenselmann, Johannes Kiess, Benjamin Guthier, and Wolfgang Effelsberg. 2011. Algorithms for video retargeting. Multimedia Tools Appl. 51, 2 (2011), 819--861. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Stephan Kopf, Johannes Kiess, Hendrik Lemelson, and Wolfgang Effelsberg. 2009. FSCAV: Fast seam carving for size adaptation of videos. In Proceedings of the 17th ACM International Conference on Multimedia (MM’09). ACM, New York, NY, 321--330. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. S. Kopf, F. Lampi, T. King, and W. Effelsberg. 2006. Automatic scaling and cropping of videos for devices with limited screen resolution. In Proceedings of the 14th ACM International Conference on Multimedia (MM’06). ACM, New York, NY, 957--958. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Philipp Krähenbühl, Manuel Lang, Alexander Hornung, and Markus Gross. 2009. A system for retargeting of streaming video. In ACM SIGGRAPH Asia papers. ACM, New York, NY, 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. J. S. Lee and T. Ebrahimi. 2012. Perceptual video compression: A survey. IEEE J. Select. Topics Signal Process. 6, 6 (Oct. 2012), 684--697.Google ScholarGoogle ScholarCross RefCross Ref
  49. Jianjun Lei, Min Wu, Changqing Zhang, Feng Wu, Nam Ling, and Chunping Hou. 2017. Depth-preserving image retargeting based in pixel fusion. IEEE Trans. Multimedia 19, 7 (2017), 1442--1453.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. B. Li, L. Y. Duan, C. W. Lin, T. Huang, and W. Gao. 2015. Depth-preserving warping for stereo image retargeting. IEEE Trans. Image Process. 24, 9 (Sept 2015), 2811--2826.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. B. Li, L. Y. Duan, J. Wang, R. Ji, C. W. Lin, and W. Gao. 2014. Spatiotemporal grid flow for video retargeting. IEEE Trans. Image Process. 23, 4 (April 2014), 1615--1628. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. S. Li, H. Lu, Z. Lin, X. Shen, and B. Price. 2015. Adaptive metric learning for saliency detection. IEEE Trans. Image Process. 24, 11 (Nov 2015), 3321--3331.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Y. Li, Y. Tian, J. Yang, L.-Y. Duan, and W. Gao. 2010. Video retargeting with multi-scale trajectory optimization. In Proceedings of the International Conference on Multimedia Information Retrieval (MIR’10). ACM, New York, NY, 45--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Yun Liang, Yong-Jin Liu, and Diego Gutierrez. 2017. Objective quality prediction of image retargeting algorithms. IEEE Trans. Visual. Comput. Graph. 23, 2 (2017), 1099--1110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Y. Liang, Y. J. Liu, X. N. Luo, L. Xie, and X. Fu. 2013. Optimal-scaling-factor assignment for patch-wise image retargeting. IEEE Comput. Graph. Appl. 33, 5 (Sept 2013), 68--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. K. C. Lien and M. Turk. 2015. On preserving structure in stereo seam carving. In Proceedings of the International Conference on 3D Vision (3DV’15). 571--579. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. S. Lin, C. Lin, I. Yeh, S. Chang, C. Yeh, and T. Lee. 2013. Content-aware video retargeting using object-preserving warping. IEEE Trans. Visual. Comput. Graph. 19, 10 (2013), 1677--1686.Google ScholarGoogle ScholarCross RefCross Ref
  58. Xiao Lin, Ying-lan Ma, Li-zhuang Ma, and Rui-ling Zhang. 2014. A survey for image resizing. J. Zhejiang Univ. Sci. C 15, 9 (2014), 697--716.Google ScholarGoogle ScholarCross RefCross Ref
  59. Di Liu, Zhaogai Wu, Xianming Lin, and Rongrong Ji. 2016. Towards perceptual video cropping with curve fitting. Multimedia Tools Appl. 75, 20 (2016), 12465--12475. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Feng Liu and Michael Gleicher. 2005. Automatic image retargeting with fisheye-view warping. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST’05). ACM, New York, NY, 153--162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Feng Liu and Michael Gleicher. 2006. Video retargeting: Automating pan and scan. In Proceedings of the 14th ACM International Conference on Multimedia (MM’06). ACM, New York, NY, 241--250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Hao Liu, Xing Xie, Wei-Ying Ma, and Hong-Jiang Zhang. 2003. Automatic browsing of large pictures on mobile devices. In Proceedings of the 11th ACM International Conference on Multimedia (MULTIMEDIA’03). ACM, New York, NY, 148--155. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Yi Liu, Lifeng Sun, and Shiqiang Yang. 2015. A retargeting method for stereoscopic 3D video. Comput. Visual Media 1, 2 (2015), 119--127.Google ScholarGoogle ScholarCross RefCross Ref
  64. L. Ma, W. Lin, C. Deng, and K. N. Ngan. 2012. Image retargeting quality assessment: A study of subjective scores and objective metrics. IEEE J. Select. Topics Signal Process. 6, 6 (Oct 2012), 626--639.Google ScholarGoogle ScholarCross RefCross Ref
  65. Yu-Fei Ma and Hong-Jiang Zhang. 2003. Contrast-based image attention analysis by using fuzzy growing. In Proceedings of the 11th ACM International Conference on Multimedia. ACM, New York, NY, 374--381. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. V. A. Mateescu and I. V. Bajic. 2016. Visual attention retargeting. IEEE MultiMedia 23, 1 (Jan. 2016), 82--91. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Yongwei Nie, Qing Zhang, Renfang Wang, and Chunxia Xiao. 2013. Video retargeting combining warping and summarizing optimization. Visual Comput. 29, 6 (2013), 785--794. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Yuzhen Niu, Feng Liu, Wu chi Feng, and Hailin Jin. 2012. Aesthetics-based stereoscopic photo cropping for heterogeneous displays. IEEE Trans. Multimedia 14, 3 (2012), 783--796. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Hyeonwoo Noh and Bohyung Han. 2012. Seam carving with forward gradient difference maps. In Proceedings of the 20th ACM International Conference on Multimedia (MM’12). ACM, New York, NY, 709--712. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Daniele Panozzo, Ofir Weber, and Olga Sorkine. 2012. Robust image retargeting via axis-aligned deformation. Comput. Graph. Forum 31, 2pt1 (2012), 229--236. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Y. Pritch, E. Kav-Venaki, and S. Peleg. 2009. Shift-map image editing. In Proceedings of the IEEE 12th International Conference on Computer Vision. 151--158.Google ScholarGoogle Scholar
  72. S. Qi, Y. T. J. Chi, A. M. Peter, and J. Ho. 2016. CASAIR: Content and shape-aware image retargeting and its applications. IEEE Trans. Image Process. 25, 5 (May 2016), 2222--2232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Zhongyan Qiu, Tongwei Ren, Yan Liu, Jia Bei, and Muyang Song. 2013. Image Retargeting by Combining Region Warping and Occlusion. Springer International Publishing, Cham, 200--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Z. Qu, J. Wang, M. Xu, and H. Lu. 2013. Context-aware video retargeting via graph model. IEEE Trans. Multimedia 15, 7 (Nov 2013), 1677--1687. Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Parvin Razzaghi and Shadrokh Samavi. 2015. Image retargeting using nonparametric semantic segmentation. Multimedia Tools Appl. 74, 24 (Dec. 2015), 11517--11536. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Tongwei Ren, Yan Liu, Ran Ju, and Gangshan Wu. 2016. How important is location information in saliency detection of natural images. Multimedia Tools Appl. 75, 5 (2016), 2543--2564. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Tongwei Ren, Yan Liu, and Gangshan Wu. 2009. Image retargeting based on global energy optimization. In Proceedings of the 2009 IEEE International Conference on Multimedia and Expo (ICME’09). IEEE Press, Piscataway, NJ, 406--409. Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Michael Rubinstein, Diego Gutierrez, Olga Sorkine, and Ariel Shamir. 2010. A comparative study of image retargeting. In ACM SIGGRAPH Asia papers. ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Michael Rubinstein, Ariel Shamir, and Shai Avidan. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27, 3 (Aug. 2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Michael Rubinstein, Ariel Shamir, and Shai Avidan. 2009. Multi-operator media retargeting. ACM Trans. Graph. SIGGRAPH 28, 3 (2009), 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. A. Santella, M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen. 2006. Gaze-based interaction for semi-automatic photo cropping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’06). 771--780. Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. C. Scharfenberger, A. Wong, and D. A. Clausi. 2015. Structure-guided statistical textural distinctiveness for salient region detection in natural images. IEEE Trans. Image Process. 24, 1 (Jan 2015), 457--470.Google ScholarGoogle ScholarCross RefCross Ref
  83. Vidya Setlur, Saeko Takagi, Ramesh Raskar, Michael Gleicher, and Bruce Gooch. 2005. Automatic image retargeting. In Proceedings of the 4th International Conference on Mobile and Ubiquitous Multimedia (MUM’05). ACM, New York, NY, 59--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. F. Shao, W. Lin, W. Lin, G. Jiang, M. Yu, and R. Fu. 2016. Stereoscopic visual attention guided seam carving for stereoscopic image retargeting. J. Display Technol. 12, 1 (Jan. 2016), 22--30.Google ScholarGoogle ScholarCross RefCross Ref
  85. J. Shi, Q. Yan, L. Xu, and J. Jia. 2016. Hierarchical image saliency detection on extended CSSD. IEEE Trans. Pattern Anal. Mach. Intell. 38, 4 (April 2016), 717--729. Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Li. Shi, J. Wang, L. Duan, and H. Lu. 2009. Consumer video retargeting: Context assisted spatial-temporal grid optimization. In Proceedings of the 17th ACM International Conference on Multimedia (MM’09). ACM, New York, NY, 301--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Bongwon Suh, Haibin Ling, Benjamin B. Bederson, and David W. Jacobs. 2003. Automatic thumbnail cropping and its effectiveness. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST’03). ACM, 95--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. W. J. Tsai and C. F. Chen. 2015. Hybrid image retargeting. In Proceedings of the Conference on Visual Communications and Image Processing (VCIP’15). 1--4.Google ScholarGoogle Scholar
  89. K. Utsugi, T. Shibahara, T. Koike, K. Takahashi, and T. Naemura. 2010. Seam carving for stereo images. In Proceedings of the Conference on True Vision—Capture, Transmission and Display of 3D Video (3DTV’10). 1--4.Google ScholarGoogle Scholar
  90. Daniel Vaquero, Matthew Turk, Kari Pulli, Marius Tico, and Natasha Gelfand. 2010. A survey of image retargeting techniques. Proc. SPIE 7798 (2010), 779814--779814--15.Google ScholarGoogle ScholarCross RefCross Ref
  91. B. Wang, H. Xiong, Z. Ren, and C. W. Chen. 2014. Deformable shape preserving video retargeting with salient curve matching. IEEE J. Emerg. Select. Topics Circ. Syst. 4, 1 (March 2014), 82--94.Google ScholarGoogle ScholarCross RefCross Ref
  92. J. Wang, Y. Fang, M. Narwaria, W. Lin, and P. Le Callet. 2014. Stereoscopic image retargeting based on 3D saliency detection. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’14). 669--673.Google ScholarGoogle Scholar
  93. J. Wang, Z. Qu, Y. Chen, T. Mei, M. Xu, L. Zhang, and H. Lu. 2016. Adaptive content condensation based on grid optimization for thumbnail image generation. IEEE Trans. Circ. Syst. Video Technol. 26, 11 (2016), 2079--2092. Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. S. Wang, M. Wang, S. Yang, and K. Zhang. 2017. Salient region detection via discriminative dictionary learning and joint Bayesian inference. IEEE Trans. Circ. Syst. Video Technol. (2017).Google ScholarGoogle Scholar
  95. Shu-Fan Wang and Shang-Hong Lai. 2011. Compressibility-aware media retargeting with structure preserving. IEEE Trans. Image Process. 20, 3 (Mar. 2011), 855--865. Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Wenguan Wang, Jianbing Shen, Yizhou Yu, and Kwan-Liu Ma. 2017. Stereoscopic thumbnail creation via efficient stereo saliency detection. IEEE Trans. Visual. Comput. Graph. 23, 8 (2017), 2014--2017.Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. Weiwei Wang, Dong Zhai, Tao Li, and Xiangchu Feng. 2014. Salient edge and region aware image retargeting. Signal Process.: Image Commun. 29, 10 (2014), 1223--1231. Google ScholarGoogle ScholarDigital LibraryDigital Library
  98. Yu-Shuen Wang, Hongbo Fu, Olga Sorkine, Tong-Yee Lee, and Hans-Peter Seidel. 2009. Motion-aware temporal coherence for video resizing. ACM Trans. Graph. 28, 5 (Dec. 2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  99. Yu-Shuen Wang, Jen-Hung Hsiao, Olga Sorkine, and Tong-Yee Lee. 2011. Scalable and coherent video resizing with per-frame optimization. ACM Trans. Graph. 30, 4 (July 2011). Google ScholarGoogle ScholarDigital LibraryDigital Library
  100. Yu-Shuen Wang, Hui-Chih Lin, Olga Sorkine, and Tong-Yee Lee. 2010. Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. SIGGRAPH 29, 4 (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Yu-Shuen Wang, Chiew-Lan Tai, Olga Sorkine, and Tong-Yee Lee. 2008. Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27, 5 (2008), 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  102. L. Wolf, M. Guttmann, and D. Cohen-Or. 2007. Non-homogeneous Content-driven Video-retargeting. In Proceedings of the IEEE 11th International Conference on Computer Vision. 1--6.Google ScholarGoogle Scholar
  103. Lifang Wu, Lianchao Cao, Min Xu, and Jinqiao Wang. 2014. A hybrid image retargeting approach via combining seam carving and grid warping. J. Multimedia 9, 4 (2014).Google ScholarGoogle ScholarCross RefCross Ref
  104. B. Yan, K. Li, X. Yang, and T. Hu. 2015. Seam searching-based pixel fusion for image retargeting. IEEE Trans. Circ. Syst. Video Technol. 25, 1 (Jan. 2015), 15--23.Google ScholarGoogle Scholar
  105. Bo Yan, Weimin Tan, Ke Li, and Tian Qi. 2017. Codebook-guided feature preserving for recognition-oriented image retargeting. IEEE Trans. Image Process. 26, 5 (2017), 2454--2465. Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. B. Yan, B. Yuan, and B. Yang. 2014. Effective video retargeting with jittery assessment. IEEE Trans. Multimedia 16, 1 (Jan 2014), 272--277.Google ScholarGoogle ScholarCross RefCross Ref
  107. Z. Yan and H. Chen. 2014. A study of image retargeting based on seam carving. In Proceedings of the 6th International Conference on Measuring Technology and Mechatronics Automation. 60--63. Google ScholarGoogle ScholarDigital LibraryDigital Library
  108. Z. Yan, P. Jingliang, and H. Yan. 2013. Improved adaptive seam carving for image retargeting. In Proceedings of the 4th International Conference on Digital Manufacturing and Automation (ICDMA’13). 675--678.Google ScholarGoogle Scholar
  109. J. Zhang and C. C. J. Kuo. 2012. Region-adaptive texture-aware image resizing. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’12). 837--840.Google ScholarGoogle ScholarCross RefCross Ref
  110. J. Zhang, S. Li, and C. C. J. Kuo. 2014. Compressed-domain video retargeting. IEEE Trans. Image Process. 23, 2 (Feb 2014), 797--809. Google ScholarGoogle ScholarDigital LibraryDigital Library
  111. Lixia Zhang, Kangshun Li, Zhaoming Ou, and Fubin Wang. 2015. Seam warping: A new approach for image retargeting for small displays. Soft Comput. (2015), 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. Luming Zhang, Xuelong Li, Liqiang Nie, Yan Yan, and Roger Zimmermann. 2016. Semantic photo retargeting under noisy image labels. ACM Trans. Multimedia Comput. Commun. Appl. 12, 3 (May 2016). Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. Luming Zhang, Meng Wang, Liqiang Nie, Liang Hong, Yong Rui, and Qi Tian. 2015. Retargeting semantically rich photos. IEEE Trans. Multimedia 17, 9 (2015), 1538--1549.Google ScholarGoogle ScholarDigital LibraryDigital Library
  114. Y. Zhang, W. Lin, X. Zhang, Y. Fang, and L. Li. 2016. Aspect ratio similarity (ARS) for image retargeting quality assessment. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’16). 1080--1084.Google ScholarGoogle Scholar
  115. Yi-Fei Zhang, Shi-Min Hu, and Ralph R. Martin. 2008. Shrinkability maps for content-aware video resizing. Comput. Graph. Forum (Special issue of Pacific Graphics) 27, 7 (2008), 1797--1804.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Survey on Content-Aware Image and Video Retargeting

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!