skip to main content
research-article
Best Paper

Automatic Generation of Visual-Textual Presentation Layout

Authors Info & Claims
Published:09 February 2016Publication History
Skip Abstract Section

Abstract

Visual-textual presentation layout (e.g., digital magazine cover, poster, Power Point slides, and any other rich media), which combines beautiful image and overlaid readable texts, can result in an eye candy touch to attract users’ attention. The designing of visual-textual presentation layout is therefore becoming ubiquitous in both commercially printed publications and online digital magazines. However, handcrafting aesthetically compelling layouts still remains challenging for many small businesses and amateur users. This article presents a system to automatically generate visual-textual presentation layouts by investigating a set of aesthetic design principles, through which an average user can easily create visually appealing layouts. The system is attributed with a set of topic-dependent layout templates and a computational framework integrating high-level aesthetic principles (in a top-down manner) and low-level image features (in a bottom-up manner). The layout templates, designed with prior knowledge from domain experts, define spatial layouts, semantic colors, harmonic color models, and font emotion and size constraints. We formulate the typography as an energy optimization problem by minimizing the cost of text intrusion, the utility of visual space, and the mismatch of information importance in perception and semantics, constrained by the automatically selected template and further preserving color harmonization. We demonstrate that our designs achieve the best reading experience compared with the reimplementation of parts of existing state-of-the-art designs through a series of user studies.

References

  1. Rudolf Arnheim. 1954. Art and visual perception: A psychology of the creative eye. University of California Press, berkeley and Los Angeles.Google ScholarGoogle Scholar
  2. Shai Avidan and Ariel Shamir. 2007. Seam Carving for Content-aware Image Resizing. ACM Transactions on Graphics (TOG) 26, 3 (2007), 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Michael Bauerly and Yili Liu. 2006. Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics. International Journal of Human-Computer Studies 64, 8 (2006), 670--682. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ming-Ming Cheng, Guo-Xin Zhang, Niloy J Mitra, Xiaolei Huang, and Shi-Min Hu. 2011. Global contrast based salient region detection. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 409--416. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Daniel Cohen-Or, Olga Sorkine, Ran Gal, Tommer Leyvand, and Ying-Qing Xu. 2006. Color Harmonization. ACM Transactions on Graphics 25, 3 (2006), 624--630. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Catherine Havasi, Robert Speer, and Justin Holmgren. 2010. Automated color selection using semantic knowledge. In Proceedings of the AAAI Fall Symposium Series.Google ScholarGoogle Scholar
  7. Qiang Huo and Zhi-Dan Feng. 2003. Improving Chinese/English OCR performance by using MCE-based character-pair modeling and negative training. In Proceedings of International Conference on Document Analysis and Recognition. IEEE, 364--368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Charles Jacobs, Wilmot Li, Evan Schrier, David Bargeron, and David Salesin. 2003. Adaptive Grid-based Document Layout. ACM Transactions on Graphics 22, 3 (2003), 838--847. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Ali Jahanian, Jerry Liu, Qian Lin, Daniel Tretter, Eamonn O’Brien-Strain, Seungyon Claire Lee, Nic Lyons, and Jan Allebach. 2013. Recommendation System for Automatic Design of Magazine Covers. In Proceedings of International Conference on Intelligent User Interfaces. ACM, 95--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Ali Jahanian, Jerry Liu, Daniel R. Tretter, Qian Lin, Niranjan Damera-Venkata, Eamonn O’Brien-Strain, Seungyon Lee, Jian Fan, and Jan P. Allebach. 2012. Automatic design of magazine covers. In IS&T/SPIE Electronic Imaging. International Society for Optics and Photonics, 83020N--83020N.Google ScholarGoogle Scholar
  11. Shigenobu Kobayashi and Louella Matsunaga. 1991. Color image scale. Kodansha international Tokyo.Google ScholarGoogle Scholar
  12. Alexander Kröner. 1999. The DesignComposer: Context-based automated layout for the internet. In Proceedings of the AAAI Fall Symposium Series: Using Layout for the Generation, Understanding, or Retrieval of Documents.Google ScholarGoogle Scholar
  13. Mikko Kuhna, Ida-Maria Kivelä, and Pirkko Oittinen. 2012. Semi-automated Magazine Layout Using Content-based Image Features. In Proceedings of the 20th ACM international conference on Multimedia (MM’12). ACM, ACM, New York, NY, USA, 379--388. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Lin Liang, Rong Xiao, Fang Wen, and Jian Sun. 2008. Face alignment via component-based discriminative search. In Computer Vision--ECCV 2008 (Lecture Notes in Computer Science), Vol. 5303. Springer Berlin Heidelberg, 72--85. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ligang Liu, Renjie Chen, Lior Wolf, and Daniel Cohen-Or. 2010. Optimizing photo composition. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 469--478.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Simon Lok and Steven Feiner. 2001. A survey of automated layout techniques for information presentations. Proceedings of SmartGraphics 2001 (2001), 61--68.Google ScholarGoogle Scholar
  17. Tao Mei, Lusong Li, Xian-Sheng Hua, and Shipeng Li. 2012. ImageSense: Towards contextual image advertising. ACM Transactions on Multimedia Computing, Communications, and Applications 8, 1 (2012), 6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Albert Henry Munsell. 1950. Munsell book of color. Munsell Color Company.Google ScholarGoogle Scholar
  19. Naila Murray, Luca Marchesotti, and Florent Perronnin. 2012. AVA: A large-scale database for aesthetic visual analysis. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2408--2415. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Masataka Tokumaru, Noriaki Muranaka, and Shigeru Imanishi. 2002. Color design support system considering color harmony. In Proceedings of the IEEE International Conference on Fuzzy System, 2002 (FUZZ-IEEE’02), Vol. 1. IEEE, 378--383.Google ScholarGoogle ScholarCross RefCross Ref
  21. Daniel Vaquero, Matthew Turk, Kari Pulli, Marius Tico, and Natasha Gelfand. 2010. A survey of image retargeting techniques. In Proc. SPIE, Vol. 7798. International Society for Optics and Photonics, 779814--779814--15.Google ScholarGoogle ScholarCross RefCross Ref
  22. Wenyuan Yin, Tao Mei, and Chang Wen Chen. 2013. Automatic generation of social media snippets for mobile browsing. In Proceedings of the 21st ACM international conference on Multimedia (MM’13). ACM, New York, NY, USA, 927--936. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Michelle X. Zhou and Sheng Ma. 1999. Toward applying machine learning to design rule acquisition for automated graphics generation. In Proc. 2000 AAAI Spring Symp. on Smart Graphics. 16--23.Google ScholarGoogle Scholar

Index Terms

  1. Automatic Generation of Visual-Textual Presentation Layout

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!