skip to main content
research-article

Automatic creation of photo books from stories in social media

Authors Info & Claims
Published:04 November 2011Publication History
Skip Abstract Section

Abstract

Photos are a special way to tell stories of our best memories and moments. The representation of those photos in appealing physical photo books is highly appreciated by many people. Today, many photos are shared via social networking sites, where people upload their photos and share their stories with their friends. The members of social networks comment on each other's photos, add tags or descriptions and upload new photos of the same events to their albums. While the media of different personal events are available on the social network, there is no easy way to collect and bundle them into a story and print this story as a photo book. We propose an approach to automatically detect media elements that match a query (where, when, what, who) in the user's social network and intelligently arrange and compose them into a printable photo book. We combine content analysis of text and images to automatically and semi-automatically select photos of a specific story. We calculate the probabilities of each two photos to belong to the same event using an Expectation-Maximization algorithm that we propose in order to be able to retrieve them easily when receiving the user queries, and we address the differences between our model and other models that use similar proposed algorithms. People's tags and the interaction between the users and the photos as well as other semantic information are exploited to select important photos that are suitable to create the photo book. The selected photos and derived semantics are then employed to automatically create an appealing layout for the photo book.

References

  1. Atkins, C. B. 2008. Blocked recursive image composition. In Proceedings of the 16th ACM International Conference on Multimedia. ACM, New York, NY, 821--824. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Gross, R. and Acquisti, A. 2005. Information Revelation and Privacy in Online Social Networks (The Facebook Case). In Proceedings of the ACM Workshop on Privacy in the Electronic Society (WPES). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Hofmann, T. 2001. Unsupervised learning by probabilistic latent semantic analysis. Mach. Learn. 42, 1--2, 177--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Kennedy, L., Naaman, M., Ahern, S., Nair, R., and Rattenbury, T. 2007. How flickr helps us make sense of the world: Context and content in community-contributed media collections. In Proceedings of the 15th International Conference on Multimedia. ACM, 631--640. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Lidwell, W., Holden, K., and Butler, J. 2003. Universal Principles of Design. Rockport Publishers.Google ScholarGoogle Scholar
  6. Mei, T., Wang, B., Hua, X.-S., Zhou, H. Q., and Li, S. 2006. Probabilistic multimodality fusion for event based home photo clustering. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1757--1760.Google ScholarGoogle Scholar
  7. Miller, A. D. and Edwards, W. K. 2007. Give and take: a study of consumer photo-sharing culture and practice. In Proceedings of the Conference on Human Factors in Computing Systems (CHI). ACM, 347--356. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Negoescu, R. A. and Gatica-Perez, D. 2008. Analyzing Flickr groups. In Proceedings of the International Conference on Image and Video Retrieval (CIVR). ACM, 417--426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. PMA. 2009. Photobook Report Summary. http://www.docstoc.com/docs/17451788/PMA-Photobook-Report-Summary/.Google ScholarGoogle Scholar
  10. Rattenbury, T., Good, N., and Naaman, M. 2007. Towards automatic extraction of event and place semantics from flickr tags. InProceedings of the 30th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 103--110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Salton, G. and Buckley, C. 1988. Term weighting approaches in automatic text retrieval. Inform. Process. Manage. 24, 513--523. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Sandhaus, P., Rabbath, M., and Boll, S. 2010. Blog2Book: Transforming blogs into photo books employing aesthetic principles. In Proceedings of the 18th International Conference on Multimedia. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Sandhaus, P., Rabbath, M., and Boll, S. 2011. Employing aesthetic principles for automatic photo book layout. In Proceedings of the 17th International Conference on Multimedia Modeling. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Shevade, B., Sundaram, H., and Xie, L. 2007. Modeling personal and social network context for event annotation in images. In Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital libraries (JCDL). ACM, 127--134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Van House, N. A. 2007. Flickr and public image-sharing: distant closeness and photo exhibition. In Proceedings of Conference on Human Factors in Computing Systems (CHI). ACM, 2717--2722. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Westermann, U. and Jain, R. 2007. Toward a common event model for multimedia applications. IEEE MultiMedia 14, 1, 19--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Zhao, M. and Liu, S. 2006. Automatic person annotation of family photo album. In Proceedings of the International Conference on Image and Video Retrieval (CIVR). 163--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Zhu, C.-Z., Hua, X.-S., Mei, T., and Wu, X.-Q. 2005. Video booklet: a natural video searching and browsing interface. In Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR'05). ACM, 113--120. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Automatic creation of photo books from stories in social media

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader
              About Cookies On This Site

              We use cookies to ensure that we give you the best experience on our website.

              Learn more

              Got it!