skip to main content
research-article

CelebrityNet: A Social Network Constructed from Large-Scale Online Celebrity Images

Published:24 August 2015Publication History
Skip Abstract Section

Abstract

Photos are an important information carrier for implicit relationships. In this article, we introduce an image based social network, called CelebrityNet, built from implicit relationships encoded in a collection of celebrity images. We analyze the social properties reflected in this image-based social network and automatically infer communities among the celebrities. We demonstrate the interesting discoveries of the CelebrityNet. We particularly compare the inferred communities with human manually labeled ones and show quantitatively that the automatically detected communities are highly aligned with that of human interpretation. Inspired by the uniqueness of visual content and tag concepts within each community of the CelebrityNet, we further demonstrate that the constructed social network can serve as a knowledge base for high-level visual recognition tasks. In particular, this social network is capable of significantly improving the performance of automatic image annotation and classification of unknown images.

References

  1. S. Bakhshi, D. A. Shamma, and E. Gilbert. 2014. Faces engage us: Photos with faces attract more likes and comments on Instagram. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, 965--974. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. A. Beauchamp. 1965. An improved index of centrality. Behav. Sci. 10, 2, 161--163.Google ScholarGoogle ScholarCross RefCross Ref
  3. M. R. Boutell, J. Luo, X. Shen, and C. M. Brown. 2004. Learning multi-label scene classification. Patt. Recog. 37, 9, 1757--1771.Google ScholarGoogle ScholarCross RefCross Ref
  4. S. Brin and L. Page. 1998. The anatomy of a large-scale hypertextual Web search engine. Comput. Netw. ISDN Syst. 30, 1, 107--117. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. L. Cao, J. Yu, J. Luo, and T. S. Huang. 2009. Enhancing semantic and geographic annotation of web images via logistic canonical correlation regression. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). ACM, New York, 125--134. DOI:http://dx.doi.org/10.1145/1631272.1631292 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Y.-Y. Chen, W. H. Hsu, and H.-Y. M. Liao. 2012. Discovering informative social subgraphs and predicting pairwise relationships from group photos. In Proceedings of the 20th ACM International Conference on Multimedia (MM'12). ACM, New York, 669--678. DOI:http://dx.doi.org/10.1145/2393347.2393439 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In Proceedings of CVPR. 886. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J. Deng, A. Berg, K. Li, and L. Fei-Fei. 2010. What does classifying more than 10,000 image categories tell us? In Proceedings of ECCV'10. 71--84. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. I. Derényi, G. Palla, and T. Vicsek. 2005. Clique percolation in random networks. Phys. Rev. Lett. 94.Google ScholarGoogle ScholarCross RefCross Ref
  10. L. Ding and A. Yilmaz. 2010. Learning relations among movie characters: A social network perspective. In Proceedings of ECCV'10. 410--423. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A library for large linear classification. J. Mach. Learn. Res. 9, 1871--1874. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. 2007. Object detection with discriminatively trained part based models. J. Art. Intell. Res. 29.Google ScholarGoogle Scholar
  13. L. C. Freeman. 1977. A set of measures of centrality based on betweenness. Sociometry 35--41.Google ScholarGoogle Scholar
  14. W. Gao and K. Wong. 2006. Natural document clustering by clique percolation in random graphs. In Proceedings of the 3rd Asia Conference on Information Retrieval Technology. Springer, 119--131. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. N. Ghamrawi and A. McCallum. 2005. Collective multi-label classification. In Proceedings of CIKM. 195--200. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. C. Gonzaléz, H. J. Herrmann, J. Kertész, and T. Vicsek. 2007. Community structure and ethnic preferences in school friendship networks. Phys. A 379, 1, 307--316.Google ScholarGoogle ScholarCross RefCross Ref
  17. P. R. Gould. 1967. On the geographical interpretation of eigenvalues. Trans. Instit. British Geog. 53--86.Google ScholarGoogle ScholarCross RefCross Ref
  18. P. Jaccard. 1901. Étude comparative de la distribution florale dans une portion des Alpes et des Jura. Bulletin del la Société Vaudoise des Sciences Naturelles.Google ScholarGoogle Scholar
  19. F. Kang, R. Jin, and R. Sukthankar. 2006. Correlated label propagation with application to multi-label learning. In Proceedings of CVPR. 1719--1726. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. H.-N. Kim, J.-G. Jung, and A. El Saddik. 2010. Associative face co-occurrence networks for recommending friends in social networks. In Proceedings of 2nd ACM SIGMM Workshop on Social Media (WSM'10). ACM, New York, 27--32. DOI:http://dx.doi.org/10.1145/1878151.1878160 Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. I. Konstas, V. Stathopoulos, and J. M. Jose. 2009. On social networks and collaborative recommendation. In Proceedings of SIGIR. ACM, 195--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 1097--1105.Google ScholarGoogle Scholar
  23. J. Leskovec, K. J. Lang, and M. Mahoney. 2010. Empirical comparison of algorithms for network community detection. In Proceedings of the 19th International Conference on World Wide Web. ACM, 631--640. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. L.-J. Li, X. Kong, and P. S. Yu. 2014. Visual recognition by exploiting latent social links in image collections. In MultiMedia Modeling, Springer, 121--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Y. Lin, F. Lv, S. Zhu, M. Yang, T. Cour, K. Yu, L. Cao, and T. Huang. 2011. Large-scale image classification: Fast feature extraction and svm training. In Proceedings of CVPR. 1689--1696. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. X. Liu, Z. Shi, Z. Li, X. Wang, and Z. Shi. 2010. Sorted label classifier chains for learning images with multi-label. In Proceedings of the 18th ACM International Conference on Multimedia (MM'10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Y. Liu, R. Jin, and L. Yang. 2006. Semi-supervised multi-label learning by constrained non-negative matrix factorization. In Proceedings of AAAI. 421--426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Q. Lu and L. Getoor. 2003. Link-based classification. In Proceedings of ICML.Google ScholarGoogle Scholar
  29. Yong Luo, Dacheng Tao, Bo Geng, Chao Xu, and Stephen J. Maybank. 2013. Manifold regularized multitask learning for semi-supervised multilabel image classification. IEEE Trans. Image Process. 22, 2, 523--536. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. L. K. McDowell, K. M. Gupta, and D. W. Aha. 2007. Cautious inference in collective classification. In Proceedings of AAAI. 596--601. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. G. Palla, I. Derényi, I. Farkas, and T. Vicsek. 2005. Uncovering the overlapping community structure of complex networks in nature and society. Nature 435, 7043, 814--818.Google ScholarGoogle Scholar
  32. Guo-Jun Qi, Xian-Sheng Hua, Yong Rui, Jinhui Tang, Tao Mei, and Hong-Jiang Zhang. 2007. Correlative multi-label video annotation. In Proceedings of the 15th International Conference on Multimedia. ACM, 17--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. J. Read, B. Pfahringer, G. Holmes, and E. Frank. 2009. Classifier chains for multi-label classification. In Proceedings of ECML/PKDD. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2014. ImageNet Large Scale Visual Recognition Challenge.Google ScholarGoogle Scholar
  35. Z. Stone, T. Zickler, and T. Darrell. 2008. Autotagging Facebook: Social network context improves photo annotation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008 (CVPRW'08). 1--8. DOI:http://dx.doi.org/10.1109/CVPRW.2008.4562956Google ScholarGoogle Scholar
  36. Z. Stone, T. Zickler, and T. Darrell. 2010. Toward large-scale face recognition using social network context. Proc. IEEE 98, 8, 1408--1415.Google ScholarGoogle ScholarCross RefCross Ref
  37. Pang-Ning Tan, Michael Steinbach, and Vipin Kumar. 2005. Introduction to Data Mining. Addison Wesley.Google ScholarGoogle Scholar
  38. S. V. N. Vishwanathan, Z. Sun, and N. Theera-Ampornpunt. 2010. Multiple kernel learning and the SMO algorithm. In Proceedings of NIPS. 2361--2369.Google ScholarGoogle Scholar
  39. G. Wang, A. Gallagher, J. Luo, and D. Forsyth. 2010. Seeing people in social context: Recognizing people and social relationships. In Proceedings of ECCV. Springer, 169--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. S. Wasserman and K. Faust. 1994. Social Network Analysis: Methods and Applications. Cambridge University Press.Google ScholarGoogle Scholar
  41. J. Weston, S. Bengio, and N. Usunier. 2010. Large scale image annotation: Learning to rank with joint word-image embeddings. Mach. Learn. 81, 1, 21--35. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Zheng-Jun Zha, Xian-Sheng Hua, Tao Mei, Jingdong Wang, G.-J. Qi, and Zengfu Wang. 2008. Joint multi-label multi-instance learning for image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2008 (CVPR'08). IEEE, 1--8.Google ScholarGoogle Scholar
  43. J. Zhuang, T. Mei, S. Hoi, X. Hua, and S. Li. 2011. Modeling social strength in social media community via kernel-based learning. In Proceedings of the 19th ACM International Conference on Multimedia (MM'11). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. CelebrityNet: A Social Network Constructed from Large-Scale Online Celebrity Images

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Multimedia Computing, Communications, and Applications
          ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 12, Issue 1
          August 2015
          220 pages
          ISSN:1551-6857
          EISSN:1551-6865
          DOI:10.1145/2816987
          Issue’s Table of Contents

          Copyright © 2015 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 24 August 2015
          • Accepted: 1 March 2015
          • Revised: 1 January 2015
          • Received: 1 July 2014
          Published in tomm Volume 12, Issue 1

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!