Abstract
Online Social Network Sites have become a primary platform for brands and organizations to engage their audience by sharing image and video posts on their timelines. Different from traditional advertising, these posts are not restricted to the products or logo but include visual elements that express more in general the values and attributes of the brand, called brand associations. Since marketers are increasingly spending time in discovering and re-posting user generated posts that reflect the brand attributes, there is an increasing demand for such discovery systems. The goal of these systems is to assist brand experts in filtering through online collections of new user media to discover actionable posts, which match the brand value and have the potential to engage the consumers. Driven by this real-life application, we define and formulate a new task of content discovery for brands and propose a framework that learns to rank posts for brands from their historical timeline. We design a Personalized Content Discovery (PCD) framework to address the three challenges of high inter-brand similarity, sparsity of brand--post interactions, and diversification of timeline. To learn fine-grained brand representation and to generate explanations for the ranking, we automatically learn visual elements of posts from the timeline of brands and from a set of brand attributes in the domain of marketing. To test our framework we use two large-scale Instagram datasets that contain a total of more than 1.5 million image and video posts from the historical timeline of hundreds of brands from multiple verticals such as food and fashion. Extensive experiments indicate that our model can effectively learn fine-grained brand representations and outperform the closest state-of-the-art solutions.
- Jennifer L. Aaker. 1997. Dimensions of brand personality. J. Market. Res. 34, 3 (1997), 347--356.Google Scholar
Cross Ref
- Hassan Alboqami, Wafi Al-Karaghouli, Yasser Baeshen, Ismail Erkan, Chris Evans, and Ahmad Ghoneim. 2015. Electronic word of mouth in social media: The common characteristics of retweeted and favourited marketer-generated content posted on Twitter. Int. J. Internet Market. Advert. 9, 4 (2015), 338--358.Google Scholar
Cross Ref
- Christy Ashley and Tracy Tuten. 2015. Creative strategies in social media marketing: An exploratory study of branded social content and consumer engagement. Psychol. Market. 32, 1 (2015), 15--27.Google Scholar
Cross Ref
- Janelle Barlow and Paul Stewart. 2004. Branded Customer Service: The New Competitive Edge. Berrett-Koehler.Google Scholar
- Chia Yu Chang. 2014. Visualizing brand personality and personal branding: case analysis on Starbucks and Nike’s brand value co-creation on Instagram. MA (Master of Arts) thesis, University of Iowa. http://ir.uiowa.edu/etd/1304.Google Scholar
- Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item- and component-level attention. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’17). 335--344.Google Scholar
Digital Library
- Tao Chen, Xiangnan He, and Min-Yen Kan. 2016. Context-aware image tweet modelling and recommendation. In Proceedings of the 2016 ACM on Multimedia Conference (MM’16). 1018--1027.Google Scholar
Digital Library
- Peng Cui, Zhiyu Wang, and Zhou Su. 2014. What videos are similar with you?: Learning a common attributed representation for video recommendation. In Proceedings of the 22nd ACM International Conference on Multimedia. 597--606.Google Scholar
Digital Library
- Lisette De Vries, Sonja Gensler, and Peter S. H. Leeflang. 2012. Popularity of brand posts on brand fan pages: An investigation of the effects of social media marketing. J. Interact. Market. 26, 2 (2012), 83--91.Google Scholar
Cross Ref
- Yi Ding, Chee Wei Phang, Xianghua Lu, Chuan-Hoo Tan, and Juliana Sutanto. 2014. The role of marketer- and user-generated content in sustaining the growth of a social media brand community. In Proceedings of the 2014 47th Hawaii International Conference on System Sciences. 1785--1792.Google Scholar
Digital Library
- Aleksandr Farseev, Kirill Lepikhin, Kenny Powar, Eu Khoon Ang, and Hendrik Schwartz. 2018. SoMin.ai: Social multimedia influencer discovery marketplace. In Proceedings of the 26th ACM International Conference on Multimedia (MM’18).Google Scholar
Digital Library
- Yue Gao, Fanglin Wang, Huanbo Luan, and Tat-Seng Chua. 2014. Brand data gathering from live social media streams. In Proceedings of the International Conference on Multimedia Retrieval (ICMR’14). 169--176.Google Scholar
Digital Library
- Francesco Gelli, Xiangnan He, Tao Chen, and Tat-Seng Chua. 2017. How personality affects our likes: Towards a better understanding of actionable images. In Proceedings of the 2017 ACM on Multimedia Conference (MM’17). 1828--1837.Google Scholar
Digital Library
- Francesco Gelli, Tiberio Uricchio, Xiangnan He, Alberto Del Bimbo, and Tat-Seng Chua. 2018. Beyond the product: Discovering image posts for brands in social media. In Proceedings of the 2018 ACM Multimedia Conference on Multimedia Conference (MM’18). 465--473.Google Scholar
Digital Library
- Francesco Gelli, Tiberio Uricchio, Xiangnan He, Alberto Del Bimbo, and Tat-Seng Chua. 2019. Learning subjective attributes of images from auxiliary sources. In Proceedings of the 27th ACM International Conference on Multimedia (MM’19). 2263--2271. DOI:https://doi.org/10.1145/3343031.3350574Google Scholar
Digital Library
- Xue Geng, Hanwang Zhang, Jingwen Bian, and Tat-Seng Chua. 2015. Learning image and user features for recommendation in social networks. In Proceedings of the International Conference on Computer Vision (ICCV’15). 4274--4282.Google Scholar
Digital Library
- Sonja Gensler, Franziska Völckner, Yuping Liu-Thompkins, and Wiertz Caroline. 2013. Managing brands in the social media environment. J. Interact. Market. 27, 4 (2013), 242--256.Google Scholar
Cross Ref
- Khim-Yong Goh, Cheng-Suang Heng, and Zhijie Lin. 2013. Social media brand community and consumer behavior: Quantifying the relative impact of user- and marketer-generated content. Inf. Syst. Res. 24, 1 (2013), 88--107.Google Scholar
Cross Ref
- Ruining He and Julian McAuley. 2016. VBPR: Visual Bayesian personalized ranking from implicit feedback. In Proceedings of the 30th AAAI Conference on Artificial Intelligence. 144--150.Google Scholar
Digital Library
- Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. TriRank: Review-aware explainable recommendation by modeling aspects. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM’15). 1661--1670.Google Scholar
Digital Library
- Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’17). 355--364.Google Scholar
Digital Library
- Balázs Hidasi, Massimo Quadrana, Alexandros Karatzoglou, and Domonkos Tikk. 2016. Parallel recurrent neural network architectures for feature-rich session-based recommendations. In Proceedings of the 10th ACM Conference on Recommender Systems (RecSys’16). 241--248.Google Scholar
Digital Library
- Sudarsan Jayasingh and Venkatesh Rajagopalan. 2015. Customer engagement factors in facebook brand pages. Asian Soc. Sci. 11, 26 (2015). DOI: 10.5539/ass.v11n26p19Google Scholar
- Wang-Cheng Kang, Chen Fang, Zhaowen Wang, and Julian McAuley. 2017. Visually-aware fashion recommendation and design with generative image models. In Proceedings of the International Conference on Data Mining (ICDM’17). 207--216.Google Scholar
Cross Ref
- Wang-Cheng Kang, Eric Kim, Jure Leskovec, Charles Rosenberg, and Julian McAuley. 2019. Complete the look: Scene-based complementary product recommendation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10532--10541.Google Scholar
Cross Ref
- Gunhee Kim and Eric P. Xing. 2013. Discovering pictorial brand associations from large-scale online image data. In Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops (ICDMW’15). 404--411.Google Scholar
- Gunhee Kim and Eric P. Xing. 2014. Visualizing brand associations from web community photos. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining (WSDM’14). 623--632.Google Scholar
- Jingu Kim, Renato D. C. Monteiro, and Haesun Park. 2012. Group sparsity in nonnegative matrix factorization. In Proceedings of the 2012 SIAM International Conference on Data Mining (SDM’12). 851--862.Google Scholar
Cross Ref
- Solomon Kullback. 1997. Information Theory and Statistics. Courier Corporation.Google Scholar
Digital Library
- Chenyi Lei, Dong Liu, Weiping Li, Zheng-Jun Zha, and Houqiang Li. 2016. Comparative deep learning of hybrid representations for image recommendations. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16). 2545--2553.Google Scholar
Cross Ref
- Tereza Litsa. 2016. How the rise of user-generated content changes marketing. Retrieved from https://www.clickz.com/how-the-rise-of-user-generated-content-changes-marketing.Google Scholar
- Mitchell Lovett, Renana Peres, and Ron Shachar. 2014. A data set of brands and their characteristics. Market. Sci. 33, 4 (2014), 609--617.Google Scholar
Digital Library
- Shuang Ma and Chang Wen Chen. 2018. D-Sempre: Learning deep semantic-preserving embeddings for user interests-social contents modeling. CoRR abs/1802.06451 (2018).Google Scholar
- Masoud Mazloom, Robert Rietveld, Stevan Rudinac, Marcel Worring, and Willemijn van Dolen. 2016. Multimodal popularity prediction of brand-related social media posts. In Proceedings of the 2016 ACM on Multimedia Conference (MM’16). 197--201.Google Scholar
Digital Library
- Wei Niu, James Caverlee, and Haokai Lu. 2018. Neural personalized ranking for image recommendation. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18). 423--431.Google Scholar
Digital Library
- Steve Olenski. 2016. Can Your Content Sell a Lifestyle and Not Just Products? Retrieved from https://www.forbes.com/sites/steveolenski/2016/07/02/can-your-content-sell-a-lifestyle-and-not-just-products.Google Scholar
- Gijs Overgoor, Masoud Mazloom, Marcel Worring, Robert Rietveld, and Willemijn van Dolen. 2017. A spatio-temporal category representation for brand popularity prediction. In Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval (ICMR’17). 233--241.Google Scholar
Digital Library
- Irena Pletikosa Cvijikj and Florian Michahelles. 2013. Online engagement factors on Facebook brand pages. Soc. Netw. Anal. Min. 3, 4 (2013), 843--861.Google Scholar
Cross Ref
- Steffen Rendle. 2010. Factorization machines. In Proceedings of the IEEE 10th International Conference on Data Mining (ICDM’10). 995--1000.Google Scholar
Digital Library
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI’09). 452--461.Google Scholar
Digital Library
- Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic matrix factorization. In Proceedings of the 20th International Conference on Neural Information Processing Systems (NIPS’07). 1257--1264.Google Scholar
Digital Library
- Martin Saveski and Amin Mantrach. 2014. Item cold-start recommendations: Learning local collective embeddings. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys’14). 89--96.Google Scholar
Digital Library
- Shaojung Sharon Wang, Yu-Ching Lin, and Ting-Peng Liang. 2018. Posts that attract millions of fans: The effect of brand-post congruence. Electr. Commerce Res. Appl. 28 (2018), 73--85. DOI: 10.1016/j.elerap.2017.12.010Google Scholar
Digital Library
- Yao Wu, Christopher DuBois, Alice X. Zheng, and Martin Ester. 2016. Collaborative denoising auto-encoders for Top-N recommender systems. In Proceedings of the 9th ACM International Conference on Web Search and Data Mining (WSDM’16). 153--162.Google Scholar
Digital Library
- Wenhui Yu, Huidi Zhang, Xiangnan He, Xu Chen, Li Xiong, and Zheng Qin. 2018. Aesthetic-based clothing recommendation. In Proceedings of the 2018 World Wide Web Conference (WWW’18). 649--658.Google Scholar
Digital Library
- Matthew D. Zeiler. 2012. ADADELTA: An adaptive learning rate method. CoRR abs/1212.5701 (2012).Google Scholar
- Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’16). 353--362.Google Scholar
Digital Library
- Hanwang Zhang, Zheng-Jun Zha, Yang Yang, Shuicheng Yan, Yue Gao, and Tat-Seng Chua. 2013. Attribute-augmented semantic hierarchy: Towards bridging semantic gap and intention gap in image retrieval. In Proceedings of the 21st ACM International Conference on Multimedia (MM’13). 33--42.Google Scholar
Digital Library
- Yin Zhang and James Caverlee. 2019. Instagrammers, fashionistas, and me: Recurrent fashion recommendation with implicit visual influence. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1583--1592.Google Scholar
Digital Library
Index Terms
Learning Visual Elements of Images for Discovery of Brand Posts
Recommendations
Multimodal Popularity Prediction of Brand-related Social Media Posts
MM '16: Proceedings of the 24th ACM international conference on MultimediaBrand-related user posts on social networks are growing at a staggering rate, where users express their opinions about brands by sharing multimodal posts. However, while some posts become popular, others are ignored. In this paper, we present an ...
Beyond the Product: Discovering Image Posts for Brands in Social Media
MM '18: Proceedings of the 26th ACM international conference on MultimediaBrands and organizations are using social networks such as Instagram to share image or video posts regularly, in order to engage and maximize their presence to the users. Differently from the traditional advertising paradigm, these posts feature not ...
Measuring Similarity between Brands using Followers' Post in Social Media
MMAsia '19: Proceedings of the ACM Multimedia AsiaIn this paper, we propose a new measure to estimate the similarity between brands via posts of brands' followers on social network services (SNS). Our method was developed with the intention of exploring the brands that customers are likely to jointly ...






Comments