Personalized, Sequential, Attentive, Metric-Aware Product Search

Abstract

The task of personalized product search aims at retrieving a ranked list of products given a user’s input query and his/her purchase history. To address this task, we propose the PSAM model, a Personalized, Sequential, Attentive and Metric-aware (PSAM) model, that learns the semantic representations of three different categories of entities, i.e., users, queries, and products, based on user sequential purchase historical data and the corresponding sequential queries. Specifically, a query-based attentive LSTM (QA-LSTM) model and an attention mechanism are designed to infer users dynamic embeddings, which is able to capture their short-term and long-term preferences. To obtain more fine-grained embeddings of the three categories of entities, a metric-aware objective is deployed in our model to force the inferred embeddings subject to the triangle inequality, which is a more realistic distance measurement for product search. Experiments conducted on four benchmark datasets show that our PSAM model significantly outperforms the state-of-the-art product search baselines in terms of effectiveness by up to 50.9% improvement under NDCG@20. Our visualization experiments further illustrate that the learned product embeddings are able to distinguish different types of products.

References

1. Qingyao Ai, Daniel N. Hill, S. V. N. Vishwanathan, and W. Bruce Croft. 2019. A zero attention model for personalized product search. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 379–388.
2. Qingyao Ai, Yongfeng Zhang, Keping Bi, Xu Chen, and W. Bruce Croft. 2017. Learning a hierarchical embedding model for personalized product search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 645–654.
3. Qingyao Ai, Yongfeng Zhang, Keping Bi, and W. Bruce Croft. 2019. Explainable product search with a dynamic relation embedding model. ACM Transactions on Information Systems.1–29.
4. Mohammad Aliannejadi and Fabio Crestani. 2018. Personalized context-aware point of interest recommendation. ACM Transactions on Information Systems 36, 4 (2018), 1–28.
5. Aurélien Bellet, Amaury Habrard, and Marc Sebban. 2013. A survey on metric learning for feature vectors and structured data. arXiv:1306.6709. Retrieved from https://arxiv.org/abs/1306.6709
6. Paul N. Bennett, Ryen W. White, Wei Chu, Susan T. Dumais, Peter Bailey, Fedor Borisyuk, and Xiaoyuan Cui. 2012. Modeling the impact of short-and long-term behavior on search personalization. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval. 185–194.
7. Keping Bi, Qingyao Ai, and W. Bruce Croft. 2020. A transformer-based embedding model for personalized product search. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1521–1524.
8. Xuxiao Bu, Jihua Zhu, and Xueming Qian. 2020. Personalized product search based on user transaction history and hypergraph learning. Multimedia Tools and Applications 79, 11 (2020), 22157–22175.
9. W. Bruce Croft, Donald Metzler, and Trevor Strohman. 2010. Search engines: Information Retrieval in Practice. Vol.  520. Addison-Wesley Reading.
10. Atish Das Sarma, Nish Parikh, and Neel Sundaresan. 2014. E-commerce product search: personalization, diversification, and beyond. In Proceedings of the 23rd International Conference on World Wide Web. 189–190.
11. Huizhong Duan and ChengXiang Zhai. 2015. Mining coordinated intent representation for entity search and recommendation. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management. 333–342.
12. Huizhong Duan, ChengXiang Zhai, Jinxing Cheng, and Abhishek Gattani. 2013. Supporting keyword search in product database: a probabilistic approach. Proceedings of the VLDB Endowment 6, 14 (2013), 1786–1797.
13. Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 249–256.
14. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the 27th International Conference on Advances in Neural Information Processing Systems. 2672–2680.
15. Anjan Goswami, Naren Chittar, and Chung H. Sung. 2011. A study on the impact of product images on user clicks for online shopping. In Proceedings of the 20th International Conference Companion on World Wide Web. 45–46.
16. Jiafeng Guo, Yixing Fan, Qingyao Ai, and W. Bruce Croft. 2016. A deep relevance matching model for ad-hoc retrieval. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management. 55–64.
17. Jiafeng Guo, Yixing Fan, Qingyao Ai, and W. Bruce Croft. 2016. Semantic matching by non-linear word transportation for information retrieval. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management. 701–710.
18. Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Yinglong Wang, Jun Ma, and Mohan Kankanhalli. 2019. Attentive long short-term preference modeling for personalized product search. ACM Transactions on Information Systems 37, 2 (2019), 1–27.
19. Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Xin-Shun Xu, and Mohan Kankanhalli. 2018. Multi-modal preference modeling for product search. In Proceedings of the 26th ACM international conference on Multimedia. 1865–1873.
20. Ruining He and Julian McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In proceedings of the 25th International Conference on World Wide Web. 507–517.
21. Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge Belongie, and Deborah Estrin. 2017. Collaborative metric learning. In Proceedings of the 26th International Conference on World Wide Web. 193–201.
22. Baotian Hu, Zhengdong Lu, Hang Li, and Qingcai Chen. 2014. Convolutional neural network architectures for matching natural language sentences. In Proceedings of the 27th International Conference on Advances in neural information processing systems. 2042–2050.
23. Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. 2013. Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management. 2333–2338.
24. Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems 20, 4 (2002), 422–446.
25. Shubhra Kanti Karmaker Santu, Parikshit Sondhi, and ChengXiang Zhai. 2017. On application of learning to rank for e-commerce search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 475–484.
26. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations.
27. Guy Lebanon. 2006. Metric learning for text documents. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 4 (2006), 497–508.
28. Omer Levy and Yoav Goldberg. 2014. Neural word embedding as implicit matrix factorization. In Proceedings of the 27th International Conference on Advances in Neural Information Processing Systems. 2177–2185.
29. Hang Li and Jun Xu. 2014. Semantic matching in search. Foundations and Trends in Information Retrieval 7, 5 (2014), 343–469.
30. Shangsong Liang. 2019. Collaborative, dynamic and diversified user profiling. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI, 4269–4276.
31. Shangsong Liang. 2019. Unsupervised semantic generative adversarial networks for expert retrieval. In Proceedings of the World Wide Web Conference. 1039–1050.
32. Shangsong Liang, Yupeng Luo, and Zaiqiao Meng. 2021. Profiling users for question answering communities via flow-based constrained co-embedding model. ACM Transactions on Information Systems (2021).
33. Shangsong Liang, Emine Yilmaz, and Evangelos Kanoulas. 2019. Collaboratively tracking interests for user clustering in streams of short texts. IEEE Transactions on Knowledge and Data Engineering 31, 2 (2019), 257–272.
34. Shangsong Liang, Xiangliang Zhang, Zhaochun Ren, and Evangelos Kanoulas. 2018. Dynamic embeddings for user profiling in twitter. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1764–1773.
35. Soon Chong Johnson Lim, Ying Liu, and Wing Bun Lee. 2010. Multi-facet product information search and retrieval using semantically annotated product family ontology. Information Processing and Management 46, 4 (2010), 479–493.
36. Xiao Lin, Min Zhang, Yiqun Liu, and Shaoping Ma. 2019. Enhancing personalized recommendation by implicit preference communities modeling. ACM Transactions on Information Systems 37, 4 (2019), 1–32.
37. Shang Liu, Wanli Gu, Gao Cong, and Fuzheng Zhang. 2020. Structural relationship representation learning with graph embedding for personalized product search. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management. 915–924.
38. Zhengdong Lu and Hang Li. 2013. A deep architecture for matching short texts. In Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems. 1367–1375.
39. Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 1412–1421.
40. Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 86 (2008), 2579–2605.
41. Alexandre Maros, Fabiano Belém, Rodrigo Silva, Sérgio Canuto, Jussara M. Almeida, and Marcos A. Gonçalves. 2019. Image aesthetics and its effects on product clicks in e-commerce search. In Proceedings of the SIGIR 2019 Workshop on eCommerce (2019).
42. Julian McAuley, Christopher Targett, Qinfeng Shi, and Anton Van Den Hengel. 2015. Image-based recommendations on styles and substitutes. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 43–52.
43. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems. 3111–3119.
44. Thanh V. Nguyen, Nikhil Rao, and Karthik Subbian. 2020. Learning robust models for e-commerce product search. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 6861–6869.
45. Lucia Noce, Ignazio Gallo, and Alessandro Zamberletti. 2016. Query and product suggestion for price comparison search engines based on query-product click-through bipartite graphs. In Proceedings of the International Conference on Web Information Systems and Technologies. 17–24.
46. Liang Pang, Yanyan Lan, Jiafeng Guo, Jun Xu, Shengxian Wan, and Xueqi Cheng. 2016. Text matching as image recognition. In Proceedings of the 13th AAAI Conference on Artificial Intelligence. 2793–2799.
47. Nish Parikh and Neel Sundaresan. 2011. Beyond relevance in marketplace search. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management. 2109–2112.
48. Nish Parikh and Neel Sundaresan. 2011. A user-tunable approach to marketplace search. In Proceedings of the 20th International Conference Companion on World Wide Web. 245–248.
49. Qi Qian, Rong Jin, Shenghuo Zhu, and Yuanqing Lin. 2015. Fine-grained visual categorization via multi-stage metric learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3716–3724.
50. Jennifer Rowley. 2000. Product search in e-shopping: a review and research propositions. Journal of Consumer Marketing 17, 1 (2000), 20–35.
51. Ruslan Salakhutdinov and Geoffrey Hinton. 2009. Semantic hashing. International Journal of Approximate Reasoning 50, 7 (2009), 969–978.
52. Aliaksei Severyn and Alessandro Moschitti. 2015. Learning to rank short text pairs with convolutional deep neural networks. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 373–382.
53. Yi Tay, Luu Anh Tuan, and Siu Cheung Hui. 2018. Latent relational metric learning via memory-based attention for collaborative ranking. In Proceedings of the 2018 World Wide Web Conference. 729–739.
54. Christophe Van Gysel, Maarten de Rijke, and Evangelos Kanoulas. 2016. Learning latent vector spaces for product search. In Proceedings of the 25th ACM International Conference on Information and Knowledge Management. 165–174.
55. Damir Vandic, Flavius Frasincar, and Uzay Kaymak. 2013. Facet selection algorithms for web product search. In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management. 2327–2332.
56. Liang Wu, Diane Hu, Liangjie Hong, and Huan Liu. 2018. Turning clicks into purchases: Revenue optimization for product search in e-commerce. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. 365–374.
57. Teng Xiao, Shangsong Liang, and Zaiqiao Meng. 2019. Hierarchical neural variational model for personalized sequential recommendation. In Proceedings of the World Wide Web Conference. 3377–3383.
58. Teng Xiao, Jiaxin Ren, Zaiqiao Meng, Huan Sun, and Shangsong Liang. 2019. Dynamic Bayesian metric learning for personalized product search. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1693–1702.
59. Eric P. Xing, Michael I. Jordan, Stuart J. Russell, and Andrew Y. Ng. 2003. Distance metric learning with application to clustering with side-information. In Proceedings of the International Conference on Advances in neural information processing systems. 521–528.
60. Chonghuan Xu. 2018. A novel recommendation method based on social network using matrix factorization technique. Information Processing and Management 54, 3 (2018), 463–474.
61. Liu Yang and Rong Jin. 2006. Distance metric learning: A comprehensive survey. Michigan State Universiy. Retrieved August 3, 2021 from http://www.cs.cmu.edu/liuy/frame_survey_v2.pdf.
62. Feng Yu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2016. A dynamic recurrent model for next basket recommendation. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 729–732.
63. Zeping Yu, Jianxun Lian, Ahmad Mahmoody, Gongshen Liu, and Xing Xie. 2019. Adaptive user modeling with long and short-term preferences for personalized recommendation. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 4213–4219.
64. Yuan Zhang, Dong Wang, and Yan Zhang. 2019. Neural IR meets graph embedding: A ranking model for product search. In The World Wide Web Conference. 2390–2400.

Index Terms

• Information systems

  • Information retrieval

    • Retrieval models and ranking