skip to main content
research-article

Factorizing Historical User Actions for Next-Day Purchase Prediction

Published:28 September 2021Publication History
Skip Abstract Section

Abstract

It is common practice for many large e-commerce operators to analyze daily logged transaction data to predict customer purchase behavior, which may potentially lead to more effective recommendations and increased sales. Traditional recommendation techniques based on collaborative filtering, although having gained success in video and music recommendation, are not sufficient to fully leverage the diverse information contained in the implicit user behavior on e-commerce platforms. In this article, we analyze user action records in the Alibaba Mobile Recommendation dataset from the Alibaba Tianchi Data Lab, as well as the Retailrocket recommender system dataset from the Retail Rocket website. To estimate the probability that a user will purchase a certain item tomorrow, we propose a new model called Time-decayed Multifaceted Factorizing Personalized Markov Chains (Time-decayed Multifaceted-FPMC), taking into account multiple types of user historical actions not only limited to past purchases but also including various behaviors such as clicks, collects and add-to-carts. Our model also considers the time-decay effect of the influence of past actions. To learn the parameters in the proposed model, we further propose a unified framework named Bayesian Sparse Factorization Machines. It generalizes the theory of traditional Factorization Machines to a more flexible learning structure and trains the Time-decayed Multifaceted-FPMC with the Markov Chain Monte Carlo method. Extensive evaluations based on multiple real-world datasets demonstrate that our proposed approaches significantly outperform various existing purchase recommendation algorithms.

References

  1. Alibaba. 2015. Ali-Mobile-Rec. Retrieved from http://tianchi.aliyun.com/datalab/dataSet.htm?id=4.Google ScholarGoogle Scholar
  2. Jeff Alstott, Ed Bullmore, and Dietmar Plenz. 2014. Powerlaw: A python package for analysis of heavy-tailed distributions. PloS one 9, 1 (2014), e85777.Google ScholarGoogle ScholarCross RefCross Ref
  3. Christophe Andrieu, Nando De Freitas, Arnaud Doucet, and Michael I. Jordan. 2003. An introduction to MCMC for machine learning. Mach. Learn. 50, 1-2 (2003), 5–43.Google ScholarGoogle ScholarCross RefCross Ref
  4. Immanuel Bayer and Steffen Rendle. 2013. Factor models for recommending given names. In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD’13) Discovery Challenge, 81.Google ScholarGoogle Scholar
  5. Wei Chen, Wynne Hsu, and Mong Li Lee. 2013. Modeling user’s receptiveness over time for recommendation. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 373–382. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, 39–46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jesse Davis and Mark Goadrich. 2006. The relationship between precision-recall and ROC curves. In Proceedings of the 23rd International Conference on Machine Learning. ACM, 233–240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Christoph Freudenthaler, Lars Schmidt-Thieme, and Steffen Rendle. 2011. Bayesian factorization machines. https://www.ismll.uni-hildesheim.de/pub/index.html.Google ScholarGoogle Scholar
  9. Andrew Gelman, John B. Carlin, Hal S. Stern, and Donald B. Rubin. 2014. Bayesian Data Analysis. Vol. 2. Taylor & Francis.Google ScholarGoogle Scholar
  10. Wanrong Gu, Shoubin Dong, and Zhizhao Zeng. 2014. Increasing recommended effectiveness with markov chains and purchase intervals. Neural Comput. Appl. 25, 5 (2014), 1153–1162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ruining He, Wang-Cheng Kang, and Julian McAuley. 2017. Translation-based recommendation. In Proceedings of the 11th ACM Conference on Recommender Systems. 161–169. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv:1511.06939. Retrieved from https://arxiv.org/abs/1511.06939.Google ScholarGoogle Scholar
  13. Thomas Hofmann. 2004. Latent semantic models for collaborative filtering. ACM Trans. Inf. Syst. 22, 1 (2004), 89–115. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 8th IEEE International Conference on Data Mining. IEEE, 263–272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Yong-Deok Kim and Seungjin Choi. 2007. Nonnegative tucker decomposition. In Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1–8.Google ScholarGoogle ScholarCross RefCross Ref
  16. Yehuda Koren. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 426–434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Yehuda Koren. 2010. Collaborative filtering with temporal dynamics. Commun. ACM 53, 4 (2010), 89–97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Neal Lathia, Stephen Hailes, Licia Capra, and Xavier Amatriain. 2010. Temporal diversity in recommender systems. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 210–217. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Beibei Li, Anindya Ghose, and Panagiotis G. Ipeirotis. 2011. Towards a theory model for product search. In Proceedings of the 20th International Conference on World Wide Web. ACM, 327–336. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Qiang Li, Maojie Gu, Keren Zhou, and Xiaoming Sun. 2015. Multi-classes feature engineering with sliding window for purchase prediction in mobile commerce. In Proceedings of the 2015 IEEE International Conference on Data Mining Workshop (ICDMW’15). IEEE, 1048–1054. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Greg Linden, Brent Smith, and Jeremy York. 2003. Amazon. com recommendations: Item-to-item collaborative filtering. IEEE Internet Comput. 7, 1 (2003), 76–80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Bamshad Mobasher, Honghua Dai, Tao Luo, and Miki Nakagawa. 2002. Using sequential and non-sequential patterns in predictive web usage mining tasks. In Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM’03). IEEE, 669–672. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Arkadiusz Paterek. 2007. Improving regularized singular value decomposition for collaborative filtering. In Proceedings of KDD Cup and Workshop, Vol. 2007. 5–8.Google ScholarGoogle Scholar
  25. Michael J. Pazzani and Daniel Billsus. 2007. Content-based recommendation systems. In The Adaptive Web. Springer, 325–341. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. L. Xiong, X. Chen, T. K. Huang, J. Schneider, and J. G. Carbonell. 2010. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In Proceedings of the 2010 SIAM International Conference on Data Mining. 211–222. Society for Industrial and Applied Mathematics.Google ScholarGoogle Scholar
  27. Jiangtao Qiu, Zhangxi Lin, and Yinghong Li. 2015. Predicting customer purchase behavior in the e-commerce context. Electr. Commerce Res. 15, 4 (2015), 427–452. https://doi.org/10.1007/s10660-015-9191-6 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Steffen Rendle. 2010. Factorization machines. In Proceedings of the 2010 IEEE 10th International Conference on Data Mining (ICDM’10). IEEE, 995–1000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Steffen Rendle. 2012. Factorization machines with libfm. ACM Trans. Intell. Syst. Technol. 3, 3 (2012), 57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452–461. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web. ACM, 811–820. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Steffen Rendle and Lars Schmidt-Thieme. 2010. Pairwise interaction tensor factorization for personalized tag recommendation. In Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. ACM, 81–90. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Christian P. Robert. 1995. Simulation of truncated normal variables. Stat. Comput. 5, 2 (1995), 121–125.Google ScholarGoogle ScholarCross RefCross Ref
  34. Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. ACM, 285–295. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Guy Shani, Ronen I. Brafman, and David Heckerman. 2002. An MDP-based recommender system. In Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann Publishers Inc., 453–460. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Erez Shmueli, Amit Kagian, Yehuda Koren, and Ronny Lempel. 2012. Care to comment?: Recommendations for commenting on news stories. In Proceedings of the 21st International Conference on World Wide Web. ACM, 429–438. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Nathan Srebro, Jason Rennie, and Tommi S. Jaakkola. 2004. Maximum-margin matrix factorization. In Advances in Neural Information Processing Systems. 1329–1336. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jian Wang and Yi Zhang. 2011. Utilizing marginal net utility for recommendation in e-commerce. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1003–1012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Jian Wang and Yi Zhang. 2013. Opportunity model for e-commerce recommendation: Right product; right time. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 303–312. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Tim Westergren. 2007. The Music Genome Project. Retrieved from http://pandora.com/mgp.Google ScholarGoogle Scholar
  41. Liang Xiang, Quan Yuan, Shiwan Zhao, Li Chen, Xiatian Zhang, Qing Yang, and Jimeng Sun. 2010. Temporal recommendation on graphs via long-and short-term preference fusion. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 723–732. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Jingyuan Yang, Chuanren Liu, Mingfei Teng, Hui Xiong, March Liao, and Vivian Zhu. 2015. Exploiting temporal and social factors for B2B marketing campaign recommendations. In 2015 IEEE International Conference on Data Mining (ICDM’15). IEEE, 499–508. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Ghim-Eng Yap, Xiao-Li Li, and S Yu Philip. 2012. Effective next-items recommendation via personalized sequential pattern mining. In Proceedings of the International Conference on Database Systems for Advanced Applications. Springer, 48–64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Gang Zhao, Mong Li Lee, Wynne Hsu, and Wei Chen. 2012. Increasing temporal diversity with purchase intervals. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 165–174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Gang Zhao, Mong LI Lee, and Hsu Wynne. 2014. Utilizing purchase intervals in latent clusters for product recommendation. In Proceedings of the 8th Workshop on Social Network Mining and Analysis. ACM, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Andrew Zimdars, David Maxwell Chickering, and Christopher Meek. 2001. Using temporal data for making recommendations. In Proceedings of the 17th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann, 580–588. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Factorizing Historical User Actions for Next-Day Purchase Prediction

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!