Abstract
Capturing the context of a user's query from the previous queries and clicks in the same session leads to a better understanding of the user's information need. A context-aware approach to document reranking, URL recommendation, and query suggestion may substantially improve users' search experience. In this article, we propose a general approach to context-aware search by learning a variable length hidden Markov model (vlHMM) from search sessions extracted from log data. While the mathematical model is powerful, the huge amounts of log data present great challenges. We develop several distributed learning techniques to learn a very large vlHMM under the map-reduce framework. Moreover, we construct feature vectors for each state of the vlHMM model to handle users' novel queries not covered by the training data. We test our approach on a raw dataset consisting of 1.9 billion queries, 2.9 billion clicks, and 1.2 billion search sessions before filtering, and evaluate the effectiveness of the vlHMM learned from the real data on three search applications: document reranking, query suggestion, and URL recommendation. The experiment results validate the effectiveness of vlHMM in the applications of document reranking, URL recommendation, and query suggestion.
- Anagnostopoulos, A., Becchetti, L., Castillo, C., and Gionis, A. 2010. An optimization framework for query recommendation. In Proceedings of the 3rd ACM International Conference on Web Search and Data Mining (WSDM'10). ACM, New York, NY, 161--170. Google Scholar
Digital Library
- Baeza-Yates, R. A. and Tiberiet, A. 2007. Extracting semantic relations from query logs. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'07). 76--85. Google Scholar
Digital Library
- Baeza-Yates, R. A., Hurtado, C., and Mendoza, M. 2004. Query recommendation using query logs in search engines. In Proceedings of the 9th International Conference on Extending Database Technology (EDBT'04) Workshop on Clustering Information over the Web. 588--596. Google Scholar
Digital Library
- Baum, L., Petrie, T., Soules, G., and Weiss, N. 1970. A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Statist. 41, 1, 164--171.Google Scholar
Cross Ref
- Beeferman, D. and Berger, A. 2000. Agglomerative clustering of a search engine query log. In Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'00). 407--416. Google Scholar
Digital Library
- Bilmes, J. 1998. A gentle tutorial of the EM algorithm and its application to parameter estimation for gaussian mixture and hidden markov models. Tech. rep. Intetrnational Computer Science Institute, Berkley, CA.Google Scholar
- Boldi, P., Bonchi, F., Castillo, C., Donato, D., and Vigna, S. 2009. Query suggestions using query-flow graphs. In Proceedings of the Workshop on Web Search Click Data (WSCD'09). 56--63. Google Scholar
Digital Library
- Boldi, P., Bonchi, F., Castillo, C., Donato, D., Gionis, A., and Vigna, S. 2008. The query-flow graph: Model and applications. In Proceeding of the 17th ACM Conference on Information and Knowledge Management (CIKM'08). 609--618. Google Scholar
Digital Library
- Borda, J. C. 1781. Mémoire sur les élections au scrution. Histoire de l'Académie Royal des Sciences.Google Scholar
- Cao, H., Jiang, D., Pei, J., Chen, E., and Li, H. 2009. Towards context-aware search by learning a very large variable length hidden Markov model from search logs. In Proceedings of the 18th International Conference on World Wide Web (WWW'09). 191--200. Google Scholar
Digital Library
- Cao, H., Jiang, D., Pei, J., He, Q., Liao, Z., Chen, E., and Li, H. 2008. Context-aware query suggestion by mining click-through and session data. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). Google Scholar
Digital Library
- Chapelle, O. and Zhang, Y. 2009. A dynamic bayesian network click model for Web search ranking. In Proceedings of the 18th International Conference on World Wide Web (WWW'09). 1--10. Google Scholar
Digital Library
- Chu, C.-T., Kim, S. K., Lin, Y.-A., Yn, Y., Bradski, G., Ng, A. Y., and Olukotun, K. 2006. Map-reduce for machine learning on multicore. In Proceedings of the 20th Annual Conference on Neural Information Processing Systems (NIPS'06). MIT Press, Combridge, MA, 281--288.Google Scholar
- Craswell, N. and Szummer, M. 2007. Random walks on the click graph. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'07). 239--246. Google Scholar
Digital Library
- Craswell, N., Zoeter, O., Taylor, M., and Ramsey, B. 2008. An experimental comparison of click position-bias models. In Proceedings of the 1st ACM International Conference on Web Search and Data Mining (WSDM'08). 87--94. Google Scholar
Digital Library
- Dean, J. and Ghemawat, S. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating System Design and Implementation (OSDI'04). USENIX Association, Berkeley, CA. Google Scholar
Digital Library
- Dempster, A. P., Laird, N. M., and Rubin, D. B. 1977. Maximal likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soci. Ser B, 39, 1--38.Google Scholar
- Deng, H., King, I., and Lyu, M. R. 2009. Entropy-biased models for query representation on the click graph. In Proceedings of the 32th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'09). 339--346. Google Scholar
Digital Library
- Donato, D., Bonchi, F., Chi, T., and Maarek, Y. 2010. Do you want to take notes?: Identifying research missions in Yahoo! search pad. In Proceedings of the 19th International Conference on World Wide Web (WWW'10). ACM, New York, NY, 321--330. Google Scholar
Digital Library
- Dupret, G. E. and Piwowarski, B. 2008. A user browsing model to predict search engine click data from past observations. In Proceedings of the 31st Annual ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR'08). 331--338. Google Scholar
Digital Library
- Durbin, R., Eddy, S. R., Krogh, A., and Mitchison, G. 1999. Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. Cambridge University Press, Cambridge, U.K.Google Scholar
- Ester, M., Kriegel, H., Sander, J., and Xu, X. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD). 226--231.Google Scholar
- Fagin, R., Kumar, R., and Sivakumar, D. 2003. Comparing top k lists. In Proceedings of the 14th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA'03). Society for Industrial and Applied Mathematics, Philadelphia, PA, 28--36. Google Scholar
Digital Library
- Fonseca, B. M., Golgher, P., Pôssas, B., Ribeiro-Neto, B., and Ziviani, N. 2005. Concept-based interactive query expansion. In Proceedings of the ACM CIKM International Conference on Information and Knowledge Management (CIKM'05). 696--703. Google Scholar
Digital Library
- Fox, S., Karnawat, K., Mydland, M., Dumais, S., and White, T. 2005. Evaluating implicit measures to improve Web search. ACM Trans. Inf. Syst. 23, 147--168. Google Scholar
Digital Library
- J.-Y. Gao, J., Yuan, W., Li, X., Deng, K., and Nie, J.-Y. Gao, J., Yuan, W., Li, X., Deng, K., and Nie, J.-Y. 2009. Smoothing clickthrough data for Web search ranking. In Proceedings of the 32th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'09). 355--362. Google Scholar
Digital Library
- Guo, F., Liu, C., and Wang, Y.-M. 2009. Efficient multiple-click models in Web search. In Proceedings of the 2nd ACM International Conference on Web Search and Data Mining (WSDM'09). 124--131. Google Scholar
Digital Library
- Hassan, A., Jones, R., and Klinkner, K.-L. 2010. Beyond DCG: User behavior as a predictor of a successful search (WSDM'10). ACM, New York, NY, 221--230. Google Scholar
Digital Library
- Huang, C., Chien, L., and Oyang, Y. 2003. Relevant term suggestion in interactive Web search based on contextual information in query session logs. J. Am. Soc. Inf. Sci. Technol. 54, 7, 638--649. Google Scholar
Digital Library
- Frider, O. Jensen, E.C, Beitzel, S., Chowdhury, A., Frider, O. Jensen, E. C, Beitzel, S., Chowdhury, A., and Frider, O. 2006. Query phrase suggestion from topically tagged session logs. In Proceedings of the 7th International Conference on Flexible Query Answering Systems (FQAS'06). Lecture Notes in Computer Science, vol. 4027, Springer, Berlin Heidelberg, 185--196. Google Scholar
Digital Library
- Joachims, T. 2002. Optimizing search engines using clickthrough data. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'02). ACM, New York, NY. Google Scholar
Digital Library
- Joachims, T., Granka, L., Pan, B., Hembrooke, H., and Gay, G. 2005. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'05). 154--161. Google Scholar
Digital Library
- Jones, R. and Klinkner, K. L. 2008. Beyond the session timeout: Automatic hierarchical segmentation of search topics in query logs. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (CIKM'08). ACM, New York, NY, 699--708. Google Scholar
Digital Library
- Jones, R., Rey, B., Madani, O., and Greiner, W. 2006. Generating query substitutions. In Proceedings of the 15th International Conference on World Wide Web (WWW'06). ACM, New York, NY, 387--396. Google Scholar
Digital Library
- Kotov, A., Bennett, P., White, R., Dumais, S., and Teevan, J. 2005. Modeling and analysis of cross-session search tasks. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'05).Google Scholar
- Liao, Z., Jiang, D., Chen, E., Pei, J., Cao, H., and Li, H. 2011. Mining concept sequences from large-scale search logs for context-aware query suggestion. ACM Trans. Intell. Syst. Technol. 3, 17:1--17:40. Google Scholar
Digital Library
- Liao, Z., Song, Y., He, L.-W., and Huang, Y. 2012. Evaluating the effectiveness of search task trails. In Proceedings of the 21st International Conference on World Wide Web (WWW'12). ACM, New York, NY, 489--498. Google Scholar
Digital Library
- Lucchese, C., Orlando, S., Perego, R., Silvestri, F., and Tolomei, G. 2011. Identifying task-based sessions in search engine query logs. In Proceedings of the 4th ACM International Conference on Web Search and Data Mining (WSDM'11). ACM, New York, NY, 277--286. Google Scholar
Digital Library
- Mei, Q., Klinkner, K., Kumar, R., and Tomkins, A. 2009. An analysis framework for search sequences. In Proceeding of the 18th ACM Conference on Information and Knowledge Management (CIKM'09). 1991--1996. Google Scholar
Digital Library
- Mei, Q., Zhou, D., and Church, K. 2008. Query suggestion using hitting time. In Proceeding of the 17th ACM Conference on Information and Knowledge Management (CIKM'08). 469--478. Google Scholar
Digital Library
- Rabiner, L. R. 1989. A tutorial on hidden Markov models and selected applications inspeech recognition. Proc. IEEE 77, 2, 257--286.Google Scholar
Cross Ref
- Radlinski, F. and Joachims, T. 2005. Query chains: Learning to rank from implicit feedback. In Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'05). ACM, New York, NY. Google Scholar
Digital Library
- Sadikov, E., Madhavan, J., Wang, L., and Halevy, A. 2010. Clustering query refinements by user intent. In Proceedings of the International Conference on World Wide Web (WWW'10). 841--850. Google Scholar
Digital Library
- Shen, X., Tan, B., and Zhai, C.-X. 2005. Context-sensitive information retrieval using implicit feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'05). ACM, New York, NY, 43--50. Google Scholar
Digital Library
- Tong, H., Faloutsos, C., and Pan, J.-Y. 2006. Fast random walk with restart and its applications. In Proceedings of the 6th International Conference on Data Mining (ICDM'06). IEEE Computer Society, Washington, DC, 613--622. Google Scholar
Digital Library
- Wang, Y., Zhou, L., Feng, J., Wang, J., and Lin, Z.-Q. 2006. Mining complex time-series data by learning Markovian models. In Proceedings of the 6th International Conference on Data Mining (ICDM'06). IEEE Computer Society, Washington, DC, 1136--1140. Google Scholar
Digital Library
- Wen, J., Nie, J., and Zhang, H. 2001. Clustering user queries of a search engine. In Proceedings of the 10th International Conference on World Wide Web (WWW'01). 162--168. Google Scholar
Digital Library
- White, R. W., Bailey, P., and Chen, L. 2009. Predicting user interests from contextual information. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'09). 363--370. Google Scholar
Digital Library
- White, R. W., Bennett, P. N., and Dumais, S. T. 2010. Predicting short-term interests using activity-based search context. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM'10). 1009--1018. Google Scholar
Digital Library
- White, R. W., Bilenko, M., and Cucerzan, S. 2007. Studying the use of popular destinations to enhance Web search interaction. In Proceedings of the 30th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'07). 159--166. Google Scholar
Digital Library
- Xiang, B., Jiang, D., Pei, J., Sun, X., Chen, E., and Li, H. 2010. Context-aware ranking in Web search. In Proceedings of the 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'10). ACM, 451--458. Google Scholar
Digital Library
- Zhao, M., Li, H., Ratnaparkhi, A., Hon, H.-W., and Wang, J. 2006. Adapting document ranking to users preferences using click-through data. In Proceedings of the Asia Information Retrieval Symposium (AIRS'06). 26--42. Google Scholar
Digital Library
Index Terms
A vlHMM approach to context-aware search
Recommendations
Context-aware ranking in web search
SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrievalThe context of a search query often provides a search engine meaningful hints for answering the current query better. Previous studies on context-aware search were either focused on the development of context models or limited to a relatively small ...
Towards context-aware search by learning a very large variable length hidden markov model from search logs
WWW '09: Proceedings of the 18th international conference on World wide webCapturing the context of a user's query from the previous queries and clicks in the same session may help understand the user's information need. A context-aware approach to document re-ranking, query suggestion, and URL recommendation may improve users'...
Towards context-aware search with right click
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrievalMany queries are submitted to search engines by right-clicking the marked text (i.e., the query) in Web browsers. Because the document being read by the searcher often provides sufficient contextual information for the query, search engine could provide ...






Comments