Personalized web exploration with task models

ABSTRACT

Personalized Web search has emerged as one of the hottest topics for both the Web industry and academic researchers. However, the majority of studies on personalized search focused on a rather simple type of search, which leaves an important research topic - the personalization in exploratory searches - as an under-studied area. In this paper, we present a study of personalization in task-based information exploration using a system called TaskSieve. TaskSieve is a Web search system that utilizes a relevance feedback based profile, called a "task model", for personalization. Its innovations include flexible and user controlled integration of queries and task models, task-infused text snippet generation, and on-screen visualization of task models. Through an empirical study using human subjects conducting task-based exploration searches, we demonstrate that TaskSieve pushes significantly more relevant documents to the top of search result lists as compared to a traditional search system. TaskSieve helps users select significantly more accurate information for their tasks, allows the users to do so with higher productivity, and is viewed more favorably by subjects under several usability related characteristics.

References

1. Ahn, J.-w., Brusilovsky, P., Grady, J., He, D., Syn, S. Y. Open user profiles for adaptive news systems: help or harm? in Proceedings of the 16th international conference on World Wide Web, WWW '07 (Banff, Canada), ACM 11--20.
2. Allan, J. HARD Track Overview in TREC 2003 High Accuracy Retrieval from Documents in Proceedings of The Twelfth Text Retrieval Conference.
3. Chen, L., Sycara, K. WebMate: A personal agent for browsing and searching in Proceedings of 2nd International Conference on Autonomous Agents (Agents'98) (St. Paul, MN), ACM Press 132--139.
4. Claypool, M., Le, P., Wased, M., Brown, D. Implicit interest indicators in Proceedings of 6th International Conference on Intelligent User Interfaces (Santa Fe, NM, January 14--17, 2002), ACM Press 33--40.
5. Díaz, A., Gervás, P. Personalisation in news delivery systems: Item summarization and multi-tier item selection using relevance feedback, Web Intelligence and Agent Systems (2005) 3, 3, 135--154.
6. Dorr, B., Zajic, D., Schwartz, R. Cross Language Headline Generation for Hindi, This volume (2003).
7. Fox, S., Karnawat, K., Mydland, M., Dumais, S., White, T. Evaluating implicit measures to improve web search, ACM Transactions on Information Systems (2005) 23, 2, 147--168.
8. Gauch, S., Speretta, M., Chandramouli, A., Micarelli, A. User profiles for personalized information access, In: Brusilovsky, P., Kobsa, A., and Neidl, W., Eds. The Adaptive Web: Methods and Strategies of Web Personalization. Springer-Verlag, Berlin Heidelberg New York, 2007, 54--89.
9. Harman, D. K. Relevance feedback revisited in Proceedings of Proceedings of ACM-SIGIR 92.
10. He, D., Brusilovsky, P., Grady, J., Li, Q., Ahn, J.-w. How Up-to-date should it be? The Value of Instant Profiling and Adaptation in Information Filtering in Proceedings of the 2007 international conference on Web Intelligence, WI '07 (Silicon Valey, CA, USA), IEEE in press.
11. He, D. et al. An Evaluation of Adaptive Filtering in the Context of Realistic Task-Based Information Exploration, Information Processing and Management (2007).
12. He, D. et al. Making MIRACLEs: Interactive Translingual Search for Cebuano and Hindi, ACM Transactions on Asian Lnaguage Information Processing (2003) 2, 3, 219--244.
13. He, D., Wang, J., Luo, J., Oard, D.W. iCLEF 2004 at Maryland: Summarization Design for Interactive Cross-Language Question Answering in Proceedings of The Proceeding of Cross-Language Evaluation Forum (CLEF 2004).
14. Houseman, E. M., Kaskela, D. E. State of the art of selective dissemination of information, IEEE Transactions on Engineering Writing and Speech (1970) 13, 2, 78--83.
15. Jung, S., Harris, K., Webster, J., Herlocker, J. L. SERF: Iintegrating human recommendations with search in Proceedings of ACM 13th Conference on Information and Knowledge Management, CIKM 2004 (Washington, DC, November 8--13, 2004 571--580.
16. Kantor, P.B., Boros, E., Melamed, B., Meñkov, V., Shapira, B., Neu, D. J. Capturing human intelligence in the net, Communications of the ACM (2000) 43, 8, 112--116.
17. Kelly, D., Teevan, J. Implicit feedback for inferring user preference: a bibliography, SIGIR Forum (2003) 37, 2, 18--28.
18. Koenemann, J., Belkin, N. J. A case for Interaction: A Study of Interactive Information Retrieval Behavior and Effectiveness in Proceedings of Proceedings of CHI '96 (New York 205--212.
19. Korfhage, R. R. 1997 Information storage and retrieval. Wiley Computer Publishing, N.Y.
20. Marchionini, G. Exploratory search: From finding to understanding, Communications of the ACM (2006) 49, 4, 41--46.
21. Micarelli, A., Gasparetti, F., Sciarrone, F., Gauch, S. Personalized search on the World Wide Web, In: Brusilovsky, P., Kobsa, A., and Neidl, W., Eds. The Adaptive Web: Methods and Strategies of Web Personalization. Springer-Verlag, Berlin Heidelberg New York, 2007, 195--230.
22. Pazzani, M. J., Billsus, D. Content-based recommendation systems, In: Brusilovsky, P., Kobsa, A., and Neidl, W., Eds. The Adaptive Web: Methods and Strategies of Web Personalization. Springer-Verlag, Berlin Heidelberg New York, 2007, 325--341.
23. Robertson, S., Walker, S., and Hancock-Beaulieu, M. Okapi at TREC-7: automatic ad hoc, filtering, VLC and Interactive track. In Proceedings of the Seventh Text REtrieval Conference. Gaithersburg, USA, November 1998.
24. Rocchio Jr, J. J. Relevance feedback in information retrieval, In: Salton, G., Ed. The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall, Englewood Cliffs, NJ, USA, 1971, 313--323.
25. Ruthven, I., Lalmas, M. A survey on the use of relevance feedback for informaton access systems, The Knowledge Engineering Review (2003) 18, 2, 95--145.
26. Salojärvi, J., Puolamäki, K., Kaski, S. Implicit Relevance Feedback from Eye Movements in Proceedings of 15th International Conference on Artificial Neural Networks, ICANN 2005 (Warsaw, Poland, September 11--15, 2005), Springer-Verlag 513--518.
27. Waern, A. User involvement in automatic filtering - an experimental study, User Modeling and User Adapted Interaction (2004) 14, 201--237.

Index Terms

• Information systems

  • Information retrieval

    • Document representation

    • Evaluation of retrieval results

      • Relevance assessment

    • Retrieval tasks and goals

      • Document filtering

      • Information extraction

    • Search engine architectures and scalability

      • Search engine indexing

  • World Wide Web

    • Web applications

    • Web services