Web search from a bus

ABSTRACT

Opportunistic connections to the Internet from open wireless access points is now commonly possible in urban areas. Vehicular networks can opportunistically connect to the Internet for several seconds via open access points. In this paper, we adapt the interactive process of web search and retrieval to vehicular networks with intermittent Internet access. Our system, called Thedu, has mobile nodes use an Internet proxy to collect search engine results and prefetch result pages. The mobile nodes download the pre-fetched web pages from the proxy. Our contribution is a novel set of techniques to make aggressive but selective prefetching practical, resulting in a significantly greater number of relevant web results returned to mobile users. In particular, we prioritize responses in the order of the usefulness of the response to the query, that allows the mobile node to download the most useful response first. To evaluate our scheme, we deployed Thedu on DieselNet, our vehicular testbed operating in a micro-urban area around Amherst, MA. Using a simulated workload, we find that users can expect four times as many useful responses to web search queries compared to not using Thedu's mechanisms. Moreover, the mean latency in receiving the first relevant response for a query is 2.7 minutes for our deployment; we expect Thedu to have even better performance in larger cities that have densely populated open APs.

References

1. Text retrieval conference (trec). http://trec.nist.gov/.
2. A. Broder. A taxonomy of web search. SIGIR Forum, 36(2):3--10, 2002.
3. J. Burgess, B. Gallagher, D. Jensen, and B. N. Levine. MaxProp: Routing for Vehicle-Based Disruption-Tolerant Networks. In Proc. IEEE INFOCOM, April 2006.
4. D. J. Goodman, J. Borras, N. B. Mandayam, and R. D. Yates. INFOSTATIONS: a new system for data and messaging services. In Proc. IEEE VTC, pages 969--973, 1997.
5. K. M. Hanna, B. N. Levine, and R. Manmatha. Mobile Distributed Information Retrieval For Highly Partitioned Networks. In Proc. IEEE Intl. Conference on Network Protocols (ICNP), pages 38--47, Nov 2003.
6. B. Hull, V. Bychkovsky, Y. Zhang, K. Chen, M. Goraczko, A. Miu, E. Shih, H. Balakrishnan, and S. Madden. Cartel: a distributed mobile sensor computing system. In Proc. ACM SenSys, pages 125--138, 2006.
7. S. Jain, K. Fall, and R. Patra. Routing in a delay tolerant network. In ACM SIGCOMM, pages 145--158, 2004.
8. B. Jansen, A. Spink, and T. Saracevic. Real life, real users, and real needs: a study and analysis of user queries on the web. Information Processing and Management, 36(2):207--227, 2000.
9. A. Lindgren, A. Doria, and O. Schelén. Probabilistic routing in intermittently connected networks. In Proc. SAPIR Workshop, 2004.
10. J. Lu and J. Callan. Content--based retrieval in hybrid peer-to-peer networks. In CIKM '03: Proceedings of the twelfth international conference on Information and knowledge management, pages 199--206, New York, NY, USA, 2003. ACM Press.
11. R. Manmatha, T. Rath, and F. Feng. Modeling score distributions for combining the outputs of search engines. In Proc. ACM SIGIR, pages 267--275, 2001.
12. J. Ott and D. Kutscher. Drive-Thru Internet: IEEE 802.11b for "Automobile" Users. In Proc. IEEE INFOCOM, 2004.
13. J. Ott and D. Kutscher. Bundling the Web: HTTP over DTN. In Workshop on Networking in Public Transport, August 2006.
14. A. Pentland, R. Fletcher, and A. Hasson. Daknet: rethinking connectivity in developing nations. Computer, 37(1):78--83, 2004.
15. S. E. Robertson. The probability ranking principle in IR. pages 281--286, 1997.
16. A. Seth, D. Kroeker, M. Zaharia, S. Guo, and S. Keshav. Low-cost communication for rural internet kiosks using mechanical backhaul. In Proc. ACM MobiCom, pages 334--345, 2006.
17. F. Song and W. B. Croft. A general language model for information retrieval. In Proc. ACM SIGIR 1999, pages 279--280, 1999.
18. T. Spyropoulos, K. Psounis, and C. S. Raghavendra. Spray and wait: an efficient routing scheme for intermittently connected mobile networks. In ACM WDTN, pages 252--259, 2005.
19. T. Strohman, D. Metzler, H. Turtle, and W. B. Croft. Indri: A language modelbased search engine for complex queries. In Proc. Intl. Conf. on Intelligence Analysis, 2005.
20. W. H. Yuen, R. D. Yates, and S.-C. Mau. Exploiting Data Diversity and Multiuser Diversity in Mobile Infostation Networks. In Proc. IEEE INFOCOM, April 2003.
21. X. Zhang, J. Kurose, B. N. Levine, D. Towsley, and H. Zhang. Study of a Bus-Based Disruption Tolerant Network: Mobility Modeling and Impact on Routing. In Proc. ACM Annual Intl. Conf. on Mobile Computing and Networking (Mobicom), September 2007.
22. Y. Zhou, B. N. Levine, and W. B. Croft. Distributed Information Retrieval For Disruption-Tolerant Mobile Networks. CIIR Technical Report IR-412, University of Massachusetts Amherst, http://maroo.cs.umass.edu/pub/web/getpdf.php?id=556, 2005.

Index Terms

• Networks

  • Network types

    • Mobile networks

    • Wireless access networks