skip to main content
article

The comparative effectiveness of sponsored and nonsponsored links for Web e-commerce queries

Published:01 May 2007Publication History
Skip Abstract Section

Abstract

The predominant business model for Web search engines is sponsored search, which generates billions in yearly revenue. But are sponsored links providing online consumers with relevant choices for products and services? We address this and related issues by investigating the relevance of sponsored and nonsponsored links for e-commerce queries on the major search engines. The results show that average relevance ratings for sponsored and nonsponsored links are practically the same, although the relevance ratings for sponsored links are statistically higher. We used 108 ecommerce queries and 8,256 retrieved links for these queries from three major Web search engines: Yahoo!, Google, and MSN. In addition to relevance measures, we qualitatively analyzed the e-commerce queries, deriving five categorizations of underlying information needs. Product-specific queries are the most prevalent (48%). Title (62%) and summary (33%) are the primary basis for evaluating sponsored links with URL a distant third (2%). To gauge the effectiveness of sponsored search campaigns, we analyzed the sponsored links from various viewpoints. It appears that links from organizations with large sponsored search campaigns are more relevant than the average sponsored link. We discuss the implications for Web search engines and sponsored search as a long-term business model and as a mechanism for finding relevant information for searchers.

References

  1. Bellman, S., Lohse, G. L., and Johnson, E. J. 1999. Predictors of online buying behavior. Comm. ACM. 42, 32--38. Google ScholarGoogle Scholar
  2. Brooks, N. 2004a. How search engine rank impacts traffic. The Atlas Rank Report i (Aug.).Google ScholarGoogle Scholar
  3. Brooks, N. 2004b. How search engine rank impacts conversions. The Atlas Rank Report ii (Jan.).Google ScholarGoogle Scholar
  4. Brooks, N. 2006. Repeat search behavior: Implications for advertisers. Bull. Amer. Soc. Inform. Scien. Technol. 32, 16--17.Google ScholarGoogle Scholar
  5. Cole, J. I., Suman, M., Schramm, P., Lunn, R., and Aquino, J. S. 2003. Surveying the digital future year three. The Ucla Internet Report (Feb.).Google ScholarGoogle Scholar
  6. Cronbach, L. J. 1951. Coefficient alpha and the internal structure of tests. Psychometrika. 16, 297--334.Google ScholarGoogle Scholar
  7. Dai, H. K., Nie, Z., Wang, L., Zhao, L., Wen, J.-R., and Li, Y. 2006. Detecting online commercial intention (oci). In Proceedings of World Wide Web Conference (WWW'06). Edinburgh, Scotland. 829--837. Google ScholarGoogle Scholar
  8. Fain, D. C. and Pedersen, J. O. 2006. Sponsored search: A brief history. Bull. Amer. Soc. Inform. Sci. Tech. 32, 12--13.Google ScholarGoogle Scholar
  9. Huang, X. and Soergel, D. 2004. Relevance judges' understanding of topical relevance types: An explication of an enriched concept of topical relevance. In Proceedings of 67th Annual Meeting of the American Society for Information Science and Technology (ASIS&T04). Providence, RI, 13--18.Google ScholarGoogle Scholar
  10. Introna, L. and Nissenbaum, H. 2000. Defining the Web: The politics of search engines. IEEE Comput. 33, 54--62. Google ScholarGoogle Scholar
  11. Jansen, B. J. 2006a. Paid search as an information seeking paradigm. Bull. Amer. Soc. Inform. Sci. Technol. 32, 7--8.Google ScholarGoogle Scholar
  12. Jansen, B. J. 2006b. Paid search. IEEE Comput. 39, 88--90. Google ScholarGoogle Scholar
  13. Jansen, B. J. 2006c. Adversarial information retrieval aspects of sponsored search. 2nd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb06). The 29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR06).Google ScholarGoogle Scholar
  14. Jansen, B. J., Koshman, S., and Spink, A. 2005a. An analysis of repeat users of vivisimo.Com. In Proceedings of the American Society for Information Science & Technology Annual Meeting. Charlotte, NC, 1--6.Google ScholarGoogle Scholar
  15. Jansen, B. J. and McNeese, M. D. 2005. Evaluating the effectiveness of and patterns of interactions with automated searching assistance. J. Amer. Soc. Inform. Sci. Tech. 56, 1480--1503. Google ScholarGoogle Scholar
  16. Jansen, B. J. and Molina, P. 2006. The effectiveness of web search engines for retrieving relevant ecommerce links. Inform. Process. Manage. 42, 1075--1098. Google ScholarGoogle Scholar
  17. Jansen, B. J. and Resnick, M. 2006. An examination of searchers' perceptions of non-sponsored and sponsored links during ecommerce Web searching. J. Amer. Soc. Inform. Sci. Technol. 57, 1949--1961. Google ScholarGoogle Scholar
  18. Jansen, B. J. and Spink, A. 2003. An analysis of Web information seeking and use: Documents retrieved versus documents viewed. In Proceedings of 4th International Conference on Internet Computing. Las Vegas, NV. 65--69.Google ScholarGoogle Scholar
  19. Jansen, B. J. and Spink, A. 2005. How are we searching the World Wide Web? A comparison of nine search engine transaction logs. Infor. Process. Manage. 42, 248--263. Google ScholarGoogle Scholar
  20. Jansen, B. J., Spink, A., and Pederson, J. 2005b. Trend analysis of altavista Web searching. J. Amer. Soc. Inform. Sci. Technol. 56, 559--570. Google ScholarGoogle Scholar
  21. Jansen, B. J., Spink, A., and Saracevic, T. 2000. Real life, real users, and real needs: A study and analysis of user queries on the Web. Inform. Process. Manag. 36, 207--227. Google ScholarGoogle Scholar
  22. Marable, L. 2003. False oracles: Consumer reaction to learning the truth about how search engines work, results of an ethnographic study. Consumer Webwatch Research, 1--66.Google ScholarGoogle Scholar
  23. Nicholson, S., Sierra, T., Eseryel, U. Y., Park, J.-H., Barkow, P., Pozo, E. J., and Ward, J. 2006. How much of it is real? Analysis of paid placement in Web search engine results. J. Amer. Soc. Inform. Scien. Technol. 57, 448--461. Google ScholarGoogle Scholar
  24. Patton, M. Q. 1990. Qualitative Evaluation and Research Methods. Sage Publications, Inc., Newbury Park, CA.Google ScholarGoogle Scholar
  25. Selberg, E., and Etzioni, O. 2000. On the instability of Web search services. In Proceedings of RIAO 2000: Computer-Assisted Information retrieval. Paris, France.Google ScholarGoogle Scholar
  26. Silverstein, C., Henzinger, M., Marais, H., and Moricz, M. 1999. Analysis of a very large Web search engine query log. SIGIR Forum. 33, 6--12. Google ScholarGoogle Scholar
  27. Spiteri, L. F. 2000. Access to electronic commerce sites on the World Wide Web: An analysis of the effectiveness of six Internet search engines. J. Inform. Scien. 26, 173--183.Google ScholarGoogle Scholar
  28. Sullivan, D. 2003. Nielsen/netratings search engine ratings. (Oct.)Google ScholarGoogle Scholar
  29. Turban, E., King, D., Lee, J., and Viehland, D. 2004. Electronic Commerce: A Managerial Perspective. Pearson-Prentice Hall, Upper Saddle River, NJ. Google ScholarGoogle Scholar
  30. Vaughan, L. 2004. New measurements for search engine evaluation proposed and tested. Inform Process. Manage. 40, 677--691. Google ScholarGoogle Scholar

Index Terms

  1. The comparative effectiveness of sponsored and nonsponsored links for Web e-commerce queries

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!