Abstract
The predominant business model for Web search engines is sponsored search, which generates billions in yearly revenue. But are sponsored links providing online consumers with relevant choices for products and services? We address this and related issues by investigating the relevance of sponsored and nonsponsored links for e-commerce queries on the major search engines. The results show that average relevance ratings for sponsored and nonsponsored links are practically the same, although the relevance ratings for sponsored links are statistically higher. We used 108 ecommerce queries and 8,256 retrieved links for these queries from three major Web search engines: Yahoo!, Google, and MSN. In addition to relevance measures, we qualitatively analyzed the e-commerce queries, deriving five categorizations of underlying information needs. Product-specific queries are the most prevalent (48%). Title (62%) and summary (33%) are the primary basis for evaluating sponsored links with URL a distant third (2%). To gauge the effectiveness of sponsored search campaigns, we analyzed the sponsored links from various viewpoints. It appears that links from organizations with large sponsored search campaigns are more relevant than the average sponsored link. We discuss the implications for Web search engines and sponsored search as a long-term business model and as a mechanism for finding relevant information for searchers.
- Bellman, S., Lohse, G. L., and Johnson, E. J. 1999. Predictors of online buying behavior. Comm. ACM. 42, 32--38. Google Scholar
- Brooks, N. 2004a. How search engine rank impacts traffic. The Atlas Rank Report i (Aug.).Google Scholar
- Brooks, N. 2004b. How search engine rank impacts conversions. The Atlas Rank Report ii (Jan.).Google Scholar
- Brooks, N. 2006. Repeat search behavior: Implications for advertisers. Bull. Amer. Soc. Inform. Scien. Technol. 32, 16--17.Google Scholar
- Cole, J. I., Suman, M., Schramm, P., Lunn, R., and Aquino, J. S. 2003. Surveying the digital future year three. The Ucla Internet Report (Feb.).Google Scholar
- Cronbach, L. J. 1951. Coefficient alpha and the internal structure of tests. Psychometrika. 16, 297--334.Google Scholar
- Dai, H. K., Nie, Z., Wang, L., Zhao, L., Wen, J.-R., and Li, Y. 2006. Detecting online commercial intention (oci). In Proceedings of World Wide Web Conference (WWW'06). Edinburgh, Scotland. 829--837. Google Scholar
- Fain, D. C. and Pedersen, J. O. 2006. Sponsored search: A brief history. Bull. Amer. Soc. Inform. Sci. Tech. 32, 12--13.Google Scholar
- Huang, X. and Soergel, D. 2004. Relevance judges' understanding of topical relevance types: An explication of an enriched concept of topical relevance. In Proceedings of 67th Annual Meeting of the American Society for Information Science and Technology (ASIS&T04). Providence, RI, 13--18.Google Scholar
- Introna, L. and Nissenbaum, H. 2000. Defining the Web: The politics of search engines. IEEE Comput. 33, 54--62. Google Scholar
- Jansen, B. J. 2006a. Paid search as an information seeking paradigm. Bull. Amer. Soc. Inform. Sci. Technol. 32, 7--8.Google Scholar
- Jansen, B. J. 2006b. Paid search. IEEE Comput. 39, 88--90. Google Scholar
- Jansen, B. J. 2006c. Adversarial information retrieval aspects of sponsored search. 2nd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb06). The 29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR06).Google Scholar
- Jansen, B. J., Koshman, S., and Spink, A. 2005a. An analysis of repeat users of vivisimo.Com. In Proceedings of the American Society for Information Science & Technology Annual Meeting. Charlotte, NC, 1--6.Google Scholar
- Jansen, B. J. and McNeese, M. D. 2005. Evaluating the effectiveness of and patterns of interactions with automated searching assistance. J. Amer. Soc. Inform. Sci. Tech. 56, 1480--1503. Google Scholar
- Jansen, B. J. and Molina, P. 2006. The effectiveness of web search engines for retrieving relevant ecommerce links. Inform. Process. Manage. 42, 1075--1098. Google Scholar
- Jansen, B. J. and Resnick, M. 2006. An examination of searchers' perceptions of non-sponsored and sponsored links during ecommerce Web searching. J. Amer. Soc. Inform. Sci. Technol. 57, 1949--1961. Google Scholar
- Jansen, B. J. and Spink, A. 2003. An analysis of Web information seeking and use: Documents retrieved versus documents viewed. In Proceedings of 4th International Conference on Internet Computing. Las Vegas, NV. 65--69.Google Scholar
- Jansen, B. J. and Spink, A. 2005. How are we searching the World Wide Web? A comparison of nine search engine transaction logs. Infor. Process. Manage. 42, 248--263. Google Scholar
- Jansen, B. J., Spink, A., and Pederson, J. 2005b. Trend analysis of altavista Web searching. J. Amer. Soc. Inform. Sci. Technol. 56, 559--570. Google Scholar
- Jansen, B. J., Spink, A., and Saracevic, T. 2000. Real life, real users, and real needs: A study and analysis of user queries on the Web. Inform. Process. Manag. 36, 207--227. Google Scholar
- Marable, L. 2003. False oracles: Consumer reaction to learning the truth about how search engines work, results of an ethnographic study. Consumer Webwatch Research, 1--66.Google Scholar
- Nicholson, S., Sierra, T., Eseryel, U. Y., Park, J.-H., Barkow, P., Pozo, E. J., and Ward, J. 2006. How much of it is real? Analysis of paid placement in Web search engine results. J. Amer. Soc. Inform. Scien. Technol. 57, 448--461. Google Scholar
- Patton, M. Q. 1990. Qualitative Evaluation and Research Methods. Sage Publications, Inc., Newbury Park, CA.Google Scholar
- Selberg, E., and Etzioni, O. 2000. On the instability of Web search services. In Proceedings of RIAO 2000: Computer-Assisted Information retrieval. Paris, France.Google Scholar
- Silverstein, C., Henzinger, M., Marais, H., and Moricz, M. 1999. Analysis of a very large Web search engine query log. SIGIR Forum. 33, 6--12. Google Scholar
- Spiteri, L. F. 2000. Access to electronic commerce sites on the World Wide Web: An analysis of the effectiveness of six Internet search engines. J. Inform. Scien. 26, 173--183.Google Scholar
- Sullivan, D. 2003. Nielsen/netratings search engine ratings. (Oct.)Google Scholar
- Turban, E., King, D., Lee, J., and Viehland, D. 2004. Electronic Commerce: A Managerial Perspective. Pearson-Prentice Hall, Upper Saddle River, NJ. Google Scholar
- Vaughan, L. 2004. New measurements for search engine evaluation proposed and tested. Inform Process. Manage. 40, 677--691. Google Scholar
Index Terms
The comparative effectiveness of sponsored and nonsponsored links for Web e-commerce queries
Recommendations
Investigating the relevance of sponsored results for web ecommerce queries
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrievalAre sponsored links, the primary business model for Web search engines, providing Web consumers with relevant results? This research addresses this issue by investigating the relevance of sponsored and non-sponsored links for ecommerce queries from the ...
Factors relating to the decision to click on a sponsored link
In this paper, we report results of an investigation into the factors influencing the selection of sponsored links by e-commerce Web searchers. In this research, 56 participants each engaged in six e-commerce Web searching tasks. We mined these tasks ...
The effectiveness of web search engines for retrieving relevant ecommerce links
Ecommerce is developing into a fast-growing channel for new business, so a strong presence in this domain could prove essential to the success of numerous commercial organizations. However, there is little research examining ecommerce at the individual ...






Comments