Abstract
Search engines help people answer consequential questions. Biases in retrieved and indexed content (e.g., skew toward erroneous outcomes that represent deviations from reality), coupled with searchers' biases in how they examine and interpret search results, can lead people to incorrect answers. In this article, we seek to better understand biases in search and retrieval, and in particular those affecting the accuracy of content in search results, including the search engine index, features used for ranking, and the formulation of search queries. Focusing on the important domain of online health search, this research broadens previous work on biases in search to examine the role of search systems in contributing to biases. To assess bias, we focus on questions about medical interventions and employ reliable ground truth data from authoritative medical sources. In the course of our study, we utilize large-scale log analysis using data from a popular Web search engine, deep probes of result lists on that search engine, and crowdsourced human judgments of search result captions and landing pages. Our findings reveal bias in results, amplifying searchers' existing biases that appear evident in their search activity. We also highlight significant bias in indexed content and show that specific ranking signals and specific query terms support bias. Both of these can degrade result accuracy and increase skewness in search results. Our analysis has implications for bias mitigation strategies in online search systems, and we offer recommendations for search providers based on our findings.
- Steven Abney, Michael Collins, and Amit Singhal. 2000. Answer extraction. In Proceedings of the Conference on Applied Natural Language. 296--301. Google Scholar
Digital Library
- Eugene Agichtein, Eric Brill, and Susan Dumais. 2006. Improving web search ranking by incorporating user behavior information. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 19--26. Google Scholar
Digital Library
- Yin Aphinyanaphongs and Constantin Aliferis. 2007. Text categorization models for identifying unproven cancer treatments on the web. In Proceedings of the 12th World Congress on Health (Medical) Informatics. 968.Google Scholar
- Rawia Awadallah, Maya Ramanath, and Gerhard Weikum. 2012. Harmony and dissonance: organizing the people's voices on political controversies. In Proceedings of the ACM Conference on Web Search and Data Mining. 523--532. Google Scholar
Digital Library
- Stephanie L. Ayers and Jennie J. Kronenfeld. 2007. Chronic illness and health-seeking information on the Internet. Health 11, 3, 327--347.Google Scholar
- Leif Azzopardi and Ciaran Owens. 2009. Search engine predilection toward news media providers. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 774--775. Google Scholar
Digital Library
- Leif Azzopardi and Vishwa Vinay. 2008. Retrievability: An evaluation measure for higher order information access tasks. In Proceedings of the International Conference on Information and Knowledge Management. 561--570. Google Scholar
Digital Library
- Doug Beeferman and Adam Berger. 2000. Agglomerative clustering of a search engine query log. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 407--416. Google Scholar
Digital Library
- Nicholas J. Belkin, Colleen Cool, W. Bruce Croft, and Jamie P. Callan. 1993. The effect of multiple query representations on information retrieval system performance. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 339--346. Google Scholar
Digital Library
- Mike Bengeri and Pierre Pluye. 2003. Shortcomings of health-related information on the internet. Health Promotion Int. 18, 4, 381--387.Google Scholar
Cross Ref
- Michael Bernstein, Jaime Teevan, Susan Dumais, Daniel Liebling, and Eric Horvitz. 2012. Direct answers for search queries in the long tail. In Proceedings of the ACM Special Interest Group on Computer-Human Interaction. 237--246. Google Scholar
Digital Library
- Krishna Bharat and Andrei Broder. 1998. A technique for measuring the relative size and overlap of public web search engines. Computer Netw. ISDN Syst. 30, 1, 379--388. Google Scholar
Digital Library
- Suresh K. Bhavnani. 2002. Domain-specific search strategies for the effective retrieval of healthcare and shopping information. In Proceedings of the ACM Special Interest Group on Computer-Human Interaction. 610--611. Google Scholar
Digital Library
- Suresh K. Bhavnani, Renju T. Jacob, Jennifer Nardine, and Frederick A. Peck. 2003. Exploring the distribution of online healthcare information. In Proceedings of the ACM Special Interest Group on Computer-Human Interaction. 816--817. Google Scholar
Digital Library
- Mikhail Bilenko and Ryen W. White. 2008. Mining the search trails of the surfing crowds: Identifying relevant websites from user activity. In Proceedings of the International World Wide Web Conference. 51--60. Google Scholar
Digital Library
- Oliver Bodenreider. 2004. The Unified Medical Language System (UMLS). Oxford University Press.Google Scholar
- Robert L. Brennan and Dale J. Prediger. 1981. Coefficient kappa: Some uses, misuses, and alternatives. Educ. Psych. Measurement 41, 3, 687--699.Google Scholar
Cross Ref
- Sergei Brin and Larry Page. 1998. The anatomy of a large-scale hypertextual search engine. In Proceedings of the International World Wide Web Conference. Google Scholar
Digital Library
- Olivier Chapelle, Thorsten Joachims, Filip Radlinski, and Yisong Yue. 2012. Large scale validation and analysis of interleaved search evaluation. ACM Trans. Inf. Syst. 30, 1. Google Scholar
Digital Library
- Lydia Chilton and Jaime Teevan. 2011. Addressing people's information needs directly in a web search result page. In Proceedings of the International World Wide Web Conference. 27--36. Google Scholar
Digital Library
- Junghoo Cho and Sourashis Roy. 2004. Impact of search engines on page popularity. In Proceedings of the International World Wide Web Conference. 20--29. Google Scholar
Digital Library
- Charles Clarke, Eugene Agichtein, Susan Dumais, and Ryen W. White. 2007. The influence of caption features on clickthrough patterns in Web search. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 135--142. Google Scholar
Digital Library
- Rebecca J. W. Cline and Katie M. Haynes. 2001. Consumer health information seeking on the internet: The state of the art. Health Educ. Res. 16, 6, 671--692.Google Scholar
Cross Ref
- James Cogley, Nicola Stokes, and Joe Carthy. 2013. Exploring the effectiveness of medical entity recognition for clinical information retrieval. In Proceedings of the 7th International Workshop on Data and Text Mining in Biomedical Informatics, 3--4. Google Scholar
Digital Library
- Kevyn Collins-Thompson, Jamie Callan, Egidio Terra, and Charles L. A. Clarke. 2004. The effect of document retrieval quality on factoid question answering performance. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 574--575. Google Scholar
Digital Library
- Nick Craswell, David Hawking, Ross Wilkinson, and Mingfang Wu. 2003. Overview of the TREC 2003 Web Track. In Proceedings of the Text Retrieval Conference.Google Scholar
- Nick Craswell, Onno Zoeter, Michael Taylor, and Bill Ramsey. 2008. An experimental comparison of click position-bias models. In Proceedings of the ACM Conference on Web Search and Data Mining. 87--94. Google Scholar
Digital Library
- Anirban Dasgupta, Arpita Gosh, Ravi Kumar, Christopher Olston, Sandeep Pandey, and Andrew Tomkins. 2007. The discoverability of the web. In Proceedings of the International World Wide Web Conference. 421--430. Google Scholar
Digital Library
- Kay Dickersin. 1990. The existence of publication bias and risk factors for its occurrence. J. Amer. Medical Assoc. 263, 10, 1385--1389.Google Scholar
Cross Ref
- Shiri Dori-Hacohen and James Allan. 2013. Detecting controversy on the web. In Proceedings of the International Conference on Information and Knowledge Management. 1845--1848. Google Scholar
Digital Library
- Susan Dumais, Michele Banko, Eric Brill, Jimmy Lin, and Andrew Ng. 2002. Web question answering: Is more always better? In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 291--298. Google Scholar
Digital Library
- Phillipa J. Easterbrook, R. Gopalan, J. A. Berlin, and David R. Matthews. 1991. Publication bias in clinical research. Lancet 337, 8746, 867--872.Google Scholar
- Matthias Egger, George Davey Smith, Martin Schneider, and Christoph Minder. 1997. Bias in meta-analysis detected by a simple, graphical test. British Med. J. 315, 7109, 629--634.Google Scholar
Cross Ref
- Rob Ennals, Beth Trushkowsky, and John M. Agosta. 2010. Highlighting disputed claims on the web. In Proceedings of the International World Wide Web Conference. 341--350. Google Scholar
Digital Library
- Gunther Eysenbach and Christian Köhler. 2002. How do consumers search for and appraise health information on the World Wide Web? Qualitative studies using focus groups, usability test, and in-depth interviews. British Med. J. 324, 573--577Google Scholar
Cross Ref
- Daniele Fanelli. 2012. Negative results are disappearing from most disciplines and countries. Scientometrics 90, 3, 891--901. Google Scholar
Digital Library
- Joseph L. Fleiss. 1971. Measuring nominal scale agreement among many raters. Psych. Bull. 76, 5, 378--382.Google Scholar
Cross Ref
- Santo Fortunato, Alessandro Flammini, Fillipo Menczer, and Alessandro Vespignani. 2006. Topical interests and the mitigation of search engine bias. Proc. Nat. Acad. Sci. U.S.A. 103, 34, 12684--12689.Google Scholar
Cross Ref
- Susannah Fox. 2006. Online Health Search 2006. Pew Internet and American Life Project.Google Scholar
- Susannah Fox and Maeve Duggan. 2013. Health Topics. Pew Internet and American Life Project.Google Scholar
- Steve Fox, Kuldeep Karnawat, Mark Mydland, Susan Dumais, and Thomas White. 2005. Evaluating implicit measures to improve Web search. ACM Trans. Inf. Syst. 23, 2, 147--168. Google Scholar
Digital Library
- Arnaud Gaudinat, Patrick Ruch, Michel Joubert, Phillipe Uziel, P., Anne Strauss, Michèle Thonnet, Robert Baud, Stéphane Spahni, Patrick Weber, Juan Bonai, Celia Boyer, Marius Fieschi, and Antoine Geissbuhler. 2006. Health search engine with e-document analysis for reliable search results. Int. J. Med. 75, 1, 73--85.Google Scholar
- Susan Gerhart. 2004. Do Web search engines suppress controversy? First Monday 9, 1--5.Google Scholar
- Jeremy Ginsberg, Matthew H. Mohebbi, Rajan S. Patel, Lynnette Brammer, Mark S. Smolinksi, and Larry Brilliant. 2008. Detecting influenza epidemics using search engine query data. Nature 457, 7232, 1012--1014.Google Scholar
- Eric Goldman. 2006. Search engine bias and the demise of search utopianism. Yale J. Law Technol.188.Google Scholar
- Qi Guo and Eugene Agichtein. 2012. Beyond dwell time: Estimating document relevance from cursor movements and other post-click searcher behavior. In Proceedings of the International World Wide Web Conference. 569--578. Google Scholar
Digital Library
- Donna Harman and Chris Buckley. 2009. Overview of the reliable information access workshop. Inf. Retrieval 12, 614--641. Google Scholar
Digital Library
- William Hart, Dolores Albarracín, Alice H. Eagly, Inge Brechan, Matthew J. Lindberg, and Lisa Merrill. 2009. Feeling validated versus being correct: A meta-analysis of selective exposure to information. Psych. Bull. 135, 4, 555--588.Google Scholar
Cross Ref
- William Hersh. 2008. Information Retrieval: A Health and Biomedical Perspective. Springer. William R. Hersh and David H. Hickam. 1998. How well do physicians use electronic information retrieval systems? A frame work for investigation and systematic review. J. Amer. Medical Informatics Assoc. 280, 1347.Google Scholar
Cross Ref
- William R. Hersh, Katherine Crabtree, David H. Hickam, Lynetta Sacherek, Charles P. Friedman, Patricia Tidmarsh, Craig Mosbaek, and Dale Kraemer. 2002. Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions. J. Amer. Medical Informatics Assoc. 9, 283--293.Google Scholar
Cross Ref
- Julian P. T. Higgins (Ed.). 2008. Cochrane Handbook for Systematic Reviews of Interventions (Vol. 5). Wiley-Blackwell, Chichester, UK.Google Scholar
- Samuel Ieong, Nina Mishra, Eldar Sadikov, and Li Zhang. 2012. Domain bias in Web search. In Proceedings of the ACM Conference on Web Search and Data Mining. 413--422. Google Scholar
Digital Library
- Peter Ingwersen. 1994. Polyrepresentation of information needs and semantic entities: Elements of a cognitive theory of information retrieval interaction. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 101--110. Google Scholar
Digital Library
- Charles B. Inlander. 1993. Good Operations, Bad Operations. The People's Medical Society's Guide to Surgery. Viking Adult.Google Scholar
- Alejandro R. Jadad, Deborah J. Cook, Alison Jones, Terry P. Klassen, Peter Tugwell, Michael Moher, and David Moher. 1998. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. J. Amer. Medical Assoc. 280, 3, 278--280.Google Scholar
Cross Ref
- Thorsten Joachims. 2002. Optimizing search engines using click-through data. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 132--142. Google Scholar
Digital Library
- Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, Filip Radlinski, and Geri Gay. 2007. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst. 25, 2. Google Scholar
Digital Library
- Anders W. Jørgensen, Jørgen Hilden, and Peter C. Gøtzsche. 2006. Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. British Med. J. 333, 7572, 782.Google Scholar
- Mouna Kacimi and Johann Gamper. 2011. Diversifying search results of controversial queries. In Proceedings of the International Conference on Information and Knowledge Management. 93--98. Google Scholar
Digital Library
- Mouna Kacimi and Johann Gamper. 2012. MOUNA: mining opinions to unveil neglected arguments. In Proceedings of the International Conference on Information and Knowledge Management. 2722--2724. Google Scholar
Digital Library
- Diane Kelly, Xiao-jun Yuan, Nicholas J. Belkin, Vanessa Murdock, and W. Bruce Croft. 2002. Features of documents relevant to task- and fact-oriented questions. In Proceedings of the International Conference on Information and Knowledge Management. 645--647. Google Scholar
Digital Library
- Jon Kleinberg. 1999. Authoritative sources in a hyperlinked environment. J. ACM 46, 5, 604--632. Google Scholar
Digital Library
- Bevan Koopman, Guido Zuccon, Peter Bruza, Laurianne Sitbon, and Michael Lawley. 2012. An evaluation of corpus-driven measures of medical concept similarity for information retrieval. In Proceedings of the International Conference on Information and Knowledge Management. 2439--2442. Google Scholar
Digital Library
- Carolyn Lauckner and Gary Hsieh. 2013. The presentation of health-related search results and its impact on negative emotional outcomes. In Proceedings of the ACM Special Interest Group on Computer-Human Interaction. 333--342. Google Scholar
Digital Library
- Hady W. Lauw, Ee-Peng Lim, and Ke Wang. 2006. Bias and controversy: Beyond the statistical deviation. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 625--630. Google Scholar
Digital Library
- Steve Lawrence and C. Lee Giles. 1999. Accessibility of information on the web. Nature 400, 6740, 107.Google Scholar
Cross Ref
- Nut Limsopatham, Craig Macdonald, Richard McCreadie, and Iadh Ounis. 2012. Exploiting term dependence while handling negation in medical search. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 1065--1066. Google Scholar
Digital Library
- Abbe Mowshowitz and Akira Kawaguchi. 2002a. Assessing bias in search engines. Inf. Process. Manage. 38, 1, 141--156. Google Scholar
Digital Library
- Abbe Mowshowitz and Akira Kawaguchi. 2002b. Bias on the Web. Commun. ACM 45, 9, 56--60. Google Scholar
Digital Library
- Yishai Ofran, Ora Paltiel, Dan Pelleg, Jacob M. Rowe, and Elad Yom-Tov. 2012. Patterns of information-seeking for cancer on the internet: An analysis of real world data. PloS One 7, 9, e45921.Google Scholar
Cross Ref
- Bo Pang and Ravi Kumar. 2011. Search in the lost sense of “query”: Question formulation in Web search queries and its temporal changes. In Proceedings of the Annual Meeting of the Association for Computational Linguistics. 135--140. Google Scholar
Digital Library
- Sandeep Pandey, Kedar Dhamdhere, and Christopher Olston. 2004. Wic: A general-purpose algorithm for monitoring web information sources. In Proceedings of the International Conference on Very Large Databases. 360--371. Google Scholar
Digital Library
- Eli Pariser. 2011. The Filter Bubble: What is the Internet Hiding from You? Penguin Press. Google Scholar
Digital Library
- Mark Petticrew, Paul Wilson, Kath Wright, and Fujian Song. 2002. Quality of Cochrane reviews: Quality of Cochrane reviews is better than that of non-Cochrane reviews. British Med. J. 324, 7336, 545.Google Scholar
Cross Ref
- Mary C. Politi, Paul K. J. Han, and Nananda F. Col. 2007. Communicating the uncertainty of harms and benefits of medical interventions. Medical Decision Making 27, 5, 681--695.Google Scholar
Cross Ref
- Filip Radlinski and Thorsten Joachims. 2006. Minimally invasive randomization for collecting unbiased preferences from click-through logs. In Proceedings of the National Conference on Artificial Intelligence. Google Scholar
Digital Library
- Matthew Richardson, Amit Prakash, and Eric Brill. 2006. Beyond PageRank: Machine learning for static ranking. In Proceedings of the International World Wide Web Conference. 707--715. Google Scholar
Digital Library
- Bonnie Rochman. 2011. Jenny McCarthy, vaccine expert? A quarter of parents trust celebrities. Time (26 April 2011).Google Scholar
- Ian Ruthven. 2003. Re-examining the potential effectiveness of interactive query expansion. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 213--220. Google Scholar
Digital Library
- David L. Sackett, William Rosenberg, J. A. Gray, R. Brian Haynes, and W. Scott Richardson. 1996. Evidence based medicine: What it is and what it isn't. British Med. J. 312, 7023: 71.Google Scholar
Cross Ref
- Julia Schwarz and Meredith Ringel Morris. 2011. Augmenting web pages and search results to help people find trustworthy information online. In Proceedings of the ACM Special Interest Group on Computer-Human Interaction. 1245--1254. Google Scholar
Digital Library
- Elizabeth Sillence, Pam Briggs, Lesley Fishwick, and Peter Harris. 2004. Trust and mistrust of online health sites. In Proceedings of the ACM Special Interest Group on Computer-Human Interaction. 663--670. Google Scholar
Digital Library
- Herbert A. Simon. 1991. Bounded rationality and organizational learning. Organization Sci. 2, 1, 125--134. Google Scholar
Digital Library
- Amit Singhal, Chris Buckley, and Mandar Mitra. 2006. Pivoted document length normalization. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 21--29. Google Scholar
Digital Library
- Karen Spärck-Jones, Steve Walker, and Stephen E. Robertson. 2000. A probabilistic model of information retrieval: development and comparative experiments. Inf. Process. Manage. 36, 6, 779--840. Google Scholar
Digital Library
- Amanda Spink, Yin Yang, Jim Jansen, Pirrko Nykanen, Daniel P. Lorence, Seda Ozmutlu, and H. Cenk Ozmutlu. 2004. A study of medical and health queries to Web search engines. Health Inf, Libraries J. 21, 44--51.Google Scholar
Cross Ref
- Thanh Tin Tang, David Hawking, Nick Craswell, and Kathy Griffiths. 2005. Focused crawling for both topical relevance and quality of medical information. In Proceedings of the International Conference on Information and Knowledge Management. 147--154. Google Scholar
Digital Library
- Robert S. Taylor. 1968. Question-negotiation and information seeking in libraries. College Research Libraries 29, 178--194.Google Scholar
Cross Ref
- Amos Tversky and Daniel Kahneman. 1973. Availability: A heuristic for judging frequency and probability. Cognitive Psych. 5, 1, 207--233.Google Scholar
Cross Ref
- Tristan Upstill, Nick Craswell, and David Hawking. 2002. Buying bestsellers online: A case study in search and searchability. In Proceedings of the 7th Australasian Document Computing Symposium.Google Scholar
- Liwen Vaughn and Mike Thelwall. 2004. Search engine coverage bias: Evidence and possible causes. Inf. Process. Manage. 40, 4, 693--707. Google Scholar
Digital Library
- V. G. Vydiswaran, Cheng Xiang Zhai, Dan Roth, and Peter Pirolli. 2012. BiasTrust: Teaching biased users about controversial topics. In Proceedings of the International Conference on Information and Knowledge Management. 1905--1909. Google Scholar
Digital Library
- Peter C. Wason. 1960. On the failure to eliminate hypotheses in a conceptual task. Quart. J. Exper. Psych. 12, 129--140.Google Scholar
Cross Ref
- Robert West, Ryen W. White, and Eric Horvitz. 2013. From cookies to cooks: Insights on dietary patterns via analysis of web usage logs. In Proceedings of the International World Wide Web Conference. 1399--1410. Google Scholar
Digital Library
- Ryen W. White. 2013. Beliefs and biases in Web search. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 3--10. Google Scholar
Digital Library
- Ryen W. White, Rave Harpaz, Nigam H. Shah, William DuMouchel, and Eric Horvitz. 2014. Toward enhanced pharmacovigilance using patient-generated data on the Internet. In Nature Clinical Pharmacology and Therapeutics. (To appear)Google Scholar
- Ryen W. White and Eric Horvitz. 2009a. Cyberchondria: Studies of the escalation of medical concerns in web search. ACM Trans. Inf. Syst. 27, 4, 23. Google Scholar
Digital Library
- Ryen W. White and Eric Horvitz. 2009b. Experiences with web search on medical concerns and self-diagnosis. In Proceedings of the American Medical Information Association Annual Symposium. 696--700.Google Scholar
- Ryen W. White and Eric Horvitz. 2010a. Web to World: Predicting transitions from self-diagnosis to the pursuit of local medical assistance in web search. In Proceedings of the American Medical Information Association Annual Symposium. 882--886.Google Scholar
- Ryen W. White and Eric Horvitz. 2010b. Predicting escalations of medical queries based on web page structure and content. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 769--770. Google Scholar
Digital Library
- Ryen W. White and Eric Horvitz. 2013 Captions and biases in diagnostic search. ACM Trans. Web 7, 4, 23. Google Scholar
Digital Library
- Ryen W. White, Nicholas P. Tatonetti, Nigam H. Shah, Russ B. Altman, and Eric Horvitz. 2013. Web-scale pharmacovigilance: Listening to signals from the crowd. J. Amer. Med. Informatics Assoc. 20, 3, 404--408.Google Scholar
Cross Ref
- Barbara M. Wildemuth. 2004. The effects of domain knowledge on search tactic information. J. Assoc. Inf. Sci. Tech. 55, 3, 246--258. Google Scholar
Digital Library
- Colin Wilkie and Leif Azzopardi. 2014. Best and fairest: An empirical analysis of retrieval system bias. In Proceedings of the European Conference on Information Retrieval, 13--25.Google Scholar
Cross Ref
- Janice C. Wright and Milton C. Weinstein. 1998. Gains in life expectancy from medical interventions: Standardizing data on outcomes. New England J. Med. 339, 6, 380--386.Google Scholar
Cross Ref
- Elad Yom-Tov, Susan Dumais, and Qi Guo. 2014. Promoting civil discourse through search engine diversity. Social Science Computer Rev. 32, 2, 145--154. Google Scholar
Digital Library
- Elad Yom-Tov and Evgeniy Gabrilovich. 2013. Post-market drug surveillance without trial costs: Discovery of adverse drug reactions through large-scale analysis of web search queries. J. Med. Internet Res. 15, 6.Google Scholar
Cross Ref
- Yisong Yue, Rajan Patel, and Hein Roehrig. 2010. Beyond position bias: Examining result attractiveness as a source of presentation bias in clickthrough data. In Proceedings of the International World Wide Web Conference. 1011--1018. Google Scholar
Digital Library
- Cheng Xiang Zhai, William W. Cohen, and John Lafferty. 2003. Beyond independent relevance: Methods and evaluation metrics for subtopic retrieval. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 10--17. Google Scholar
Digital Library
Index Terms
Content Bias in Online Health Search
Recommendations
Beliefs and biases in web search
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrievalPeople's beliefs, and unconscious biases that arise from those beliefs, influence their judgment, decision making, and actions, as is commonly accepted among psychologists. Biases can be observed in information retrieval in situations where searchers ...
The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments
ICTIR '17: Proceedings of the ACM SIGIR International Conference on Theory of Information RetrievalPeople regularly use web search engines to investigate the efficacy of medical treatments. Search results can contain documents that present incorrect information that contradicts current established medical understanding on whether a treatment is ...
A Think-Aloud Study to Understand Factors Affecting Online Health Search
CHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and RetrievalThe majority of US Internet users have searched the internet for health-related information. When people conduct these health searches, searching for information about medical treatments is among the more common reasons. While being a convenient and ...






Comments