research-article

Public Access

Discrimination through Optimization: How Facebook's Ad Delivery Can Lead to Biased Outcomes

Authors:

Piotr Sapiezynski,

Aleksandra Korolova,

Aaron RiekeAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 3, Issue CSCW

Article No.: 199, Pages 1 - 30

https://doi.org/10.1145/3359301

Published: 07 November 2019 Publication History

Abstract

The enormous financial success of online advertising platforms is partially due to the precise targeting features they offer. Although researchers and journalists have found many ways that advertisers can target---or exclude---particular groups of users seeing their ads, comparatively little attention has been paid to the implications of the platform's ad delivery process, comprised of the platform's choices about which users see which ads. It has been hypothesized that this process can "skew" ad delivery in ways that the advertisers do not intend, making some users less likely than others to see particular ads based on their demographic characteristics. In this paper, we demonstrate that such skewed delivery occurs on Facebook, due to market and financial optimization effects as well as the platform's own predictions about the "relevance" of ads to different groups of users. We find that both the advertiser's budget and the content of the ad each significantly contribute to the skew of Facebook's ad delivery. Critically, we observe significant skew in delivery along gender and racial lines for "real" ads for employment and housing opportunities despite neutral targeting parameters. Our results demonstrate previously unknown mechanisms that can lead to potentially discriminatory ad delivery, even when advertisers set their targeting parameters to be highly inclusive. This underscores the need for policymakers and platforms to carefully consider the role of the ad delivery optimization run by ad platforms themselves---and not just the targeting choices of advertisers---in preventing discrimination in digital advertising.

References

[1]

Alan Agresti and Brent A Coull. 1998. Approximate Is Better Than "exact" For Interval Estimation Of Binomial Proportions. The American Statistician, Vol. 52, 2 (1998), 119--126.

[2]

Athanasios Andreou, Márcio Silva, Fabrício Benevenuto, Oana Goga, Patrick Loiseau, and Alan Mislove. 2019. Measuring The Facebook Advertising Ecosystem. In Network and Distributed System Security Symposium. San Diego, California, USA.

[3]

Athanasios Andreou, Giridhari Venkatadri, Oana Goga, Krishna P. Gummadi, Patrick Loiseau, and Alan Mislove. 2018. Investigating Ad Transparency Mechanisms In Social Media: A Case Study Of Facebook's Explanations. In Network and Distributed System Security Symposium. San Diego, California, USA.

[4]

Tolga Bolukbasi, Kai-Wei Chang, James Y. Zou, Venkatesh Saligrama, and Adam T. Kalai. 2016. Man Is To Computer Programmer As Woman Is To Homemaker? Debiasing Word Embeddings. In Neural and Information Processing Systems. Barcelona, Spain.

Digital Library

[5]

Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities In Commercial Gender Classification. In Conference on Fairness, Accountability, and Transparency. New York, New York, USA.

[6]

Robert J. Cabin and Randall J. Mitchell. 2000. To Bonferroni Or Not To Bonferroni: When And How Are The Questions. Bulletin of the Ecological Society of America, Vol. 81, 3 (2000), 246--248.

[7]

Le Chen, Aniko Hannak, Ruijin Ma, and Christo Wilson. 2018. Investigating The Impact Of Gender On Rank In Resume Search Engines. In Annual Conference of the ACM Special Interest Group on Computer Human Interaction. Montreal, Canada.

[8]

Geff Cumming and Sue Finch. 2005. Inference By Eye: Confidence Intervals And How To Read Pictures Of Data. American Psychologist, Vol. 60, 2 (2005), 170.

[9]

Amit Datta, Anupam Datta, Jael Makagon, Deirdre K. Mulligan, and Michael Carl Tschantz. 2018. Discrimination In Online Personalization: A Multidisciplinary Inquiry. In Conference on Fairness, Accountability, and Transparency. New York, New York, USA.

[10]

Amit Datta, Michael Carl Tschantz, and Anupam Datta. 2015. Automated Experiments On Ad Privacy Settings: a Tale Of Opacity, Choice, And Discrimination. In Privacy Enhancing Technologies Symposium. Philadelphia, Pennsylvania, USA.

[11]

Nicholas Diakopoulos, Daniel Trielli, JenniferStark, and Sean Mussenden. 2018. I Vote Fortextemdashhow Search Informs Our Choice Of Candidate. In Digital Dominance: The Power of Google, Amazon, Facebook, and Apple, M. Moore and D. Tambini (Eds.). Oxford University Press.

[12]

Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012. Fairness Through Awareness. In Proceedings of the 3rd Innovations in Theoretical Computer Science Conference. ACM, 214--226.

Digital Library

[13]

Cynthia Dwork and Christina Ilvento. 2018. Fairness Under Composition. In 10th Innovations in Theoretical Computer Science Conference (ITCS 2019) (Leibniz International Proceedings in Informatics (LIPIcs)), Vol. 124. 33:1--33:20. https://doi.org/10.4230/LIPIcs.ITCS.2019.33

[14]

Irfan Faizullabhoy and Aleksandra Korolova. 2018. Facebook's Advertising Platform: New Attack Vectors And The Need For Interventions. Computing Research Repository (March 2018). https://arxiv.org/abs/1803.10099, Workshop on Technology and Consumer Protection (ConPro).

[15]

Avijit Ghosh, Giridhari Venkatadri, and Alan Mislove. 2019. Analyzing Facebook Political Advertisers' Targeting. In Workshop on Technology and Consumer Protection. San Francisco, California, USA.

[16]

Ben Green and Yiling Chen. 2019. Disparate Interactions: An Algorithm-in-the-loop Analysis Of Fairness In Risk Assessments. In Conference on Fairness, Accountability, and Transparency. Atlanta, Georgia, USA.

Digital Library

[17]

Aniko Hannak, Gary Soeller, David Lazer, Alan Mislove, and Christo Wilson. 2014. Measuring Price Discrimination And Steering On E-commerce Web Sites. In ACM Internet Measurement Conference. Vancouver, Canada.

[18]

Aniko Hannak, Claudia Wagner, David Garcia, Alan Mislove, Markus Strohmaier, and Christo Wilson. 2017. Bias In Online Freelance Marketplaces: Evidence From Taskrabbit And Fiverr. In ACM Conference on Computer Supported Cooperative Work. Portland, Oregon, USA.

Digital Library

[19]

Matthew Kay, Cynthia Matuszek, and Sean A. Munson. 2015. Unequal Representation And Gender Stereotypes In Image Search Results For Occupations. In Annual Conference of the ACM Special Interest Group on Computer Human Interaction.

[20]

Larry Kim. 2011. The Most Expensive Keywords In Google Adwords. http://www.wordstream.com/blog/ws/2011/07/18/most-expensive-google-adwords-keywords/.

[21]

Michael P. Kim, Aleksandra Korolova, Guy N. Rothblum, and Gal Yona. 2019. Preference-informed Fairness. https://arxiv.org/abs/1904.01793.

[22]

Aleksandra Korolova. 2018. Facebook's Illusion Of Control Over Location-related Ad Targeting. Medium. https://medium.com/@korolova/facebooks-illusion-of-control-over-location-related-ad-targeting-de7f865aee78.

[23]

Juhi Kulshrestha, Motahhare Eslami, Johnnatan Messias, Muhammad Bilal Zafar, Saptarshi Ghosh, Krishna Gummadi, and Karrie Karahalios. 2017. Quantifying Search Bias: Investigating Sources Of Bias For Political Searches In Social Media. In ACM Conference on Computer Supported Cooperative Work. Portland, Oregon, USA.

Digital Library

[24]

Anja Lambrecht and Catherine E. Tucker. 2018. Algorithmic Bias? An Empirical Study Into Apparent Gender-based Discrimination In The Display Of Stem Career Ads. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2852260.

[25]

Mathias Lecuyer, Guillaume Ducoffe, Francis Lan, Andrei Papancea, Theofilos Petsios, Riley Spahn, Augustin Chaintreau, and Roxana Geambasu. 2014. Xray: Enhancing The Web's Transparency With Differential Correlation. In USENIX Security Symposium. San Diego, California, USA.

[26]

Mathias Lecuyer, Riley Spahn, Yannis Spiliopolous, Augustin Chaintreau, Roxana Geambasu, and Daniel Hsu. 2015. Sunlight: Fine-grained Targeting Detection At Scale With Statistical Confidence. In ACM Conference on Computer and Communications Security.

Digital Library

[27]

Yabing Liu, Chloe Kliman-Silver, Balachander Krishnamurthy, Robert Bell, and Alan Mislove. 2014. Measurement And Analysis Of Osn Ad Auctions. In ACM Conference on Online Social Networks. Dublin, Ireland.

[28]

Nico Neumann, Catherine E. Tucker, and Timothy Whitfield. 2018. How Effective Is Black-box Digital Consumer Profiling And Audience Delivery?: Evidence From Field Studies. Social Science Research Network Working Paper Series (2018).

[29]

Javier Parra-Arnau, Jagdish Prasad Achara, and Claude Castelluccia. 2017. Myadchoices: Bringing Transparency And Control To Online Advertising. ACM Transactions on the Web, Vol. 11 (2017).

[30]

Ronald E. Robertson, Shan Jiang, Kenneth Joseph, Lisa Friedland, David Lazer, and Christo Wilson. 2018. Auditing Partisan Audience Bias Within Google Search. In Annual Conference of the ACM Special Interest Group on Computer Human Interaction.

[31]

Diego Saez-Trumper, Yabing Liu, Ricardo Baeza-Yates, Balachander Krishnamurthy, and Alan Mislove. 2014. Beyond Cpm And Cpc: Determining The Value Of Users On Osns. In ACM Conference on Online Social Networks. Dublin, Ireland.

Digital Library

[32]

Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing Algorithms: Research Methods For Detecting Discrimination On Internet Platforms. In International Communication Association Conference.

[33]

Piotr Sapiezynski, Wesley Zeng, Ronald E. Robertson, Alan Mislove, and Christo Wilson. 2019. Quantifying The Impact Of User Attention On Fair Group Representation In Ranked Lists. In Workshop on Fairness, Accountability, Transparency, Ethics, and Society on the Web. San Francisco, California, USA.

[34]

Till Speicher, Muhammad Ali, Giridhari Venkatadri, Filipe Nunes Ribeiro, George Arvanitakis, Fabrício Benevenuto, Krishna P. Gummadi, Patrick Loiseau, and Alan Mislove. 2018. On The Potential For Discrimination In Online Targeted Advertising. In Conference on Fairness, Accountability, and Transparency. New York, New York, USA.

[35]

Latanya Sweeney. 2013. Discrimination In Online Ad Delivery. Commun. ACM, Vol. 56, 5 (2013), 44--54.

Digital Library

[36]

Giridhari Venkatadri, Yabing Liu, Athanasios Andreou, Oana Goga, Patrick Loiseau, Alan Mislove, and Krishna P. Gummadi. 2018a. Privacy Risks With facebook's Pii-based Targeting: Auditing A Data Broker's Advertising Interface. In IEEE Symposium on Security and Privacy. San Francisco, California, USA.

[37]

Giridhari Venkatadri, Elena Lucherini, Piotr Sapiezy'nski, and Alan Mislove. 2019 a. Investigating Sources Of Pii Used In facebook's Targeted Advertising. In Privacy Enhancing Technologies Symposium. Stockholm, Sweden.

[38]

Giridhari Venkatadri, Alan Mislove, and Krishna P. Gummadi. 2018b. Treads: Transparency-enhancing Ads. In Workshop on Hot Topics in Networks. Redmond, Washington, USA.

[39]

Giridhari Venkatadri, Piotr Sapiezy'nski, Elissa M. Redmiles, Alan Mislove, Oana Goga, Michelle Mazurek, and Krishna P. Gummadi. 2019 b. Auditing Offline Data Brokers Via Facebook's Advertising Platform. In International World Wide Web Conference. San Francisco, California, USA.

[40]

Craig E. Wills and Can Tatar. 2012. Understanding What They Do With What They Know. In Workshop on Privacy in the Electronic Society.

Cited By

Burgess JCarah NAngus DObeid AAndrejevic M(2024)Why Am I Seeing This Ad? The affordances and limits of automated user-level explanation in Meta’s advertising systemNew Media & Society10.1177/1461444824125179626:9(5130-5149)Online publication date: 30-Aug-2024
https://doi.org/10.1177/14614448241251796
Behrend TRavid DThapa S(2024)Implications of Social Media for a Changing Work LandscapeAnnual Review of Organizational Psychology and Organizational Behavior10.1146/annurev-orgpsych-110721-04102311:1(337-361)Online publication date: 22-Jan-2024
https://doi.org/10.1146/annurev-orgpsych-110721-041023
Fabris ABaranowska NDennis MGraus DHacker PSaldivar JZuiderveen Borgesius FBiega A(2024)Fairness and Bias in Algorithmic Hiring: A Multidisciplinary SurveyACM Transactions on Intelligent Systems and Technology10.1145/369645716:1(1-54)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1145/3696457
Show More Cited By

Index Terms

Discrimination through Optimization: How Facebook's Ad Delivery Can Lead to Biased Outcomes

Recommendations

Real time bid optimization with smooth budget delivery in online advertising
ADKDD '13: Proceedings of the Seventh International Workshop on Data Mining for Online Advertising

Today, billions of display ad impressions are purchased on a daily basis through a public auction hosted by real time bidding (RTB) exchanges. A decision has to be made for advertisers to submit a bid for each selected RTB ad request in milliseconds. ...
An empirical study of reserve price optimisation in real-time bidding
KDD '14: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining

In this paper, we report the first empirical study and live test of the reserve price optimisation problem in the context of Real-Time Bidding (RTB) display advertising from an operational environment. A reserve price is the minimum that the auctioneer ...
An economic analysis of online advertising using behavioral targeting

Online publishers and advertisers have recently shown increasing interest in using targeted advertising online. Such targeting allows them to present users with advertisements that are a better match, based on their past browsing and search behavior and ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 3, Issue CSCW

November 2019

5026 pages

EISSN:2573-0142

DOI:10.1145/3371885

Editors:
Airi Lampinen
Stockholm University, Sweden
,
Darren Gergle
Northwestern University, USA
,
David A. Shamma
FXPAL, USA

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2019

Published in PACMHCI Volume 3, Issue CSCW

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Data Transparency Lab
National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

207
Total Citations
View Citations
8,786
Total Downloads

Downloads (Last 12 months)2,569
Downloads (Last 6 weeks)378

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Burgess JCarah NAngus DObeid AAndrejevic M(2024)Why Am I Seeing This Ad? The affordances and limits of automated user-level explanation in Meta’s advertising systemNew Media & Society10.1177/1461444824125179626:9(5130-5149)Online publication date: 30-Aug-2024
https://doi.org/10.1177/14614448241251796
Behrend TRavid DThapa S(2024)Implications of Social Media for a Changing Work LandscapeAnnual Review of Organizational Psychology and Organizational Behavior10.1146/annurev-orgpsych-110721-04102311:1(337-361)Online publication date: 22-Jan-2024
https://doi.org/10.1146/annurev-orgpsych-110721-041023
Fabris ABaranowska NDennis MGraus DHacker PSaldivar JZuiderveen Borgesius FBiega A(2024)Fairness and Bias in Algorithmic Hiring: A Multidisciplinary SurveyACM Transactions on Intelligent Systems and Technology10.1145/369645716:1(1-54)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1145/3696457
Liu HDas ABoltz AZhou DPinaroc DLease MLee M(2024)Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AIProceedings of the ACM on Human-Computer Interaction10.1145/36869628:CSCW2(1-44)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686962
Sapiezynski PKaplan LMislove AKorolova A(2024)On the Use of Proxies in Political Ad TargetingProceedings of the ACM on Human-Computer Interaction10.1145/36869178:CSCW2(1-31)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686917
Santini RSalles DMartins BMoreira AHaddad J(2024)Seeing through opacity: The limitations of digital ad transparency in BrazilProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659034(2209-2221)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3659034
Slaughter IBrown EWeber N(2024)The Impact of iBuying is About More Than Just Racial Disparities: Evidence from Mecklenburg County, NCProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659027(2086-2100)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3659027
Rezk ASimkute ALuger EVines JElsden CEvans MJones R(2024)Agency Aspirations: Understanding Users' Preferences And Perceptions Of Their Role In Personalised News CurationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642634(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642634
Kaspersen MMusaeus LBilstrup KPetersen MIversen ODindler CDalsgaard P(2024)From Primary Education to Premium Workforce: Drawing on K-12 Approaches for Developing AI LiteracyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642607(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642607
Taylor JSimpson ETran ABrubaker JFox SZhu H(2024)Cruising Queer HCI on the DL: A Literature Review of LGBTQ+ People in HCIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642494(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642494
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents