skip to main content
research-article
Open Access

Contestability For Content Moderation

Authors Info & Claims
Published:18 October 2021Publication History
Skip Abstract Section

Abstract

Content moderation systems for social media have had numerous issues of bias, in terms of race, gender, and ability among many others. One proposal for addressing such issues in automated decision making is by designing for contestability, whereby users can shape and influence how decisions are made. In this study, we conduct a series of participatory design workshops with participants from communities that have experienced problems with social media content moderation in the past. Together with participants, we explore the idea of designing for contestability in content moderation and find that users' designs suggest three fruitful, practical avenues: adding representation, improving communication, and designing with compassion. We conclude with design recommendations drawn from participants' proposals, and reflect on the challenges that remain.

Skip Supplemental Material Section

Supplemental Material

References

  1. Wajeeha Ahmad and Ilaria Liccardi. 2020. Addressing Anonymous Abuses: Measuring the Effects of Technical Mechanisms on Reported User Behaviors. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Leigh Alexander. 2016. Facebook's censorship of Aboriginal bodies raises troubling ideas of “decency”. The Guardian (March 2016). https://www.theguardian.com/technology/2016/mar/23/facebook-censorship-topless-aboriginal-womenGoogle ScholarGoogle Scholar
  3. Marco Almada. 2019. Human Intervention In Automated Decision-Making: Toward The Construction Of Contestable Systems. In Proc. International Conference on Artificial Intelligence and Law. 2--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Mike Ananny and Kate Crawford. 2018. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society (2018).Google ScholarGoogle Scholar
  5. Julia Angwin and Hannes Grassegger. 2017. Facebook's Secret Censorship Rules Protect White Men From Hate Speech But Not Black Children. https://www.propublica.org/article/facebook-hate-speech-censorship-internal-documents-algorithms. ProPublica.Google ScholarGoogle Scholar
  6. Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Sam Biddle, Paulo Victor Ribeiro, and Tatiana Dias. 2020. TikTok Told Moderators: Suppress Posts by the "Ugly" and Poor. https://theintercept.com/2020/03/16/tiktok-app-moderators-users-discriminationGoogle ScholarGoogle Scholar
  8. Danielle Blunt, Ariel Wolf, Emily Coombes, and Shanelle Mullin. 2020. Posting Into the Void: Studying the Impact of Shadowbanning on Sex Workers and Activists. https://hackinghustling.org/posting-into-the-void-content-moderation/Google ScholarGoogle Scholar
  9. Ariel Bogle. 2019. Aussie sex workers were kicked off American websites so they built their own. https://www.abc.net.au/news/science/2019-06--22/fosta-sesta-laws-impact-australian-sex-workers-one-year-later/11229724Google ScholarGoogle Scholar
  10. Elena Botella. 2019. TikTok Admits It Suppressed Videos by Disabled, Queer, and Fat Creators. Slate (2019).Google ScholarGoogle Scholar
  11. Zach-Amaury Boufoy-Bastick and Lenandlar Singh. 2007. The Socio-Technical Indicator Model: Socially-Sensitive CMC Technology, with an Implementation of Representative Moderation. International Journal of Computer, Information, and Systems Science, and Engineering, Vol. 1 (2007), 1.Google ScholarGoogle Scholar
  12. Richard E Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development .sage.Google ScholarGoogle Scholar
  13. Tone Bratteteig and Guri Verne. 2018. Does AI Make PD Obsolete? Exploring Challenges From Artificial Intelligence To Participatory Design. In Proc. Participatory Design Conference.Google ScholarGoogle Scholar
  14. Anna Brown, Alexandra Chouldechova, Emily Putnam-Hornstein, Andrew Tobin, and Rhema Vaithianathan. 2019. Toward Algorithmic Accountability In Public Services: A Qualitative Study Of Affected Community Perspectives On Algorithmic Decision-Making In Child Welfare Services. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jenna Burrell, Zoe Kahn, Anne Jonas, and Daniel Griffin. 2019. When Users Control the Algorithms: Values Expressed in Practices on Twitter. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--20.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Online Censorship. [n.d.]. OFFLINE-ONLINE: data visuals exploring how content moderation practices impact marginalized communities. https://onlinecensorship.org/content/infographics.Google ScholarGoogle Scholar
  17. @cfiesler (Casey Fiesler). 2020. “OK I'm going to weigh in on the tagging/content moderation conversation happening right now”. https://twitter.com/cfiesler/status/1273300997801041920Google ScholarGoogle Scholar
  18. Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A Cross-Community Learning-Based System to Assist Reddit Moderators. Proc. ACM Hum.-Comput. Interact. CSCW (2019). https://doi.org/10.1145/3359276Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Qijin Cheng and Elad Yom-Tov. 2019. Do search engine helpline notices aid in preventing suicide? Analysis of archival data. Journal of medical internet research, Vol. 21, 3 (2019).Google ScholarGoogle ScholarCross RefCross Ref
  20. Alexander Cheves. 2018. The Dangerous Trend of LGBTQ Censorship on the Internet. Out Magazine (2018). http://www.out.com/out-exclusives/2018/12/06/dangerous-trend-lgbtq-censorship-internetGoogle ScholarGoogle Scholar
  21. Keith Coleman. 2021. Introducing Birdwatch, a community-based approach to misinformation. Twitter Blog (2021).Google ScholarGoogle Scholar
  22. Roger Coleman and Cherie Lebbon. 1999. Inclusive design. Helen Hamlyn Research Centre, Royal College of Art (1999).Google ScholarGoogle Scholar
  23. Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society, Vol. 18, 3 (2016), 410--428.Google ScholarGoogle Scholar
  24. Nigel Cross. 1982. Designerly ways of knowing. Design studies, Vol. 3, 4 (1982).Google ScholarGoogle Scholar
  25. Michael A DeVito, Darren Gergle, and Jeremy Birnholtz. 2017. Algorithms Ruin Everything: #RIPTwitter, Folk Theories, and Resistance to Algorithmic Change in Social Media. In Proc. CHI. https://doi.org/10.1145/3025453.3025659Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Nicholas Diakopoulos and Michael Koliska. 2017. Algorithmic Transparency in the News Media. Digital Journalism (2017). https://doi.org/10.1080/21670811.2016.1208053Google ScholarGoogle Scholar
  27. Carl DiSalvo, Jonathan Lukens, Thomas Lodato, Tom Jenkins, and Tanyoung Kim. 2014. Making Public Things: How HCI Design Can Express Matters of Concern. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Evelyn Douek. 2021. The Facebook Oversight Board's First Decisions: Ambitious, and Perhaps Impractical. Lawfare Blog (2021).Google ScholarGoogle Scholar
  29. Maximiliano Duron. 2019. Instagram Holds Closed-Door Roundtable with Artists on Art and Nudity. (2019). https://www.artnews.com/art-news/news/instagram-censorship-roundtable-13431/Google ScholarGoogle Scholar
  30. Elizabeth Dwoskin, Jeanne Whalen, and Regine Cabato. 2019. Content moderators at YouTube, Facebook and Twitter see the worst of the web and suffer silently. https://www.washingtonpost.com/technology/2019/07/25/social-media-companies-are-outsourcing-their-dirty-work-philippines-generation-workers-is-paying-priceGoogle ScholarGoogle Scholar
  31. Victoria Elliott. 2018. Thinking About the Coding Process in Qualitative Data Analysis. The Qualitative Report (2018).Google ScholarGoogle Scholar
  32. Jenny Fan and Amy X Zhang. 2020. Digital Juries: A Civics-Oriented Approach to Platform Governance. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Jessica L Feuston, Alex S Taylor, and Anne Marie Piper. 2020. Conformity of Eating Disorders through Content Moderation. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--28.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Juniper Fitzgerald and Jessie Sage. 2019. Shadowbans: Secret Policies Depriving Sex Workers of Income and Community. https://titsandsass.com/shadowbans-secret-policies-depriving-sex-workers-of-income-and-community/Google ScholarGoogle Scholar
  35. Eivind Flobak, Jo D Wake, Joakim Vindenes, Smiti Kahlon, Tine Nordgreen, and Frode Guribye. 2019. Participatory Design of VR Scenarios for Exposure Therapy. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Christine Floyd, Wolf-Michael Mehl, Fanny-Michaela Resin, Gerhard Schmidt, and Gregor Wolf. 1989. Out Of Scandinavia: Alternative Approaches To Software Design And System Development. Human-Computer Interaction, Vol. 4, 4 (1989), 253--350.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Chris Fox. 2020. TikTok admits restricting some LGBT hashtags. BBC News (September 2020). https://www.bbc.com/news/technology-54102575Google ScholarGoogle Scholar
  38. Sarah Fox, Mariam Asad, Katherine Lo, Jill P Dimond, Lynn S Dombrowski, and Shaowen Bardzell. 2016. Exploring Social Justice, Design, and HCI. In Proc. CHI Extended Abstracts.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Andrea Gasparini. 2015. Perspective and use of empathy in design thinking. In Proc. ACHI.Google ScholarGoogle Scholar
  40. Cally Gatehouse, Matthew Wood, Jo Briggs, James Pickles, and Shaun Lawson. 2018. Troubling vulnerability: Designing with LGBT young people's ambivalence towards hate crime reporting. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.Google ScholarGoogle Scholar
  42. G Anthony Gorry. 1973. Computer-Assisted Clinical Decision Making. Methods of Information in Medicine, Vol. 12, 1 (1973), 45.Google ScholarGoogle ScholarCross RefCross Ref
  43. Peter Leo Gorski, Yasemin Acar, Luigi Lo Iacono, and Sascha Fahl. 2020. Listen to Developers! A Participatory Design Study on Security Warnings for Cryptographic APIs. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Mary L Gray. 2009. Out in the country: Youth, media, and queer visibility in rural America .NYU Press.Google ScholarGoogle Scholar
  45. Rebecca Greenfield. 2012. Pinterest Has an Anorexia Problem Now. The Atlantic (March 2012). https://www.theatlantic.com/technology/archive/2012/03/pinterest-has-anorexia-problem-now-too/330315/Google ScholarGoogle Scholar
  46. Jessica Guynn. 2017. Facebook apologizes to black activist who was censored for calling out racism. USA Today (August 2017). https://www.usatoday.com/story/tech/2017/08/03/facebook-ijeoma-oluo-hate-speech/537682001/Google ScholarGoogle Scholar
  47. Oliver L Haimson, Avery Dame-Griff, Elias Capello, and Zahari Richter. 2019. Tumblr was a trans technology: the meaning, importance, history, and future of trans technologies. Feminist Media Studies (2019), 1--17.Google ScholarGoogle Scholar
  48. Oliver L Haimson, Dykee Gorrell, Denny L Starks, and Zu Weinger. 2020. Designing trans technology: Defining challenges and envisioning community-centered solutions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Oliver L Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing" authentic" identity online: Facebook, real names, and non-normative identities. First Monday (2016).Google ScholarGoogle Scholar
  50. Jean Hardy and Stefani Vargas. 2019. Participatory design and the future of rural LGBTQ communities. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion. 195--199.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Christina Harrington, Sheena Erete, and Anne Marie Piper. 2019. Deconstructing community-based collaborative design: Towards more equitable participatory design engagements. Proc. CSCW (2019).Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Jaz Hee-jeong Choi, Laura Forlano, and Denisa Kera. 2020. Situated Automation: Algorithmic Creatures in Participatory Design. In Proc. Participatory Design Conference.Google ScholarGoogle Scholar
  53. Ann Heylighen and Andy Dong. 2019. To empathise or not to empathise? Empathy and its limits in design. Design Studies (2019).Google ScholarGoogle Scholar
  54. Tad Hirsch, Kritzia Merced, Shrikanth Narayanan, Zac E Imel, and David C Atkins. 2017. Designing Contestability: Interaction Design, Machine Learning, And Mental Health. In Proc. DIS. 95--99.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Vivian Ho. 2018. Tumblr's adult content ban dismays some users: 'It was a safe space'. https://www.theguardian.com/technology/2018/dec/03/tumblr-adult-content-ban-lgbt-community-gender?__s=abutgqgfq3qtwvi5gq42Google ScholarGoogle Scholar
  56. Amanda Holpuch. 2015. Facebook still suspending Native Americans over `real name' policy. The Guardian (February 2015). https://www.theguardian.com/technology/2015/feb/16/facebook-real-name-policy-suspends-native-americansGoogle ScholarGoogle Scholar
  57. Tracy Jan and Elizabeth Dwoskin. 2017. A white man called her kids the n-word. Facebook stopped her from sharing it. https://www.washingtonpost.com/business/economy/for-facebook-erasing-hate-speech-proves-a-daunting-challenge/2017/07/31/922d9bc6--6e3b-11e7--9c15--177740635e83_story.html The Washington Post.Google ScholarGoogle Scholar
  58. Chantal Jandard. 2015. The “What Should I Design” Generator. http://www.whatshouldidesign.com/Google ScholarGoogle Scholar
  59. Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2018. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proceedings of the ACM on Human-Computer Interaction, Vol. 2 (2018).Google ScholarGoogle Scholar
  60. Michael Katell, Meg Young, Dharma Dailey, Bernease Herman, Vivian Guetler, Aaron Tam, Corinne Bintz, Daniella Raz, and PM Krafft. 2020. Toward Situated Interventions For Algorithmic Equity: Lessons From The Field. In Proc. FAT*.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Janet Kelly. 2019. Towards ethical principles for participatory design practice. CoDesign, Vol. 15, 4 (2019), 329--344.Google ScholarGoogle ScholarCross RefCross Ref
  62. Os Keyes, Josephine Hoy, and Margaret Drouhard. 2019. Human-Computer Insurrection: Notes on an Anarchist HCI. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Sunyoung Kim, Muyang Li, Jennifer Senick, and Gediminas Mainelis. 2020. Designing To Engage Children In Monitoring Indoor Air Quality: A Participatory Approach. In Proc. Interaction Design and Children. 323--334.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Kate Klonick. 2017. The new governors: The people, rules, and processes governing online speech. Harvard Law Review, Vol. 131 (2017), 1598.Google ScholarGoogle Scholar
  65. Daniel N Kluttz and Deirdre K Mulligan. 2019. Automated Decision Support Technologies And The Legal Profession. Berkeley Tech. Law Journal, Vol. 34 (2019), 853.Google ScholarGoogle Scholar
  66. Jason Koebler and Joseph Cox. 2018. The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (August 2018). https://www.vice.com/en_us/article/xwk9zd/how-facebook-content-moderation-worksGoogle ScholarGoogle Scholar
  67. Dev Raj Lamichhane and Janet C Read. 2020. Play It My Way: Participatory Mobile Game Design with Children in Rural Nepal. In International Conference on Human-Computer Interaction. Springer, 325--336.Google ScholarGoogle Scholar
  68. Kyle Langvardt. 2017. Regulating Online Content Moderation. Georgetown Law Journal, Vol. 106 (2017), 1353.Google ScholarGoogle Scholar
  69. Iris Latour. 2020. The guide to mastering online brainstorming: 20 Brainstorming Techniques That Work. https://miro.com/guides/online-brainstorming/techniques-methods#20-crazy-eightsGoogle ScholarGoogle Scholar
  70. Min Kyung Lee and Su Baykal. 2017. Algorithmic Mediation in Group Decisions: Fairness Perceptions of Algorithmically Mediated vs. Discussion-Based Social Division. In Proc. CSCW. ACM. https://doi.org/10.1145/2998181.2998230Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Min Kyung Lee, Anuraag Jain, Hea Jin Cha, Shashank Ojha, and Daniel Kusbit. 2019 a. Procedural justice in algorithmic fairness: Leveraging transparency and outcome control for fair algorithmic mediation. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--26.Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019 b. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35.Google ScholarGoogle Scholar
  73. Kimberly Leonard. 2015. Is Social Media Making Self-Harm Worse for Teens? US News (May 2015). https://www.usnews.com/news/articles/2015/05/29/is-social-media-making-self-harm-worse-for-teensGoogle ScholarGoogle Scholar
  74. Sam Levin. 2017. As Facebook blocks the names of trans users and drag queens, this burlesque performer is fighting back. The Guardian (June 2017). https://www.theguardian.com/world/2017/jun/29/facebook-real-name-trans-drag-queen-dottie-luxGoogle ScholarGoogle Scholar
  75. Karyne Levy. 2014. Facebook Apologizes For 'Real Name' Policy That Forced Drag Queens To Change Their Profiles. Business Insider (2014). https://www.businessinsider.com/facebook-apologizes-for-real-name-policy-2014--10Google ScholarGoogle Scholar
  76. Q Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: informing design practices for explainable AI user experiences. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Shannon Liao. 2019. After the porn ban, Tumblr users have ditched the platform as promised. The Verge. https://www.theverge.com/2019/3/14/18266013/tumblr-porn-ban-lost-users-down-traffic.Google ScholarGoogle Scholar
  78. Dottie Lux and Little Miss Hot Mess. 2017. Facebook's Hate Speech Policies Censor Marginalized Users. Wired (August 2017). https://www.wired.com/story/facebooks-hate-speech-policies-censor-marginalized-users/Google ScholarGoogle Scholar
  79. Amber Madison. 2015. When Social-Media Companies Censor Sex Education. https://www.theatlantic.com/health/archive/2015/03/when-social-media-censors-sex-education/385576/. The Atlantic.Google ScholarGoogle Scholar
  80. Aaron Mak. 2018. Facebook content moderation rules: How company decides what to remove. https://slate.com/technology/2018/04/facebook-content-moderation-rules-how-company-decides-what-to-remove.html. Slate.Google ScholarGoogle Scholar
  81. Ariadna Matamoros-Fernandez. 2017. Platformed racism: The mediation and circulation of an Australian race-based controversy on Twitter, Facebook and YouTube. Information, Communication & Society, Vol. 20, 6 (2017), 930--946.Google ScholarGoogle ScholarCross RefCross Ref
  82. J Matias, Amy Johnson, Whitney Erin Boesel, Brian Keegan, Jaclyn Friedman, and Charlie DeTar. 2015. Reporting, reviewing, and responding to harassment on Twitter. Available at SSRN 2602018 (2015).Google ScholarGoogle Scholar
  83. Louise Matsakis and Paris Martineau. 2020. Coronavirus Disrupts Social Media's First Line of Defense. Wired. https://www.wired.com/story/coronavirus-social-media-automated-content-moderation/.Google ScholarGoogle Scholar
  84. Michael J Muller and Allison Druin. 2012. Participatory Design: The Third Space In Human-Computer Interaction. In Human Computer Interaction Handbook. CRC Press, 1125--1153.Google ScholarGoogle Scholar
  85. Deirdre K Mulligan, Daniel Kluttz, and Nitin Kohli. 2019. Shaping Our Tools: Contestability as a Means to Promote Responsible Algorithmic Decision Making in the Professions. Available at SSRN 3311894 (2019).Google ScholarGoogle Scholar
  86. Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, Vol. 20, 11 (2018), 4366--4383.Google ScholarGoogle ScholarCross RefCross Ref
  87. David G Novick and Stephen Sutton. 1997. What is Mixed-Initiative Interaction. In Proc. AAAI Spring Symposium, Vol. 2. 12.Google ScholarGoogle Scholar
  88. Frank A Pasquale. 2011. Restoring transparency to automated authority. Journal on Telecommunications and High Technology Law, (2011).Google ScholarGoogle Scholar
  89. Delia Paunescu. 2019. Inside Instagram's nudity ban. (2019). https://www.vox.com/recode/2019/10/27/20932915/instagram-free-the-nipple-photo-facebook-nudity-ban-art-reset-podcastGoogle ScholarGoogle Scholar
  90. Abby Phillip. 2015. Online 'authenticity' and how Facebook's 'real name' policy hurts Native Americans. The Washington Post (February 2015). https://www.washingtonpost.com/news/morning-mix/wp/2015/02/10/online-authenticity-and-how-facebooks-real-name-policy-hurts-native-americans/Google ScholarGoogle Scholar
  91. Alisha Pradhan, Ben Jelen, Katie A Siek, Joel Chan, and Amanda Lazar. 2020. Understanding Older Adults' Participation in Design Workshops. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--15.Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. Ondvr ej Procházka. 2019. Making Sense of Facebook's Content Moderation: A Posthumanist Perspective on Communicative Competence and Internet Memes. Signs and Society, Vol. 7, 3 (2019), 362--397.Google ScholarGoogle ScholarCross RefCross Ref
  93. Adam Przeworski, Susan Carol Stokes Stokes, Susan C Stokes, and Bernard Manin. 1999. Democracy, accountability, and representation. Vol. 2. Cambridge University Press.Google ScholarGoogle Scholar
  94. Anniek Bao Qian Tong and Flynn Murphy. 2020. Young Shopkeeper's Suicide After WeChat Ban Highlights App's Influence Over 1.2 Billion Lives. Caixin Global (August 2020). https://www.caixinglobal.com/2020-08--28/young-shopkeepers-suicide-after-wechat-ban-highlights-apps-influence-over-12-billion-lives-101598510.htmlGoogle ScholarGoogle Scholar
  95. Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations as mechanisms for supporting algorithmic transparency. In Proc. CHI. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. Why should i trust you?: Explaining the predictions of any classifier. In Proc. KDD. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. Jane Ritchie, Jane Lewis, Carol McNaughton Nicholls, Rachel Ormston, et al. 2013. Qualitative research practice: A guide for social science students and researchers. Sage.Google ScholarGoogle Scholar
  98. Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work. In The Intersectional Internet: Race, Sex, Class and Culture Online, S. U. Noble and B. Tynes (Eds.). Peter Lang Publishing.Google ScholarGoogle Scholar
  99. Sarah T Roberts. 2018. Digital detritus: `Error' and the logic of opacity in social media content moderation. First Monday, Vol. 23, 3 (2018).Google ScholarGoogle ScholarCross RefCross Ref
  100. Adi Robertson. 2019. TikTok prevented disabled users? videos from showing up in feeds. The Verge (2019). https://www.theverge.com/2019/12/2/20991843/tiktok-bytedance-platform-disabled-autism-lgbt-fat-user-algorithm-reach-limitGoogle ScholarGoogle Scholar
  101. Aja Romano. 2018. Tumblr is banning adult content. It's about so much more than porn. Vox (2018).Google ScholarGoogle Scholar
  102. Elizabeth B-N Sanders and Pieter Jan Stappers. 2012. Convivial Toolbox: Generative Research for the Front End of Design. BIS Publishers.Google ScholarGoogle Scholar
  103. Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society (2019).Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. Claire Selvin. 2019. Betty Tompkins Ousted from Instagram for Posting Classic Painting of Penetration. https://www.artnews.com/art-news/news/betty-tompkins-expelled-from-instagram-12463/Google ScholarGoogle Scholar
  105. Limor Shifman. 2014. Memes in digital culture. MIT press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Edward Hance Shortliffe and Bruce G Buchanan. 1985. Rule-based Expert Systems: the MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley Publishing Company.Google ScholarGoogle Scholar
  107. Ellen Silver. 2018. Hard Questions: Who Reviews Objectionable Content on Facebook? And Is the Company Doing Enough to Support Them? https://newsroom.fb.com/news/2018/07/hard-questions-content-reviewers/Google ScholarGoogle Scholar
  108. Jesper Simonsen and Toni Robertson. 2012. Routledge International Handbook Of Participatory Design .Routledge.Google ScholarGoogle Scholar
  109. Olivia Solon. 2017a. Facebook is hiring moderators. But is the job too gruesome to handle? https://www.theguardian.com/technology/2017/may/04/facebook-content-moderators-ptsd-psychological-dangersGoogle ScholarGoogle Scholar
  110. Olivia Solon. 2017b. Underpaid and overburdened: the life of a Facebook moderator. The Guardian (May 2017). https://www.theguardian.com/news/2017/may/25/facebook-moderator-underpaid-overburdened-extreme-contentGoogle ScholarGoogle Scholar
  111. Olivia Solon. 2020. Facebook ignored racial bias research, employees say. NBC News (2020). https://www.nbcnews.com/tech/tech-news/facebook-management-ignored-internal-research-showing-racial-bias-current-former-n1234746Google ScholarGoogle Scholar
  112. Kaitlyn Tiffany. 2017. Twitter criticized for suspending popular LGBTQ academic @meakoopa. The Verge (June 2017). https://www.theverge.com/2017/6/13/15794296/twitter-suspended-meakoopa-anthony-oliveira-controversyGoogle ScholarGoogle Scholar
  113. Kaitlyn Tiffany. 2019. Tumblr's First Year Without Porn. The Atlantic (2019).Google ScholarGoogle Scholar
  114. Alexandra To, Hillary Carey, Geoff Kaufman, and Jessica Hammer. 2021. Reducing Uncertainty and Offering Comfort: Designing Technology for Coping with Interpersonal Racism. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. Kristen Vaccaro, Karrie Karahalios, Deirdre Mulligan, Daniel Kluttz, and Tad Hirsch. 2019. Contestability in Algorithmic Decision Making. In Proc. CSCW Workshops. ACM.Google ScholarGoogle Scholar
  116. Kristen Vaccaro, Christian Sandvig, and Karrie Karahalios. 2020. “At the End of the Day Facebook Does What It Wants”: How Users Experience Contesting Algorithmic Content Moderation. In Proc. CSCW. ACM.Google ScholarGoogle Scholar
  117. Maja Van der Velden, C Mörtberg, J Van den Hoven, PE Vermaas, and I Van de Poel. 2014. Participatory design and design for values. Development, Vol. 11, 3 (2014), 215--236.Google ScholarGoogle Scholar
  118. Richmond Y. Wong, Deirdre K. Mulligan, Ellen Van Wyk, James Pierce, and John Chuang. 2017. Eliciting Values Reflections by Engaging Privacy Futures Using Design Workbooks. Proc. ACM HCI CSCW (2017). https://doi.org/10.1145/3134746Google ScholarGoogle ScholarDigital LibraryDigital Library
  119. Allison Woodruff. 2019. 10 things you should know about algorithmic fairness. interactions, Vol. 26, 4 (2019), 47--51.Google ScholarGoogle Scholar
  120. Peter Wright and John McCarthy. 2008. Empathy and experience in HCI. In Proc. CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Contestability For Content Moderation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!