Abstract
Content moderation systems for social media have had numerous issues of bias, in terms of race, gender, and ability among many others. One proposal for addressing such issues in automated decision making is by designing for contestability, whereby users can shape and influence how decisions are made. In this study, we conduct a series of participatory design workshops with participants from communities that have experienced problems with social media content moderation in the past. Together with participants, we explore the idea of designing for contestability in content moderation and find that users' designs suggest three fruitful, practical avenues: adding representation, improving communication, and designing with compassion. We conclude with design recommendations drawn from participants' proposals, and reflect on the challenges that remain.
Supplemental Material
Available for Download
- Wajeeha Ahmad and Ilaria Liccardi. 2020. Addressing Anonymous Abuses: Measuring the Effects of Technical Mechanisms on Reported User Behaviors. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.Google Scholar
Digital Library
- Leigh Alexander. 2016. Facebook's censorship of Aboriginal bodies raises troubling ideas of “decency”. The Guardian (March 2016). https://www.theguardian.com/technology/2016/mar/23/facebook-censorship-topless-aboriginal-womenGoogle Scholar
- Marco Almada. 2019. Human Intervention In Automated Decision-Making: Toward The Construction Of Contestable Systems. In Proc. International Conference on Artificial Intelligence and Law. 2--11.Google Scholar
Digital Library
- Mike Ananny and Kate Crawford. 2018. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society (2018).Google Scholar
- Julia Angwin and Hannes Grassegger. 2017. Facebook's Secret Censorship Rules Protect White Men From Hate Speech But Not Black Children. https://www.propublica.org/article/facebook-hate-speech-censorship-internal-documents-algorithms. ProPublica.Google Scholar
- Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proc. CHI.Google Scholar
Digital Library
- Sam Biddle, Paulo Victor Ribeiro, and Tatiana Dias. 2020. TikTok Told Moderators: Suppress Posts by the "Ugly" and Poor. https://theintercept.com/2020/03/16/tiktok-app-moderators-users-discriminationGoogle Scholar
- Danielle Blunt, Ariel Wolf, Emily Coombes, and Shanelle Mullin. 2020. Posting Into the Void: Studying the Impact of Shadowbanning on Sex Workers and Activists. https://hackinghustling.org/posting-into-the-void-content-moderation/Google Scholar
- Ariel Bogle. 2019. Aussie sex workers were kicked off American websites so they built their own. https://www.abc.net.au/news/science/2019-06--22/fosta-sesta-laws-impact-australian-sex-workers-one-year-later/11229724Google Scholar
- Elena Botella. 2019. TikTok Admits It Suppressed Videos by Disabled, Queer, and Fat Creators. Slate (2019).Google Scholar
- Zach-Amaury Boufoy-Bastick and Lenandlar Singh. 2007. The Socio-Technical Indicator Model: Socially-Sensitive CMC Technology, with an Implementation of Representative Moderation. International Journal of Computer, Information, and Systems Science, and Engineering, Vol. 1 (2007), 1.Google Scholar
- Richard E Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development .sage.Google Scholar
- Tone Bratteteig and Guri Verne. 2018. Does AI Make PD Obsolete? Exploring Challenges From Artificial Intelligence To Participatory Design. In Proc. Participatory Design Conference.Google Scholar
- Anna Brown, Alexandra Chouldechova, Emily Putnam-Hornstein, Andrew Tobin, and Rhema Vaithianathan. 2019. Toward Algorithmic Accountability In Public Services: A Qualitative Study Of Affected Community Perspectives On Algorithmic Decision-Making In Child Welfare Services. In Proc. CHI.Google Scholar
Digital Library
- Jenna Burrell, Zoe Kahn, Anne Jonas, and Daniel Griffin. 2019. When Users Control the Algorithms: Values Expressed in Practices on Twitter. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--20.Google Scholar
Digital Library
- Online Censorship. [n.d.]. OFFLINE-ONLINE: data visuals exploring how content moderation practices impact marginalized communities. https://onlinecensorship.org/content/infographics.Google Scholar
- @cfiesler (Casey Fiesler). 2020. “OK I'm going to weigh in on the tagging/content moderation conversation happening right now”. https://twitter.com/cfiesler/status/1273300997801041920Google Scholar
- Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A Cross-Community Learning-Based System to Assist Reddit Moderators. Proc. ACM Hum.-Comput. Interact. CSCW (2019). https://doi.org/10.1145/3359276Google Scholar
Digital Library
- Qijin Cheng and Elad Yom-Tov. 2019. Do search engine helpline notices aid in preventing suicide? Analysis of archival data. Journal of medical internet research, Vol. 21, 3 (2019).Google Scholar
Cross Ref
- Alexander Cheves. 2018. The Dangerous Trend of LGBTQ Censorship on the Internet. Out Magazine (2018). http://www.out.com/out-exclusives/2018/12/06/dangerous-trend-lgbtq-censorship-internetGoogle Scholar
- Keith Coleman. 2021. Introducing Birdwatch, a community-based approach to misinformation. Twitter Blog (2021).Google Scholar
- Roger Coleman and Cherie Lebbon. 1999. Inclusive design. Helen Hamlyn Research Centre, Royal College of Art (1999).Google Scholar
- Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society, Vol. 18, 3 (2016), 410--428.Google Scholar
- Nigel Cross. 1982. Designerly ways of knowing. Design studies, Vol. 3, 4 (1982).Google Scholar
- Michael A DeVito, Darren Gergle, and Jeremy Birnholtz. 2017. Algorithms Ruin Everything: #RIPTwitter, Folk Theories, and Resistance to Algorithmic Change in Social Media. In Proc. CHI. https://doi.org/10.1145/3025453.3025659Google Scholar
Digital Library
- Nicholas Diakopoulos and Michael Koliska. 2017. Algorithmic Transparency in the News Media. Digital Journalism (2017). https://doi.org/10.1080/21670811.2016.1208053Google Scholar
- Carl DiSalvo, Jonathan Lukens, Thomas Lodato, Tom Jenkins, and Tanyoung Kim. 2014. Making Public Things: How HCI Design Can Express Matters of Concern. In Proc. CHI.Google Scholar
Digital Library
- Evelyn Douek. 2021. The Facebook Oversight Board's First Decisions: Ambitious, and Perhaps Impractical. Lawfare Blog (2021).Google Scholar
- Maximiliano Duron. 2019. Instagram Holds Closed-Door Roundtable with Artists on Art and Nudity. (2019). https://www.artnews.com/art-news/news/instagram-censorship-roundtable-13431/Google Scholar
- Elizabeth Dwoskin, Jeanne Whalen, and Regine Cabato. 2019. Content moderators at YouTube, Facebook and Twitter see the worst of the web and suffer silently. https://www.washingtonpost.com/technology/2019/07/25/social-media-companies-are-outsourcing-their-dirty-work-philippines-generation-workers-is-paying-priceGoogle Scholar
- Victoria Elliott. 2018. Thinking About the Coding Process in Qualitative Data Analysis. The Qualitative Report (2018).Google Scholar
- Jenny Fan and Amy X Zhang. 2020. Digital Juries: A Civics-Oriented Approach to Platform Governance. In Proc. CHI.Google Scholar
Digital Library
- Jessica L Feuston, Alex S Taylor, and Anne Marie Piper. 2020. Conformity of Eating Disorders through Content Moderation. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--28.Google Scholar
Digital Library
- Juniper Fitzgerald and Jessie Sage. 2019. Shadowbans: Secret Policies Depriving Sex Workers of Income and Community. https://titsandsass.com/shadowbans-secret-policies-depriving-sex-workers-of-income-and-community/Google Scholar
- Eivind Flobak, Jo D Wake, Joakim Vindenes, Smiti Kahlon, Tine Nordgreen, and Frode Guribye. 2019. Participatory Design of VR Scenarios for Exposure Therapy. In Proc. CHI.Google Scholar
Digital Library
- Christine Floyd, Wolf-Michael Mehl, Fanny-Michaela Resin, Gerhard Schmidt, and Gregor Wolf. 1989. Out Of Scandinavia: Alternative Approaches To Software Design And System Development. Human-Computer Interaction, Vol. 4, 4 (1989), 253--350.Google Scholar
Digital Library
- Chris Fox. 2020. TikTok admits restricting some LGBT hashtags. BBC News (September 2020). https://www.bbc.com/news/technology-54102575Google Scholar
- Sarah Fox, Mariam Asad, Katherine Lo, Jill P Dimond, Lynn S Dombrowski, and Shaowen Bardzell. 2016. Exploring Social Justice, Design, and HCI. In Proc. CHI Extended Abstracts.Google Scholar
Digital Library
- Andrea Gasparini. 2015. Perspective and use of empathy in design thinking. In Proc. ACHI.Google Scholar
- Cally Gatehouse, Matthew Wood, Jo Briggs, James Pickles, and Shaun Lawson. 2018. Troubling vulnerability: Designing with LGBT young people's ambivalence towards hate crime reporting. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.Google Scholar
Digital Library
- Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press.Google Scholar
- G Anthony Gorry. 1973. Computer-Assisted Clinical Decision Making. Methods of Information in Medicine, Vol. 12, 1 (1973), 45.Google Scholar
Cross Ref
- Peter Leo Gorski, Yasemin Acar, Luigi Lo Iacono, and Sascha Fahl. 2020. Listen to Developers! A Participatory Design Study on Security Warnings for Cryptographic APIs. In Proc. CHI.Google Scholar
Digital Library
- Mary L Gray. 2009. Out in the country: Youth, media, and queer visibility in rural America .NYU Press.Google Scholar
- Rebecca Greenfield. 2012. Pinterest Has an Anorexia Problem Now. The Atlantic (March 2012). https://www.theatlantic.com/technology/archive/2012/03/pinterest-has-anorexia-problem-now-too/330315/Google Scholar
- Jessica Guynn. 2017. Facebook apologizes to black activist who was censored for calling out racism. USA Today (August 2017). https://www.usatoday.com/story/tech/2017/08/03/facebook-ijeoma-oluo-hate-speech/537682001/Google Scholar
- Oliver L Haimson, Avery Dame-Griff, Elias Capello, and Zahari Richter. 2019. Tumblr was a trans technology: the meaning, importance, history, and future of trans technologies. Feminist Media Studies (2019), 1--17.Google Scholar
- Oliver L Haimson, Dykee Gorrell, Denny L Starks, and Zu Weinger. 2020. Designing trans technology: Defining challenges and envisioning community-centered solutions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.Google Scholar
Digital Library
- Oliver L Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing" authentic" identity online: Facebook, real names, and non-normative identities. First Monday (2016).Google Scholar
- Jean Hardy and Stefani Vargas. 2019. Participatory design and the future of rural LGBTQ communities. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion. 195--199.Google Scholar
Digital Library
- Christina Harrington, Sheena Erete, and Anne Marie Piper. 2019. Deconstructing community-based collaborative design: Towards more equitable participatory design engagements. Proc. CSCW (2019).Google Scholar
Digital Library
- Jaz Hee-jeong Choi, Laura Forlano, and Denisa Kera. 2020. Situated Automation: Algorithmic Creatures in Participatory Design. In Proc. Participatory Design Conference.Google Scholar
- Ann Heylighen and Andy Dong. 2019. To empathise or not to empathise? Empathy and its limits in design. Design Studies (2019).Google Scholar
- Tad Hirsch, Kritzia Merced, Shrikanth Narayanan, Zac E Imel, and David C Atkins. 2017. Designing Contestability: Interaction Design, Machine Learning, And Mental Health. In Proc. DIS. 95--99.Google Scholar
Digital Library
- Vivian Ho. 2018. Tumblr's adult content ban dismays some users: 'It was a safe space'. https://www.theguardian.com/technology/2018/dec/03/tumblr-adult-content-ban-lgbt-community-gender?__s=abutgqgfq3qtwvi5gq42Google Scholar
- Amanda Holpuch. 2015. Facebook still suspending Native Americans over `real name' policy. The Guardian (February 2015). https://www.theguardian.com/technology/2015/feb/16/facebook-real-name-policy-suspends-native-americansGoogle Scholar
- Tracy Jan and Elizabeth Dwoskin. 2017. A white man called her kids the n-word. Facebook stopped her from sharing it. https://www.washingtonpost.com/business/economy/for-facebook-erasing-hate-speech-proves-a-daunting-challenge/2017/07/31/922d9bc6--6e3b-11e7--9c15--177740635e83_story.html The Washington Post.Google Scholar
- Chantal Jandard. 2015. The “What Should I Design” Generator. http://www.whatshouldidesign.com/Google Scholar
- Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2018. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proceedings of the ACM on Human-Computer Interaction, Vol. 2 (2018).Google Scholar
- Michael Katell, Meg Young, Dharma Dailey, Bernease Herman, Vivian Guetler, Aaron Tam, Corinne Bintz, Daniella Raz, and PM Krafft. 2020. Toward Situated Interventions For Algorithmic Equity: Lessons From The Field. In Proc. FAT*.Google Scholar
Digital Library
- Janet Kelly. 2019. Towards ethical principles for participatory design practice. CoDesign, Vol. 15, 4 (2019), 329--344.Google Scholar
Cross Ref
- Os Keyes, Josephine Hoy, and Margaret Drouhard. 2019. Human-Computer Insurrection: Notes on an Anarchist HCI. In Proc. CHI.Google Scholar
Digital Library
- Sunyoung Kim, Muyang Li, Jennifer Senick, and Gediminas Mainelis. 2020. Designing To Engage Children In Monitoring Indoor Air Quality: A Participatory Approach. In Proc. Interaction Design and Children. 323--334.Google Scholar
Digital Library
- Kate Klonick. 2017. The new governors: The people, rules, and processes governing online speech. Harvard Law Review, Vol. 131 (2017), 1598.Google Scholar
- Daniel N Kluttz and Deirdre K Mulligan. 2019. Automated Decision Support Technologies And The Legal Profession. Berkeley Tech. Law Journal, Vol. 34 (2019), 853.Google Scholar
- Jason Koebler and Joseph Cox. 2018. The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (August 2018). https://www.vice.com/en_us/article/xwk9zd/how-facebook-content-moderation-worksGoogle Scholar
- Dev Raj Lamichhane and Janet C Read. 2020. Play It My Way: Participatory Mobile Game Design with Children in Rural Nepal. In International Conference on Human-Computer Interaction. Springer, 325--336.Google Scholar
- Kyle Langvardt. 2017. Regulating Online Content Moderation. Georgetown Law Journal, Vol. 106 (2017), 1353.Google Scholar
- Iris Latour. 2020. The guide to mastering online brainstorming: 20 Brainstorming Techniques That Work. https://miro.com/guides/online-brainstorming/techniques-methods#20-crazy-eightsGoogle Scholar
- Min Kyung Lee and Su Baykal. 2017. Algorithmic Mediation in Group Decisions: Fairness Perceptions of Algorithmically Mediated vs. Discussion-Based Social Division. In Proc. CSCW. ACM. https://doi.org/10.1145/2998181.2998230Google Scholar
Digital Library
- Min Kyung Lee, Anuraag Jain, Hea Jin Cha, Shashank Ojha, and Daniel Kusbit. 2019 a. Procedural justice in algorithmic fairness: Leveraging transparency and outcome control for fair algorithmic mediation. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--26.Google Scholar
Digital Library
- Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019 b. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35.Google Scholar
- Kimberly Leonard. 2015. Is Social Media Making Self-Harm Worse for Teens? US News (May 2015). https://www.usnews.com/news/articles/2015/05/29/is-social-media-making-self-harm-worse-for-teensGoogle Scholar
- Sam Levin. 2017. As Facebook blocks the names of trans users and drag queens, this burlesque performer is fighting back. The Guardian (June 2017). https://www.theguardian.com/world/2017/jun/29/facebook-real-name-trans-drag-queen-dottie-luxGoogle Scholar
- Karyne Levy. 2014. Facebook Apologizes For 'Real Name' Policy That Forced Drag Queens To Change Their Profiles. Business Insider (2014). https://www.businessinsider.com/facebook-apologizes-for-real-name-policy-2014--10Google Scholar
- Q Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: informing design practices for explainable AI user experiences. In Proc. CHI.Google Scholar
Digital Library
- Shannon Liao. 2019. After the porn ban, Tumblr users have ditched the platform as promised. The Verge. https://www.theverge.com/2019/3/14/18266013/tumblr-porn-ban-lost-users-down-traffic.Google Scholar
- Dottie Lux and Little Miss Hot Mess. 2017. Facebook's Hate Speech Policies Censor Marginalized Users. Wired (August 2017). https://www.wired.com/story/facebooks-hate-speech-policies-censor-marginalized-users/Google Scholar
- Amber Madison. 2015. When Social-Media Companies Censor Sex Education. https://www.theatlantic.com/health/archive/2015/03/when-social-media-censors-sex-education/385576/. The Atlantic.Google Scholar
- Aaron Mak. 2018. Facebook content moderation rules: How company decides what to remove. https://slate.com/technology/2018/04/facebook-content-moderation-rules-how-company-decides-what-to-remove.html. Slate.Google Scholar
- Ariadna Matamoros-Fernandez. 2017. Platformed racism: The mediation and circulation of an Australian race-based controversy on Twitter, Facebook and YouTube. Information, Communication & Society, Vol. 20, 6 (2017), 930--946.Google Scholar
Cross Ref
- J Matias, Amy Johnson, Whitney Erin Boesel, Brian Keegan, Jaclyn Friedman, and Charlie DeTar. 2015. Reporting, reviewing, and responding to harassment on Twitter. Available at SSRN 2602018 (2015).Google Scholar
- Louise Matsakis and Paris Martineau. 2020. Coronavirus Disrupts Social Media's First Line of Defense. Wired. https://www.wired.com/story/coronavirus-social-media-automated-content-moderation/.Google Scholar
- Michael J Muller and Allison Druin. 2012. Participatory Design: The Third Space In Human-Computer Interaction. In Human Computer Interaction Handbook. CRC Press, 1125--1153.Google Scholar
- Deirdre K Mulligan, Daniel Kluttz, and Nitin Kohli. 2019. Shaping Our Tools: Contestability as a Means to Promote Responsible Algorithmic Decision Making in the Professions. Available at SSRN 3311894 (2019).Google Scholar
- Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, Vol. 20, 11 (2018), 4366--4383.Google Scholar
Cross Ref
- David G Novick and Stephen Sutton. 1997. What is Mixed-Initiative Interaction. In Proc. AAAI Spring Symposium, Vol. 2. 12.Google Scholar
- Frank A Pasquale. 2011. Restoring transparency to automated authority. Journal on Telecommunications and High Technology Law, (2011).Google Scholar
- Delia Paunescu. 2019. Inside Instagram's nudity ban. (2019). https://www.vox.com/recode/2019/10/27/20932915/instagram-free-the-nipple-photo-facebook-nudity-ban-art-reset-podcastGoogle Scholar
- Abby Phillip. 2015. Online 'authenticity' and how Facebook's 'real name' policy hurts Native Americans. The Washington Post (February 2015). https://www.washingtonpost.com/news/morning-mix/wp/2015/02/10/online-authenticity-and-how-facebooks-real-name-policy-hurts-native-americans/Google Scholar
- Alisha Pradhan, Ben Jelen, Katie A Siek, Joel Chan, and Amanda Lazar. 2020. Understanding Older Adults' Participation in Design Workshops. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--15.Google Scholar
Digital Library
- Ondvr ej Procházka. 2019. Making Sense of Facebook's Content Moderation: A Posthumanist Perspective on Communicative Competence and Internet Memes. Signs and Society, Vol. 7, 3 (2019), 362--397.Google Scholar
Cross Ref
- Adam Przeworski, Susan Carol Stokes Stokes, Susan C Stokes, and Bernard Manin. 1999. Democracy, accountability, and representation. Vol. 2. Cambridge University Press.Google Scholar
- Anniek Bao Qian Tong and Flynn Murphy. 2020. Young Shopkeeper's Suicide After WeChat Ban Highlights App's Influence Over 1.2 Billion Lives. Caixin Global (August 2020). https://www.caixinglobal.com/2020-08--28/young-shopkeepers-suicide-after-wechat-ban-highlights-apps-influence-over-12-billion-lives-101598510.htmlGoogle Scholar
- Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations as mechanisms for supporting algorithmic transparency. In Proc. CHI. ACM.Google Scholar
Digital Library
- Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. Why should i trust you?: Explaining the predictions of any classifier. In Proc. KDD. ACM.Google Scholar
Digital Library
- Jane Ritchie, Jane Lewis, Carol McNaughton Nicholls, Rachel Ormston, et al. 2013. Qualitative research practice: A guide for social science students and researchers. Sage.Google Scholar
- Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work. In The Intersectional Internet: Race, Sex, Class and Culture Online, S. U. Noble and B. Tynes (Eds.). Peter Lang Publishing.Google Scholar
- Sarah T Roberts. 2018. Digital detritus: `Error' and the logic of opacity in social media content moderation. First Monday, Vol. 23, 3 (2018).Google Scholar
Cross Ref
- Adi Robertson. 2019. TikTok prevented disabled users? videos from showing up in feeds. The Verge (2019). https://www.theverge.com/2019/12/2/20991843/tiktok-bytedance-platform-disabled-autism-lgbt-fat-user-algorithm-reach-limitGoogle Scholar
- Aja Romano. 2018. Tumblr is banning adult content. It's about so much more than porn. Vox (2018).Google Scholar
- Elizabeth B-N Sanders and Pieter Jan Stappers. 2012. Convivial Toolbox: Generative Research for the Front End of Design. BIS Publishers.Google Scholar
- Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society (2019).Google Scholar
Digital Library
- Claire Selvin. 2019. Betty Tompkins Ousted from Instagram for Posting Classic Painting of Penetration. https://www.artnews.com/art-news/news/betty-tompkins-expelled-from-instagram-12463/Google Scholar
- Limor Shifman. 2014. Memes in digital culture. MIT press.Google Scholar
Digital Library
- Edward Hance Shortliffe and Bruce G Buchanan. 1985. Rule-based Expert Systems: the MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley Publishing Company.Google Scholar
- Ellen Silver. 2018. Hard Questions: Who Reviews Objectionable Content on Facebook? And Is the Company Doing Enough to Support Them? https://newsroom.fb.com/news/2018/07/hard-questions-content-reviewers/Google Scholar
- Jesper Simonsen and Toni Robertson. 2012. Routledge International Handbook Of Participatory Design .Routledge.Google Scholar
- Olivia Solon. 2017a. Facebook is hiring moderators. But is the job too gruesome to handle? https://www.theguardian.com/technology/2017/may/04/facebook-content-moderators-ptsd-psychological-dangersGoogle Scholar
- Olivia Solon. 2017b. Underpaid and overburdened: the life of a Facebook moderator. The Guardian (May 2017). https://www.theguardian.com/news/2017/may/25/facebook-moderator-underpaid-overburdened-extreme-contentGoogle Scholar
- Olivia Solon. 2020. Facebook ignored racial bias research, employees say. NBC News (2020). https://www.nbcnews.com/tech/tech-news/facebook-management-ignored-internal-research-showing-racial-bias-current-former-n1234746Google Scholar
- Kaitlyn Tiffany. 2017. Twitter criticized for suspending popular LGBTQ academic @meakoopa. The Verge (June 2017). https://www.theverge.com/2017/6/13/15794296/twitter-suspended-meakoopa-anthony-oliveira-controversyGoogle Scholar
- Kaitlyn Tiffany. 2019. Tumblr's First Year Without Porn. The Atlantic (2019).Google Scholar
- Alexandra To, Hillary Carey, Geoff Kaufman, and Jessica Hammer. 2021. Reducing Uncertainty and Offering Comfort: Designing Technology for Coping with Interpersonal Racism. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.Google Scholar
Digital Library
- Kristen Vaccaro, Karrie Karahalios, Deirdre Mulligan, Daniel Kluttz, and Tad Hirsch. 2019. Contestability in Algorithmic Decision Making. In Proc. CSCW Workshops. ACM.Google Scholar
- Kristen Vaccaro, Christian Sandvig, and Karrie Karahalios. 2020. “At the End of the Day Facebook Does What It Wants”: How Users Experience Contesting Algorithmic Content Moderation. In Proc. CSCW. ACM.Google Scholar
- Maja Van der Velden, C Mörtberg, J Van den Hoven, PE Vermaas, and I Van de Poel. 2014. Participatory design and design for values. Development, Vol. 11, 3 (2014), 215--236.Google Scholar
- Richmond Y. Wong, Deirdre K. Mulligan, Ellen Van Wyk, James Pierce, and John Chuang. 2017. Eliciting Values Reflections by Engaging Privacy Futures Using Design Workbooks. Proc. ACM HCI CSCW (2017). https://doi.org/10.1145/3134746Google Scholar
Digital Library
- Allison Woodruff. 2019. 10 things you should know about algorithmic fairness. interactions, Vol. 26, 4 (2019), 47--51.Google Scholar
- Peter Wright and John McCarthy. 2008. Empathy and experience in HCI. In Proc. CHI.Google Scholar
Digital Library
Index Terms
Contestability For Content Moderation
Recommendations
Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels
CSCW2When toxic online communities on mainstream platforms face moderation measures, such as bans, they may migrate to other platforms with laxer policies or set up their own dedicated websites. Previous work suggests that within mainstream platforms, ...
Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas
CSCW2Social media sites use content moderation to attempt to cultivate safe spaces with accurate information for their users. However, content moderation decisions may not be applied equally for all types of users, and may lead to disproportionate censorship ...
A Trade-off-centered Framework of Content Moderation
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it ...






Comments