No Humans Here: Ethical Speculation on Public Data, Unintended Consequences, and the Limits of Institutional Review

Abstract

Many research communities routinely conduct activities that fall outside the bounds of traditional human subjects research, yet still frequently rely on the determinations of institutional review boards (IRBs) or similar regulatory bodies to scope ethical decision-making. Presented as a U.S. university-based fictional memo describing a post-hoc IRB review of a research study about social media and public health, this design fiction draws inspiration from current debates and uncertainties in the HCI and social computing communities around issues such as the use of public data, privacy, open science, and unintended consequences, in order to highlight the limitations of regulatory bodies as arbiters of ethics and the importance of forward-thinking ethical considerations from researchers and research communities.

References

1. Nazanin Andalibi and Justin Buss. 2020. The Human in Emotion Recognition on Social Media: Attitudes, Outcomes, Risks. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--16. https://doi.org/10.1145/3313831.3376680
2. Nazanin Andalibi, Pinar Rzturk, and Andrea Forte. 2017. Sensitive Self-Disclosures, Responses, and Social Support on Instagram: The Case of #Depression. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW '17). Association for Computing Machinery, New York, NY, USA, 1485--1500. https://doi.org/10.1145/2998181.2998243
3. Jyoti Angal, Julie M. Petersen, Deborah Tobacco, and Amy J. Elliott. 2016. Ethics review for a multi-site project involving tribal nations in the northern plains. Journal of Empirical Research on Human Research Ethics , Vol. 11, 2 (2016), 91--96.
4. Pernille Bjorn, Casey Fiesler, Michael Muller, Jessica Pater, and Pamela Wisniewski. 2018. Research Ethics Town Hall Meeting. In Proceedings of the 2018 ACM Conference on Supporting Groupwork (Sanibel Island, Florida, USA) (GROUP '18). Association for Computing Machinery, New York, NY, USA, 393--396. https://doi.org/10.1145/3148330.3154523
5. Mark Blythe. 2014. Research through Design Fiction: Narrative in Real and Imaginary Abstracts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 703--712. https://doi.org/10.1145/2556288.2557098
6. Urie Brofenbrenner. 1992. Ecological systems theory .Jessica Kingsley Publishers.
7. Amy Bruckman. 2020. 'Have You Thought About?': Talking about Ethical Implications of Research. Commun. ACM , Vol. 63, 9 (Aug. 2020), 38--40. https://doi.org/10.1145/3377405
8. Elizabeth Buchanan, John Aycock, Scott Dexter, David Dittrich, and Erin Hvizdak. 2011. Computer science security research and human subjects: Emerging considerations for research ethics boards. Journal of Empirical Research on Human Research Ethics , Vol. 6, 2 (2011), 71--83. https://doi.org/10.1525/jer.2011.6.2.71
9. Stevie Chancellor, Shion Guha, Jofish Kaye, Jen King, Niloufar Salehi, Sarita Schoenbeck, and Elizabeth Stowell. 2019. The Relationships between Data, Power, and Justice in CSCW Research. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing (Austin, TX, USA) (CSCW '19). Association for Computing Machinery, New York, NY, USA, 102--105. https://doi.org/10.1145/3311957.3358609
10. Lauren E. Charles-Smith, Tera L. Reynolds, Mark A. Cameron, Mike Conway, Eric HY Lau, Jennifer M. Olsen, and Julie A. Pavlin. 2015. Using social media for actionable disease surveillance and outbreak management: a systematic literature review. PloS one , Vol. 10, 10 (2015), e0139701. https://doi.org/10.1371/journal.pone.0139701
11. Monica Chin. 2021. How a University got Itself Banned from the Linux Kernel. (2021). https://www.theverge.com/2021/4/30/22410164/linux-kernel-university-of-minnesota-banned-open-source
12. Munmun De Choudhury, Scott Counts, and Eric Horvitz. 2013. Social Media as a Measurement Tool of Depression in Populations. In Proceedings of the 5th Annual ACM Web Science Conference (Paris, France) (WebSci '13). Association for Computing Machinery, New York, NY, USA, 47--56. https://doi.org/10.1145/2464464.2464480
13. Kerstin Denecke, Peter Dolog, and Pavel Smrz. 2012. Making Use of Social Media Data in Public Health. In Proceedings of the 21st International Conference on World Wide Web (Lyon, France) (WWW '12 Companion). Association for Computing Machinery, New York, NY, USA, 243--246. https://doi.org/10.1145/2187980.2188019
14. Brianna Dym and Casey Fiesler. 2020. Ethical and privacy considerations for research using online fandom data. Transformative Works and Cultures , Vol. 33 (2020).
15. Elisabeth S. Faller and Claudia Norman. 2015. Ethics & the IRB review process: A guide for SoTL researchers at UC . https://www.uc.edu/content/dam/uc/cetl/docs/IRB|%20for|&20SoTL.pdf
16. S. Fazeli, D. Zamanzadeh, A. Ovalle, T. Nguyen, and G. Gee adn M. Sarrafzadeh. 2021. COVID-19 and Big Data: Multi-faceted Analysis for Spatio-temporal Understanding of the Pandemic with Social Media Conversations. arXiv preprint arXiv:2104.10807 (2021).
17. Casey Fiesler. 2019. Ethical Considerations for Research Involving (Speculative) Public Data. Proc. ACM Hum.-Comput. Interact. , Vol. 3, GROUP, Article 249 (Dec. 2019), bibinfonumpages13 pages. https://doi.org/10.1145/3370271
18. Casey Fiesler. 2021. Innovating Like an Optimist, Preparing Like a Pessimist: Ethical Speculation and the Legal Imagination. Colorado Technology Law Journal , Vol. 19, 1 (2021).
19. Casey Fiesler and Nicholas Proferes. 2018. "Participant" perceptions of Twitter research ethics. Social Media
20. Society , Vol. 4, 1 (2018).
21. Casey Fiesler, Pamela Wisniewski, Jessica Pater, and Nazanin Andalibi. 2016. Exploring Ethics and Obligations for Studying Digital Communities. In Proceedings of the 19th International Conference on Supporting Group Work (Sanibel Island, Florida, USA) (GROUP '16). Association for Computing Machinery, New York, NY, USA, 457--460. https://doi.org/10.1145/2957276.2996293
22. Max Fleming, Priyanka Dondeti, Caitlin N. Dreisbach, and Adam Poliak. 2021. Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets. arXiv preprint arXiv:2104.05501 (2021).
23. Centers for Disease Control and Prevention. 2015. The social-ecological model: A framework for prevention. (2015). https://www.cdc.gov/violenceprevention/about/social-ecologicalmodel.html
24. Centere for the Governance of AI. 2020. A Guide to Writing the NeurIPS Impact Statement. (2020). https://medium.com/@GovAI/a-guide-to-writing-the-neurips-impact-statement-4293b723f832
25. Eduard Fosch-Villaronga, A. Poulsen, Roger Andre Søraa, and B. H. M. Custers. 2021. A little bird told me your gender: Gender inferences in social media. Information Processing & Management , Vol. 58, 3 (2021), 102541. https://doi.org/10.1016/j.ipm.2021.102541
26. Phoebe Friesen, Rachel Douglas-Jones, Mason Marks, Robin Pierce, Katherine Fletcher, Abhishek Mishra, Jessica Lorimer, Carissa Véliz, Nina Hallowell, Mackenzie Graham, Mei Sum Chan, Huw Davies, and Taj Sallamuddin. 2021. Governing AI-Driven Health Research: Are IRBs Up to the Task? Ethics & human research , Vol. 43, 2 (2021), 35--42. https://doi.org/10.1002/eahr.500085
27. Venkata Rama Kiran Garimella, Abdulrahman Alfayad, and Ingar Weber. 2016. Social Media Image Analysis for Public Health. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 5543--5547. https://doi.org/10.1145/2858036.2858234
28. C. Kristina Gunsalus, Nicholas C. Burbules Edward M. Bruner, Leon Dash, Matthew Finkin, Joseph P. Goldberg, and William T. Greenough. 2007. The Illinois white paper: Improving the system for protecting human subjects: Counteracting IRB ?mission creep". Qualitative Inquiry , Vol. 13, 5 (2007), 617--649.
29. Gary Harrison and William L. Gannon. 2015. Victor Frankenstein's Institutional Review Board Proposal, 1790. Science and Engineering Ethics , Vol. 21, 5 (2015), 1139--1157. https://doi.org/10.1007/s11948-014--9588-y
30. Molly Havard and David Magnus. 2011. Beyond the IRB: Local Service Versus Global Oversight. The American Journal of BioEthics , Vol. 11, 5 (2011), 1--2. https://doi.org/10.1080/15265161.2011.576932
31. Brent Hecht. 2018. It's time to do something: Mitigating the negative impacts of computing through a change to the peer review process. (2018). https://acm-fca.org/2018/03/29/negativeimpacts/
32. Liaquat Hossain, D. Kam, F. Kong, R. T. Wigand, and Terence Bossomaier. 2016. Social media in Ebola outbreak. Epidemiology & Infection , Vol. 144, 10 (2016), 2136--2143.
33. Matthew Hutson. 2021. Who Should Stop Unethical A.I.? (2021). https://www.newyorker.com/tech/annals-of-technology/who-should-stop-unethical-ai
34. Michal Kosinski. 2021. Facial recognition technology can expose political orientation from naturalistic facial images. Scientific reports , Vol. 11, 1 (2021), 1--7. https://doi.org/10.1038/s41598-020--79310--1
35. Yubo Kou, Xinning Gui, Yunan Chen, and Kathleen Pine. 2017. Conspiracy Talk on Social Media: Collective Sensemaking during a Public Health Crisis. Proc. ACM Hum.-Comput. Interact. , Vol. 1, CSCW, Article 61 (Dec. 2017), bibinfonumpages21 pages. https://doi.org/10.1145/3134696
36. Adam DI Kramer, Jamie E. Guillory, and Jeffrey T. Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences , Vol. 111, 24 (2014), 8788--8790. https://doi.org/10.1073/pnas.1320040111
37. Joseph Lindley and Paul Coulton. 2016. Pushing the Limits of Design Fiction: The Case For Fictional Research Papers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 4032--4043. https://doi.org/10.1145/2858036.2858446
38. Cosmin Munteanu, Heather Molneaux, Wendy Moncur, Mario Romero, Susan O'Donnell, and John Vines. 2015. Situational Ethics: Re-Thinking Approaches to Formal Ethics Requirements for Human-Computer Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 105--114. https://doi.org/10.1145/2702123.2702481
39. Jessica Pater, Oliver L. Haimson, Nazanin Andalibi, and Elizabeth D. Mynatt. 2016. "Hunger Hurts but Starving Works": Characterizing the Presentation of Eating Disorders Online. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW '16). Association for Computing Machinery, New York, NY, USA, 1185--1200. https://doi.org/10.1145/2818048.2820030
40. Jessica Pater, Alicia Nobles, Sarah Gilbert, Michael Zimmer, and Casey Fiesler. 2020. Data is People: New Challenges and Tensions in Social Media Research. In 14TH International Conference on Web and Social Media (ICWSM). AAAI.
41. EU: General Data Protection Regulation. 2021. Chapter 2, Article 6: Data Processing. (2021). https://gdpr-info.eu/art-6-gdpr/
42. Abeed Sarker, Sahithi Lakamana, Whitney Hogg-Bremer, Angel Xie, Mohammed Ali Al-Garadi, and Yuan-Chi Yang. 2020. Self-reported COVID-19 symptoms on Twitter: an analysis and a research resource. Journal of the American Medical Informatics Association , Vol. 27, 8 (2020), 1310--1315.
43. Judy Shen and Frank Rudzicz. 2017. Detecting anxiety through reddit. In Proceedings of the Fourth Workshop on Computational Linguistics and Clinical Psychology-From Linguistic Signal to Clinical Reality. 58--65.
44. Katie Shilton, Emanuel Moss, Sarah A. Gilbert, Matthew J. Bietz, Casey Fiesler, Jacob Metcalf adn Jessica Vitak, and Michael Zimmer. 2021. Excavating awareness and power in data science: A manifesto for trustworthy pervasive data research. Big Data & Society , Vol. 8, 2 (2021).
45. Kafuruki Shubis, Omar Juma, Rahiya Sharifu, Brandt Burgess, and Salim Abdulla. 2009. Challenges of establishing a Community Advisory Board (CAB) in a low-income, low-resource setting: experiences from Bagamoyo, Tanzania. Health Research Policy and Systems , Vol. 7, 1 (2009), 1--5.
46. Kyle Siler, Kirby Lee, and Lisa Bero. 2015. Measuring the effectiveness of scientific gatekeeping. Proceedings of the National Academy of Sciences , Vol. 112, 2 (2015), 360--365.
47. Ruba Skaik and Diana Inkpen. 2020. Using Social Media for Mental Health Surveillance: A Review. ACM Comput. Surv. , Vol. 53, 6, Article 129 (Dec. 2020), bibinfonumpages31 pages. https://doi.org/10.1145/3422824
48. Robert Soden, Michael Skirpan, Casey Fiesler, Zahra Ashktorab, Eric P.S. Baumer, Mark Blythe, and Jasmine Jones. 2019. CHI4EVIL: Creative Speculation on the Negative Impacts of HCI Research. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA '19). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3290607.3299033
49. Eric P.S. Baumer Stevie Chancellor and Munmun De Choudhury. 2019. Who is the "Human" in Human-Centered Machine Learning: The Case of Predicting Mental Health from Social Media. Proc. ACM Hum.-Comput. Interact. , Vol. 3, CSCW, Article 147 (Nov. 2019), bibinfonumpages32 pages. https://doi.org/10.1145/3359249
50. Harini Suresh and John V. Guttag. 2019. A framework for understanding unintended consequences of machine learning. arXiv preprint arXiv:1901.10002 (2019).
51. Maurizio Teli, Marcus Foth, Mariacristina Sciannamblo, Irina Anastasiu, and Peter Lyle. 2020. Tales of Institutioning and Commoning: Participatory Design Processes with a Strategic and Tactical Perspective. In Proceedings of the 16th Participatory Design Conference 2020 - Participation(s) Otherwise - Volume 1 (Manizales, Colombia) (PDC '20). Association for Computing Machinery, New York, NY, USA, 159--171. https://doi.org/10.1145/3385010.3385020
52. Maurizio Teli, Peter Lyle, and Mariacristina Sciannamblo. 2018. Institutioning the Common: The Case of Commonfare. In Proceedings of the 15th Participatory Design Conference: Full Papers - Volume 1 (Hasselt and Genk, Belgium) (PDC '18). Association for Computing Machinery, New York, NY, USA, Article 6, bibinfonumpages11 pages. https://doi.org/10.1145/3210586.3210590
53. Jessica Vitak, Nicholas Proferes adn Katie Shilton, and Zahra Ashktorab. 2017. Ethics regulation in social computing research: Examining the role of institutional review boards. Journal of Empirical Research on Human Research Ethics , Vol. 12, 5 (2017), 372--382. https://doi.org/10.1177/1556264617725200
54. Jessica Vitak, Katie Shilton, and Sahra Ashktorab. 2016. Beyond the Belmont Principles: Ethical Challenges, Practices, and Beliefs in the Online Data Research Community. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW '16). Association for Computing Machinery, New York, NY, USA, 941--953. https://doi.org/10.1145/2818048.2820078
55. Chat Wacharamanotham, Lukas Eisenring, Steve Haroz, and Florian Echtler. 2020. Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376448
56. Richard Y. Wong, Ellen Van Wyk, and James Pierce. 2017. Real-Fictional Entanglements: Using Science Fiction and Design Fiction to Interrogate Sensing Technologies. In Proceedings of the 2017 Conference on Designing Interactive Systems (Edinburgh, United Kingdom) (DIS '17). Association for Computing Machinery, New York, NY, USA, 567--579. https://doi.org/10.1145/3064663.3064682
57. Michael Zimmer. 2010. "But the data is already public": on the ethics of research in Facebook. Ethics and information technology , Vol. 12, 4 (2010), 313--325. https://doi.org/10.100z.252Fs10676-010--9227--5
58. Michael Zimmer. 2016. OkCupid Study Reveals the Perils of Big-Data Science. (2016). https://www.wired.com/2016/05/okcupid-study-reveals-perils-big-data-science/
59. Michael Zimmer. 2021. The Zuckerberg Files. (2021). https://zuckerbergfiles.org/

Index Terms

• Social and professional topics

  • Professional topics

    • Computing profession

      • Codes of ethics