Abstract
Management of technological change in organizations is one of the most enduring topics in the literature on computer-supported cooperative work. The successful navigation of technological change is both more challenging and more critical in online communities that are entirely mediated by technology than it is in traditional organizations. This paper presents an analysis of 14 in-depth interviews with moderators of subcommunities of one technological platform (Reddit) that added communities on a new technological platform (Discord). Moderation teams experienced several problems related to moderating content at scale as well as a disconnect between the affordances of Discord and their assumptions based on their experiences on Reddit. We found that moderation teams used Discord's API to create scripts and bots that augmented Discord to make the platform work more like tools on Reddit. These tools were particularly important in communities struggling with scale. Our findings suggest that increasingly widespread end user programming allow users of social computing systems to innovate and deploy solutions to unanticipated design problems by transforming new technological platforms to align with their past expectations.
Supplemental Material
Available for Download
This is the readme.txt for the auxiliary material for the CSCW '19 paper: "Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams". Full citation: Charles Kiene, Jialun "Aaron" Jiang, and Benjamin Mako Hill. 2019. Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams. In Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW, Article 44 (November 2019). ACM, New York, NY. 23 pages. https://doi.org/10.1145/3359146 This auxiliary material contains the interview protocol questions the authors referred to when conducting the interviews for this study. The auxiliary material is simply a PDF and can be viewed with any PDF viewer.
- Thomas J. Allen. 1984. Managing the flow of technology: Technology transfer and the dissemination of technological information within the R&D organization. MIT Press, Cambridge, MA.Google Scholar
- Philip Anderson and Michael L. Tushman. 1990. Technological discontinuities and dominant designs: A cyclical model of technological change. Administrative Science Quarterly, Vol. 35, 4 (1990), 604--633. https://doi.org/10.2307/2393511Google Scholar
Cross Ref
- Stephen R. Barley. 1986. Technology as an occasion for structuring: evidence from observations of ct scanners and the social order of radiology departments. Administrative Science Quarterly, Vol. 31, 1 (1986), 78--108. https://doi.org/10.2307/2392767Google Scholar
Cross Ref
- Michael Barrett, Eivor Oborn, Wanda J. Orlikowski, and JoAnne Yates. 2011. Reconfiguring boundary relations: Robotic innovations in pharmacy work. Organization Science, Vol. 23, 5 (April 2011), 1448--1466. https://doi.org/10.1287/orsc.1100.0639Google Scholar
- Wiebe E Bijker, Thomas Parke Hughes, and T. J Pinch (Eds.). 1987. The social construction of technological systems: New directions in the sociology and history of technology .MIT Press, Cambridge, MA.Google Scholar
- Jeremy Blackburn and Haewoon Kwak. 2014. Stfu noob!: Predicting crowdsourced decisions on toxic behavior in online games. In Proceedings of the 23rd International Conference on World Wide Web (WWW '14). ACM, New York, NY, USA, 877--888. https://doi.org/10.1145/2566486.2567987Google Scholar
Digital Library
- Erin Bradner. 2001. Social affordances of computer-mediated communication technology: Understanding adoption. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 67--68. https://doi.org/10.1145/634067.634111Google Scholar
Digital Library
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology, Vol. 3, 2 (Jan. 2006), 77--101. https://doi.org/10.1191/1478088706qp063oaGoogle Scholar
Cross Ref
- Brian S. Butler. 2001. Membership size, communication activity, and sustainability: A resource-based model of online social structures. Information Systems Research, Vol. 12, 4 (Dec. 2001), 346--362. https://doi.org/10.1287/isre.12.4.346.9703Google Scholar
Digital Library
- Kathy Charmaz. 2015. Constructing grounded theory: A practical guide through qualitative analysis 2nd ed.). SAGE, Thousand Oaks, California.Google Scholar
- Nicole Crenshaw and Bonnie Nardi. 2016. "It was more than just the game, it was the community": Social affordances in online games. In Proceedings of the 49th Hawaii International Conference on System Sciences (HICSS '16). IEEE Computer Society, Koloa, Hawaii, 3781--3790. https://doi.org/10.1109/HICSS.2016.471Google Scholar
Digital Library
- Elizabeth Davidson. 2006. A Technological Frames Perspective on Information Technology and Organizational Change. The Journal of Applied Behavioral Science, Vol. 42, 1 (March 2006), 23--39. https://doi.org/10.1177/0021886305285126Google Scholar
Cross Ref
- Bryan Dosono and Bryan Semaan. 2019. Moderation practices as emotional labor in sustaining online communities: The case of AAPI identity work on Reddit. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 142:1--142:13. https://doi.org/10.1145/3290605.3300372Google Scholar
Digital Library
- Casey Fiesler, Jialun" Aaron" Jiang, Joshua McCann, Kyle Frye, and Jed R. Brubaker. 2018. Reddit rules! Characterizing an ecosystem of governance. In ICWSM. AAAI, North America, 72--81. http://cmci.colorado.edu/ cafi5706/icwsm18-redditrules.pdfGoogle Scholar
- Janet Fulk. 1993. Social construction of communication technology. AMJ, Vol. 36, 5 (Oct. 1993), 921--950. https://doi.org/10.5465/256641Google Scholar
- William W. Gaver. 1991. Technology affordances. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '91). ACM, New York, NY, USA, 79--84. https://doi.org/10.1145/108844.108856Google Scholar
Digital Library
- William W. Gaver. 1992. The affordances of media spaces for collaboration. In Proceedings of the 1992 ACM Conference on Computer-supported Cooperative Work (CSCW '92). ACM, New York, NY, USA, 17--24. https://doi.org/10.1145/143457.371596Google Scholar
Digital Library
- R. Stuart Geiger. 2014. Bots, bespoke, code and the materiality of software platforms. Information, Communication & Society, Vol. 17, 3 (March 2014), 342--356. https://doi.org/10.1080/1369118X.2013.873069Google Scholar
Cross Ref
- Tarleton Gillespie. 2010. The politics of 'platforms'. New Media & Society, Vol. 12, 3 (May 2010), 347--364. https://doi.org/10.1177/1461444809342738Google Scholar
- Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press, New Haven.Google Scholar
- Erving Goffman. 1959. The presentation of self in everyday life 1 ed.). Anchor, London.Google Scholar
- James Grimmelmann. 2015. The Virtues of Moderation. 17 Yale Journal of Law & Technology, Vol. 42 (2015). https://doi.org/10.31228/osf.io/qwxf5Google Scholar
- Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity is causing its decline. American Behavioral Scientist, Vol. 57, 5 (May 2013), 664--688. https://doi.org/10.1177/0002764212469365Google Scholar
Cross Ref
- Lee Humphreys. 2010. Technological determinism. In Encyclopedia of Science and Technology Communication. SAGE Publications, Inc., Thousand Oaks, California, US.Google Scholar
- Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-machine collaboration for content regulation: The case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact., Vol. 26, 5 (July 2019), 31:1--31:35. https://doi.org/10.1145/3338243Google Scholar
Digital Library
- Jialun "Aaron" Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation challenges in voice-based online communities on Discord. In Proc. ACM Hum.-Comput. Interact. (CSCW '19), Vol. 3. ACM, New York, NY, USA, 23. https://doi.org/10.1145/3359157Google Scholar
Digital Library
- Charles Kiene, Andrés Monroy-Hernández, and Benjamin Mako Hill. 2016. Surviving an "Eternal September": How an online community managed a surge of newcomers. In Proceedings of the 2016 ACM Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, 1152--1156. https://doi.org/10.1145/2858036.2858356Google Scholar
Digital Library
- Robert E. Kraut, Paul Resnick, and Sara Kiesler. 2012. Building successful online communities: Evidence-based social design. MIT Press, Cambridge, MA.Google Scholar
Digital Library
- Cliff Lampe and Paul Resnick. 2004. Slash(dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Conference on Human Factors in Computing Systems (CHI '04). ACM, Vienna, Austria, 543--550. https://doi.org/10.1145/985692.985761Google Scholar
Digital Library
- Ganaele Langlois. 2013. Participatory culture and the new governance of communication: the paradox of participatory media. Television & New Media, Vol. 14, 2 (March 2013), 91--105. https://doi.org/10.1177/1527476411433519Google Scholar
Cross Ref
- Dorothy Leonard-Barton. 1988. Implementation as mutual adaptation of technology and organization. Research Policy, Vol. 17, 5 (Oct. 1988), 251--267. https://doi.org/10.1016/0048--7333(88)90006--6Google Scholar
Cross Ref
- Paul M. Leonardi and Stephen R. Barley. 2008. Materiality and change: Challenges to building better theory about technology and organizing. Information and Organization, Vol. 18, 3 (Jan. 2008), 159--176. https://doi.org/10.1016/j.infoandorg.2008.03.001Google Scholar
Digital Library
- Zhiyuan Lin, Niloufar Salehi, Bowen Yao, Yiqi Chen, and Michael S. Bernstein. 2017. Better when it was smaller? Community content and behavior after massive growth. In ICWSM. AAAI, North America, 132--141. https://aaai.org/ocs/index.php/ICWSM/ICWSM17/paper/view/15628Google Scholar
- Adrienne Massanari. 2017. #Gamergate and The Fappening: How Reddit's algorithm, governance, and culture support toxic technocultures. New Media & Society, Vol. 19, 3 (March 2017), 329--346. https://doi.org/10.1177/1461444815608807Google Scholar
Cross Ref
- J. Nathan Matias. 2016. Going dark: Social factors in collective action against platform operators in the Reddit blackout. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, 1138--1151. https://doi.org/10.1145/2858036.2858391Google Scholar
Digital Library
- Marshall McLuhan. 1964. Understanding media: The extensions of man .McGraw-Hill, New York, NY.Google Scholar
- Natalja Menold. 2008. How to use information technology for cooperative work: Development of shared technological frames. Comput Supported Coop Work, Vol. 18, 1 (Sept. 2008), 47. https://doi.org/10.1007/s10606-008--9083--6Google Scholar
- Jonathan T. Morgan and Aaron Halfaker. 2018. Evaluating the impact of the Wikipedia teahouse on newcomer socialization and retention. In Proceedings of the 14th International Symposium on Open Collaboration (OpenSym '18). ACM, New York, NY, USA, 20:1--20:7. https://doi.org/10.1145/3233391.3233544Google Scholar
- Bonnie A. Nardi. 1993. A small matter of programming: Perspectives on end user computing .MIT Press, Cambridge, MA, USA.Google Scholar
Digital Library
- Mancur Olson. 1965. The logic of collective action: Public goods and the theory of groups .Harvard University Press, Cambridge, MA.Google Scholar
- Wanda J. Orlikowski. 1992. Learning from notes: Organizational issues in groupware implementation. In Proceedings of the 1992 ACM Conference on Computer-supported Cooperative Work (CSCW '92). ACM, New York, NY, USA, 362--369. https://doi.org/10.1145/143457.143549Google Scholar
Digital Library
- Wanda J. Orlikowski. 1996. Improvising organizational transformation over time: A situated change perspective. Information Systems Research, Vol. 7, 1 (March 1996), 63--92. https://doi.org/10.1287/isre.7.1.63Google Scholar
Digital Library
- Wanda J. Orlikowski. 2000. Using technology and constituting structures: A practice lens for studying technology in organizations. Organization Science, Vol. 11, 4 (Aug. 2000), 404--428. https://doi.org/10.1287/orsc.11.4.404.14600Google Scholar
Digital Library
- Wanda J. Orlikowski and Debra C. Gash. 1994. Technological frames: Making sense of information technology in organizations. ACM Trans. Inf. Syst., Vol. 12, 2 (April 1994), 174--207. https://doi.org/10.1145/196734.196745Google Scholar
Digital Library
- Trevor J. Pinch and Wiebe E. Bijker. 1984. The social construction of facts and artefacts: Or how the sociology of science and the sociology of technology might benefit each other. Soc Stud Sci, Vol. 14, 3 (Aug. 1984), 399--441. https://doi.org/10.1177/030631284014003004Google Scholar
Cross Ref
- Joseph Seering, Juan Pablo Flores, Saiph Savage, and Jessica Hammer. 2018. The social roles of bots: evaluating impact of bots on discussions in online communities. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 157:1--157:29. https://doi.org/10.1145/3274426Google Scholar
Digital Library
- Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society, Vol. 21 (Jan. 2019), 1417--1443. Issue 7. https://doi.org/10.1177/1461444818821316Google Scholar
Cross Ref
- Aaron Shaw and Benjamin Mako Hill. 2014. Laboratories of oligarchy? How the iron law extends to peer production. J Commun, Vol. 64, 2 (2014), 215--238. https://doi.org/10.1111/jcom.12082Google Scholar
Cross Ref
- Nancy Shaw, Lee-Partridge Eng, and James Ang. 1997. Understanding end-user computing through technological frames. In Proceedings of the 18th International Conference on Information Systems. ICIS 1997 Proceedings, 37.Google Scholar
- Constance A. Steinkuehler and Dmitri Williams. 2006. Where everybody knows your (screen) name: Online games as "third places". Journal of Computer-Mediated Communication, Vol. 11, 4 (Oct. 2006), 885--909. https://doi.org/10.1111/j.1083--6101.2006.00300.xGoogle Scholar
- Ed Summers and Ricardo Punzalan. 2017. Bots, seeds and people: Web archives as infrastructure. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 821--834. https://doi.org/10.1145/2998181.2998345Google Scholar
Digital Library
- Jeffrey W. Treem and Paul M. Leonardi. 2013. Social media use in organizations: Exploring the affordances of visibility, editability, persistence, and association. Annals of the International Communication Association, Vol. 36, 1 (Jan. 2013), 143--189. https://doi.org/10.1080/23808985.2013.11679130Google Scholar
Cross Ref
- Jan E. Trost. 1986. Statistically nonrepresentative stratified sampling: A sampling technique for qualitative studies. Qual Sociol, Vol. 9, 1 (March 1986), 54--57. https://doi.org/10.1007/BF00988249Google Scholar
Cross Ref
- Michael L. Tushman and Philip Anderson. 1986. Technological discontinuities and organizational environments. Administrative Science Quarterly, Vol. 31, 3 (Sept. 1986), 439--465. http://www.jstor.org/stable/2392832Google Scholar
Cross Ref
- James M. Utterback. 1997. Mastering the dynamics of innovation: How companies can seize opportunities in the face of technological change. Harvard Business School Press, Boston, MA, USA.Google Scholar
- Eric von Hippel. 1988. The sources of innovation. Oxford University Press, New York, NY.Google Scholar
- Eric von Hippel. 2006. Democratizing innovation. The MIT Press, Cambridge, MA, USA.Google Scholar
- Eric von Hippel and Ralph Katz. 2002. Shifting innovation to users via toolkits. Management Science, Vol. 48, 7 (2002), 821--833. http://www.jstor.org/stable/822693Google Scholar
Digital Library
- Langdon Winner. 1980. Do artifacts have politics? Daedalus, Vol. 109, 1 (1980), 121--136. http://www.jstor.org/stable/20024652Google Scholar
- Yvette Wohn. 2019. Volunteer moderators in twitch micro communities: How they get involved, the roles they play, and the emotional labor they experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). ACM, Glasgow, UK.Google Scholar
Digital Library
- Li-Yin Young. 2018. The effect of moderator bots on abusive language use. In Proceedings of the International Conference on Pattern Recognition and Artificial Intelligence (PRAI 2018). ACM, New York, NY, USA, 133--137. https://doi.org/10.1145/3243250.3243257Google Scholar
Digital Library
Index Terms
(auto-classified)Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams
Recommendations
Moderation Practices as Emotional Labor in Sustaining Online Communities: The Case of AAPI Identity Work on Reddit
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsWe examine how and why Asian American and Pacific Islander (AAPI) moderators on Reddit shape the norms of their online communities through the analytic lens of emotional labor. We conduct interviews with 21 moderators who facilitate identity work ...
Moderation Challenges in Voice-based Online Communities on Discord
Online community moderators are on the front lines of combating problems like hate speech and harassment, but new modes of interaction can introduce unexpected challenges. In this paper, we consider moderation practices and challenges in the context of ...
Who Uses Bots? A Statistical Analysis of Bot Usage in Moderation Teams
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsAdopting new technology is challenging for volunteer moderation teams of online communities. Challenges are aggravated when communities increase in size. In a prior qualitative study, Kiene et al. found evidence that moderator teams adapted to ...






Comments