skip to main content
research-article
Public Access

Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams

Published:07 November 2019Publication History
Skip Abstract Section

Abstract

Management of technological change in organizations is one of the most enduring topics in the literature on computer-supported cooperative work. The successful navigation of technological change is both more challenging and more critical in online communities that are entirely mediated by technology than it is in traditional organizations. This paper presents an analysis of 14 in-depth interviews with moderators of subcommunities of one technological platform (Reddit) that added communities on a new technological platform (Discord). Moderation teams experienced several problems related to moderating content at scale as well as a disconnect between the affordances of Discord and their assumptions based on their experiences on Reddit. We found that moderation teams used Discord's API to create scripts and bots that augmented Discord to make the platform work more like tools on Reddit. These tools were particularly important in communities struggling with scale. Our findings suggest that increasingly widespread end user programming allow users of social computing systems to innovate and deploy solutions to unanticipated design problems by transforming new technological platforms to align with their past expectations.

Skip Supplemental Material Section

Supplemental Material

References

  1. Thomas J. Allen. 1984. Managing the flow of technology: Technology transfer and the dissemination of technological information within the R&D organization. MIT Press, Cambridge, MA.Google ScholarGoogle Scholar
  2. Philip Anderson and Michael L. Tushman. 1990. Technological discontinuities and dominant designs: A cyclical model of technological change. Administrative Science Quarterly, Vol. 35, 4 (1990), 604--633. https://doi.org/10.2307/2393511Google ScholarGoogle ScholarCross RefCross Ref
  3. Stephen R. Barley. 1986. Technology as an occasion for structuring: evidence from observations of ct scanners and the social order of radiology departments. Administrative Science Quarterly, Vol. 31, 1 (1986), 78--108. https://doi.org/10.2307/2392767Google ScholarGoogle ScholarCross RefCross Ref
  4. Michael Barrett, Eivor Oborn, Wanda J. Orlikowski, and JoAnne Yates. 2011. Reconfiguring boundary relations: Robotic innovations in pharmacy work. Organization Science, Vol. 23, 5 (April 2011), 1448--1466. https://doi.org/10.1287/orsc.1100.0639Google ScholarGoogle Scholar
  5. Wiebe E Bijker, Thomas Parke Hughes, and T. J Pinch (Eds.). 1987. The social construction of technological systems: New directions in the sociology and history of technology .MIT Press, Cambridge, MA.Google ScholarGoogle Scholar
  6. Jeremy Blackburn and Haewoon Kwak. 2014. Stfu noob!: Predicting crowdsourced decisions on toxic behavior in online games. In Proceedings of the 23rd International Conference on World Wide Web (WWW '14). ACM, New York, NY, USA, 877--888. https://doi.org/10.1145/2566486.2567987Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Erin Bradner. 2001. Social affordances of computer-mediated communication technology: Understanding adoption. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 67--68. https://doi.org/10.1145/634067.634111Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology, Vol. 3, 2 (Jan. 2006), 77--101. https://doi.org/10.1191/1478088706qp063oaGoogle ScholarGoogle ScholarCross RefCross Ref
  9. Brian S. Butler. 2001. Membership size, communication activity, and sustainability: A resource-based model of online social structures. Information Systems Research, Vol. 12, 4 (Dec. 2001), 346--362. https://doi.org/10.1287/isre.12.4.346.9703Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Kathy Charmaz. 2015. Constructing grounded theory: A practical guide through qualitative analysis 2nd ed.). SAGE, Thousand Oaks, California.Google ScholarGoogle Scholar
  11. Nicole Crenshaw and Bonnie Nardi. 2016. "It was more than just the game, it was the community": Social affordances in online games. In Proceedings of the 49th Hawaii International Conference on System Sciences (HICSS '16). IEEE Computer Society, Koloa, Hawaii, 3781--3790. https://doi.org/10.1109/HICSS.2016.471Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Elizabeth Davidson. 2006. A Technological Frames Perspective on Information Technology and Organizational Change. The Journal of Applied Behavioral Science, Vol. 42, 1 (March 2006), 23--39. https://doi.org/10.1177/0021886305285126Google ScholarGoogle ScholarCross RefCross Ref
  13. Bryan Dosono and Bryan Semaan. 2019. Moderation practices as emotional labor in sustaining online communities: The case of AAPI identity work on Reddit. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 142:1--142:13. https://doi.org/10.1145/3290605.3300372Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Casey Fiesler, Jialun" Aaron" Jiang, Joshua McCann, Kyle Frye, and Jed R. Brubaker. 2018. Reddit rules! Characterizing an ecosystem of governance. In ICWSM. AAAI, North America, 72--81. http://cmci.colorado.edu/ cafi5706/icwsm18-redditrules.pdfGoogle ScholarGoogle Scholar
  15. Janet Fulk. 1993. Social construction of communication technology. AMJ, Vol. 36, 5 (Oct. 1993), 921--950. https://doi.org/10.5465/256641Google ScholarGoogle Scholar
  16. William W. Gaver. 1991. Technology affordances. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '91). ACM, New York, NY, USA, 79--84. https://doi.org/10.1145/108844.108856Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. William W. Gaver. 1992. The affordances of media spaces for collaboration. In Proceedings of the 1992 ACM Conference on Computer-supported Cooperative Work (CSCW '92). ACM, New York, NY, USA, 17--24. https://doi.org/10.1145/143457.371596Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. R. Stuart Geiger. 2014. Bots, bespoke, code and the materiality of software platforms. Information, Communication & Society, Vol. 17, 3 (March 2014), 342--356. https://doi.org/10.1080/1369118X.2013.873069Google ScholarGoogle ScholarCross RefCross Ref
  19. Tarleton Gillespie. 2010. The politics of 'platforms'. New Media & Society, Vol. 12, 3 (May 2010), 347--364. https://doi.org/10.1177/1461444809342738Google ScholarGoogle Scholar
  20. Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press, New Haven.Google ScholarGoogle Scholar
  21. Erving Goffman. 1959. The presentation of self in everyday life 1 ed.). Anchor, London.Google ScholarGoogle Scholar
  22. James Grimmelmann. 2015. The Virtues of Moderation. 17 Yale Journal of Law & Technology, Vol. 42 (2015). https://doi.org/10.31228/osf.io/qwxf5Google ScholarGoogle Scholar
  23. Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity is causing its decline. American Behavioral Scientist, Vol. 57, 5 (May 2013), 664--688. https://doi.org/10.1177/0002764212469365Google ScholarGoogle ScholarCross RefCross Ref
  24. Lee Humphreys. 2010. Technological determinism. In Encyclopedia of Science and Technology Communication. SAGE Publications, Inc., Thousand Oaks, California, US.Google ScholarGoogle Scholar
  25. Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-machine collaboration for content regulation: The case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact., Vol. 26, 5 (July 2019), 31:1--31:35. https://doi.org/10.1145/3338243Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Jialun "Aaron" Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation challenges in voice-based online communities on Discord. In Proc. ACM Hum.-Comput. Interact. (CSCW '19), Vol. 3. ACM, New York, NY, USA, 23. https://doi.org/10.1145/3359157Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Charles Kiene, Andrés Monroy-Hernández, and Benjamin Mako Hill. 2016. Surviving an "Eternal September": How an online community managed a surge of newcomers. In Proceedings of the 2016 ACM Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, 1152--1156. https://doi.org/10.1145/2858036.2858356Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Robert E. Kraut, Paul Resnick, and Sara Kiesler. 2012. Building successful online communities: Evidence-based social design. MIT Press, Cambridge, MA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Cliff Lampe and Paul Resnick. 2004. Slash(dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Conference on Human Factors in Computing Systems (CHI '04). ACM, Vienna, Austria, 543--550. https://doi.org/10.1145/985692.985761Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Ganaele Langlois. 2013. Participatory culture and the new governance of communication: the paradox of participatory media. Television & New Media, Vol. 14, 2 (March 2013), 91--105. https://doi.org/10.1177/1527476411433519Google ScholarGoogle ScholarCross RefCross Ref
  31. Dorothy Leonard-Barton. 1988. Implementation as mutual adaptation of technology and organization. Research Policy, Vol. 17, 5 (Oct. 1988), 251--267. https://doi.org/10.1016/0048--7333(88)90006--6Google ScholarGoogle ScholarCross RefCross Ref
  32. Paul M. Leonardi and Stephen R. Barley. 2008. Materiality and change: Challenges to building better theory about technology and organizing. Information and Organization, Vol. 18, 3 (Jan. 2008), 159--176. https://doi.org/10.1016/j.infoandorg.2008.03.001Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Zhiyuan Lin, Niloufar Salehi, Bowen Yao, Yiqi Chen, and Michael S. Bernstein. 2017. Better when it was smaller? Community content and behavior after massive growth. In ICWSM. AAAI, North America, 132--141. https://aaai.org/ocs/index.php/ICWSM/ICWSM17/paper/view/15628Google ScholarGoogle Scholar
  34. Adrienne Massanari. 2017. #Gamergate and The Fappening: How Reddit's algorithm, governance, and culture support toxic technocultures. New Media & Society, Vol. 19, 3 (March 2017), 329--346. https://doi.org/10.1177/1461444815608807Google ScholarGoogle ScholarCross RefCross Ref
  35. J. Nathan Matias. 2016. Going dark: Social factors in collective action against platform operators in the Reddit blackout. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, 1138--1151. https://doi.org/10.1145/2858036.2858391Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Marshall McLuhan. 1964. Understanding media: The extensions of man .McGraw-Hill, New York, NY.Google ScholarGoogle Scholar
  37. Natalja Menold. 2008. How to use information technology for cooperative work: Development of shared technological frames. Comput Supported Coop Work, Vol. 18, 1 (Sept. 2008), 47. https://doi.org/10.1007/s10606-008--9083--6Google ScholarGoogle Scholar
  38. Jonathan T. Morgan and Aaron Halfaker. 2018. Evaluating the impact of the Wikipedia teahouse on newcomer socialization and retention. In Proceedings of the 14th International Symposium on Open Collaboration (OpenSym '18). ACM, New York, NY, USA, 20:1--20:7. https://doi.org/10.1145/3233391.3233544Google ScholarGoogle Scholar
  39. Bonnie A. Nardi. 1993. A small matter of programming: Perspectives on end user computing .MIT Press, Cambridge, MA, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Mancur Olson. 1965. The logic of collective action: Public goods and the theory of groups .Harvard University Press, Cambridge, MA.Google ScholarGoogle Scholar
  41. Wanda J. Orlikowski. 1992. Learning from notes: Organizational issues in groupware implementation. In Proceedings of the 1992 ACM Conference on Computer-supported Cooperative Work (CSCW '92). ACM, New York, NY, USA, 362--369. https://doi.org/10.1145/143457.143549Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Wanda J. Orlikowski. 1996. Improvising organizational transformation over time: A situated change perspective. Information Systems Research, Vol. 7, 1 (March 1996), 63--92. https://doi.org/10.1287/isre.7.1.63Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Wanda J. Orlikowski. 2000. Using technology and constituting structures: A practice lens for studying technology in organizations. Organization Science, Vol. 11, 4 (Aug. 2000), 404--428. https://doi.org/10.1287/orsc.11.4.404.14600Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Wanda J. Orlikowski and Debra C. Gash. 1994. Technological frames: Making sense of information technology in organizations. ACM Trans. Inf. Syst., Vol. 12, 2 (April 1994), 174--207. https://doi.org/10.1145/196734.196745Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Trevor J. Pinch and Wiebe E. Bijker. 1984. The social construction of facts and artefacts: Or how the sociology of science and the sociology of technology might benefit each other. Soc Stud Sci, Vol. 14, 3 (Aug. 1984), 399--441. https://doi.org/10.1177/030631284014003004Google ScholarGoogle ScholarCross RefCross Ref
  46. Joseph Seering, Juan Pablo Flores, Saiph Savage, and Jessica Hammer. 2018. The social roles of bots: evaluating impact of bots on discussions in online communities. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW (Nov. 2018), 157:1--157:29. https://doi.org/10.1145/3274426Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society, Vol. 21 (Jan. 2019), 1417--1443. Issue 7. https://doi.org/10.1177/1461444818821316Google ScholarGoogle ScholarCross RefCross Ref
  48. Aaron Shaw and Benjamin Mako Hill. 2014. Laboratories of oligarchy? How the iron law extends to peer production. J Commun, Vol. 64, 2 (2014), 215--238. https://doi.org/10.1111/jcom.12082Google ScholarGoogle ScholarCross RefCross Ref
  49. Nancy Shaw, Lee-Partridge Eng, and James Ang. 1997. Understanding end-user computing through technological frames. In Proceedings of the 18th International Conference on Information Systems. ICIS 1997 Proceedings, 37.Google ScholarGoogle Scholar
  50. Constance A. Steinkuehler and Dmitri Williams. 2006. Where everybody knows your (screen) name: Online games as "third places". Journal of Computer-Mediated Communication, Vol. 11, 4 (Oct. 2006), 885--909. https://doi.org/10.1111/j.1083--6101.2006.00300.xGoogle ScholarGoogle Scholar
  51. Ed Summers and Ricardo Punzalan. 2017. Bots, seeds and people: Web archives as infrastructure. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 821--834. https://doi.org/10.1145/2998181.2998345Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Jeffrey W. Treem and Paul M. Leonardi. 2013. Social media use in organizations: Exploring the affordances of visibility, editability, persistence, and association. Annals of the International Communication Association, Vol. 36, 1 (Jan. 2013), 143--189. https://doi.org/10.1080/23808985.2013.11679130Google ScholarGoogle ScholarCross RefCross Ref
  53. Jan E. Trost. 1986. Statistically nonrepresentative stratified sampling: A sampling technique for qualitative studies. Qual Sociol, Vol. 9, 1 (March 1986), 54--57. https://doi.org/10.1007/BF00988249Google ScholarGoogle ScholarCross RefCross Ref
  54. Michael L. Tushman and Philip Anderson. 1986. Technological discontinuities and organizational environments. Administrative Science Quarterly, Vol. 31, 3 (Sept. 1986), 439--465. http://www.jstor.org/stable/2392832Google ScholarGoogle ScholarCross RefCross Ref
  55. James M. Utterback. 1997. Mastering the dynamics of innovation: How companies can seize opportunities in the face of technological change. Harvard Business School Press, Boston, MA, USA.Google ScholarGoogle Scholar
  56. Eric von Hippel. 1988. The sources of innovation. Oxford University Press, New York, NY.Google ScholarGoogle Scholar
  57. Eric von Hippel. 2006. Democratizing innovation. The MIT Press, Cambridge, MA, USA.Google ScholarGoogle Scholar
  58. Eric von Hippel and Ralph Katz. 2002. Shifting innovation to users via toolkits. Management Science, Vol. 48, 7 (2002), 821--833. http://www.jstor.org/stable/822693Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Langdon Winner. 1980. Do artifacts have politics? Daedalus, Vol. 109, 1 (1980), 121--136. http://www.jstor.org/stable/20024652Google ScholarGoogle Scholar
  60. Yvette Wohn. 2019. Volunteer moderators in twitch micro communities: How they get involved, the roles they play, and the emotional labor they experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). ACM, Glasgow, UK.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Li-Yin Young. 2018. The effect of moderator bots on abusive language use. In Proceedings of the International Conference on Pattern Recognition and Artificial Intelligence (PRAI 2018). ACM, New York, NY, USA, 133--137. https://doi.org/10.1145/3243250.3243257Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

(auto-classified)
  1. Technological Frames and User Innovation: Exploring Technological Change in Community Moderation Teams

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!