Abstract

This research examines how Russian disinformation actors participated in a highly charged online conversation about the #BlackLivesMatter movement and police-related shootings in the USA during 2016. We first present high-level dynamics of this conversation on Twitter using a network graph based on retweet flows that reveals two structurally distinct communities. Next, we identify accounts in this graph that were suspended by Twitter for being affiliated with the Internet Research Agency, an entity accused of conducting information operations in support of Russian political interests. Finally, we conduct an interpretive analysis that consolidates observations about the activities of these accounts. Our findings have implications for platforms seeking to develop mechanisms for determining authenticity---by illuminating how disinformation actors enact authentic personas and caricatures to target different audiences. This work also sheds light on how these actors systematically manipulate politically active online communities by amplifying diverging streams of divisive content.
- Monica Anderson and Paul Hitlin. 2016. Social Media Conversations About Race: How social media users see, share, and discuss race and the rise of hashtags like #BlackLivesMatter. (August 2016). Retrieved July 10, 2017 from http://www.pewinternet.org/2016/08/15/social-media-conversations-about-race/Google Scholar
- Ahmer Arif, John J. Robinson, Stephanie A. Stanek, Elodie S. Fichet, Paul Townsend, Zena Worku, and Kate Starbird. 2017. A closer look at the self-correcting crowd: Examining corrections in online rumors. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, 155--168. Google Scholar
Digital Library
- Leigh Armistead (Ed.). 2004. Information Operations: Warfare and the Hard Reality of Soft Power. Potomac Books Inc., Lincoln, NE.Google Scholar
- Mathieu Bastian, Sebastien Heymann, and Mathieu Jacomy. 2009. Gephi: An open source software for exploring and manipulating networks. In Proceedings of the International AAAI Conference on Weblogs and Social Media.Google Scholar
- Ladislav Bittman. 1985. The KGB and Soviet Disinformation: An Insider's View. Pergamon-Brassey's, Washington, DC.Google Scholar
- Black Lives Matter. Herstory. Retrieved April 4, 2018 from https://blacklivesmatter.com/about/herstory/Google Scholar
- Blue Lives Matter. 2017. About Us -- Blue Lives Matter. (May 2017). Retrieved April 4, 2018 from https://bluelivesmatter.blue/organization/Google Scholar
- Kyle Booten. 2016. Hashtag drift: Tracing the evolving uses of political hashtags over time. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, 2401--2405. Google Scholar
Digital Library
- danah boyd. 2017. Google and Facebook can't just make fake news disappear. Backchannel. (March 2017). Retrieved July 10, 2011 from https://medium.com/backchannel/google-and-facebook-cant-just-make-fake-news-disappear-48f4b4e5fbe8Google Scholar
- Alex Burns and Ben Eltham. 2009. Twitter Free Iran: An Evaluation of Twitter's Role in Public Diplomacy and Information Operations in Iran's 2009 Election Crisis. In Communications Policy & Research Forum. 298--310.Google Scholar
- Kathy Charmaz. 2014. Constructing Grounded Theory. Sage, Thousand Oaks, CA.Google Scholar
- Dharma Dailey and Kate Starbird. 2017. Social Media Seamsters: Stitching Platforms & Audiences into Local Crisis Infrastructure. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1277--1289. Google Scholar
Digital Library
- Teun A. Van Dijk. 2015. Racism and the Press. Routledge, Abingdon, UK.Google Scholar
- John DH Downing and Charles Husband. 2005. Representing Race: Racisms, Ethnicity and the Media. Sage, Thousand Oaks, CA.Google Scholar
- Daniel Edler and Martin Rosvall. 2014. The MapEquation software package. Retrieved from http://www.mapequation.orgGoogle Scholar
- Robert M. Faris, Hal Roberts, Bruce Etling, Nikki Bourassa, Ethan Zuckerman, and Yochai Benkler. 2017. Partisanship, Propaganda, and Disinformation: Online Media and the 2016 U.S. Presidential Election. Berkman Klein Center for Internet & Society Research. Harvard University, Cambridge, Massachusetts, United States.Google Scholar
- Johan Farkas, Jannick Schou, and Christina Neumayer. 2018. Cloaked Facebook pages: Exploring fake Islamist propaganda in social media. New Media and Society 20, 5. 1850--1867.Google Scholar
Cross Ref
- Johan Farkas, Jannick Schou, and Christina Neumayer. 2018. Platformed antagonism: Racist discourses on fake Muslim Facebook pages. Critical Discourse Studies 0, 0. 1--18.Google Scholar
- R. Stuart Geiger and David Ribes. 2011. Trace ethnography: Following coordination through documentary practices. In Proceedings of the Annual Hawaii International Conference on System Sciences. 1--10. Google Scholar
Digital Library
- Matthew Gentzkow and Jesse M. Shapiro. Ideological segregation online and offline. The Quarterly Journal of Economics 126, 4 (2011). 1799--1839.Google Scholar
- Anthony Giddens. 1984. The Constitution of Society: Outline of the Theory of Structuration. University of California Press, Berkeley, CA.Google Scholar
- Catherine Grevet, Loren G. Terveen, and Eric Gilbert. 2014. Managing political differences in social media. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW '14). ACM, New York, NY, USA, 1400--1408. Google Scholar
Digital Library
- Drew Griffin and Donie O'Sullivan. 2017. The Fake Tea Party Twitter Account Linked to Russia and Followed by Sebastian Gorka. (Sep. 2017). Retrieved April 17, 2018 from https://www.cnn.com/2017/09/21/politics/tpartynews-twitter-russia-link/index.htmlGoogle Scholar
- Jessica Guynn. 2015. Meet the Woman Who Coined #BlackLivesMatter. (March 4, 2015). Retrieved April 4, 2018 from https://www.usatoday.com/story/tech/2015/03/04/alicia-garza-black-lives-matter/24341593/#Google Scholar
- Jonathan Haidt. 2012. The Righteous mind: Why Good People are Divided by Politics and Religion. Vintage, New York, NY.Google Scholar
- Rongbin Han. 2015. Manufacturing consent in cyberspace: China's 'fifty-cent army'. Journal of Current Chinese Affairs 44, 2 (2015). 105--134.Google Scholar
Cross Ref
- Philip N. Howard. 2002. Network ethnography and the hypermedia organization: New media, new organizations, new methods. New Media & Society 4, 4 (2002). 550--574.Google Scholar
- Joint Chiefs of Staff. 2014. Information Operations. Joint Publication 3--13. Department of Defense, United States. Retrieved from http://www.jcs.mil/Portals/36/Documents/Doctrine/pubs/jp3_13.pdfGoogle Scholar
- Garth S. Jowett and Victoria O'Donnell. 1999. Propaganda and Persuasion. SAGE Publications, Los Angeles, CA.Google Scholar
- Marina Kogan, Leysia Palen, and Kenneth M. Anderson. 2015. Think Local, Retweet Global: Retweeting by the Geographically-Vulnerable during Hurricane Sandy. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 981--993. Google Scholar
Digital Library
- David Lazer, Brian Rubineau, Carol Chetkovich, Nancy Katz, and Michael Neblo. 2010. The coevolution of networks and political attitudes. Political Communication 27, 3 (2010). 248--274.Google Scholar
- Herbert S. Lin and Jaclyn Kerr. 2017. On Cyber-Enabled Information/Influence Warfare and Manipulation. Oxford University Press, UK.Google Scholar
- Eden Litt. 2012. Knock, knock. Who's there? The imagined audience. Journal of Broadcasting & Electronic Media 56, 3 (Sep. 2012), 330--345.Google Scholar
Cross Ref
- Jim Maddock, Kate Starbird, Haneen J. Al-Hassani, David E. Sandoval, Mania Orand, and Robert M. Mason. 2015. Characterizing online rumoring behavior using multi-dimensional signatures. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, New York, NY, 228--241. Google Scholar
Digital Library
- George E. Marcus. 1995. Ethnography in/of the world system: The emergence of multi-sited ethnography. Annual Review of Anthropology 24 (1995). 95--117.Google Scholar
Cross Ref
- Alice E. Marwick and danah boyd. I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience. New Media & Society 13, 1 (2011), 114--133.Google Scholar
- Alice Marwick and Rebecca Lewis. 2017. Media manipulation and disinformation online. Data & Society Research Institute, New York, NY.Google Scholar
- Louise Matsakis. 2017. Twitter Told Congress This Random American Is a Russian Propaganda Troll. (Nov. 2017). Retrieved April 17, 2018 from https://motherboard.vice.com/en_us/article/8x5mma/twitter-told-congress-this-random-american-is-a-russian-propaganda-trollGoogle Scholar
- Gregg R. Murray and Anthony Scime. Microtargeting and electorate segmentation: Data mining the American national election studies. Journal of Political Marketing 9, 3 (2010). 143--166.Google Scholar
- Jonathan Corpus Ong and Jason Vincent A. Cabanes. 2018. Architects of Networked Disinformation. The Newton Tech4Dev Network. University of Leeds, Leeds, UK. Retrieved from http://newtontechfordev.com/wp-content/uploads/2018/02/ARCHITECTS-OF-NETWORKED-DISINFORMATION-FULL-REPORT.pdfGoogle Scholar
- Walter J. Ong. 1975. The writer's audience is always a fiction. Publications of the Modern Language Association of America 90, 1 (Jan. 1975), 9--21.Google Scholar
Cross Ref
- Leysia Palen and Kenneth M. Anderson. 2016. Crisis informatics - New data for extraordinary times. Science 353, 6296 (2016). 224--225.Google Scholar
- Christopher Paul and Miriam Matthews. 2016. The Russian "Firehose of Falsehood" Propaganda Model. Rand Corporation, Santa Monica, CA.Google Scholar
- Zizi Papacharissi. 2009. The virtual geographies of social networks: a comparative analysis of Facebook, LinkedIn and A SmallWorld. New Media & Society 11. 199--220.Google Scholar
Cross Ref
- Peter Pomerantsev and Michael Weiss. 2014. The menace of unreality: How the Kremlin weaponizes information, culture and money. Institute of Modern Russia, New York, NY.Google Scholar
- Jarred Prier. 2017. Commanding the trend: Social media as information warfare. Strategic Studies Quarterly 11, 4 (2017), 36 pages.Google Scholar
- Martin Rosvall, Daniel Axelsson, and Carl T. Bergstrom. 2009. The map equation. The European Physical Journal Special Topics 178, 1 (Sep. 2009), 13--23.Google Scholar
Cross Ref
- Dana Rotman, Jennifer Preece, Yurong He, and Allison Druin. 2012. Extreme ethnography: challenges for research in large scale online environments. In Proceedings of the 2012 iConference. ACM, New York, NY, 207--214. Google Scholar
Digital Library
- Saiph Savage, Andres Monroy-Hernandez, and Tobias Höllerer. 2016. Botivist: Calling Volunteers to Action using Online Bots. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 813--822. Google Scholar
Digital Library
- Esther Shein. 2013. Ephemeral data. Communications of the ACM 56, 9 (2013). 20--22. Google Scholar
Digital Library
- Craig Silverman. 2018. Russian Trolls Ran Wild On Tumblr And The Company Refuses To Say Anything About It. (Feb. 2018). Retrieved April 17, 2018 from https://www.buzzfeed.com/craigsilverman/russian-trolls-ran-wild-on-tumblr-and-the-company-refuses?utm_term=.ad65gb5jz#.rdwOw8O6ZGoogle Scholar
- Alvin A. Snyder. Warriors of Disinformation: American Propaganda, Soviet Lies, and the Winning of the Cold War: An Insider's Account. Arcade Publishing, New York. NY.Google Scholar
- Alex Stamos. 2018. Authenticity Matters: The IRA Has No Place on Facebook. (Apr. 2018) Retrieved April 17, 2018 from https://newsroom.fb.com/news/2018/04/authenticity-matters/Google Scholar
- Kate Starbird and Leysia Palen. 2012. (How) will the revolution be retweeted? Information diffusion and the 2011 Egyptian uprising. In Proceedings of the 2012 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, 7--16. Google Scholar
Digital Library
- Leo Graiden Stewart, Ahmer Arif, A. Conrad Nied, Emma S. Spiro, and Kate Starbird. 2017. Drawing the lines of contention: Networked frame contests within #BlackLivesMatter discourse. In Proceedings of ACM Human-Computer Interaction 1, CSCW, Article 96 (December 2017), 23 pages. Google Scholar
Digital Library
- The Internet Archive. About the Internet Archive. Retrieved April 17, 2018 from https://archive.org/about/Google Scholar
- Anton Troianovski. 2018. A Former Russian Troll Speaks: 'It Was Like Being in Orwell's World'. (Feb. 2018). Retrieved April 17, 2018 from https://www.washingtonpost.com/news/worldviews/wp/2018/02/17/a-former-russian-troll-speaks-it-was-like-being-in-orwells-world/Google Scholar
- Joshua Tucker, Andrew Guess, Pablo Barberá, Cristian Vaccari, Alexandra Siegel, Sergey Sanovich, Denis Stukal, and Brendan Nyhan. 2018. Social Media, Political Polarization, and Political Disinformation: A Review of the Scientific Literature. William Flora Hewlett Foundation, Menlo Park, CA.Google Scholar
- Tumblr Help Center. 2018. Public Record of Usernames Linked to State-Sponsored Disinformation Campaigns. (Mar. 2018). Retrieved April 17, 2018 from https://tumblr.zendesk.com/hc/en-us/articles/360002280214Google Scholar
- Twitter. 2018. Update on Twitter's Review of the 2016 U.S. Election. (Jan. 2018) Retrieved April 17, 2018 from https://blog.twitter.com/official/en_us/topics/company/2018/2016-election-update.htmlGoogle Scholar
- United States District Court for the District of Columbia. 2018. Case 1:18-cr-00032-DLF - USA v. IRA et al. (Feb. 2018). Retrieved April 17, 2018 from https://www.justice.gov/file/1035477/downloadGoogle Scholar
- United States House of Representatives Permanent Select Committee on Intelligence. 2017. Exhibit B (Nov. 2017). https://democrats-intelligence.house.gov/uploadedfiles/exhibit_b.pdfGoogle Scholar
- United States House of Representatives Permanent Select Committee on Intelligence. 2017. Testimony of Sean J. Edgett. (Nov. 2017). Retrieved April 17, 2018 from https://intelligence.house.gov/uploadedfiles/prepared_testimony_of_sean_j._edgett_from_twitter.pdfGoogle Scholar
- Yiran Wang and Gloria Mark. 2017. Engaging with Political and Social Issues on Facebook in College Life. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 433--445. Google Scholar
Digital Library
- Clair Wardle and Hossein Derakhshan. 2017. Information Disorder: Toward an Interdisciplinary Framework for Research and Policy Making. Council of Europe Report.Google Scholar
- Jen Weedon, William Nuland and Alex Stamos. 2017. Information Operations and Facebook. (Apr. 2017) Retrieved April 17th, 2018 from https://fbnewsroomus.files.wordpress.com/2017/04/facebook-and-information-operations-v1.pdfGoogle Scholar
- Marisol Wong-Villacres, Cristina M. Velasquez, and Neha Kumar. 2017. Social Media for Earthquake Response: Unpacking its Limitations with Care. In Proceedings of the ACM on Human Computer Interaction 1, CSCW, Article 112 (December 2017), 22 pages. Google Scholar
Digital Library
- Samuel C. Woolley and Philip N. Howard. 2017. Computational Propaganda Worldwide: Executive Summary. Computational Propaganda Research Project. Oxford University, Oxford, UK.Google Scholar
Index Terms
Acting the Part: Examining Information Operations Within #BlackLivesMatter Discourse
Recommendations
Disinformation Warfare: Understanding State-Sponsored Trolls on Twitter and Their Influence on the Web
WWW '19: Companion Proceedings of The 2019 World Wide Web ConferenceOver the past couple of years, anecdotal evidence has emerged linking coordinated campaigns by state-sponsored actors with efforts to manipulate public opinion on the Web, often around major political events, through dedicated accounts, or “trolls.” ...
Disinformation as Collaborative Work: Surfacing the Participatory Nature of Strategic Information Operations
In this paper, we argue that strategic information operations (e.g. disinformation, political propaganda, and other forms of online manipulation) are a critical concern for CSCW researchers, and that the CSCW community can provide vital insight into ...
On the Misinformation Beat: Understanding the Work of Investigative Journalists Reporting on Problematic Information Online
CSCWJournalists are increasingly investigating and reporting on problematic online content such as misinformation, disinformation, and conspiracy theories, leading to the creation of a new misinformation beat. The process of collecting, analyzing, and ...






Comments