Abstract
This paper combines data-driven and model-driven methods for real-time misinformation detection. Our algorithm, named QuickStop, is an optimal stopping algorithm based on a probabilistic information spreading model obtained from labeled data. The algorithm consists of an offline machine learning algorithm for learning the probabilistic information spreading model and an online optimal stopping algorithm to detect misinformation. The online detection algorithm has both low computational and memory complexities. Our numerical evaluations with a real-world dataset show that QuickStop outperforms existing misinformation detection algorithms in terms of both accuracy and detection time (number of observations needed for detection). Our evaluations with synthetic data further show that QuickStop is robust to (offline) learning errors.
- Mohammad-Ali Abbasi and Huan Liu. 2013. Measuring user credibility in social media. In Proc. Int. Conf. Social Comput. Behavioral-Cultural Model. and Prediction (SBP). Springer-Verlag, Washington, DC, 441--448.Google Scholar
Digital Library
- Michele Banko, Michael J Caella, Stephen Soderland, Matthew Broadhead, and Oren Etzioni. 2007. Open information extraction from the web.. In Proc. Int. Joint Conf. Artif. Intell. Org (IJCAI), Vol. 7. Morgan Kaufmann Publishers Inc., Hyderabad, India, 2670--2676. Google Scholar
Digital Library
- Dimitri P. Bertsekas. 2017. Dynamic Programming and Optimal Control 4th ed.). Athena Scientific, Belmont, MA. Google Scholar
Digital Library
- Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information Credibility on Twitter. In Proc. Int. Conf. World Wide Web (WWW). ACM, New York, NY, 675--684. Google Scholar
Digital Library
- Cheng Chang, Yihong Zhang, Claudia Szabo, and Quan Z Sheng. 2016. Extreme user and political rumor detection on Twitter. In Int. Conf. on Adv. Data Mining and Appl(ADMA). Springer, Gold Coast, Australia, 751--763.Google Scholar
Cross Ref
- Tong Chen, Xue Li, Hongzhi Yin, and Jun Zhang. 2018. Call attention to rumors: Deep attention based recurrent neural networks for early rumor detection. In Pacific-Asia Conf. Knowledge Discovery and Data Mining (PAKDD). Springer, Melbourne, Australia, 40--52.Google Scholar
Cross Ref
- Zi Chu, Steven Gianvecchio, Haining Wang, and Sushil Jajodia. 2012. Detecting automation of twitter accounts: Are you a human, bot, or cyborg? IEEE Trans. Dependable Secur. Comput., Vol. 9, 6 (Nov. 2012), 811--824. Google Scholar
Digital Library
- Alton Yeow Kuan Chua and Snehasish Banerjee. 2016. Linguistic predictors of rumor veracity on the Internet. In Proc. Int. MultiConf. Emerg. and Comput. Scientists (IMECS). Newswood Limited, Hongkong, China, 387--391.Google Scholar
- Giovanni Luca Ciampaglia, Prashant Shiralkar, Luis M Rocha, Johan Bollen, Filippo Menczer, and Alessandro Flammini. 2015. Computational fact checking from knowledge networks. PloS one, Vol. 10, 6 (2015), e0128193.Google Scholar
Cross Ref
- Bontcheva Kalina Liakata Maria Procter Rob Wong Sak Hoi Geraldine Derczynski, Leon and Arkaitz Zubiaga. 2017. SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours. In Proc. Int. Workshop Semantic Eval.(SemEval). Association for Computational Linguistics, Vancouver, Canada, 69--76.Google Scholar
- Adrien Friggeri, Lada A Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor Cascades.. In Proc. Int. Conf. Weblogs and Social Media (ICWSM). AAAI Press, Ann Arbor, MI, 101--110.Google Scholar
- Manish Gupta, Peixiang Zhao, and Jiawei Han. 2012. Evaluating event credibility on Twitter. In IEEE Int. Conf. Data Mining (ICDM). SIAM, Brussels, Belgium, 153--164.Google Scholar
Cross Ref
- Sardar Hamidian and Mona Diab. 2016. Rumor Identification and Belief Investigation on Twitter. In Proc. Workshop Comput. Approaches to Subjectivity, Sentiment and Social Media Anal (WASSA). Association for Computational Linguistics, San Diego, CF, 3--8.Google Scholar
Cross Ref
- Sardar Hamidian and Mona T Diab. 2015. Rumor detection and classification for Twitter data. In Proc. Int. Conf. Social Media Technol (SOTICS). IARIA XPS Press, Barcelona, Spain, 71--77.Google Scholar
- Fang Jin, Edward Dougherty, Parang Saraf, Yang Cao, and Naren Ramakrishnan. 2013. Epidemiological modeling of news and rumors on twitter. In Proc. Workshop Social Netw Mining and Anal (SNAKDD). ACM, Chicago, IL, 8:1--8:9.Google Scholar
Digital Library
- Zhiwei Jin, Juan Cao, Yongdong Zhang, and Jiebo Luo. 2016. News Verification by Exploiting Conflicting Social Viewpoints in Microblogs.. In AAAI Conf. Artificial Intelligence. AAAI Press, Phoenix, AZ, 2972--2978. Google Scholar
Digital Library
- Sejeong Kwon, Meeyoung Cha, and Kyomin Jung. 2017. Rumor detection over varying time windows. PloS ONE, Vol. 12, 1 (jan 2017), e0168344.Google Scholar
Cross Ref
- Sejeong Kwon, Meeyoung Cha, Kyomin Jung, Wei Chen, and Yajun Wang. 2013. Prominent features of rumor propagation in online social media. In IEEE Int. Conf. Data Mining (ICDM). IEEE, Dallas, TX, 1103--1108.Google Scholar
Cross Ref
- Damien Lamberton and Bernard Lapeyre. 2008. Introduction to Stochastic Calculus Applied to Finance 2nd ed.). Chapman & Hall/CRC, Boca Raton, FL, 38.Google Scholar
- David MJ Lazer, Matthew A Baum, Yochai Benkler, Adam J Berinsky, Kelly M Greenhill, Filippo Menczer, Miriam J Metzger, Brendan Nyhan, Gordon Pennycook, David Rothschild, et almbox. 2018. The science of fake news. Science, Vol. 359, 6380 (2018), 1094--1096.Google Scholar
- Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, Rui Fang, and Sameena Shah. 2015. Real-time Rumor Debunking on Twitter. In Proc. ACM Int. Conf. Information and Knowledge Management (CIKM). ACM, Melbourne, Australia, 1867--1870. Google Scholar
Digital Library
- Yang Liu and Yi-Fang Brook Wu. 2018. Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks. In AAAI Conf. Artificial Intelligence. AAAI Press, New Orleans, Louisiana, 354--361.Google Scholar
Cross Ref
- Jing Ma, Wei Gao, Prasenjit Mitra, Sejeong Kwon, Bernard J Jansen, Kam-Fai Wong, and Meeyoung Cha. 2016. Detecting Rumors from Microblogs with Recurrent Neural Networks. In Proc. Int. Joint Conf. Artif. Intell. Org (IJCAI). AAAI Press, New York, NY, 3818--3824. Google Scholar
Digital Library
- Jing Ma, Wei Gao, Zhongyu Wei, Yueming Lu, and Kam-Fai Wong. 2015. Detect Rumors Using Time Series of Social Context Information on Microblogging Websites. In Proc. ACM Int. Conf. Information and Knowledge Management (CIKM). ACM, Melbourne, Australia, 1751--1754. Google Scholar
Digital Library
- Jing Ma, Wei Gao, and Kam-Fai Wong. 2017. Detect rumors in microblog posts using propagation structure via kernel learning. In Proc. Annu. Meeting Assoc. Comput. Linguistics (ACL), Vol. 1. Association for Computational Linguistics, Vancouver, Canada, 708--717.Google Scholar
Cross Ref
- Jing Ma, Wei Gao, and Kam-Fai Wong. 2018. Rumor detection on twitter with tree-structured recursive neural networks. In Proc. Annu. Meeting Assoc. Comput. Linguistics (ACL), Vol. 1. Association for Computational Linguistics, Melbourne, Australia, 1980--1989.Google Scholar
Cross Ref
- Amr Magdy and Nayer Wanas. 2010. Web-based statistical fact checking of textual documents. In Proc. Int. Workshop Search and Mining User-generated Contents (SMUC). ACM, ACM, Toronto, ON, Canada, 103--110. Google Scholar
Digital Library
- Chris Milling, Constantine Caramanis, Shie Mannor, and Sanjay Shakkottai. 2013. Detecting epidemics using highly noisy data. In Proc. ACM Int. Symp. Mobile Ad Hoc Networking and Computing (MobiHoc). ACM, Bangalore, India, 177--186. Google Scholar
Digital Library
- Fred Morstatter, Liang Wu, Tahora H Nazer, Kathleen M Carley, and Huan Liu. 2016. A new approach to bot detection: striking the balance between precision and recall. In Proc. IEEE/ACM Int. Conf. Adv. Social Netw. Anal. and Mining (ASONAM). IEEE Press, Davis, CF, 533--540. Google Scholar
Digital Library
- H. Vincent Poor and Olympia Hadjiliadis. 2008. Quickest Detection .Cambridge University Press, Cambridge, United Kingdom, Chapter Markov optimal stopping theory, 40--64.Google Scholar
- Vahed Qazvinian, Emily Rosengren, Dragomir R Radev, and Qiaozhu Mei. 2011. Rumor Has It: Identifying Misinformation in Microblogs. In Proc. the Conf. on Empirical Methods in Natural Language Process. Association for Computational Linguistics, Edinburgh, United Kingdom, 1589--1599. Google Scholar
Digital Library
- Natali Ruchansky, Sungyong Seo, and Yan Liu. 2017. Csi: A hybrid deep model for fake news detection. In Proc. ACM Int. Conf. Information and Knowledge Management (CIKM). ACM, Singapore, Singapore, 797--806. Google Scholar
Digital Library
- Devavrat Shah and Tauhid Zaman. 2011. Rumors in a Network: Who's the Culprit? IEEE Trans. Inf. Theory, Vol. 57, 8 (Aug. 2011), 5163--5181. Google Scholar
Digital Library
- Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Alessandro Flammini, and Filippo Menczer. 2018. The spread of fake news by social bots. Nature Communications, Vol. 9 (2018), 96--104.Google Scholar
Cross Ref
- Baoxu Shi and Tim Weninger. 2016. Fact checking in heterogeneous information networks. In Proc. Int. Conf. World Wide Web (WWW). International World Wide Web Conferences Steering Committee, Montréal, Québec, Canada, 101--102.Google Scholar
Digital Library
- Kai Shu, Amy Sliva, Suhang Wang, Jiliang Tang, and Huan Liu. 2017. Fake news detection on social media: A data mining perspective. ACM SIGKDD Explorations Newsletter, Vol. 19, 1 (Sept. 2017), 22--36. Google Scholar
Digital Library
- Kai Shu, Suhang Wang, and Huan Liu. 2018. Understanding user profiles on social media for fake news detection. In Conf. Multimedia Inf. Process. and Retrieval (MIPR). IEEE, Miami, FL, 430--435.Google Scholar
Cross Ref
- Herbert A Simon. 1955. On a class of skew distribution functions. Biometrika, Vol. 42, 3--4 (Dec. 1955), 425--440.Google Scholar
Cross Ref
- Eugenio Tacchini, Gabriele Ballarin, Marco L Della Vedova, Stefano Moret, and Luca de Alfaro. 2017. Some like it hoax: Automated fake news detection in social networks. In Workshop on Data Science for Social Good, Vol. 1960. CEUR-WS, Skopje, Macedonia, 1--15.Google Scholar
- Tetsuro Takahashi and Nobuyuki Igata. 2012. Rumor detection on twitter. In Proc. Int. Conf. Soft Comput. and Intell. Syst. and Proc. Int. Symp. Adv. Intell. Syst (SCIS & ISIS). IEEE, Kobe, Japan, 452--457.Google Scholar
Cross Ref
- Sebastian Tschiatschek, Adish Singla, Manuel Gomez Rodriguez, Arpit Merchant, and Andreas Krause. 2018. Fake News Detection in Social Networks via Crowd Signals. In Proc. Int. Conf. World Wide Web (WWW). International World Wide Web Conferences Steering Committee, Lyon, France, 517--524. Google Scholar
Digital Library
- Soroush Vosoughi. 2015. Automatic detection and verification of rumors on Twitter. Ph.D. Dissertation. Massachusetts Institute of Technology.Google Scholar
- Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science, Vol. 359, 6380 (2018), 1146--1151.Google Scholar
- Ke Wu, Song Yang, and Kenny Q Zhu. 2015. False rumors detection on Sina Weibo by propagation structures. In Proc. Int. Conf. Data Engineering (ICDE). IEEE, Seoul, South Korea, 651--662.Google Scholar
Cross Ref
- Fan Yang, Yang Liu, Xiaohui Yu, and Min Yang. 2012. Automatic Detection of Rumor on Sina Weibo. In Proc. Ann. ACM SIGKDD Conf. Knowledge Discovery and Data Mining (KDD). ACM, Beijing, China, Article 13, bibinfonumpages7 pages. Google Scholar
Digital Library
- Fan Ye and Enlu Zhou. 2013. Optimal Stopping of Partially Observable Markov Processes: A Filtering-Based Duality Approach. IEEE Trans. Autom. Control, Vol. 58, 10 (Oct 2013), 2698--2704.Google Scholar
Cross Ref
- Lei Ying and Kai Zhu. 2018. Diffusion source localization in large networks. Synthesis Lectures on Communication Networks, Vol. 11, 1 (2018), 1--95. Google Scholar
Digital Library
- Zhe Zhao, Paul Resnick, and Qiaozhu Mei. 2015. Enquiring minds: Early detection of rumors in social media from enquiry posts. In Proc. Int. Conf. World Wide Web (WWW). (IW3C2, Florence, Italy, 1395--1405. Google Scholar
Digital Library
Index Terms
QuickStop: A Markov Optimal Stopping Approach for Quickest Misinformation Detection
Recommendations
QuickStop: A Markov Optimal Stopping Approach for Quickest Misinformation Detection
This paper combines data-driven and model-driven methods for real-time misinformation detection. Our algorithm, named Quick- Stop, is an optimal stopping algorithm based on a probabilistic information spreading model obtained from labeled data. The ...
QuickStop: A Markov Optimal Stopping Approach for Quickest Misinformation Detection
SIGMETRICS '19: Abstracts of the 2019 SIGMETRICS/Performance Joint International Conference on Measurement and Modeling of Computer SystemsThis paper combines data-driven and model-driven methods for real-time misinformation detection. Our algorithm, named QuickStop, is an optimal stopping algorithm based on a probabilistic information spreading model obtained from labeled data. The ...
The web centipede: understanding how web communities influence each other through the lens of mainstream and alternative news sources
IMC '17: Proceedings of the 2017 Internet Measurement ConferenceAs the number and the diversity of news outlets on the Web grows, so does the opportunity for "alternative" sources of information to emerge. Using large social networks like Twitter and Facebook, misleading, false, or agenda-driven information can ...






Comments