skip to main content
research-article
Public Access

QuickStop: A Markov Optimal Stopping Approach for Quickest Misinformation Detection

Authors Info & Claims
Published:19 June 2019Publication History
Skip Abstract Section

Abstract

This paper combines data-driven and model-driven methods for real-time misinformation detection. Our algorithm, named QuickStop, is an optimal stopping algorithm based on a probabilistic information spreading model obtained from labeled data. The algorithm consists of an offline machine learning algorithm for learning the probabilistic information spreading model and an online optimal stopping algorithm to detect misinformation. The online detection algorithm has both low computational and memory complexities. Our numerical evaluations with a real-world dataset show that QuickStop outperforms existing misinformation detection algorithms in terms of both accuracy and detection time (number of observations needed for detection). Our evaluations with synthetic data further show that QuickStop is robust to (offline) learning errors.

References

  1. Mohammad-Ali Abbasi and Huan Liu. 2013. Measuring user credibility in social media. In Proc. Int. Conf. Social Comput. Behavioral-Cultural Model. and Prediction (SBP). Springer-Verlag, Washington, DC, 441--448.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Michele Banko, Michael J Caella, Stephen Soderland, Matthew Broadhead, and Oren Etzioni. 2007. Open information extraction from the web.. In Proc. Int. Joint Conf. Artif. Intell. Org (IJCAI), Vol. 7. Morgan Kaufmann Publishers Inc., Hyderabad, India, 2670--2676. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Dimitri P. Bertsekas. 2017. Dynamic Programming and Optimal Control 4th ed.). Athena Scientific, Belmont, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information Credibility on Twitter. In Proc. Int. Conf. World Wide Web (WWW). ACM, New York, NY, 675--684. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cheng Chang, Yihong Zhang, Claudia Szabo, and Quan Z Sheng. 2016. Extreme user and political rumor detection on Twitter. In Int. Conf. on Adv. Data Mining and Appl(ADMA). Springer, Gold Coast, Australia, 751--763.Google ScholarGoogle ScholarCross RefCross Ref
  6. Tong Chen, Xue Li, Hongzhi Yin, and Jun Zhang. 2018. Call attention to rumors: Deep attention based recurrent neural networks for early rumor detection. In Pacific-Asia Conf. Knowledge Discovery and Data Mining (PAKDD). Springer, Melbourne, Australia, 40--52.Google ScholarGoogle ScholarCross RefCross Ref
  7. Zi Chu, Steven Gianvecchio, Haining Wang, and Sushil Jajodia. 2012. Detecting automation of twitter accounts: Are you a human, bot, or cyborg? IEEE Trans. Dependable Secur. Comput., Vol. 9, 6 (Nov. 2012), 811--824. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Alton Yeow Kuan Chua and Snehasish Banerjee. 2016. Linguistic predictors of rumor veracity on the Internet. In Proc. Int. MultiConf. Emerg. and Comput. Scientists (IMECS). Newswood Limited, Hongkong, China, 387--391.Google ScholarGoogle Scholar
  9. Giovanni Luca Ciampaglia, Prashant Shiralkar, Luis M Rocha, Johan Bollen, Filippo Menczer, and Alessandro Flammini. 2015. Computational fact checking from knowledge networks. PloS one, Vol. 10, 6 (2015), e0128193.Google ScholarGoogle ScholarCross RefCross Ref
  10. Bontcheva Kalina Liakata Maria Procter Rob Wong Sak Hoi Geraldine Derczynski, Leon and Arkaitz Zubiaga. 2017. SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours. In Proc. Int. Workshop Semantic Eval.(SemEval). Association for Computational Linguistics, Vancouver, Canada, 69--76.Google ScholarGoogle Scholar
  11. Adrien Friggeri, Lada A Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor Cascades.. In Proc. Int. Conf. Weblogs and Social Media (ICWSM). AAAI Press, Ann Arbor, MI, 101--110.Google ScholarGoogle Scholar
  12. Manish Gupta, Peixiang Zhao, and Jiawei Han. 2012. Evaluating event credibility on Twitter. In IEEE Int. Conf. Data Mining (ICDM). SIAM, Brussels, Belgium, 153--164.Google ScholarGoogle ScholarCross RefCross Ref
  13. Sardar Hamidian and Mona Diab. 2016. Rumor Identification and Belief Investigation on Twitter. In Proc. Workshop Comput. Approaches to Subjectivity, Sentiment and Social Media Anal (WASSA). Association for Computational Linguistics, San Diego, CF, 3--8.Google ScholarGoogle ScholarCross RefCross Ref
  14. Sardar Hamidian and Mona T Diab. 2015. Rumor detection and classification for Twitter data. In Proc. Int. Conf. Social Media Technol (SOTICS). IARIA XPS Press, Barcelona, Spain, 71--77.Google ScholarGoogle Scholar
  15. Fang Jin, Edward Dougherty, Parang Saraf, Yang Cao, and Naren Ramakrishnan. 2013. Epidemiological modeling of news and rumors on twitter. In Proc. Workshop Social Netw Mining and Anal (SNAKDD). ACM, Chicago, IL, 8:1--8:9.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Zhiwei Jin, Juan Cao, Yongdong Zhang, and Jiebo Luo. 2016. News Verification by Exploiting Conflicting Social Viewpoints in Microblogs.. In AAAI Conf. Artificial Intelligence. AAAI Press, Phoenix, AZ, 2972--2978. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Sejeong Kwon, Meeyoung Cha, and Kyomin Jung. 2017. Rumor detection over varying time windows. PloS ONE, Vol. 12, 1 (jan 2017), e0168344.Google ScholarGoogle ScholarCross RefCross Ref
  18. Sejeong Kwon, Meeyoung Cha, Kyomin Jung, Wei Chen, and Yajun Wang. 2013. Prominent features of rumor propagation in online social media. In IEEE Int. Conf. Data Mining (ICDM). IEEE, Dallas, TX, 1103--1108.Google ScholarGoogle ScholarCross RefCross Ref
  19. Damien Lamberton and Bernard Lapeyre. 2008. Introduction to Stochastic Calculus Applied to Finance 2nd ed.). Chapman & Hall/CRC, Boca Raton, FL, 38.Google ScholarGoogle Scholar
  20. David MJ Lazer, Matthew A Baum, Yochai Benkler, Adam J Berinsky, Kelly M Greenhill, Filippo Menczer, Miriam J Metzger, Brendan Nyhan, Gordon Pennycook, David Rothschild, et almbox. 2018. The science of fake news. Science, Vol. 359, 6380 (2018), 1094--1096.Google ScholarGoogle Scholar
  21. Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, Rui Fang, and Sameena Shah. 2015. Real-time Rumor Debunking on Twitter. In Proc. ACM Int. Conf. Information and Knowledge Management (CIKM). ACM, Melbourne, Australia, 1867--1870. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Yang Liu and Yi-Fang Brook Wu. 2018. Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks. In AAAI Conf. Artificial Intelligence. AAAI Press, New Orleans, Louisiana, 354--361.Google ScholarGoogle ScholarCross RefCross Ref
  23. Jing Ma, Wei Gao, Prasenjit Mitra, Sejeong Kwon, Bernard J Jansen, Kam-Fai Wong, and Meeyoung Cha. 2016. Detecting Rumors from Microblogs with Recurrent Neural Networks. In Proc. Int. Joint Conf. Artif. Intell. Org (IJCAI). AAAI Press, New York, NY, 3818--3824. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jing Ma, Wei Gao, Zhongyu Wei, Yueming Lu, and Kam-Fai Wong. 2015. Detect Rumors Using Time Series of Social Context Information on Microblogging Websites. In Proc. ACM Int. Conf. Information and Knowledge Management (CIKM). ACM, Melbourne, Australia, 1751--1754. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Jing Ma, Wei Gao, and Kam-Fai Wong. 2017. Detect rumors in microblog posts using propagation structure via kernel learning. In Proc. Annu. Meeting Assoc. Comput. Linguistics (ACL), Vol. 1. Association for Computational Linguistics, Vancouver, Canada, 708--717.Google ScholarGoogle ScholarCross RefCross Ref
  26. Jing Ma, Wei Gao, and Kam-Fai Wong. 2018. Rumor detection on twitter with tree-structured recursive neural networks. In Proc. Annu. Meeting Assoc. Comput. Linguistics (ACL), Vol. 1. Association for Computational Linguistics, Melbourne, Australia, 1980--1989.Google ScholarGoogle ScholarCross RefCross Ref
  27. Amr Magdy and Nayer Wanas. 2010. Web-based statistical fact checking of textual documents. In Proc. Int. Workshop Search and Mining User-generated Contents (SMUC). ACM, ACM, Toronto, ON, Canada, 103--110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Chris Milling, Constantine Caramanis, Shie Mannor, and Sanjay Shakkottai. 2013. Detecting epidemics using highly noisy data. In Proc. ACM Int. Symp. Mobile Ad Hoc Networking and Computing (MobiHoc). ACM, Bangalore, India, 177--186. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Fred Morstatter, Liang Wu, Tahora H Nazer, Kathleen M Carley, and Huan Liu. 2016. A new approach to bot detection: striking the balance between precision and recall. In Proc. IEEE/ACM Int. Conf. Adv. Social Netw. Anal. and Mining (ASONAM). IEEE Press, Davis, CF, 533--540. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. H. Vincent Poor and Olympia Hadjiliadis. 2008. Quickest Detection .Cambridge University Press, Cambridge, United Kingdom, Chapter Markov optimal stopping theory, 40--64.Google ScholarGoogle Scholar
  31. Vahed Qazvinian, Emily Rosengren, Dragomir R Radev, and Qiaozhu Mei. 2011. Rumor Has It: Identifying Misinformation in Microblogs. In Proc. the Conf. on Empirical Methods in Natural Language Process. Association for Computational Linguistics, Edinburgh, United Kingdom, 1589--1599. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Natali Ruchansky, Sungyong Seo, and Yan Liu. 2017. Csi: A hybrid deep model for fake news detection. In Proc. ACM Int. Conf. Information and Knowledge Management (CIKM). ACM, Singapore, Singapore, 797--806. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Devavrat Shah and Tauhid Zaman. 2011. Rumors in a Network: Who's the Culprit? IEEE Trans. Inf. Theory, Vol. 57, 8 (Aug. 2011), 5163--5181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Alessandro Flammini, and Filippo Menczer. 2018. The spread of fake news by social bots. Nature Communications, Vol. 9 (2018), 96--104.Google ScholarGoogle ScholarCross RefCross Ref
  35. Baoxu Shi and Tim Weninger. 2016. Fact checking in heterogeneous information networks. In Proc. Int. Conf. World Wide Web (WWW). International World Wide Web Conferences Steering Committee, Montréal, Québec, Canada, 101--102.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Kai Shu, Amy Sliva, Suhang Wang, Jiliang Tang, and Huan Liu. 2017. Fake news detection on social media: A data mining perspective. ACM SIGKDD Explorations Newsletter, Vol. 19, 1 (Sept. 2017), 22--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Kai Shu, Suhang Wang, and Huan Liu. 2018. Understanding user profiles on social media for fake news detection. In Conf. Multimedia Inf. Process. and Retrieval (MIPR). IEEE, Miami, FL, 430--435.Google ScholarGoogle ScholarCross RefCross Ref
  38. Herbert A Simon. 1955. On a class of skew distribution functions. Biometrika, Vol. 42, 3--4 (Dec. 1955), 425--440.Google ScholarGoogle ScholarCross RefCross Ref
  39. Eugenio Tacchini, Gabriele Ballarin, Marco L Della Vedova, Stefano Moret, and Luca de Alfaro. 2017. Some like it hoax: Automated fake news detection in social networks. In Workshop on Data Science for Social Good, Vol. 1960. CEUR-WS, Skopje, Macedonia, 1--15.Google ScholarGoogle Scholar
  40. Tetsuro Takahashi and Nobuyuki Igata. 2012. Rumor detection on twitter. In Proc. Int. Conf. Soft Comput. and Intell. Syst. and Proc. Int. Symp. Adv. Intell. Syst (SCIS & ISIS). IEEE, Kobe, Japan, 452--457.Google ScholarGoogle ScholarCross RefCross Ref
  41. Sebastian Tschiatschek, Adish Singla, Manuel Gomez Rodriguez, Arpit Merchant, and Andreas Krause. 2018. Fake News Detection in Social Networks via Crowd Signals. In Proc. Int. Conf. World Wide Web (WWW). International World Wide Web Conferences Steering Committee, Lyon, France, 517--524. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Soroush Vosoughi. 2015. Automatic detection and verification of rumors on Twitter. Ph.D. Dissertation. Massachusetts Institute of Technology.Google ScholarGoogle Scholar
  43. Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science, Vol. 359, 6380 (2018), 1146--1151.Google ScholarGoogle Scholar
  44. Ke Wu, Song Yang, and Kenny Q Zhu. 2015. False rumors detection on Sina Weibo by propagation structures. In Proc. Int. Conf. Data Engineering (ICDE). IEEE, Seoul, South Korea, 651--662.Google ScholarGoogle ScholarCross RefCross Ref
  45. Fan Yang, Yang Liu, Xiaohui Yu, and Min Yang. 2012. Automatic Detection of Rumor on Sina Weibo. In Proc. Ann. ACM SIGKDD Conf. Knowledge Discovery and Data Mining (KDD). ACM, Beijing, China, Article 13, bibinfonumpages7 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Fan Ye and Enlu Zhou. 2013. Optimal Stopping of Partially Observable Markov Processes: A Filtering-Based Duality Approach. IEEE Trans. Autom. Control, Vol. 58, 10 (Oct 2013), 2698--2704.Google ScholarGoogle ScholarCross RefCross Ref
  47. Lei Ying and Kai Zhu. 2018. Diffusion source localization in large networks. Synthesis Lectures on Communication Networks, Vol. 11, 1 (2018), 1--95. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Zhe Zhao, Paul Resnick, and Qiaozhu Mei. 2015. Enquiring minds: Early detection of rumors in social media from enquiry posts. In Proc. Int. Conf. World Wide Web (WWW). (IW3C2, Florence, Italy, 1395--1405. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. QuickStop: A Markov Optimal Stopping Approach for Quickest Misinformation Detection

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!