skip to main content
research-article

Mutual Supervised Fusion & Transfer Learning with Interpretable Linguistic Meaning for Social Data Analytics

Published:09 May 2023Publication History
Skip Abstract Section

Abstract

Social data analytics is often taken as the most commonly used method for community discovery, product recommendations, knowledge graph, and so on. In this study, social data are firstly represented in different feature spaces by using various feature extraction algorithms. Then we build a transfer learning model to leverage knowledge from multiple feature spaces. During modeling, since the assumption that the training and the testing data have the same distribution is always true, we give a theorem and its proof which asserts the necessary and sufficient condition for achieving a minimum testing error. We also theoretically demonstrate that maximizing the classification error consistency across different feature spaces can improve the classification performance. Additionally, the cluster assumption derived from semi-supervised learning is introduced to enhance knowledge transfer. Finally, a Tagaki-Sugeno-Kang (TSK) fuzzy system-based learning algorithm is proposed, which can generate interpretable fuzzy rules. Experimental results not only demonstrate the promising social data classification performance of our proposed approach but also show its interpretability which is missing in many other models.

REFERENCES

  1. [1] Lopes da Silva F. H.. 2008. The impact of EEG/MEG signal processing and modeling in the diagnostic and management of epilepsy. IEEE Reviews in Biomedical Engineering 1 (2008), 143156.Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Stamoulis C. and Chang B. S.. 2013. Modeling noninvasive neurostimulation in epilepsy as stochastic interference in brain networks. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21, 3 (May 2013), 354363.Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Peker M., Sen B., and Delen D.. 2016. A novel method for automated diagnosis of epilepsy using complex-valued classifiers. IEEE Journal of Biomedical and Health Informatics 20, 1 (Jan. 2016), 108118.Google ScholarGoogle ScholarCross RefCross Ref
  4. [4] Wu D., Lawhern V. J., Hairston W. D., and Lance B. J.. 2016. Switching EEG headsets made easy: Reducing offline calibration effort using active weighted adaptation regularization. IEEE Transactions on Neural Systems and Rehabilitation Engineering 24, 11 (Nov. 2016), 11251137.Google ScholarGoogle ScholarCross RefCross Ref
  5. [5] Wu D., Lawhern V. J., Gordon S., Lance, B. J. and Lin C.. 2017. Driver drowsiness estimation from EEG signals using online weighted adaptation regularization for regression (OwARR). IEEE Transactions on Fuzzy Systems 25, 6 (Dec. 2017), 15221535.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Xu X., Li W., Xu D., and Tsang I. W.. 2016. Co-labeling for multi-view weakly labeled learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 38, 6 (1 June 2016), 11131125.Google ScholarGoogle ScholarCross RefCross Ref
  7. [7] Xu C., Tao D., and Xu C.. 2015. Multi-view intact space learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 37, 12 (1 Dec. 2015), 25312544.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. [8] Li Y., Yang M., and Zhang Z.. 2019. A survey of multi-view representation learning. In IEEE Transactions on Knowledge and Data Engineering 31, 10 (1 Oct. 2019), 18631883.Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Yang C., Deng Z., Choi K.-S., Jiang Y., and Wang S.. 2014. Transductive domain adaptive learning for epileptic electroencephalogram recognition. Artif. Intell. Med. 62, 3 (Nov. 2014), 165177.Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] Jiang Y. et al. 2017. Seizure classification from EEG signals using transfer learning, semi-supervised learning and TSK fuzzy system. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 12 (Dec. 2017), 22702284.Google ScholarGoogle ScholarCross RefCross Ref
  11. [11] Jiang Y., Zhang Y., Lin C., Wu, D. and Lin C.-T.. 2021. EEG-based driver drowsiness estimation using an online multi-view and transfer TSK fuzzy system. IEEE Transactions on Intelligent Transportation Systems 22, 3 (2021), 17521764. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. [12] Jiang Y., Chung F., Ishibuchi H., Deng Z., and Wang S.. 2015. Multitask TSK fuzzy system modeling by mining intertask common hidden structure. IEEE Transactions on Cybernetics 45, 3 (March 2015), 534547.Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Argyriou A., Evgeniou T., and Pontil M.. 2007. Multi-task feature learning. In NIPS. MIT Press, (2007), 41.Google ScholarGoogle Scholar
  14. [14] Dai W., Xue G.-R., Yang Q., and Yu Y.. 2007. Co-clustering based classification for out-of-domain documents. In KDD, (2007), 210219.Google ScholarGoogle Scholar
  15. [15] Dai W., Yang Q., Xue G., and Yu Y.. 2008. Self-taught clustering. In ICML, (2008), 200207.Google ScholarGoogle Scholar
  16. [16] Duan L., Tsang I., Xu D., and Maybank S.. 2009. Domain transfer SVM for video concept detection. CVPR, 13751381, (2009).Google ScholarGoogle Scholar
  17. [17] Pan S., Kwok J., and Yang Q.. Transfer learning via dimensionality reduction. In Proceedings of AAAI, 677682.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Raina R., Battle A., Lee H., Packer B., and Ng A.. 2007. Self-taught learning: Transfer learning from unlabeled data. In ICML, (2007), 766–763.Google ScholarGoogle Scholar
  19. [19] Bonilla E., Chai K., and Williams C.. 2008. Multi-task Gaussian process prediction. NIPS 20, (2008), 153160.Google ScholarGoogle Scholar
  20. [20] Lawrence N. and Platt J.. 2004. Learning to learn with the informative vector machine. In ICML, (2004), 65.Google ScholarGoogle Scholar
  21. [21] Dai W., Yang Q., Xue G., and Yu Y.. 2007. Boosting for transfer learning. In ICML, (2007), 200207.Google ScholarGoogle Scholar
  22. [22] Zadrozny B.. 2004. Learning and evaluating classifiers under sample selection bias. In ICML, (2004).Google ScholarGoogle Scholar
  23. [23] Hang W., Liang S., Choi K.-S., Chung, F.-L. and Wang S.. 2021. Selective transfer classification learning with classification-error-based consensus regularization. IEEE Transactions on Emerging Topics in Computational Intelligence 5, 2 (2021), 178190. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Davis J. and Domingos P.. 2009. Deep transfer via second-order Markov logic. In ICML, (2009), 217224.Google ScholarGoogle Scholar
  25. [25] Mihalkova L., Huynh T., and Mooney R.. 2007. Mapping and revising Markov logic networks for transfer learning. In AAAI 22, (2007), 608613.Google ScholarGoogle Scholar
  26. [26] Mihalkova L. and Mooney R.. 2008. Transfer learning by mapping with minimal target data. In Proceedings of the AAAI-08 Workshop on Transfer Learning for Complex Tasks.Google ScholarGoogle Scholar
  27. [27] Xu J., Han J., Nie, F. and Li X.. 2020. Multi-view scaling support vector machines for classification and feature selection. IEEE Transactions on Knowledge and Data Engineering 32, 7 (2020), 1419–1430. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Xu C., Tao D., and Xu C.. 2015. Multi-view intact space learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 37, 12 (1 Dec. 2015), 25312544.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. [29] Wang Y., Lin X., Wu L., Zhang W., Zhang Q., and Huang X.. 2015. Robust subspace clustering for multi-view data by exploiting correlation consensus. IEEE Transactions on Image Processing 24, 11 (Nov. 2015), 39393949.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. [30] Li G., Chang K., and Hoi S. C. H.. 2012. Multiview semi-supervised learning with consensus. IEEE Transactions on Knowledge and Data Engineering 24, 11 (Nov. 2012), 20402051.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. [31] Ganchev K., Graça J., Blitzer J., and Taskar B.. 2008. Multi-view learning over structured and non-identical outputs. In UAI, (2008), 204211.Google ScholarGoogle Scholar
  32. [32] Zhang D., He J., Liu Y., Si L., and Lawrence R.. 2011. Multi-view transfer learning with a large margin approach. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’11). Association for Computing Machinery, New York, NY, USA, 12081216.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. [33] Briat C.. 2011. Convergence and equivalence results for the Jensen's inequality—application to time-delay and sampled-data systems. IEEE Transactions on Automatic Control 56, 7 (July 2011), 16601665.Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Yang C., Deng Z., Choi K., and Wang S.. 2016. Takagi–Sugeno–Kang transfer learning fuzzy logic system for the adaptive recognition of epileptic electroencephalogram signals. IEEE Transactions on Fuzzy Systems 24, 5 (Oct. 2016), 10791094.Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] Tian X. et al. 2019. Deep multi-view feature learning for EEG-based epileptic seizure detection. IEEE Transactions on Neural Systems and Rehabilitation Engineering 27, 10 (Oct. 2019), 19621972.Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Deng Z., Cao L., Jiang Y., and Wang S.. 2015. Minimax probability TSK fuzzy system classifier: A more transparent and highly interpretable classification model. IEEE Transactions on Fuzzy Systems 23, 4 (Aug. 2015), 813826.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. [37] Rouhani M., Mohammadi M., and Kargarian A.. 2016. Parzen window density estimator-based probabilistic power flow with correlated uncertainties. IEEE Transactions on Sustainable Energy 7, 3 (July 2016), 11701181.Google ScholarGoogle ScholarCross RefCross Ref
  38. [38] Alcal-Fdez J., et al. 2011. KEEL data-mining software tool: Data set repository integration of algorithms and experimental analysis framework. J. Multiple-Valued Log. Soft Comput. 17, 2 (2011), 255287.Google ScholarGoogle Scholar
  39. [39] Subasi A. and Gursoy M. I.. 2010. EEG signal classification using PCA, ICA, LDA and support vector machines. Expert Syst. Appl. 37, 12 (Dec. 2010), 86598666.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Jiang Y. et al. 2017. Recognition of epileptic EEG signals using a novel multiview TSK fuzzy system. IEEE Transactions on Fuzzy Systems 25, 1 (Feb. 2017), 320.Google ScholarGoogle ScholarCross RefCross Ref
  41. [41] Long M., Wang J., Ding G., Shen D., and Yang Q.. 2014. Transfer learning with graph co-regularization. IEEE Trans. Knowl. Data Eng. 26, 7 (Jul. 2014), 18051818.Google ScholarGoogle ScholarCross RefCross Ref
  42. [42] Long M., Wang J., Ding G., Pan, S. J. and Yu P. S.. 2014. Adaptation regularization: A general framework for transfer learning. IEEE Transactions on Knowledge and Data Engineering 26, 5 (May 2014), 10761089.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. [43] Demar J.. 2006. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7 (2006), 130.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. [44] Holm S.. 1979. A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6, 2 (1979), 6570.Google ScholarGoogle Scholar
  45. [45] Shi Y., Lin C., Chang Y., Ding W., Shi Y., and Yao X.. Consensus learning for distributed fuzzy neural network in big data environment. In IEEE Transactions on Emerging Topics in Computational Intelligence. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  46. [46] Ding W., Nayak J., Naik B., Pelusi D., and Mishra M.. Fuzzy and real coded chemical reaction optimization for intrusion detection in industrial big data environment. In IEEE Transactions on Industrial Informatics. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  47. [47] Ding W., Abdel-Basset M., Eldrandaly K. A., Abdel-Fatah L., and de Albuquerque V. H. C.. Smart supervision of cardiomyopathy based on fuzzy Harris Hawks Optimizer and wearable sensing data optimization: A new model. In IEEE Transactions on Cybernetics. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  48. [48] Cheng C., Ding W., Xiao F., and Pedrycz W.. A majority rule-based measure for Atanassov type intuitionistic membership grades in MCDM. In IEEE Transactions on Fuzzy Systems. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. [49] Ding W., Lin C.-T., and Cao Z.. 2019. Shared nearest-neighbor quantum game-based attribute reduction with hierarchical coevolutionary spark and its application in consistent segmentation of neonatal cerebral cortical surfaces. In IEEE Transactions on Neural Networks and Learning Systems 30, 7 (July 2019), 20132027.Google ScholarGoogle ScholarCross RefCross Ref
  50. [50] Ding W.. 2019. SVM-based feature selection for differential space fusion and its application to diabetic fundus image classification. In IEEE Access 7 (2019), 149493149502.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Mutual Supervised Fusion & Transfer Learning with Interpretable Linguistic Meaning for Social Data Analytics

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Asian and Low-Resource Language Information Processing
      ACM Transactions on Asian and Low-Resource Language Information Processing  Volume 22, Issue 5
      May 2023
      653 pages
      ISSN:2375-4699
      EISSN:2375-4702
      DOI:10.1145/3596451
      Issue’s Table of Contents

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 May 2023
      • Online AM: 20 October 2022
      • Accepted: 14 October 2022
      • Revised: 7 October 2022
      • Received: 2 June 2022
      Published in tallip Volume 22, Issue 5

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
    • Article Metrics

      • Downloads (Last 12 months)58
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!