Abstract
Text sentiment classification is an important technology for natural language processing. A fuzzy system is a strong tool for processing imprecise or ambiguous data, and it can be used for text sentiment analysis. This article proposes a new formulation of a multi-task Takagi-Sugeno-Kang fuzzy system (TSK FS) modeling, which can be used for text sentiment image classification. Using a novel multi-task fuzzy c-means clustering algorithm, the common (public) information among all tasks and the individual (private) information for each task are extracted. The information about clustering, for example, cluster centers, can be used to learn the antecedent parameters of multi-task TSK fuzzy systems. With the common and individual antecedent parameters obtained, a corresponding multi-task learning mechanism for learning consequent parameters is devised. Accordingly, a multi-task fuzzy clustering–based multi-task TSK fuzzy system (MTFCM-MT-TSK-FS) is proposed. When the proposed model is built, the information conveyed by the fuzzy rules formed is two-fold, including (1) common fuzzy rules representing the inter-task correlation information and (2) individual fuzzy rules depicting the independent information of each task. The experimental results on several text sentiment datasets demonstrate the validity of the proposed model.
- [1] . 2018. Incorporating multi-level user preference into document-level sentiment classification. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 1 (2018), 7, 1–17. Google Scholar
Digital Library
- [2] . 2019. Multi-entity aspect-based sentiment analysis with context, entity, aspect memory and dependency information. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 4 (2019), 47, 1–22. Google Scholar
Digital Library
- [3] . 2017. A neural word embeddings approach for multi-domain sentiment analysis. IEEE Transactions on Affective Computing 8, 4 (2017), 457–470.Google Scholar
Cross Ref
- [4] . 2019. Leveraging semantics for sentiment polarity detection in social media. International Journal of Machine Learning and Cybernetics 10, 8 (2019), 2045–2055.Google Scholar
Cross Ref
- [5] . 2019. Target sentiment analysis model with Naïve Bayes and support vector machine for product review classification. International Journal of Computer Science and Information Security 17, 7 (2019), 1–17.Google Scholar
- [6] . 2000. Generalization of adaptive neural-fuzzy inference systems. IEEE Transactions on Neural Networks and Learning Systems 11, 6 (2000), 1332–1346. Google Scholar
Digital Library
- [7] . 2015. Fuzzy (c + p)-means clustering and its application to a fuzzy rule-based classifier: Towards good generalization and good interpretability. 2015. IEEE Transactions on Fuzzy Systems 23, 4 (2015), 802–812.Google Scholar
Digital Library
- [8] . Sentiment analysis by using fuzzy logic. 2014. International Journal of Computer Science, Engineering and Information Technology 4, 1 (2014), 33–48.Google Scholar
Cross Ref
- [9] . 2014. A fuzzy system for concept-level sentiment analysis. Communications in Computer & Information Science 475 (2014), 21–27.Google Scholar
Cross Ref
- [10] . 2010. Chinese sentence-level sentiment classification based on fuzzy sets. In Proceedings of the 23rd International Conference on Computational Linguistics: Posters. Association for Computational Linguistics, Beijing, China, 312–319. Google Scholar
Digital Library
- [11] . 2017. A hybrid sentiment classification method using neural network and fuzzy logic. In Proceedings of the 11th International Conference on Intelligent Systems and Control (ISCO’17), IEEE, Coimbatore, India. 93–96.Google Scholar
- [12] . 2014. Fuzzy deep belief networks for semisupervised sentiment classification. Neurocomputing 131, 5 (2014), 312–322. Google Scholar
Digital Library
- [13] . 2021. Fuzzy logic applied to opinion mining: A review. Knowledge-Based Systems 222, 6 (2021), 107018.Google Scholar
Cross Ref
- [14] . 2021. Sentence-level classification using parallel fuzzy deep learning classifier. IEEE Access 9 (2021), 17943–17985.Google Scholar
Cross Ref
- [15] . 2020. Social network analysis: Transforming a black and white approach into a grey approach using fuzzy logic system. Journal of Information Technology Research 13, 3 (2020), 142–155.Google Scholar
Digital Library
- [16] . 2019. Sentiment and sarcasm classification with multitask learning. IEEE Intelligent Systems 34, 3 (2019), 38–43.Google Scholar
Cross Ref
- [17] . 2019. Multi-task stack propagation for neural quality estimation. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 4 (2019), 48, 1–18. Google Scholar
Digital Library
- [18] . Biographies, Bollywood, boomboxes and blenders: Domain adaptation for sentiment classification. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Prague, Czech Republic, 25–27.Google Scholar
- [19] . 2010. Cross-domain sentiment classification via spectral feature alignment. In Proceedings of the 19th International Conference on World Wide Web. Association for Computing Machinery, Raleigh North Carolina USA, 26–30. Google Scholar
Digital Library
- [20] . 2016. Predicting readers’ sarcasm understandability by modeling gaze behavior. In Proceedings of the 30th AAAI Conference on Artificial Intelligence. AAAI Press, Phoenix, Arizona, USA, 3747–3753. Google Scholar
Digital Library
- [21] . 2008. An empirical study of sentiment analysis for Chinese documents. Expert Systems with Applications 34 (2008), 2622–2629 Google Scholar
Digital Library
- [22] . 2016. Computational semantic analysis of language: SemEval-2014 and beyond [J]. Language Resources and Evaluation 50, 1 (2016), 1–4. Google Scholar
Digital Library
- [23] . 2014. Multitask TSK fuzzy system modeling by mining intertask common hidden structure. IEEE Transactions on Cybernetics 45, 3 (2014), 534–547.Google Scholar
Cross Ref
- [24] . 2015. Multi-task TSK fuzzy system modeling using inter-task correlation information. Information Sciences 298, 3 (2015), 512–533. Google Scholar
Digital Library
- [25] . 2018. Learning representations for sentiment classification using multi-task framework. In Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Association for Computational Linguistics, Brussels, Belgium, 299–308.Google Scholar
Cross Ref
- [26] . 2019. Multi-task learning for multi-modal emotion recognition and sentiment analysis. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 370–379.Google Scholar
Cross Ref
- [27] . 2004. An -margin nonlinear classifier based on fuzzy if-then rules. IEEE Transactions on Systems, Man, and Cybernetics, Part B 34, 1 (2004), 68–76. Google Scholar
Digital Library
- [28] . 2007. Fuzzy system learned through fuzzy clustering and support vector machine for human skin color segmentation. IEEE Transactions on Systems, Man, and Cybernetics, Part A 37, 6 (2007), 1077–1087. Google Scholar
Digital Library
- [29] . 2017. Bayesian Takagi-Sugeno-Kang fuzzy classifier. IEEE Transactions on Fuzzy Systems 25, 6 (2017), 1655–1671.Google Scholar
Digital Library
- [30] . 2013. Knowledge-leverage-based TSK fuzzy system modeling. IEEE Transactions on Neural Networks and Learning Systems 24, 8 (2013), 1200–1212. Google Scholar
Digital Library
- [31] . 2005. TSK-fuzzy modeling based on ɛ-insensitive learning. IEEE Transactions on Fuzzy Systems 13, 2 (2005), 181–193. Google Scholar
Digital Library
- [32] . 2008. An empirical study of sentiment analysis for Chinese documents. Expert Systems with Applications 34 (2008), 2622—2629. Google Scholar
Digital Library
- [33] . 2014. Semeval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval’14), Dublin, Ireland. 27–35.Google Scholar
Cross Ref
- [34] . 2013. Efficient estimation of word representations in vector space. CoRR abs/1301.3781 (2013). arXiv:1301.3781Google Scholar
- [35] . 2003. Chinese lexical analysis using hierarchical hidden Markov model. In Proceedings of the 2nd SIGHAN Workshop on Chinese Language Processing, Sapporo, Japan, July 2003. Association for Computational Linguistics, Sapporo, Japan, 63–70. Google Scholar
Digital Library
- [36] . 2019. Cross-domain text sentiment analysis based on CNN_FT method. Information. 10, 162 (2019), 1–14.Google Scholar
- [37] . 2017. Deep TSK fuzzy classifier with stacked generalization and triplely concise interpretability guarantee for large data. IEEE Transactions on Fuzzy Systems 25, 5 (2017), 1207–1221.Google Scholar
Digital Library
- [38] . 2019. Aspect-based sentiment classification with aspect-specific graph convolutional networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China. Association for Computational Linguistics, Hong Kong, China, 4567–4577.Google Scholar
Cross Ref
- [39] . 2020. Deep neural network approach for Arabic community question answering. Alexandria Engineering Journal 59, 6 (2020), 4427–4434.Google Scholar
Cross Ref
Index Terms
Multi-task Fuzzy Clustering–Based Multi-task TSK Fuzzy System for Text Sentiment Classification
Recommendations
Learning Rule for TSK Fuzzy Logic Systems Using Interval Type-2 Fuzzy Subtractive Clustering
Simulated Evolution and LearningAbstractThe paper deals with an approach to model TSK fuzzy logic systems (FLS), especially interval type-2 TSK FLS, using interval type-2 fuzzy subtractive clustering (IT2-SC). The IT2-SC algorithm is combined with least square estimation (LSE) ...
Multi-task TSK fuzzy system modeling using inter-task correlation information
The classical fuzzy system modeling methods have been typically developed for the single task modeling scene, which is essentially not in accordance with many practical applications where a multi-task problem must be considered for the given modeling ...
The bi-objective fuzzy c-means cluster analysis for TSK fuzzy system identification
For conventional fuzzy clustering-based approaches to fuzzy system identification, a fuzzy function is used for cluster formation and another fuzzy function is used for cluster validation to determine the number and location of the clusters which define ...






Comments