Abstract
Investigating public attitudes on social media is important in opinion mining systems. Stance detection aims to analyze the attitude of an opinionated text (e.g., favor, neutral, or against) toward a given target. Existing methods mainly address this problem from the perspective of fine-tuning. Recently, prompt-tuning has achieved success in natural language processing tasks. However, conducting prompt-tuning methods for stance detection in real-world remains a challenge for several reasons: (1) The text form of stance detection is usually short and informal, which makes it difficult to design label words for the verbalizer. (2) The tweet text may not explicitly give the attitude. Instead, users may use various hashtags or background knowledge to express stance-aware perspectives. In this article, we first propose a prompt-tuning-based framework that performs stance detection in a cloze question manner. Specifically, a knowledge-enhanced prompt-tuning framework (KEprompt) method is designed, which consists of an automatic verbalizer (AutoV) and background knowledge injection (BKI). Specifically, in AutoV, we introduce a semantic graph to build a better mapping from the predicted word of the pretrained language model and detection labels. In BKI, we first propose a topic model for learning hashtag representation and introduce ConceptGraph as the supplement of the target. At last, we present a challenging dataset for stance detection, where all stance categories are expressed in an implicit manner. Extensive experiments on a large real-world dataset demonstrate the superiority of KEprompt over state-of-the-art methods.
- [1] . 2020. Zero-shot stance detection: A dataset and model using generalized topic representations. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 8913–8931.Google Scholar
Cross Ref
- [2] . 2020. Zero-shot stance detection: A dataset and model using generalized topic representations. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 8913–8931.Google Scholar
Cross Ref
- [3] . 2016. Stance detection with bidirectional conditional encoding. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.Google Scholar
Cross Ref
- [4] . 2022. SenticNet 7: A commonsense-based neurosymbolic AI framework for explainable sentiment analysis. In Proceedings of the International Conference on Language Resources and Evaluation.Google Scholar
- [5] . 2018. SenticNet 5: Discovering conceptual primitives for sentiment analysis by means of context embeddings. In Proceeedings of the 32nd AAAI Conference on Artificial Intelligence.Google Scholar
Cross Ref
- [6] . 2022. Do dependency relations help in the task of stance detection? In Proceedings of the 3rd Workshop on Insights from Negative Results in NLP. Association for Computational Linguistics, 10–17.Google Scholar
Cross Ref
- [7] . 2020. Will-they-won’t-they: A very large dataset for stance detection on Twitter. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 1715–1724.Google Scholar
Cross Ref
- [8] . 2021. Synthetic examples improve cross-target generalization: A study on stance detection on a Twitter corpus. In Proceedings of the 11th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Association for Computational Linguistics, 181–187.Google Scholar
- [9] . 2022. Enhancing class understanding via prompt-tuning for zero-shot text classification. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 4303–4307.Google Scholar
Cross Ref
- [10] . 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 4171–4186.Google Scholar
- [11] . 2018. Topical stance detection for Twitter: A two-phase LSTM model using attention. In Proceedings of the European Conference on Information Retrieval. Springer, 529–536.Google Scholar
Cross Ref
- [12] . 2017. Stance classification with target-specific neural attention networks. In Proceedings of the International Joint Conferences on Artificial Intelligence.Google Scholar
- [13] . 2021. Making pre-trained language models better few-shot learners. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 3816–3830.Google Scholar
Cross Ref
- [14] . 2022. Few-shot cross-lingual stance detection with sentiment-based pre-training. In Proceedings of the AAAI Conference on Artificial Intelligence. 10729–10737.Google Scholar
Cross Ref
- [15] . 2022. Infusing Wikipedia knowledge to enhance stance detection. arXiv preprint arXiv:2204.03839 (2022).Google Scholar
- [16] . 2021. Knowledgeable prompt-tuning: Incorporating knowledge into prompt verbalizer for text classification. arXiv preprint arXiv:2108.02035 (2021).Google Scholar
- [17] . 2022. Knowledgeable prompt-tuning: Incorporating knowledge into prompt verbalizer for text classification. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 2225–2240.Google Scholar
Cross Ref
- [18] . 2018. Aspect level sentiment classification with attention-over-attention neural networks. In Proceedings of the International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation. Springer, 197–206.Google Scholar
Cross Ref
- [19] . 2022. Fake news classification: A quantitative research description. ACM Trans. Asian Low Resour. Lang. Inf. Process. 21, 1 (2022), 3:1–3:17.Google Scholar
Digital Library
- [20] . 2022. Few-shot stance detection via target-aware prompt distillation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 837–847.Google Scholar
Digital Library
- [21] . 2020. Stance detection: A survey. ACM Comput. Surv. 53, 1 (2020), 1–37.Google Scholar
Digital Library
- [22] . 2021. Sentiprompt: Sentiment knowledge enhanced prompt-tuning for aspect-based sentiment analysis. arXiv preprint arXiv:2109.08306 (2021).Google Scholar
- [23] . 2022. Joint stance and rumor detection in hierarchical heterogeneous graph. IEEE Trans. Neural Netw. Learn. Syst. 33, 6 (2022), 2530–2542.Google Scholar
Cross Ref
- [24] . 2019. Multi-task stance detection with sentiment and stance lexicons. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 6299–6305.Google Scholar
Cross Ref
- [25] . 2021. P-stance: A large dataset for stance detection in political domain. In Findings of the Association for Computational Linguistics.Google Scholar
- [26] . 2022. Zero-shot stance detection via contrastive learning. In Proceedings of the ACM Web Conference. 2738–2747.Google Scholar
Digital Library
- [27] . 2021. Target-adaptive graph for cross-target stance detection. In Proceedings of the Web Conference. 3453–3464.Google Scholar
Digital Library
- [28] . 2021. Enhancing zero-shot and few-shot stance detection with commonsense knowledge graph. In Findings of the Association for Computational Linguistics. 3152–3157.Google Scholar
- [29] . 2016. SemEval-2016 task 6: Detecting stance in tweets. In Proceedings of the 10th International Workshop on Semantic Evaluation. 31–41.Google Scholar
Cross Ref
- [30] . 2019. STANCY: Stance classification based on consistency cues. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 6413–6418.
DOI: Google ScholarCross Ref
- [31] . 2022. Aspect-based sentiment analysis using dependency parsing. ACM Trans. Asian Low Resour. Lang. Inf. Process. 21, 3 (2022), 56:1–56:19.Google Scholar
Digital Library
- [32] . 2020. Automatically identifying words that can serve as labels for few-shot text classification. In Proceedings of the 28th International Conference on Computational Linguistics. 5569–5578.Google Scholar
Cross Ref
- [33] . 2021. Exploiting cloze-questions for few-shot text classification and natural language inference. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 255–269.Google Scholar
Cross Ref
- [34] . 2020. AutoPrompt: Eliciting knowledge from language models with automatically generated prompts. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 4222–4235.Google Scholar
Cross Ref
- [35] . 2017. A dataset for multi-target stance detection. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. 551–557.Google Scholar
Cross Ref
- [36] . 2009. Recognizing stances in online debates. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Association for Computational Linguistics, 226–234.Google Scholar
Digital Library
- [37] . 2018. Stance detection with hierarchical attention network. In Proceedings of the 27th International Conference on Computational Linguistics. 2399–2409.Google Scholar
- [38] . 2016. Aspect level sentiment classification with deep memory network. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.Google Scholar
Cross Ref
- [39] . 2012. Stance classification using dialogic properties of persuasion. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 592–596.Google Scholar
- [40] . 2021. Solving stance detection on tweets as multi-domain and multi-task text classification. IEEE Access 9 (2021), 157780–157789.Google Scholar
Cross Ref
- [41] . 2018. Multi-target stance detection via a dynamic memory-augmented network. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. ACM, 1229–1232.Google Scholar
Digital Library
- [42] . 2019. Modeling transferable topics for cross-target stance detection. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1173–1176.Google Scholar
Digital Library
- [43] . 2018. Cross-target stance classification with self-attention networks. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. 778–783.Google Scholar
Cross Ref
- [44] . 2019. Hierarchical human-like strategy for aspect-level sentiment classification with sentiment linguistic knowledge and reinforcement learning. Neural Netw. 117 (2019), 240–248.Google Scholar
Digital Library
- [45] . 2019. Investigating the transferring capability of capsule networks for text classification. Neural Netw. 118 (2019), 247–261.Google Scholar
Digital Library
- [46] . 2020. Enhancing cross-target stance detection with transferable semantic-emotion knowledge. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 3188–3197.Google Scholar
Cross Ref
- [47] . 2019. Aspect-based sentiment classification with aspect-specific graph convolutional networks. arXiv preprint arXiv:1909.03477 (2019).Google Scholar
- [48] . 2021. Knowledge enhanced target-aware stance detection on tweets. In Proceedings of the China Conference on Knowledge Graph and Semantic Computing. Springer, 171–184.Google Scholar
Cross Ref
- [49] . 2021. Learning interaction dynamics with an interactive LSTM for conversational sentiment analysis. Neural Netw. 133 (2021), 40–56.Google Scholar
Cross Ref
Index Terms
Knowledge-enhanced Prompt-tuning for Stance Detection
Recommendations
Stance Detection: A Survey
Automatic elicitation of semantic information from natural language texts is an important research problem with many practical application areas. Especially after the recent proliferation of online content through channels such as social media sites, ...
Ranking-based Method for News Stance Detection
WWW '18: Companion Proceedings of the The Web Conference 2018A valuable step towards news veracity assessment is to understand stance from different information sources, and the process is known as the stance detection. Specifically, the stance detection is to detect four kinds of stances ("agree'', "disagree'', "...
Twitter stance detection using deep learning model with FastText Embedding
CACML '23: Proceedings of the 2023 2nd Asia Conference on Algorithms, Computing and Machine LearningThe interactivity of social media platforms allows a large number of users to comment on different political or social issues to express their views, and identifying users' stances from online comment texts helps the government to monitor public opinion ...






Comments