skip to main content
research-article

A Span-based Target-aware Relation Model for Frame-semantic Parsing

Authors Info & Claims
Published:10 March 2023Publication History
Skip Abstract Section

Abstract

Frame-semantic Parsing (FSP) is a challenging and critical task in Natural Language Processing (NLP). Most of the existing studies decompose the FSP task into frame identification (FI) and frame semantic role labeling (FSRL) subtasks, and adopt a pipeline model architecture that clearly causes error propagation problem. However, recent jointly learning models aim to address the above problem and generally treat FSP as a span-level structured prediction task, which, unfortunately, leads to cascading error propagation problem between roles and less-efficient solutions due to huge search space of roles. To address these problems, we reformulate the FSRL task into a target-aware relation classification task and propose a novel and lightweight jointly learning framework that simultaneously processes three subtasks of FSP, including frame identification, argument identification, and role classification. The novel task formulation and jointly learning with interaction mechanisms among subtasks can help improve the overall system performance and reduce the search space and time complexity, compared with existing methods. Extensive experimental results demonstrate that our proposed model significantly outperforms 10 state-of-the-art models in terms of F1 score across two benchmark datasets.

REFERENCES

  1. [1] Baker Collin, Ellsworth Michael, and Erk Katrin. 2007. SemEval-2007 task 19: Frame semantic structure extraction. In Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval’07). Association for Computational Linguistics, 99104.Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] Baker Collin F., Fillmore Charles J., and Lowe John B.. 1998. The Berkeley FrameNet project. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics. Association for Computational Linguistics, 8690. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Chen Xudong, Zheng Ce, and Chang Baobao. 2021. Joint multi-decoder framework with hierarchical pointer network for frame semantic parsing. In Findings of the Association for Computational Linguistics. Association for Computational Linguistics, 25702578. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  4. [4] Das Dipanjan, Chen Desai, Martins André F. T., Schneider Nathan, and Smith Noah A.. 2014. Frame-semantic parsing. Comput. Ling. 40, 1 (2014), 956. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] Devlin Jacob, Chang Ming-Wei, Lee Kenton, and Toutanova Kristina. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 41714186. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  6. [6] Dozat Timothy and Manning Christopher D.. 2017. Deep biaffine attention for neural dependency parsing. ArXiv abs/1611.01734 (2017).Google ScholarGoogle Scholar
  7. [7] Eberts Markus and Ulges Adrian. 2019. Span-based joint entity and relation extraction with transformer pre-training. CoRR abs/1909.07755 (2019).Google ScholarGoogle Scholar
  8. [8] Fillmore C. and Baker Collin F.. 2001. Frame semantics for text understanding. In Proceedings of the NAACL WordNet and Other Lexical Resources Workshop. Association for Computational Linguistics, Pittsburgh.Google ScholarGoogle Scholar
  9. [9] Fillmore C. J.. 1985. Frames and the semantics of understanding. Quaderni di Semantica 6, 2 (1985), 222254.Google ScholarGoogle Scholar
  10. [10] FitzGerald Nicholas, Täckström Oscar, Ganchev Kuzman, and Das Dipanjan. 2015. Semantic role labeling with neural network factors. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Lisbon, 960970. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  11. [11] Gildea Daniel and Jurafsky Daniel. 2002. Automatic labeling of semantic roles. Comput. Ling. 28, 3 (Sept.2002), 245288. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. [12] Guan Yong, Guo Shaoru, Li Ru, Li Xiaoli, and Zhang Hu. 2021. Frame Semantics guided network for abstractive sentence summarization. Knowl.-based Syst. 221 (2021), 106973. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Guo Shaoru, Guan Yong, Li Ru, Li Xiaoli, and Tan Hongye. 2020. Incorporating syntax and frame semantics in neural network for machine reading comprehension. In Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics, Barcelona, 26352641. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  14. [14] Guo Shaoru, Li Ru, Tan Hongye, Li Xiaoli, Guan Yong, Zhao Hongyan, and Zhang Yueping. 2020. A frame-based sentence representation for machine reading comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 891896. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  15. [15] Hartmann Silvana, Kuznetsov Ilia, Martin Teresa, and Gurevych Iryna. 2017. Out-of-domain FrameNet semantic role labeling. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 471482.Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Hermann Karl Moritz, Das Dipanjan, Weston Jason, and Ganchev Kuzman. 2014. Semantic frame identification with distributed word representations. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Valencia, 14481458. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Hermann Karl Moritz, Das Dipanjan, Weston Jason, and Ganchev Kuzman. 2014. Semantic frame identification with distributed word representations. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics ACL 2014, June 22-27, 2014, Baltimore, MD, USA, Volume 1: Long Papers. The Association for Computer Linguistics, 14481458. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Lin ZhiChao, Sun Yueheng, and Zhang Meishan. 2021. A graph-based neural model for end-to-end frame semantic parsing. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Punta Cana, 38643874. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] Liu Shulin, Chen Yubo, He Shizhu, Liu Kang, and Zhao Jun. 2016. Leveraging FrameNet to improve automatic event detection. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Berlin, 21342143. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Ouchi Hiroki, Shindo Hiroyuki, and Matsumoto Yuji. 2018. A span selection model for semantic role labeling. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Brussels, 16301642. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Peng Hao, Thomson Sam, Swayamdipta Swabha, and Smith Noah A.. 2018. Learning joint semantic parsers from disjoint data. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, New Orleans, 14921502. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  22. [22] Pennington Jeffrey, Socher Richard, and Manning Christopher. 2014. GloVe: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’14). Association for Computational Linguistics, Doha, 15321543. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Roth Michael and Lapata Mirella. 2015. Context-aware frame-semantic role labeling. Trans. Assoc. Comput. Ling. 3 (2015), 449460. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Ruppenhofer Josef, Ellsworth Michael, Petruck Miriam R. L., Johnson Christopher R., Baker Collin F., and Scheffczyk Jan. 2016. FrameNet ii: Extended Theory and Practice. Retrieved from https://framenet2.icsi.berkeley.edu/docs/r1.7/book.pdf.Google ScholarGoogle Scholar
  25. [25] Shi Tianze, Malioutov Igor, and Irsoy Ozan. 2020. Semantic role labeling as syntactic dependency parsing. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’20). Association for Computational Linguistics, 75517571. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  26. [26] Su Xuefeng, Li Ru, Li Xiaoli, Pan Jeff Z., Zhang Hu, Chai Qinghua, and Han Xiaoqi. 2021. A knowledge-guided framework for frame identification. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 52305240. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] Swayamdipta Swabha, Thomson Sam, Dyer Chris, and Smith Noah A.. 2017. Frame-semantic parsing with softmax-margin segmental RNNs and a syntactic scaffold. CoRR abs/1706.09528 (2017).Google ScholarGoogle Scholar
  28. [28] Täckström Oscar, Ganchev Kuzman, and Das Dipanjan. 2015. Efficient inference and structured learning for semantic role labeling. Trans. Assoc. Comput. Ling. 3 (2015), 2941.Google ScholarGoogle ScholarCross RefCross Ref
  29. [29] Täckström Oscar, Ganchev Kuzman, and Das Dipanjan. 2015. Efficient inference and structured learning for semantic role labeling. Trans. Assoc. Comput. Ling. 3 (2015), 2941. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Wang Yijun, Sun Changzhi, Wu Yuanbin, Zhou Hao, Li Lei, and Yan Junchi. 2021. UniRE: A unified label space for entity relation extraction. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 220231. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Weston Jason, Bengio Samy, and Usunier Nicolas. 2011. N.: Wsabie: Scaling up to large vocabulary image annotation. In Proceedings of the International Joint Conference on Artificial Intelligence.Google ScholarGoogle Scholar
  32. [32] Xu Lu, Chia Yew Ken, and Bing Lidong. 2021. Learning span-level interactions for aspect sentiment triplet extraction. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 47554766. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Yang Bishan and Mitchell Tom. 2017. A joint sequential and relational model for frame-semantic parsing. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 12471256.Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Yu Juntao, Bohnet Bernd, and Poesio Massimo. 2020. Named entity recognition as dependency parsing. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 64706476. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] Zhao Hongyan, Li Ru, Li Xiaoli, and Tan Hongye. 2020. CFSRE: Context-aware based on frame-semantics for distantly supervised relation extraction. Knowl.-based Syst. 210 (2020), 106480. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Zhong Zexuan and Chen Danqi. 2021. A frustratingly easy approach for entity and relation extraction. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 5061. DOI:Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Span-based Target-aware Relation Model for Frame-semantic Parsing

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Asian and Low-Resource Language Information Processing
          ACM Transactions on Asian and Low-Resource Language Information Processing  Volume 22, Issue 3
          March 2023
          570 pages
          ISSN:2375-4699
          EISSN:2375-4702
          DOI:10.1145/3579816
          Issue’s Table of Contents

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 10 March 2023
          • Online AM: 27 October 2022
          • Accepted: 14 October 2022
          • Revised: 20 September 2022
          • Received: 10 July 2022
          Published in tallip Volume 22, Issue 3

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
        • Article Metrics

          • Downloads (Last 12 months)105
          • Downloads (Last 6 weeks)5

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        View Full Text

        HTML Format

        View this article in HTML Format .

        View HTML Format
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!