skip to main content
research-article

Bilingual Semantic Role Labeling Inference via Dual Decomposition

Authors Info & Claims
Published:09 January 2016Publication History
Skip Abstract Section

Abstract

This article focuses on bilingual Semantic Role Labeling (SRL); its goal is to annotate semantic roles on both sides of the parallel bilingual texts (bi-texts). Since rich bilingual information is encoded, bilingual SRL has been applied in many natural-language processing (NLP) tasks such as machine translation (MT), cross-lingual information retrieval (IR), and the like. A feasible way of performing bilingual SRL is using monolingual SRL systems to perform SRL on each side of bi-texts separately. However, it is difficult to obtain consistent SRL results on both sides of bi-texts in this way. Some works have tried to jointly infer bilingual SRL because there are many complementary language cues on both sides of bi-texts and they reported better performance than monolingual systems. However, there are two limits in the existing methods. First, the existing methods often require high inference costs due to the complex objective function. Second, the existing methods fully adopt the candidates generated by monolingual SRL systems, but many candidates are discarded in the argument pruning or identification stage of monolingual systems. In this article, we propose two strategies to overcome these limits. We utilize a simple but efficient technique: Dual Decomposition to search for consistent results for both sides of bi-texts. On the other hand, we propose a method called Bi-Directional Projection (BDP) to recover arguments discarded in monolingual SRL systems.

We evaluate our method on a standard parallel benchmark: the OntoNotes dataset. The experimental results show that our method yields significant improvements over the state-of-the-art monolingual systems. In addition, our approach is also better and faster than existing methods due to BDP and Dual Decomposition.

References

  1. Stephen Boyd and Almir Mutapcic. 2003. Subgradient Methods. Lecture notes of ee392o. Stanford University, Stanford, CA.Google ScholarGoogle Scholar
  2. Xavier Carreras, Lluís Màrquez, and Grzegorz Chrupała. 2004. Hierarchical recognition of propositional arguments with perceptrons. In HLT-NAACL 2004 Workshop: 8th Conference on Computational Natural Language Learning (CoNLL’04).Google ScholarGoogle Scholar
  3. Pascale Fung, Zhaojun Wu, Yongsheng Yang, and Dekai Wu. 2006. Automatic learning of Chinese English semantic structure mapping. In Proceedings of the 2006 ACL Spoken Language Technology Workshop. 230--233. DOI:http://dx.doi.org/10.1109/SLT.2006.326797Google ScholarGoogle ScholarCross RefCross Ref
  4. Pascale Fung, Zhaojun Wu, Yongsheng Yang, and Dekai Wu. 2007. Learning bilingual semantic frames: Shallow semantic parsing vs. semantic role projection. In Proceedings of the 11th International Conference on Theoretical and Methodological Issues in Machine Translation (TMI’07).Google ScholarGoogle Scholar
  5. Kuzman Ganchev, Jennifer Gillenwater, and Ben Taskar. 2009. Dependency grammar induction via bitext projection constraints. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL (ACL’09). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Daniel Gildea and Daniel Jurafsky. 2002. Automatic labeling for semantic roles. Comput. Linguist. 28, 3 (2002), 245--288. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Daniel Gildea and Martha Palmer. 2002. The necessity of parsing for predicate argument recognition. In Proceedings of the Joint Conference of the 40th Annual Meeting of the ACL (ACL'02). DOI:http://dl.acm.org/citation.cfm?id=1073124 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Fei Huang and Stephan Vogel. 2002. Improved named entity translation and bilingual named entity extraction. In 4th IEEE International Conference on Multimodal Interfaces (ICMI’02). DOI:http://dx.doi.org/ 10.1109/ICMI.2002.1167002 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Rebecca Hwa, Philip Resnik, Amy Weinberg, Clara Cabezas, and Okan Kolak. 2005. Bootstrapping parsers via syntactic projection across parallel texts. Natural Language Engineering 11, 3, 311--325. DOI:http://dx.doi.org/10.1017/S1351324905003840 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Terry Koo, Alexander M. Rush, Michael Collins, Tommi Jaakkola, and David Sontag. 2010. Dual decomposition for parsing with non-projective head automata. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (EMNLP’10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ding Liu and Daniel Gildea. 2010. Semantic role features for machine translation. In Proceedings of the 23rd International Conference on Computational Linguistics (COLING’10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Robert C. Moore. 2003. Learning translations of named-entity phrases from parallel corpora. In Proceedings of the 10th Conference on European Chapter of the Association for Computational Linguistics (EACL’03). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Alessandro Moschitti, Daniele Pighin, and Roberto Basili. 2008. Tree kernels for semantic role labeling. Computational Linguistics 34, 2, 193--224. DOI:http://dx.doi.org/10.1162/coli.2008.34.2.193 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Srini Narayanan and Sanda Harabagiu. 2004. Question answering based on semantic structures. In Proceedings of the 17th International Conference on Computational Linguistics (COLING’04). Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics 29, 1, 19--51. DOI:http://dx.doi.org/10.1162/089120103321337421 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Sebastian Padó and Mirella Lapata. 2009. Cross-lingual annotation projection of semantic roles. Journal of Artificial Intelligence Research 36, 1, 307--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Martha Palmer, Nianwen Xue, Olga Babko-Malaya, Jinying Chen, and Benjamin Snyder. 2005. A parallel proposition bank II for Chinese and English. In Proceedings of the Workshop on Frontiers in Corpus Annotations II: Pie in the Sky (CorpusAnno’05). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Sameer Pradhan, Kadri Hacioglu, Valerie Krugler, Wayne Ward, James H. Martin, and Daniel Jurafsky. 2005. Support vector learning for semantic argument classification. Machine Learning 60, 1--3, 11--39. DOI:http://dx.doi.org/10.1007/s10994-005-0912-2 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Vasin Punyakanok, Dan Roth, Wen-tau Yih, and Dav Zimak. 2004. Semantic role labeling via integer linear programming inference. In Proceedings of the 20th International Conference on Computational Linguistics (COLING’04). DOI:http://dx.doi.org/10.3115/1220355.1220552 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Alexander M. Rush, David Sontag, Michael Collins, and Tommi Jaakkola. 2010. On dual decomposition and linear programming relaxations for natural language processing. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (EMNLP’10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Luo Si and Jamie Callan. 2005. Multilingual retrieval by combining multiple multilingual ranked lists. In Accessing Multilingual Information Repositories, 6th Workshop of the Cross-Language Evalution Forum (CLEF’05). DOI:http://dx.doi.org/10.1007/11878773_13Google ScholarGoogle Scholar
  22. Philipp Sorg and Philipp Cimiano. 2012. Exploiting Wikipedia for cross-lingual and multilingual information retrieval. Data and Knowledge Engineering 74, 26--45. DOI:http://dx.doi.org/10.1016/j.datak.2012.02.003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Mihai Surdeanu, Sanda Harabagiu, John Williams, and Paul Aarseth. 2003. Using predicate-argument structures for information extraction. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics (ACL’03). DOI:http://dx.doi.org/10.3115/1075096.1075098 Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Kristina Toutanova, Aria Haghighi, and Christopher D. Manning. 2008. A global joint model for semantic role labeling. Computational Linguistics 34, 2, 161--191. DOI:http://dx.doi.org/10.1162/coli.2008.34.2.161 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Mengqiu Wang, Wanxiang Che, and Christopher D. Manning. 2013a. Joint word alignment and bilingual named entity recognition using dual decomposition. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL’13).Google ScholarGoogle Scholar
  26. Zhiguo Wang, Chengqing Zong, and Nianwen Xue. 2013b. A lattice-based framework for joint Chinese word segmentation, POS tagging and parsing. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL’13).Google ScholarGoogle Scholar
  27. Dekai Wu and Pascale Fung. 2009a. Can semantic role labeling improve SMT? In Proceedings of the 13th Annual Conference of European Association for Machine Translation (EAMT’09).Google ScholarGoogle Scholar
  28. Dekai Wu and Pascale Fung. 2009b. Semantic roles for SMT: A hybrid two-pass model. In Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics (NAACL’09). Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Deyi Xiong, Min Zhang, and Haizhou Li. 2012. Modeling the translation of predicate-argument structure for SMT. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Jeju Island, Korea, 902--911. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Nianwen Xue. 2004. Calibrating features for semantic role labeling. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’04).Google ScholarGoogle Scholar
  31. Nianwen Xue. 2008. Labeling Chinese predicates with semantic roles. Computational Linguistics 34, 2, 225--255. DOI:http://dx.doi.org/10.1162/coli.2008.34.2.225 Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Nianwen Xue and Martha Palmer. 2004. Calibrating features for semantic role labeling. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’04).Google ScholarGoogle Scholar
  33. Haitong Yang, Tao Zhuang, and Chengqing Zong. 2015. Domain adaptation for syntactic and semantic dependency parsing using deep belief networks. Transactions of the Association for Computational Linguistics 3, 271--282.Google ScholarGoogle ScholarCross RefCross Ref
  34. Haitong Yang and Chengqing Zong. 2014. Multi-predicate semantic role labeling. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP’14).Google ScholarGoogle ScholarCross RefCross Ref
  35. David Yarowsky, Grace Ngai, and Richard Wicentowski. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of the 1st International Conference on Human Language Technology Research (HLT’01). DOI:http://dx.doi.org/10.3115/1072133.1072187 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Feifei Zhai, Jiajun Zhang, Yu Zhou, and Chengqing Zong. 2012. Machine translation by modeling predicate-argument structure transformation. In Proceedings of the 23rd International Conference on Computational Linguistics (COLING’12).Google ScholarGoogle Scholar
  37. Feifei Zhai, Jiajun Zhang, Yu Zhou, and Chengqing Zong. 2013. Handling ambiguities of bilingual predicate-argument structures for statistical machine translation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL’13).Google ScholarGoogle Scholar
  38. Ying Zhang, Stephan Vogel, and Alex Waibel. 2004. Interpreting Bleu/NIST scores: How much improvement do we need to have a better system?. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC’04). 2051--2054.Google ScholarGoogle Scholar
  39. Tao Zhuang and Chengqing Zong. 2010a. Joint inference for bilingual semantic role labeling. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (EMNLP’10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Tao Zhuang and Chengqing Zong. 2010b. A minimum error weighting combination strategy for Chinese semantic role labeling. In Proceedings of the 23rd International Conference on Computational Linguistics (COLING’10). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Bilingual Semantic Role Labeling Inference via Dual Decomposition

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!