Abstract
Semantic information that has been proven to be necessary to the resolution of common noun phrases is typically ignored by most existing Chinese zero pronoun resolvers. This is because that zero pronouns convey no descriptive information, which makes it almost impossible to calculate semantic similarities between the zero pronoun and its candidate antecedents. Moreover, most of traditional approaches are based on the single-candidate model, which considers the candidate antecedents of a zero pronoun in isolation and thus overlooks their reciprocities. To address these problems, we first propose a neural-network-based zero pronoun resolver (NZR) that is capable of generating vector-space semantics of zero pronouns and candidate antecedents. On the basis of NZR, we develop the collaborative filtering-based framework for Chinese zero pronoun resolution task, exploring the reciprocities between the candidate antecedents of a zero pronoun to more rationally re-estimate their importance. Experimental results on the Chinese portion of the OntoNotes 5.0 corpus are encouraging: Our proposed model substantially surpasses the Chinese zero pronoun resolution baseline systems.
- Charu C. Aggarwal, Joel L. Wolf, Kun-Lung Wu, and Philip S. Yu. 1999. Horting hatches an Egg: A new graph-theoretic approach to collaborative filtering. In Proceedings of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 201--212 Google Scholar
Digital Library
- Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. J. Machine Learn. Res. 3 (2003), 1137--1155. Google Scholar
Digital Library
- Chen Chen and Vincent Ng. 2013. Chinese zero pronoun resolution: Some recent advances. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’13). 1360--1365.Google Scholar
- Chen Chen and Vincent Ng. 2014. Chinese zero pronoun resolution: An unsupervised approach combining ranking and integer linear programming. In Proceedings of the 28th AAAI Conference on Artificial Intelligence.1622--1628. Google Scholar
Digital Library
- Chen Chen and Vincent Ng. 2015. Chinese zero pronoun resolution: A joint unsupervised discourse-aware model rivaling state-of-the-art resolvers. In Proceedings of the 53rd Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL’15), Volume 2: Short Papers. 320--326.Google Scholar
- Chen Chen and Vincent Ng. 2016. Chinese zero pronoun resolution with deep neural networks. In Proceedings of the 54th Meeting of the Association for Computational Linguistics (ACL’16), Volume 1: Long Papers.Google Scholar
Cross Ref
- Kevin Clark and Christopher D. Manning. 2016. Improving coreference resolution by learning entity-level distributed representations. In Proceedings of the 54th Meeting of the Association for Computational Linguistics (’16), Volume 1: Long Papers.Google Scholar
- Susan P. Converse and Martha Stone Palmer. 2006. Pronominal Anaphora Resolution in Chinese. Citeseer.Google Scholar
- Jeffrey L. Elman. 1991. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learn. 7 (1991), 195--225. Google Scholar
Digital Library
- David Goldberg, David A. Nichols, Brian M. Oki, and Douglas B. Terry. 1992. Using collaborative filtering to weave an information tapestry. Commun. ACM 35, 12 (1992), 61--70. Google Scholar
Digital Library
- SongJie Gong. 2009. Joining case-based reasoning and item-based collaborative filtering in recommender systems. In Proceedings of the 2nd International Symposium on Electronic Commerce and Security, Vol. 1. IEEE, 40--42. Google Scholar
Digital Library
- José Luis Vicedo González and Antonio Ferrández Rodríguez. 2000. Importance of pronominal anaphora resolution in question answering systems. In 38th Meeting of the Association for Computational Linguistics. Google Scholar
Digital Library
- Na-Rae Han. 2006. Korean Zero Pronouns: Analysis and Resolution. Ph.D. Dissertation. Citeseer. University of Pennsylvania. Google Scholar
Digital Library
- Masatsugu Hangyo, Daisuke Kawahara, and Sadao Kurohashi. 2013. Japanese zero reference resolution considering exophora and author/reader mentions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’13). 924--934.Google Scholar
- Yuta Hayashibe, Mamoru Komachi, and Yuji Matsumoto. 2011. Japanese predicate argument structure analysis exploiting argument position and type. In Proceedings of the 5th International Joint Conference on Natural Language Processing (IJCNLP’11). 201--209.Google Scholar
- Karl Moritz Hermann, Tomás Kociský, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015. Teaching machines to read and comprehend. In Proceedings of the Conference on Neural Information Processing Systems. 1693--1701. Google Scholar
Digital Library
- William C. Hill, Larry Stead, Mark Rosenstein, and George W. Furnas. 1995. Recommending and evaluating choices in a virtual community of use. In Proceedings of the Conference on Human Factors in Computing Systems (CHI’95). 194--201. Google Scholar
Digital Library
- Jerry R. Hobbs. 1978. Resolving pronoun references. Lingua 44, 4 (1978), 311--338.Google Scholar
Digital Library
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computat. 9, 8 (1997), 1735--1780. Google Scholar
Digital Library
- Ryu Iida, Kentaro Inui, and Yuji Matsumoto. 2006. Exploiting syntactic patterns as clues in zero-anaphora resolution. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Meeting of the Association for Computational Linguistics (ACL’06). Google Scholar
Digital Library
- Ryu Iida, Kentaro Inui, and Yuji Matsumoto. 2007. Zero-anaphora resolution by learning rich syntactic pattern features. ACM Trans. Asian Lang. Inf. Process. 6, 4 (2007), 1:1--1:22. Google Scholar
Digital Library
- Ryu Iida and Massimo Poesio. 2011. A cross-lingual ILP solution to zero anaphora resolution. In Proceedings of the 49th Meeting of the Association for Computational Linguistics: Human Language Technologies. 804--813. Google Scholar
Digital Library
- Ryu Iida, Kentaro Torisawa, Chikara Hashimoto, Jong-Hoon Oh, and Julien Kloetzer. 2015. Intra-sentential zero anaphora resolution using subject sharing recognition. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’15). 2179--2189.Google Scholar
Cross Ref
- Kenji Imamura, Kuniko Saito, and Tomoko Izumi. 2009. Discriminative approach to predicate-argument structure analysis with zero-anaphora resolution. In Proceedings of the 47th Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Short Papers. 85--88. Google Scholar
Digital Library
- Hideki Isozaki and Tsutomu Hirao. 2003. Japanese zero pronoun resolution based on ranking rules and machine learning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’03). Google Scholar
Digital Library
- Young-Joo Kim. 2000. Subject/object drop in the acquisition of Korean: A cross-linguistic comparison. J. East Asian Ling. 9, 4 (2000), 325--351.Google Scholar
Cross Ref
- Fang Kong and Guodong Zhou. 2010. A tree kernel-based unified framework for Chinese zero anaphora resolution. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’10). 882--891. Google Scholar
Digital Library
- Joseph A. Konstan, Bradley N. Miller, David Maltz, Jonathan L. Herlocker, Lee R. Gordon, and John Riedl. 1997. GroupLens: Applying collaborative filtering to Usenet news. Commun. ACM 40, 3 (1997), 77--87. Google Scholar
Digital Library
- Nitin Pradeep Kumar and Zhenzhen Fan. 2015. Hybrid user-item based collaborative filtering. In Proceedings of the 19th International Conference in Knowledge Based and Intelligent Information and Engineering Systems (KES’15). 1453--1461.Google Scholar
Cross Ref
- Ting Liu, Yiming Cui, Qingyu Yin, Weinan Zhang, Shijin Wang, and Guoping Hu. 2017. Generating and exploiting large-scale pseudo training data for zero pronoun resolution. In Proceedings of the 55th Meeting of the Association for Computational Linguistics (ACL’17). 102--111.Google Scholar
Cross Ref
- Tomas Mikolov, Martin Karafiát, Lukás Burget, Jan Cernocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Proceedings of the 11th Conference of the International Speech Communication Association (INTERSPEECH’10). 1045--1048.Google Scholar
- Ruslan Mitkov. 1999. Introduction: Special issue on anaphora resolution in machine translation and multilingual NLP. Machine Trans. 14, 3--4 (1999), 159--161. Google Scholar
Digital Library
- Vincent Ng. 2007. Semantic class induction and coreference resolution. In Proceedings of the 45th Meeting of the Association for Computational Linguistics (ACL’07).Google Scholar
- Tim Rocktäschel, Edward Grefenstette, Karl Moritz Hermann, Tomás Kociský, and Phil Blunsom. 2016. Reasoning about entailment with neural attention. In Proceedings of the 4th International Conference on Learning Representations (ICLR’16).Google Scholar
- Antonio Ferrández Rodríguez and Jesús Peral. 2000. A computational approach to zero-pronouns in Spanish. In Proceedings of the 38th Meeting of the Association for Computational Linguistics (ACL’00). Google Scholar
Digital Library
- Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A neural attention model for abstractive sentence summarization. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’15). 379--389.Google Scholar
Cross Ref
- Badrul Munir Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International World Wide Web Conference (WWW’10). 285--295.Google Scholar
Digital Library
- Ryohei Sasano and Sadao Kurohashi. 2011. A discriminative approach to Japanese zero anaphora resolution with large-scale lexicalized case frames. In Proceedings of the 5th International Joint Conference on Natural Language Processing (IJCNLP’11). 758--766.Google Scholar
- Kazuhiro Seki, Atsushi Fujii, and Tetsuya Ishikawa. 2002. A probabilistic method for analyzing Japanese anaphora integrating zero pronoun detection and resolution. In Proceedings of the 19th International Conference on Computational Linguistics (COLING’02). Google Scholar
Digital Library
- Upendra Shardanand and Pattie Maes. 1995. Social information filtering: Algorithms for automating “word of mouth.” In Proceedings of the Conference on Human Factors in Computing Systems (CHI’95). 210--217. Google Scholar
Digital Library
- Richard Socher, Danqi Chen, Christopher D. Manning, and Andrew Y. Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. In Proceedings of the 27th Conference on Advances in Neural Information Processing Systems. 926--934. Google Scholar
Digital Library
- Shuang Xia, Yang Zhao, Yong Zhang, Chunxiao Xing, Scott Roepnack, and Shihong Huang. 2010. Optimizations for item-based collaborative filtering algorithm. In Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering (NLPKE’10). 1--5.Google Scholar
- Xiaofeng Yang, Jian Su, and Chew Lim Tan. 2008. A twin-candidate model for learning-based anaphora resolution. Computat. Ling. 34, 3 (2008), 327--356. Google Scholar
Digital Library
- Xiaofeng Yang, Guodong Zhou, Jian Su, and Chew Lim Tan. 2003. Coreference resolution using competition learning approach. In Proceedings of the 41st Meeting of the Association for Computational Linguistics (ACL’03). 176--183. Google Scholar
Digital Library
- Koichiro Yoshino, Shinsuke Mori, and Tatsuya Kawahara. 2013. Predicate argument structure analysis using partially annotated corpora. In Proceedings of the 6th International Joint Conference on Natural Language Processing (IJCNLP’13). 957--961.Google Scholar
- Shanheng Zhao and Hwee Tou Ng. 2007. Identification and resolution of Chinese zero pronouns: A machine learning approach. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL’07). 541--550.Google Scholar
Index Terms
Chinese Zero Pronoun Resolution: A Collaborative Filtering-based Approach
Recommendations
Chinese Zero Pronoun Resolution: A Chain-to-chain Approach
Chinese zero pronoun (ZP) resolution plays a critical role in discourse analysis. Different from traditional mention-to-mention approaches, this article proposes a chain-to-chain approach to improve the performance of ZP resolution in three aspects. ...
Zero pronoun resolution in Bulgarian
CompSysTech '11: Proceedings of the 12th International Conference on Computer Systems and TechnologiesThis paper introduces the problem "zero anaphora resolution" in Bulgarian. Different types of subject ellipses in Bulgarian are described. Rules for identification of clauses with zero pronouns in Bulgarian are proposed. The antecedent of the omitted ...
An algorithm for zero pronoun resolution in Bulgarian
CompSysTech '13: Proceedings of the 14th International Conference on Computer Systems and TechnologiesThis paper presents an algorithm for identifying the noun phrase antecedents of zero pronouns in Bulgarian. The algorithm applies to syntactic representation in XML format, generated by context-free grammar parser. Like the parser, the algorithm is ...






Comments