Abstract
Sign language is the fundamental communication language of deaf people. Efforts to develop sign language generation systems can make the life of these people smooth and effortless. Despite the importance of sign language generation systems, there is a paucity of a systematic literature review. This is the foremost recognizable scholastic literature review of sign language generation systems. It presents a scholastic database of the literature between 1998 and 2020 and suggests classification criteria to systematize research studies. Four hundred fourteen research studies were recognized and reviewed for their direct pertinence to sign language generation systems. One hundred sixty-two research studies were subsequently chosen, examined, and classified. Each of the 162 chosen research papers was categorized based on 30 sign languages and was further comparatively analyzed based on seven comparison parameters (input form, translation technologies, application domain, use of parsers/grammars, manual/non-manual features, accuracy, and output form). It is evident from our research findings that the majority of research on sign language generation was carried out using data-driven approaches in the absence of proper grammar rules and generated only manual signs. This research study may provide researchers a roadmap toward future research directions and facilitate the compilation of information in the field of sign language generation.
- [1] . 2009. Design and development of a frame based MT system for English-to-ISL. In Proceedings of the World Congress on Nature and Biologically Inspired Computing (NABIC’09), 1382–1387. Google Scholar
Cross Ref
- [2] . 2003. Indo-Pakistani Sign Language grammar: A typological outline. Sign Lang. Stud. 3, 2 (2003), 157–212.Google Scholar
Cross Ref
- [3] . 2022. Retrieved March 1, 2022 from https://www.who.int/en/news-room/fact-sheets/detail/deafness-and-hearing-loss.Google Scholar
- [4] . 2022. Retrieved March 1, 2022 from https://www.startasl.com/american-sign-language.Google Scholar
- [5] . 2022. Retrieved March 1, 2022 from https://bda.org.uk/help-resources/#statistics.Google Scholar
- [6] . 2022. Retrieved March 1, 2022 from https://edl.ecml.at/Facts/FAQsonsignlanguage/tabid/2741/language/Default.aspx.Google Scholar
- [7] . 2022. Signall. Retrieved March 2022 from http://www.signall.us.Google Scholar
- [8] . 2022. Kintrans. Retrieved March 1, 2022 from http://www.kintrans.com.Google Scholar
- [9] . 2008a. Prototype machine translation system from text-to-Indian Sign Language. In Proceedings of the International Conference on Intelligent User Interfaces, 313–316. Google Scholar
Digital Library
- [10] . 2009. Systematic literature reviews in software engineering—A systematic literature review. Inf. Softw. Technol. 51, 1 (2009), 7–15.Google Scholar
Digital Library
- [11] (eds.). 2021. Ethnologue: Languages of the World. (24th ed.). SIL International. Dallas, Texas.Google Scholar
- [12] . 2016. Text to sign language translation system. Int. J. Synth. Emot. 7, 2 (2016), 62–77. Google Scholar
Digital Library
- [13] . 2018. Automatic translation from Arabic to Arabic sign language: A review. In Proceedings of the JCCO Joint International Conference on ICT in Education and Training, International Conference on Computing in Arabic, and International Conference on Geocomputing (JCCO: TICET-ICCA-GECO’18), 11–15. Google Scholar
Cross Ref
- [14] . 2020. Sign language generation—A survey of techniques. Int. J. Innov. Technol. Explor. Eng. 9, 9 (2020), 473–476. Google Scholar
Cross Ref
- [15] . 1998. The challenges of cross-modal translation: English-to-sign-language translation in the Zardoz system. Mach. Transl. 13 (1998), 81–106. Google Scholar
Digital Library
- [16] . 1999. English to American Sign Language machine translation of weather reports. In Proceedings of the 2nd High Desert Student Conference in Linguistics (HDSL2’99), 46–55.Google Scholar
- [17] . 2000. A machine translation system from English to American Sign Language. In Proceedings of the Conference of the Association for Machine Translation in the Americas. Springer, Berlin, 54–67.Google Scholar
Cross Ref
- [18] . 2001. Representation of ASL for Machine Translation. Ph.D. Dissertation, Georgetown University.Google Scholar
- [19] . 2002. SignSynth: A sign language synthesis application using Web3D and perl. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 2298, 134–145. Google Scholar
Cross Ref
- [20] . 2003. iSign: Making the benefits of reading aloud accessible to families with deaf children. In Proceedings of the IASTED International Conference on Computer Graphics and Imaging. 74–78.Google Scholar
- [21] . 2004. VSigns—A virtual sign synthesis web tool. In Conference: Proc. 6th COST 276 Workshop on Information and Knowledge Management for Integrated Media Communication. https://www.researchgate.net/publication/230608781_VSigns_-_A_Virtual_Sign_Synthesis_Web_Tool.Google Scholar
- [22] . 2005. Text-to-sign language synthesis tool. In Proceedings of the 13th European Signal Processing Conference (EUSIPCO’05), 2521–2524.Google Scholar
- [23] . 2004. A Multi-path Architecture for Machine Translation of English Text into American Sign Language Animation, 25–30. Google Scholar
Cross Ref
- [24] . 2005. American sign language generation: Multimodal NLG with multiple linguistic channels. In Proceedings of the Conference 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05), 37–42. Google Scholar
Cross Ref
- [25] . 2006. Generating American Sign Language Classifier Predicates for English-to-ASL Machine Translation. Ph.D. Dissertation, University of Pennsylvania.Google Scholar
- [26] . 2007. Design and evaluation of an American Sign Language generator. In Proceedings of the Workshop on Embodied Language Processing, Association for Computational Linguistics, Prague, 51--58. https://aclanthology.org/W07-1907/.Google Scholar
Digital Library
- [27] . 2011. Statistical sign language machine translation: From English written text to American Sign Language gloss IJCSI International Journal of Computer Science Issues 8, 5 (2011), 65--73. Google Scholar
Cross Ref
- [28] . 2012. English-ASL Gloss Parallel Corpus 2012: ASLG-PC12. In Conference: 5th Workshop on the Representation and Processing of Sign Languages LREC12.Google Scholar
- [29] . 2015. English to ASL Gloss Machine Translation. Ph.D. Dissertation, Brigham Young University.Google Scholar
- [30] . 2018. English to ASL Translator for SPEECH2SIGNS. Retrieved March 16, 2021 from https://www.semanticscholar.org/paper/english-to-asl-translator-for-speech2signs-Manzano/88d6a9573b9a2d0cf54c90e947f4fbe12578fbca.Google Scholar
- [31] . 2006. Automatic translation of Arabic text to Arabic Sign Language. AIML J. 6, 4 (2006), 15–19.Google Scholar
- [32] . 2008. Arabic sign language translation system on mobile devices. Int.l J. Comput. Sci. Netw. Secur. 8, 1 (2008), 251–256.Google Scholar
- [33] . 2011. A proposed semantic machine translation system for translating Arabic text to Arabic Sign Language. In Proceedings of the 2nd Kuwait Conference on E-Services and e-Systems (KCESS’11). Google Scholar
Digital Library
- [34] . 2012. SemSignWriting: A proposed semantic system for Arabic text-to-signwriting translation. J. Softw. Eng. Appl. 5, 8 (2012), 604–612. Google Scholar
Cross Ref
- [35] . 2011. Arabic text to Arabic Sign Language translation system for the deaf and hearing-impaired community. In Proceedings of the 2nd Workshop on Speech and Language Processing for Assistive Technologies (SLPAT’11), 101–109.Google Scholar
Digital Library
- [36] . 2011. Mobile Arabic Sign Language. In Proceedings of the International Conference for Internet Technology and Secured Transactions (ICITST’11), 363–367.Google Scholar
- [37] . 2013. An avatar based translation system from Arabic speech to Arabic Sign Language for deaf people. Int. J. Comput. Sci. Netw. Secur. 13, 12 (2013), 43–52.Google Scholar
- [38] . 2013. Towards an automatic translation from Arabic text to sign language. In Proceedings of the 4th International Conference on Information and Communication Technology and Accessibility (ICTA’13). Google Scholar
Cross Ref
- [39] . 2018. Translation system from Arabic text to Arabic Sign Language. J. Appl. Intell. Syst. 3, 2 (2018), 57–70. Google Scholar
Cross Ref
- [40] . 2017. Arab gloss and implementation for Arabic Sign Language. In Proceedings of the 6th International Conference on Information and Communication Technology and Accessbility (ICTA’17), 1–6. Google Scholar
Cross Ref
- [41] El A. E. E. Alfi and EL S. M. Atawy. 2018. Intelligent Arabic Sign Language to Arabic text Translation for easy deaf communication. International Journal of Computer Applications 180, 41 (2018), 19--26. https://www.ijcaonline.org/archives/volume180/number41/29403-2018917081.Google Scholar
- [42] . 2016. Translation from Arabic speech to Arabic Sign Language based on cloud computing. Egypt. Inf. J. 17, 3 (2016), 295–303. Google Scholar
Cross Ref
- [43] . 2017. Arabic text-to-sign (ArTTS) model from automatic SR system. Proc. Comput. Sci. 117 (2017), 304–311. Google Scholar
Cross Ref
- [44] . 2018. Automatic translation of Arabic text-to-Arabic Sign Language. Univ. Access Inf. Soc. 18, 4 (2018), 939–951. Google Scholar
Cross Ref
- [45] . 2018. Prototype for learning and teaching Arabic Sign Language using 3D animations. In Proceedings of the International Conference on Intelligent Autonomous Systems (ICoIAS’18), 51–57. Google Scholar
Cross Ref
- [46] . 2019. ATLASLang MTS 1: Arabic text language into Arabic Sign Language machine translation system. Proc. Comput. Sci. 148 (2019) 236–245. Google Scholar
Digital Library
- [47] H. M. Al-Barhamtoshy, N. E. Abuzinadah, A. Nabawi, T. F. Himdi, A. A. Malibari, and A. A. Allinjawi. 2019. Development of an intelligent Arabic text translation model for deaf students using state of the art information technology. Biosci. Biotechnol. Res. Commun. 12, 2 (2019), 338–345. 7Google Scholar
Cross Ref
- [48] . 2005. Towards a sign language gloss representation of modern standard Arabic. ArXiv, 1--4. Google Scholar
Cross Ref
- [49] . 2000. Virtual signing: Capture, animation, storage and transmission—An overview of the ViSiCAST project. IEE Colloq. 25 (2000), 23–29. Google Scholar
Cross Ref
- [50] . 2001. Translation of English text to a DRS-based sign language oriented semantic representation. In Proceedings of the Conference on Automatic Treatment Natural Languages (TALN’01), 297–306.Google Scholar
- [51] . 2002a. Sign language translation via DRT and HPSG. In Proceedings of the Conference on Computational Linguistics and Intelligent Text Processing. (CICLing’02), Lecture Notes in Computer Science, Vol. 2276, A. Gelbukh (ed.). Springer, Berlin. Google Scholar
Cross Ref
- [52] . 2002b. Sign language generation using HPSG. Inf. Syst. (2002), 1–10Google Scholar
- [53] . 2002. Synthetic animation of deaf signing gestures. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 2298, 146–157. Google Scholar
Cross Ref
- [54] . 2003. Computer Science, Linguistics. Google Scholar
Digital Library
- [55] . 2002. TESSA, a system to aid communication with deaf people. In Proceedings of the Annual ACM Conference on Assistive Technologies, 205–212. Google Scholar
Cross Ref
- [56] . 2003. The development and evaluation of a speech-to-sign translation system to assist transactions. Int. J. Hum.–Comput. Interact. 16, 2 (2003), 141–161. Google Scholar
Cross Ref
- [57] . 2004. A formulaic approach to translation at the post office: Reading the signs. Lang. Commun. 24, 1 (2004), 59–75. Google Scholar
Cross Ref
- [58] . 2006. VANESSA—A system for communication between deaf and hearing people. Technol. Disabil. 18, 4 (2006), 207–216. Google Scholar
Cross Ref
- [59] . 2008. Linguistic modelling and language-processing technologies for Avatar-based sign language presentation. Univ, Access Inf. Soc. 6, 4 (2008), 375–391. Google Scholar
Digital Library
- [60] . 2007. INGIT: Limited domain formulaic translation from Hindi strings to Indian Sign Language. InProceedings of the International Conference on Natural Language Processing (ICON’14).Google Scholar
- [61] . 2008b. An English to Indian Sign Language machine translation system. Retrieved March 16, 2021 from http://www.cse.iitd.ac.in/∼assistech/Proceedings/P17.pdf.Google Scholar
- [62] . 2013. Domain bounded English to Indian Sign Language translation model. Int. J. Comput. Sci. Inf. 3, 1 (2013), 41–45.Google Scholar
- [63] . 2013. Issues in English to Indian sign generation and translation model and developed corpus based translation system to tackle those issues. In Proceedings of the ICEECMPE International Conference. 53–59.Google Scholar
- [64] . 2013. Animation system for indian sign language communication using LOTS notation. In Proceedings of the International Conference on Emerging Trends in Communication, Control, Signal Processing and Computing Applications (IEEE-C2SPCA’13). Google Scholar
Cross Ref
- [65] . 2014. HamNoSys generation system for sign language. In Proceedings of the International Conference on Advances in Computing, Communications and Informatics (ICACCI’14), 2727–2734. Google Scholar
Cross Ref
- [66] . 2014. Sign Language Automation. Master's Dissertation, Thapar University, Punjab, India.Google Scholar
- [67] . 2014. A prototype Malayalam to Sign Language automatic translator. arXiv:1412.7415. Retrieved from http://arxiv.org/abs/1412.7415.Google Scholar
- [68] . 2015. Indian Sign Language animation generation system. In Proceedings of the 1st International Conference on Next Generation Computing Technologies (NGCT’15), 909–914. Google Scholar
Cross Ref
- [69] . 2015. Indian Sign Language animation generation system for Gurumukhi script. Int. J. Comput. Sci. Technol. 6, 3 (2015), 117–121.Google Scholar
- [70] . 2016. Conversion of Malayalam text to Indian Sign Language using synthetic animation. In Proceedings of the International Conference on Next Generation Intelligent Systems (ICNGIS’16), 1–4. Google Scholar
Cross Ref
- [71] . 2016a. Automatic translation of English text to Indian Sign Language synthetic animations. In Proceedings of the 13th International Conference on Natural Language Processing. 144–153Google Scholar
- [72] . 2016b. Development of Indian Sign Language dictionary using synthetic animations. Ind. J. Sci. Technol. 9, 32 (2016). Google Scholar
Cross Ref
- [73] . 2016. Mapping Hindi text to Indian Sign Language with extension using wordnet. In Proceedings of the ACM International Conference on Advances in Information Communication Technology & Computing. 1–5. Google Scholar
Digital Library
- [74] . 2017. Tutorial for deaf—Teaching Punjabi alphabet using synthetic animations. In Proceedings of the 14th International Conference on Natural Language Processing. 172--177.Google Scholar
- [75] . 2017. Word based statistical machine translation from English text to Indian Sign Language. ARPN J. Eng. Appl. Sci. 12, 2 (2017), 481–488.Google Scholar
- [76] . 2018. English to SiGML conversion for sign language generation. In Proceedings of the International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET’18), 1–6. Google Scholar
Cross Ref
- [77] . 2019. Tutorial for deaf—Teaching Hindi alphabet using synthetic animations. Gyancity J. Eng. Technol. 5, 1 (2019), 26–33. Google Scholar
Cross Ref
- [78] . 2019a. Generating glosses of Indian Sign Language from English texts: A proposed hybrid machine translation method. International Journal of Innovations in Engineering and Technology (IJIET) 13, 1 (2019), 120–125.Google Scholar
- [79] , and Pooja. 2019b. English text to Indian Sign Language machine translation: A rule based method. Int. J. Innov. Technol. Explor. Eng. 8, 10 (2019), 460–467. Google Scholar
Cross Ref
- [80] . 2020. Rule based translation of English complex/compound sentences into Indian Sign Language synthetic video animations. Alochana Chakra J. 9, 9 (2020), 339–348.Google Scholar
- [81] . 2020. An automatic conversion of Punjabi text to Indian Sign Language. ICST Trans. Scal. Inf. Syst. (2020), 165279. Google Scholar
Cross Ref
- [82] . 2020. ES2ISL: An advancement in speech to sign language translation using 3d avatar animator. In Proceedings of the Canadian Conference on Electrical and Computer Engineering. Google Scholar
Cross Ref
- [83] . 2004. Generating gestures from speech. In Proceedings of the 8th International Conference on Spoken Language Processing (ICSLP’04), 1817–1820.Google Scholar
Cross Ref
- [84] . 2006. Augmented Service for Deaf People Using a Text to Sign Language Translator. https://www.academia.edu/16702795/Augmented_Service_for_Deaf_People_Using_a_Text_to_Sign_Language_Translator.Google Scholar
- [85] . 2006. A Spanish speech to sign language translation system for assisting deaf-mute people. In Proceedings of the Annual Conference of the International Speech Communication Association and the 9th International Conference on Spoken Language Processing (INTERSPEECH-ICSLP’06), 1399–1402.Google Scholar
Cross Ref
- [86] . 2008. Speech to sign language translation system for Spanish. Speech Commun. 50, 11–12 (2008), 1009–1020. Google Scholar
Digital Library
- [87] . 2009. Automatic translation system to Spanish sign language with a virtual interpreter. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 5726, 196–199. Google Scholar
Digital Library
- [88] . 2012. Design, development and field evaluation of a Spanish into sign language translation system. Pattern Anal. Appl. 15, 2 (2012), 203–224. Google Scholar
Cross Ref
- [89] . 2012. Automatic categorization for improving Spanish into Spanish Sign Language machine translation. Comput. Speech Lang. 26, 3 (2012), 149–167. Google Scholar
Digital Library
- [90] . 2013. Increasing adaptability of a speech into sign language translation system. Expert Syst. Appl. 40, 4 (2013), 1312–1322. Google Scholar
Digital Library
- [91] . 2014. Translating bus information into sign language for deaf people. Eng. Appl. Artif. Intell. 32 (2014), 258–269. Google Scholar
Cross Ref
- [92] . 2014. A rule-based translation from written Spanish to Spanish sign language glosses. Comput. Speech Lang. 28, 3 (2014), 788–811. Google Scholar
Digital Library
- [93] . 2002. A novel concept of 3d animation based “intelligent assistant” for deaf people: For understanding Bengali expressions. International Conference on Computer and Information Technology (ICCIT'02).Google Scholar
- [94] . 2009. A Translator for Bangla Text to Sign Language. 3–6.Google Scholar
- [95] . 2016. Automated Bangla sign language translation system: Prospects. Limit. Appl. (2016), 856–862.Google Scholar
- [96] . 2017. A communication platform between Bangla and sign language. In Proceedings of the 5th IEEE Region 10 Humanitarian Technology Conference (R10-HTC’17), 1–4.Google Scholar
Cross Ref
- [97] . 2000. Study on translating Chinese into Chinese Sign Language. J. Comput. Sci. Technol. 15, 5 (2000), 485–490. Google Scholar
Digital Library
- [98] . 2008. Avatars based Chinese sign language synthesis system. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 444–449. Google Scholar
Cross Ref
- [99] . 2010. Chinese Sign Language animation system on mobile devices. In Proceedings of the 2nd International Conference on Information Technology and Computer Science (ITCS’10), 52–55. Google Scholar
Digital Library
- [100] . 2012. Chinese Sign Language synthesis system on mobile device. Proc. Eng. 29 (2012), 986–992. Google Scholar
Cross Ref
- [101] . 2007. Towards web-based automatic interpretation of written text to sign language. In Proceedings of the IEEE International Conference on Integrated Circuits, Technologies and Applications (ICTA’07). 43–48.Google Scholar
- [102] . 2008. A system to make signs using collaborative approach. In Proceedings of the International Conference on Computers Helping People with Special Needs (ICCHP’08). Lecture Notes in Computer Science, Vol. 5105, K. Miesenberger, J. Klaus, W. Zagler, and A. Karshmer (eEds.). Springer, Berlin,. Google Scholar
Digital Library
- [103] . 2010. SportSign: A service to make sports news accessible to deaf persons in sign languages. In Proceedings of the International Conference on Computers Helping People with Special Needs. (ICCHP’08). Springer, Berlin. Google Scholar
Cross Ref
- [104] . 2015. KAZOO: A sign language generation platform based on production rules. Univ. Access Inf. Soc. Google Scholar
Digital Library
- [105] . 2015. A rule triggering system for automatic text-to-sign translation. Univ. Access Inf. Soc. (2015). Google Scholar
Digital Library
- [106] . 2018. Prototype of automatic translation to the sign language of French-speaking Belgium. Eval. Deaf Commun. Model. Meas. Contr. C 79, 4 (2018), 162–167.Google Scholar
Cross Ref
- [107] . 2004. Statistical sign language translation. In Proceedings of the International Conference on Language Resources and Evaluation and Workshop on Representation and Processing of Sign Languages (LREC’04), 105–108.Google Scholar
- [108] . 2006. Automatic generation of German Sign Language glosses from German words. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 3881, 49–52. Google Scholar
Digital Library
- [109] . 2006. Morpho-syntax based statistical methods for automatic sign language translation. In Proceedings of the 11th Annual Conference of the European Association for Machine Translation (EAMT’06), 169–177.Google Scholar
- [110] . 2016. Building a Swiss German Sign Language avatar with jasigning and evaluating it among the deaf community. Univ. Access Inf. Soc. 15, 4 (2016), 577–587. Google Scholar
Digital Library
- [111] . 2013. Exploiting the full potential of JASigning to build an avatar signing train announcements. In Proceedings of the 3rd International Symposium on Sign Language Translation and Avatar Technology. Google Scholar
Cross Ref
- [112] . 2016. Automatic Translation from German to Synthesized Swiss German Sign Language. Ph.D. Dissertation, University of Zurich.Google Scholar
- [113] . 2016. An open web platform for rule-based speech-to-sign translation. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL’16), Short Papers, 162–168. Google Scholar
Cross Ref
- [114] . 2018. Sign language production using neural machine translation and generative adversarial networks. In Proceedings of the British Machine Vision Conference (BMVC’18), 1–12.Google Scholar
- [115] . 2020. Text2Sign: Towards sign language production using neural machine translation and generative adversarial networks. Int. J. Comput. Vis. 128, 4 (2020), 891–908. Google Scholar
Digital Library
- [116] . 2004. Developing an e-learning platform for the Greek Sign Language. In International Conference on Computers Helping People with Special Needs (ICCHP’04), K. Miesenberger, J. Klaus, W. L. Zagler, D. Burger (Eds.), Lecture Notes in Computer Science, Vol. 3118. Springer, Berlin. Google Scholar
Cross Ref
- [117] . 2005. Generating linguistic content for Greek to GSL conversion. In Proceedings of the 7th Hellenic European Conference on Computer Mathematics and Its Applications (HERCMA’05), 22–24.Google Scholar
- [118] . 2010. A prototype greek text to Greek Sign Language conversion system. Behav. Inf. Technol. 29, 5 (2010), 467–481. Google Scholar
Digital Library
- [119] . 2015. From grammar-based MT to post-processed SL representations. Univ. Access Inf. Soc. 15, 4 (2015), 499–511. Google Scholar
Digital Library
- [120] . 2018a. A novel rule based machine translation scheme from Greek to Greek Sign Language: Production of different types of large corpora and language models evaluation. Comput. Speech Lang 51 (2018), 110–135. Google Scholar
Cross Ref
- [121] . 2018b. Statistical machine translation for Greek to Greek Sign Language using parallel corpora produced via rule-based machine translation. In CEUR Workshop Proceedings, Vol. 2252, 28–42.Google Scholar
- [122] . 2009. An avatar-based Italian Sign Language visualization system. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering. 154–160. Google Scholar
Cross Ref
- [123] . 2009. Designing health care applications for the deaf. In Proceedings of the 3rd International Conference on Pervasive Computing Technologies for Healthcare (PCTHealth’09). Google Scholar
Cross Ref
- [124] . 2010. A virtual interpreter for the Italian Sign Language. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 6356, 201–207. Google Scholar
Cross Ref
- [125] . 2011. An avatar-based interface for the Italian Sign Language. In Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems (CISIS’11), 589–594. Google Scholar
Digital Library
- [126] . 2011. Improving accessibility for deaf people: An editor for computer assisted translation through virtual avatars. In Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’11), 253–254. Google Scholar
Digital Library
- [127] . 2013. Deep natural language processing for Italian Sign Language translation. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 8249, 193–204. Google Scholar
Digital Library
- [128] . 2012. Speech Translation into Pakistan Sign Language. Ph.D. Dissertation.Google Scholar
- [129] . 2018. Developing a prototype to translate text and speech to Pakistan sign language with bilingual subtitles: A framework. J. Educ. Technol. Syst. 47, 2 (2018), 248–266. Google Scholar
Cross Ref
- [130] . 2020. Two-way smart communication system for deaf dumb and normal people. In Proceedings of the 2nd International Conference on Information Science and Communication Technology (ICISCT’20), 1–4. Google Scholar
Cross Ref
- [131] . 2020. A novel natural language processing (NLP)–based machine translation model for English to Pakistan Sign Language translation. Cogn. Comput. 12, 4 (2020), 748–765. Google Scholar
Cross Ref
- [132] . 2016. Avatar-based sign language training interface for primary school education. In Proceedings of the Graphical and Robotic Embodied Agents for Therapeutic Systems (GREATS’16).Google Scholar
- [133] . 2016. Building machine-readable knowledge representations for Turkish Sign Language generation. Knowl.-Bas. Syst. 108 (2016), 179–194. Google Scholar
Digital Library
- [134] . 2017. Bidirectional machine translation between Turkish and Turkish Sign Language: A data-driven approach. Int. J. Nat. Lang. Comput. 6, 3 (2017), 33–46. Google Scholar
Cross Ref
- [135] . 2019. Developing a statistical Turkish Sign Language translation system for primary school students. In Proceedings of the IEEE International Symposium on Innovations in Intelligent Systems and Applications (INISTA’19), Google Scholar
Cross Ref
- [136] . 2019a. A hybrid translation system from Turkish spoken language to Turkish Sign Language. In Proceedings of the IEEE International Symposium on Innovations in Intelligent Systems and Applications (INISTA’19), Google Scholar
Cross Ref
- [137] . 2019b. Hybrid Translation System from Turkish Spoken Language to Turkish Sign Language. Ph. D. Dissertation, Bogazici University.Google Scholar
Cross Ref
- [138] . 2020. Web service translating content into Turkish Sign Language. In Proceedings of the 5th International Conference on Computer Science and Engineering (UBMK’20), 355–259. Google Scholar
Cross Ref
- [139] . 2007. Bridging the gap: Thai-Thai sign machine translation. In Proceedings of the 10th Conference of the Pacific Association for Computational Linguistics, 191–199.Google Scholar
- [140] . 2008. Intelligent thai text—Thai sign translation for language learning. Comput. Educ. 51, 3 (2008), 1125–1141. Google Scholar
Digital Library
- [141] . 2013. Thai text-Thai sign translation application (T3STA). In Computational Approaches to Assistive Technologies for People with Disabilities, Frontiers in Artificial Intelligence and Applications, Vol. 253, 51–64. Google Scholar
Cross Ref
- [142] . 2017. Web service framework to translate text into sign language. In Proceedings of the International Conference on Computer, Information and Telecommunication Systems (CITS’17), 180–184. Google Scholar
Cross Ref
- [143] . 2014. Avatars on Portuguese sign language. 2014 9th Iberian Conference on Information Systems and Technologies (CISTI'14), 1--7. Google Scholar
Cross Ref
- [144] . 2014a. Exploring Challenges in Avatar-based Translation from European Portuguese to Portuguese Sign Language. 1–10.Google Scholar
- [145] . 2014b. Exploring challenges in avatar-based translation from European Portuguese to Portuguese Sign Language. Retrieved December 14, 2020 from http://web.ist.utl.pt/∼ist163556/pt2lgp/shortv.pdf.Google Scholar
- [146] . 2015a. Coupling natural language processing and animation synthesis in Portuguese Sign Language Translation. In Proceedings of the 2015 Workshop on Vision and Language (VL'15), 94--103. https://aclanthology.org/W15-2815/.Google Scholar
- [147] . 2015b. From European Portuguese to Portuguese Sign Language. In Proceedings of SLPAT 2015: 6th Workshop on Speech and Language Processing for Assistive Technologies, 140--143. https://aclanthology.org/W15-5124.Google Scholar
- [148] . 2015. Virtual sign—A real time bidirectional translator of Portuguese Sign Language. Proc. Comput. Sci. 67 (2015), 252–262. Google Scholar
Cross Ref
- [149] . 2006. South African Sign Language machine translation project. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’06), 233–234. Google Scholar
Digital Library
- [150] . 2006. The South African Sign Language machine translation project: Issues on non-manual sign generation. In ACM International Conference Proceeding Series, Vol. 204, 127–134. Google Scholar
Digital Library
- [151] . 2007. A Prototype System for Machine Translation from English to South African Sign Language Using Synchronous Tree Adjoining Grammars. Ph.D. Dissertation.Google Scholar
- [152] . 2006. Czech-sign speech corpus for semantic based machine translation. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 4188, 613–620. Google Scholar
Digital Library
- [153] . 2008. Czech text-to-sign speech synthesizer. In Machine Learning for Multimodal Interaction (MLMI’07), Lecture Notes in Computer Science, Vol. 4892, A. Popescu-Belis, S. Renals, H. Bourlard (Eds.). Springer, Berlin. Google Scholar
Cross Ref
- [154] . 2000. Design and implementation of a Koran text to sign language translation system. Kor. Inf. Process. Soc. J. 7, 3 (2000), 756–765.Google Scholar
- [155] . 2005. From text to sign language: Exploiting the spatial and motioning dimension. In Proceedings of the 19th Pacific Asia Conference on Language, Information and Computation (PACLIC’19).Google Scholar
- [156] . 2005. Development of Video Synthesis Based Taiwanese Sign Communication-Aided System. 263–265.Google Scholar
- [157] . 2007. Transfer-based statistical translation of Taiwanese Sign Language using PCFG. ACM Trans. As. Lang. Inf. Process. 6, 1 (2007), 1–18. Google Scholar
Digital Library
- [158] . 2016. 3D signing avatar for Sinhala Sign Language. In Proceedings of the IEEE 10th International Conference on Industrial and Information Systems (ICIIS’15), 290–295. Google Scholar
Cross Ref
- [159] . 2017. Computer interpreter for translating written Sinhala to Sinhala Sign Language. OUSL J. 12, 1 (2017), 70. Google Scholar
Cross Ref
- [160] . 2019a. Rule-based machine translation into Ukrainian Sign Language using concept dictionary. In CEUR Workshop Proceedings, Vol. 2387, 191–201.Google Scholar
- [161] . 2019b. The sign translator information system for tourist. In Proceedings of the IEEE 14th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT’19), 162–165. Google Scholar
Cross Ref
- [162] . 2011. Development of computer sign language translation technology for deaf people. In Proceedings of the 6th International Forum on Strategic Technology (IFOST’11), 674–677. Google Scholar
Cross Ref
- [163] . 2012. Computer sign language translation system for hearing impaired users. In Proceedings of the 7th International Forum on Strategic Technology (IFOST’12), Google Scholar
Cross Ref
- [164] . 2007. Joining hands: Developing a sign language machine translation system with and for the deaf community. In CEUR Workshop Proceedings, Vol. 415.Google Scholar
- [165] . 2008a. Assistive translation technology for deaf people : Translating into and animating Irish Sign Language. Retrieved March 18, 2021 from https://www.semanticscholar.org/paper/Assistive-translation-technology-for-deaf-people%3A-Morrissey/18d3ca7ad64eaba641a6b8ec2e72295188527f01.Google Scholar
- [166] . 2008b. Data-driven Machine Translation for Sign Languages. Ph.D. DissertationGoogle Scholar
- [167] . 2002. A signing avatar on the WWW. In Gesture and Sign Language in Human-Computer Interaction. GW 2001. Lecture Notes in Computer Science(), I. Wachsmuth and T. Sowa (Eds.). Vol. 2298, Springer, Berlin, Heidelberg. Google Scholar
Cross Ref
- [168] . 2005. An example-based approach to translating sign language. In MTSUMMIT. https://www.aclanthology.org/2005.mtsummit-ebmt.14.pdf.Google Scholar
- [169] . 2002. Animating sign language in the real time. In Applied Informatics-Proceedings. 276–281. https://www.researchgate.net/publication/2494990_Animating_Sign_Language_in_the_Real_Time.Google Scholar
- [170] . 2002. Transtlating polish texts into sign language in the TGT system. In Proceedings of the 20th International Multiconference on Applied Informatics. 282–287.Google Scholar
- [171] . 2007. Continuous text translation using text modeling in the Thetos system. Int. J. Comput. Inf. Eng. 1, 8 (2007), 2638–2641. http://scholar.waset.org/1307-6892/4171. Accessed 18 March 2021.Google Scholar
- [172] . 2002. A teaching system of Japanese Sign Language using sign language recognition and generation. In Proceedings of the ACM International Multimedia Conference and Exhibition. 137–145. Google Scholar
Cross Ref
- [173] . 2009. V2S: Voice to sign language translation system for Malaysian deaf people. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 5857, 868–876. Google Scholar
Digital Library
- [174] . 2019. Converting the Vietnamese television news into 3D sign language animations for the deaf. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, Vol. 257. Springer International Publishing. Google Scholar
Cross Ref
- [175] . 2020. Designing an avatar-based translator system from Persian into Persian Sign Language (PSL). Technol. Educ. J 1 (2020), 1–14.Google Scholar
- [176] . 2012. Towards the development of a Mexican speech-to-sign-language translator for the deaf community. Acta Univ. 22 (2012), 83–89. Google Scholar
Cross Ref
- [177] 2001. Supporting deaf sign languages in written form on the web. In Proceedings of the 10th World Wide Web Conference.Google Scholar
- [178] . 2008. Project Gutenberg (1971--2008). University of Toronto and Project Gutenberg. EBook #27045. https://www.gutenberg.org/ebooks/27045.Google Scholar
- [179] . 1989. HamNoSys Version 2.0: Hamburg Notation System for Sign Languages: An Introductory Guide, International Studies on Sign Language and Communication of the Deaf, Vol. 5. Signum Press, Hamburg, Germany.Google Scholar
- [180] . 2004. HamNoSys–Representing sign language data in language resources and language processing contexts. In Workshop Proceedings: Representation and Processing of Sign Languages (LREC’04), 1–6.Google Scholar
- [181] . 2008. Arabic morphological tagging, diacritization, and lemmatization using lexeme models and feature ranking. In Proceedings of ACL-08: HLT, Short Papers. 15–20 and 11—120.Google Scholar
Cross Ref
- [182] . 2014. MADAMIRA: A fast, comprehensive tool for morphological analysis and disambiguation of Arabic. In Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC’14), 1094–1101.Google Scholar
- [183] . 2010. Alkhalil morpho sys: A morpho-syntactic analysis system for Arabic texts. In Proceedings of the International Arab Conference on Information Technology (ACIT'10).Google Scholar
- [184] . 2011. SAFAR platform and its morphological layer. In Proceeding of the 11th International Conference on Language Engineering (ESOLEC’11), 14–15.Google Scholar
- [185] . 1991. Parsing English with a Link Grammar. Carnegie Mellon University Computer Science Technical Report CMU-CS-91–196.Google Scholar
- [186] . 1993. From discourse to logic. Introduction to Model Theoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory. Kluwer Academic.Google Scholar
- [187] . 1994. Head-Driven Phrase Structure Grammar. The University of Chicago Press, Chicago.Google Scholar
- [188] . 2004. An overview of the SiGML notation and SiGML signing software system. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC’04).Google Scholar
- [189] . 2004. Retrieved March 1, 2022 from https://www.sign-lang.uni-hamburg.de/esign.Google Scholar
- [190] . 2005. Hierarchy in fluid construction grammar. In Proceedings of the 28th Annual German Conference on AI, (KI’05), Lecture Notes in Artificial Intelligence, Vol. 3698, Furbach, Ulrich (ed.). Springer, Berlin, 1–15.Google Scholar
Digital Library
- [191] . 1998. Dependency-based evaluation of MINIPAR. In Workshop on the Evaluation of Parsing Systems.Google Scholar
- [192] . 1989. The formal architecture of lexical-functional grammar. J. Inf. Sci. Eng. 5 (1989), 305–22.Google Scholar
- [193] . 2003. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, Association for Computational Linguistics, New York, NY, 423–430.Google Scholar
Digital Library
- [194] . 2012. Moses: Statistical Machine Translation System User Manual and Code Guide. Retrieved March 22, 2021 from http://www.statmt.org/moses/manual/X.pdf.Google Scholar
- [195] . 2004. Machine translation with inferred stochastic finite-state transducers. Comput. Linguist. 30, 2 (2004), 205–225.Google Scholar
Digital Library
- [196] . 2012. Sign language technologies and resources of the dicta-sign project. In Proceedings of the 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon, Satellite Workshop to the 8th International Conference on Language Resources and Evaluation (LREC’12), ELRA, 37–44.Google Scholar
- [197] . 2012. Combining two synchronisation methods in a linguistic model to describe sign language. In Gesture and Sign Language in Human–Computer Interaction and Embodied Communication, LNCS/LNAI, Vol. 7206, E. Efthimiou, G. Kouroupetroglou, and S.-E. Fotinea (Eds.). Springer, Berlin, 194–203.Google Scholar
Digital Library
- [198] . 2011. Virtual signer coarticulation in octopus, a sign language generation platform. In Proceedings of the 9th International Gesture Workshop (GW’11): Gesture in Embodied Communication and Human–Computer Interaction, E. Efthimiou, G. Kouroupetroglou (Eds.). ILSP/ATHENA RC and National and Kapodistrian University of Athens. 29–32Google Scholar
- [199] . 2012. Thumb modelling for the generation of sign language. In Gesture and Sign Language in Human Computer Interaction and Embodied Communication, LNCS/LNIA, Vol. 7206, E. Efthimiou, G. Kouroupetroglou, S.-E. Fotinea (Eds.). Springer, Berlin, 151–160.Google Scholar
- [200] . 2010. On the creation and annotation of a large-scale italian-lis parallel corpus. In Proceedings of the 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies (CSLT’10).Google Scholar
- [201] . 2020. Visual modeling of turkish morphology. In Proceedings of the 12th Conference on Language Resources and Evaluation (LREC’20), 3984–3990.Google Scholar
- [202] . 1997. Handbook of Formal Languages. Springer-Verlag.Google Scholar
- [203] . 1986. Outline of a Proposed Orthography of American Sign Language. Retrieved March 22, 2021 from http://members.home.net/dnewkirk/signfont/orthog.htm.Google Scholar
- [204] . 2006. MaTrEx: DCU machine translation system for IWSLT 2006. In Proceedings of the International Workshop on Spoken Language Translation. 31–36.Google Scholar
- [205] . 1990. The ATIS spoken language systems pilot corpus. In Proceedings of the Workshop on Speech and Natural Language. 96–101.Google Scholar
- [206] 2019. Sign language recognition, generation, and translation: An interdisciplinary perspective. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility. 16–31Google Scholar
Digital Library
- [207] . 2019. Cross-modal neural sign language translation. In Proceedings of the 27th ACM International Conference on Multimedia, 1650–1654. Google Scholar
Digital Library
- [208] . 2021. Sign language recognition systems: A decade systematic literature review. Arch. Computat. Methods Eng. 28 (2021), 785–813. Google Scholar
Cross Ref
- [209] 2021. Advances in machine translation for sign language: Approaches, limitations, and challenges. Neural Comput. Appl. 33 (2021), 14357–14399. Google Scholar
Digital Library
- [210] . 2021. Machine translation from text to sign language: A systematic review. Univ. Access Inf. Soc. (2021). Google Scholar
Digital Library
- [211] . 2020. Airport announcement system for deaf. In Proceedings of the 17th International Conference on Natural Language Processing on Natural Language Processing, 18–21 https://aclanthology.org/2020.icon-demos.15.pdf.Google Scholar
- [212] . 2020. Railway stations announcement system for deaf. In Proceedings of the 17th International Conference on Natural Language Processing on Natural Language Processing. 18–21Google Scholar
- [213] . 2021. Comparative analysis of automatic sign language generation systems. J. Sci. Res. 65, 5 (2021), 226–235. Google Scholar
Cross Ref
- [214] . 2021. Artificial intelligence technologies for sign language. Sensors 21 (2021), 5843. Google Scholar
Cross Ref
- [215] . 2021. Machine learning methods for sign language recognition: A critical review and analysis. Intell. Syst. Appl. 12 (2021), 200056. Google Scholar
Cross Ref
Index Terms
State of the Art of Automation in Sign Language: A Systematic Review
Recommendations
Text to Sign Language Translation System: A Review of Literature
Many machine translation systems for spoken languages are available, but the translation system between the spoken and Sign Language are limited. The translation from Text to Sign Language is different from the translation between spoken languages ...
Machine translation from text to sign language: a systematic review
AbstractAn equal opportunity for all is the basic right of every human being. The deaf society of the world needs to have access to all the information just like hearing people do. For this to happen there should be a mode of direct communication between ...
Evaluation of arabic machine translation system based on the universal networking language
NLDB'09: Proceedings of the 14th international conference on Applications of Natural Language to Information SystemsThis paper evaluates a machine translation (MT) system based on the interlingua approach, the Universal Network Language (UNL) system, designed for Multilanguage translation. The study addresses evaluation of English-Arabic translation and aims at ...






Comments