Evaluation of inkurdish Machine Translation System
DOI:
https://doi.org/10.21928/juhd.v3n2y2017.pp862-868Keywords:
NLP, Machine Translation (MT), Kurdish, Asiya Toolkit, inkurdish translator, BLEU, NIST, METEORAbstract
Lack of having a perfect machine translation for Kurdish language is a huge gap in Kurdish Language processing (KNLP). inkurdish is a first machine translation system for Kurdish language which is capable of translating English into Kurdish sentences. Building "inkurdish" machine translation system was a great point regarding Kurdish language processing, but like any other translation system has strengths as well as many shortcomings and issues. This paper tries to evaluate inkurdish machine translation system according to both linguistics and computational issues. It might help any other researchers interested in doing research in this field. It attempts to evaluate inKurdish from different perspectives, such as, giving un common words, sentences, phrases and paragraphs in this machine to check whether it provides the correct translation or not. A general evaluation can be done after getting a valid sample with their translations from the machine and compared to the meanings of the words outside the machine.
References
[Banerjee and Lavie2005] Satanjeev Banerjee and AlonLavie. 2005. Meteor: An automatic metric formt evaluationwith improved correlationwith humanjudgments. In Proceedings of the ACL.
[Bojar et al.2015] Ondˇrej Bojar, Rajen Chatterjee, Christian Federmann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, and Marco Turchi. 2015. Findings of the 2015 workshop on statistical machine translation. In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 1–46, Lisbon, Portugal, September. Association for Computational Linguistics.
[Callison-Burch et al.2007] Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz,and Josh Schroeder. 2007. (meta-) evaluation of machine translation. In Proceedings of WMT.
[Chomsky el at., 1988] Cook, V.J.' Chomsky's Universal Grammar'. In D. Crystal and K. Johnson(ed.) Applied Language Studies. Oxford: Basil Blackwell.1-196, 1988.
[Doddington2002] George Doddington. 2002. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In HLT Proceedings.
[Faraj el at.,2009] Faraj, Hadar. ‘Object Movement in Standard English and Central Kurdish’. Unpublished MA, University of Koya, 2009.
[Group2010] NIST Multimodal Information Group, ‘Nist 2005 open machine translation (openmt) evaluation’. In Philadelphia: Linguistic Data Consortium.Report, 2010.
[Hashem el at., 2017] Hashm Ameen, unpublished MA. Thesis ‘Zmany farmy u pegay zmany kurdy la new zmana jihanyakanda’, Tahran university, 2017.
[Jan Berka el at.,2011] Jan Berka, Martin Černý, Ondřej Bojar, ‘Quiz-Based Evaluation of Machine Translation’, April 2011, 77–86.
[Koehn and Monz2006] Philipp Koehn and Christof Monz. 2006. Manual and automatic evaluation of machine translation between european languages. In Proceedings on the Workshop on Statistical Machine Translation, pages 102–121, New York City, June. Association for Computational Linguistics.
[Liu et al.2011] Chang Liu, Daniel Dahlmeier, and Hwee Tou Ng. ‘Better evaluation metrics lead to better machine translation’. In Proceedings of EMNLP, 2011.
[Mahwi el at.,2011] Mahwi, ‘Bnamakany Sintaksy Kurdy’ ( The principles of Kurdish Syntax). Slemany: Zankoy Slemany, M. 2011.
[Mohammed el at.,2013] Mohammed N. Al-Kabi, Taghreed M. Hailat, Emad M. Al-Shawakfa, and Izzat M. Alsmadi, ‘Evaluating English to Arabic Machine Translation Using BLEU’, Vol. 4, No.1, 2013, ppt. 66-73.
[Papineni et al.2002] Kishore Papineni, Salim Roukos,Todd Ward, and Wei Jing Zhu. 2002. Bleu: amethod for automatic evaluation of machine translation. In Proceedings of ACL.
[Qader el at.,2011] Qader, Tara. 2011. ‘Zmany Kurdy u Minimal Program’ ( Kurdish language and Minimalist Program), Unpublished PhD, University of Sulaimania.
[Snover et al.2006] Mattthew Snover, Bonnie J. Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In Proceeding of AMTA.
[Stephen el at.,2010] Stephen Doherty, Sharon O’Brien, Michael Carl, ‘Eye tracking as an MT evaluation technique’, Springer Science+Business Media B.V. 2010.
[Wahab el at., 2015] Omer Fathulla Wahab, unpublished MA. ‘Thesis Pewazhokary khokaryanay zmany Kurdy’, Sulaimani university, 2015.
