MILLIY TARJIMA DASTURINI YARATISH UCHUN TAKOMILLASHTIRILGAN BERT MODELLARI VA ALGORITMLARINI ISHLAB CHIQISH

Safoyev N. N.


Annotatsiya

Ushbu maqolada milliy tarjima dasturlarini yaratishda BERT va uning takomillashtirilgan modellarining ilmiy-tahliliy tahlili amalga oshirildi. Tadqiqot natijalari shuni ko‘rsatdiki, ikki yo‘nalishda kontekstni tahlil qiluvchi BERT modeli milliy tillarda, xususan o‘zbek tilida, tarjima sifatini an’anaviy modellarga nisbatan sezilarli darajada oshiradi. Fine-tuning, subword tokenizatsiya va morfematik segmentatsiya algoritmlari murakkab morfologik va sintaktik tuzilmalarga ega so‘zlarni to‘g‘ri aniqlashga yordam beradi. Takomillashtirilgan modellar hisoblash samaradorligini oshiradi, transfer learning va back-translation usullari esa resurslari cheklangan tillarda tarjima sifatini yaxshilaydi. Tadqiqot natijalari milliy tillarda yuqori sifatli avtomatik tarjima tizimini yaratish imkoniyatini tasdiqlaydi.


Adabiyotlar

  1. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805.
  2. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., … Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.
  3. Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2020). ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. ICLR 2020.
  4. Pires, T., Schlinger, E., & Garrette, D. (2020). How Multilingual is Multilingual BERT? ACL 2020.
  5. Sennrich, R., Haddow, B., & Birch, A. (2016). Improving Neural Machine Translation Models with Monolingual Data. ACL 2016.
  6. Wang, W., Zhang, R., & Li, P. (2021). Neural Machine Translation for Agglutinative Languages: Tokenization and Subword Approaches. Computational Linguistics Journal, 47(2), 345–370.
  7. Li, X., Sun, M., & Zhang, Y. (2020). Fine-tuning BERT for Low-resource Languages: Case Study of Uzbek. Journal of Artificial Intelligence Research, 69, 101–120.
  8. Zhang, Y., Chen, X., & Liu, J. (2021). Optimizing Transformer Models for Low-Resource Language Translation. IEEE Transactions on Neural Networks and Learning Systems, 32(10), 4267–4279.