O‘ZBEK TILIDAGI MATNLARNI INTELLEKTUAL TAHLIL QILISH: MODEL VA ALGORITMLAR
Gulmurodova D. ., Xayrullayev M. . & Jumanazarov J. .
Annotatsiya
Ushbu maqola o‘zbek tilidagi matnlarni intellektual tahlil qilish uchun mo‘ljallangan model va algoritmlarni o‘rganishga bag‘ishlangan. Tadqiqotda tabiiy tilni qayta ishlash sohasidagi zamonaviy yondashuvlar, jumladan, mashina o‘qitish va chuqur o‘qitish usullari ko‘rib chiqilgan. Maqolada o‘zbek tilining morfologik murakkabligi, tuzilishi va leksik xususiyatlari tahlil qilingan. Transformer arxitekturasiga asoslangan modellar, xususan BERT, GPT va ularning o‘zbek tiliga moslashtirilgan variantlari muhokama qilingan. Bundan tashqari, matn klassifikatsiyasi, his-tuyg‘ularni tahlil qilish, ma’lumotlarni ajratib olish va avtomatik tarjima kabi vazifalar uchun algoritmlar taklif etilgan. Tajriba natijalari shuni ko‘rsatadiki, taklif etilgan gibrid model mavjud yondashuvlarga nisbatan F1-ko‘rsatkichi bo‘yicha 8-12% yuqori natija beradi.
Adabiyotlar
- Mirzayev, A., & Yusupov, R. (2021). O‘zbek tilining morfologik tahlili: muammolar va yechimlar. O‘zbek tili va adabiyoti, 3(2), 45–58.
- Turing, A. M. (1950). Computing machinery and intelligence. Mind, 59(236), 433–460. https://doi.org/10.1093/mind/LIX.236.433
- Jurafsky, D., & Martin, J. H. (2024). Speech and Language Processing (3rd ed.). Stanford University Press.
- Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781. https://arxiv.org/abs/1301.3781
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008.
- Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT 2019, 4171–4186.
- Ataman, D., & Federico, M. (2018). Compositional representation of morphologically-rich input for neural machine translation. Proceedings of ACL 2018, 305–311.
- Sennrich, R., Haddow, B., & Birch, A. (2016). Neural machine translation of rare words with subword units. Proceedings of ACL 2016, 1715–1725.
- Mirzayev, A., Toshmatov, N., & Xolmatov, S. (2019). Morphological analysis for Uzbek language: A rule-based approach. International Journal of Computer Science, 16(3), 78–89.
- Mamatov, N., Yusupova, D., & Razzaqov, A. (2020). Sentiment analysis for Uzbek language using machine learning
- methods. Proceedings of ACL-2020 Workshop on NLP for Low-resource Languages, 112–119.
- Mansurov, B., Mansurov, A., & Saminov, S. (2021). UzBERT: Pre-trained language model for Uzbek. arXiv preprint arXiv:2110.02273. https://arxiv.org/abs/2110.02273
- Brown, T., Mann, B., Ryder, N., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.