QORAQALPOQ TILI MATNLARINI AVTOMATIK QAYTA ISHLASHNING HISOBLASH USULLARI VA MODELLARI
Abdullayev S. S. & Allaberdiyeva D. G.
Annotatsiya
Mazkur maqolada qoraqalpoq tili uchun tabiiy tilni qayta ishlash (Natural Language Processing, NLP) sohasining hozirgi holati tizimli ravishda tahlil qilinadi. Qoraqalpoq tili turkiy tillar oilasining qipchoq-noʻgʻay guruhiga mansub, qariyb 800 ming–2 million kishi soʻzlashadigan, YuNESKO tasnifi boʻyicha “zaif” (vulnerable) maqomidagi til boʻlib, hisoblash lingvistikasi nuqtai nazaridan “kam resursli” (low-resource) tillar qatoriga kiradi. Tadqiqotda tilning agglutinativ morfologiyasi, unli singarmonizmi va koʻp yozuvli (lotin, kirill, arab) tabiati keltirib chiqaradigan asosiy hisoblash muammolari koʻrib chiqiladi. Soʻnggi yillarda yaratilgan korpuslar (dilmash, KAASC), qoidaga asoslangan morfologik tahlilgichlar (Apertium/FST), neyron mashina tarjimasi modellari (NLLB) hamda yaqin qardosh tillardan (oʻzbek, qozoq) bilim koʻchirish (cross-lingual transfer) yondashuvlari qiyosiy baholanadi. Tahlil natijalari kam resursli sharoitda eng samarali yoʻnalish sifatida koʻp tilli oldindan oʻrgatilgan modellarni qardosh tillar yordamida moslashtirish ekanligini koʻrsatadi. Maqola soʻngida soha rivoji uchun amaliy tavsiyalar va kelajakdagi tadqiqot yoʻnalishlari taklif etiladi.
Adabiyotlar
- Berdimuratov E., Dáwletov A. Házirgi qaraqalpaq tili. — Qaraqalpaqstan, 1979. (oliy oʻquv yurtlari filologiya talabalari uchun darslik).
- Karakalpak language. // Ethnologue (2024); Wikipedia: Karakalpak language. — URL: https://en.wikipedia.org/wiki/Karakalpak_language
- Mamasaidov M., Shopulatov A. Open Language Data Initiative: Advancing Low-Resource Machine Translation for Karakalpak. — arXiv:2409.04269, 2024. — URL: https://arxiv.org/abs/2409.04269
- Dataset of Karakalpak language stop words (KAASC). // Data in Brief, 2023. — URL: https://www.sciencedirect.com/science/article/pii/S2352340923002305
- Jones A., Caswell I., Firat O., Saxena I. GATITOS: Using a New Multilingual Lexicon for Low-Resource Machine Translation. // Proceedings of EMNLP 2023. — P. 371–405.
- Feng F., Yang Y., Cer D., Arivazhagan N., Wang W. Language-agnostic BERT Sentence Embedding (LaBSE). — arXiv:2007.01852, 2020.
- Forcada M.L., Ginestí-Rosell M., Nordfalk J. et al. Apertium: a free/open-source platform for rule-based machine translation. // Machine Translation, 2011. — Vol. 25. — P. 127–144.
- Hybrid AI architectures for automatic text correction in the Kazakh language (KazMorphCorpus-2025). // PMC, 2025. — URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12741073/
- Sennrich R., Haddow B., Birch A. Neural Machine Translation of Rare Words with Subword Units (BPE). // Proceedings of ACL 2016. — P. 1715–1725.
- Kudo T., Richardson J. SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. — arXiv:1808.06226, 2018.
- Vaswani A., Shazeer N., Parmar N. et al. Attention Is All You Need. // Advances in Neural Information Processing Systems (NeurIPS), 2017.
- NLLB Team, Costa-jussà M.R., Cross J. et al. No Language Left Behind: Scaling Human-Centered Machine Translation. — arXiv:2207.04672, 2022.
- Conneau A., Khandelwal K., Goyal N. et al. Unsupervised Cross-lingual Representation Learning at Scale (XLM-R). // Proceedings of ACL 2020. — P. 8440–8451.
- Mirzakhalov J. Turkic Interlingua: A Case Study of Machine Translation in Low-Resource Languages. — Master’s thesis, University of South Florida, 2021.
- TurkicNLP: An NLP Toolkit for Turkic Languages. — arXiv:2602.19174, 2026. — URL: https://github.com/turkic-nlp/turkicnlp
- TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages. — 2025.
- Kudugunta S., Caswell I., Zhang B. et al. MADLAD-400: A Multilingual and Document-Level Large Audited Dataset. // Advances in Neural Information Processing Systems (NeurIPS), 2024.
- Post M. A Call for Clarity in Reporting BLEU Scores. // Proceedings of WMT 2018. — P. 186–191.
- Universal Dependencies Treebank for Uzbek; de Marneffe M.-C., Manning C., Nivre J., Zeman D. Universal Dependencies. // Computational Linguistics, 2021. — Vol. 47(2). — P. 255–308.