DEVELOPMENT OF A SYNONYM DICTIONARY FOR ARTIFICIAL INTELLIGENCE-BASED TRANSLATION MODELS FROM THE KHOREZM DIALECT INTO STANDARD UZBEK

Sharipov M. C., Kurbanova L. U. & Atanazarova M. .


Annotatsiya

Khorezm dialect is one of the important regional varieties of the Uzbek language and is widely used in everyday communication; however, due to a lack of resources, the issue of its written form and automatic normalization/“translation” into the standard literary language remains highly relevant. This article proposes an approach to developing a synonymic lexicon for artificial intelligence–based models that convert (dialect → standard) Khorezm dialect texts into Standard Uzbek. As the primary source for the study, an explanatory lexicon database of the Khorezm dialect was selected and aligned with its equivalents in the standard literary language. The lexicon entries were organized according to lexico-grammatical tags (noun/adjective/verb/interjection, defective auxiliary verb, etc.) and a set of correspondences was formed in the format “dialect unit → Standard Uzbek synonym(s).” The proposed synonymic lexicon supports the standardization of dialectal variants, meaning-preserving normalization, and serves as an additional lexical knowledge resource for neural translation/transformer-based models. Experimental results show that the lexicon-enriched approach improves lexical adaptation in converting Khorezm dialect into Standard Uzbek, helps interpret ambiguous units, and reduces meaning loss. Finally, the paper presents the developed lexicon resource and practical recommendations for integrating it into the model training process.


Adabiyotlar

  1. Agostini, A., & Usmanov, T. (2021). UZWORDNET: A Lexical-Semantic Database for the Uzbek Language. Proceedings of the 11th Global Wordnet Conference (GWC 2021).
  2. Abdurakhmonova, N., Astanova, G., Akhmedov, A., Mengliev, D., Ibragimov, B., & Abdullayev, A. (2025). Development of a lexical dataset and a rule-based algorithm for the analysis of Khorezm dialects of the Uzbek language. Data in Brief.
  3. Farhan, W., et al. (2020). Unsupervised dialectal neural machine translation. Information Sciences.
  4. Kuparinen, O., et al. (2023a). Dialect-to-Standard Normalization… Findings of EMNLP 2023.
  5. Kuparinen, O., et al. (2023b). Dialect Representation Learning with Neural Dialect-to-Standard Normalization. VarDial 2023.
  6. Mengliev, D. (2025). Dataset of Khorezm dialect words of Uzbek language (Words extracted from books). Mendeley Data, V1.
  7. MorphUz. MorphUz: Morphological Analyzer for the Uzbek Language (description/publication).
  8. Sharipov.M. "Linguistic features of Khorezm dialect" // Journal of Turkic Studies. - 2022.
  9. Abdunazarova, N. "OMONIMLAR VA SINONIMLAR SEMASOLOGIYASI" // TECHNICAL SCIENCE RESEARCH IN UZBEKISTAN. - 2024. - 2(10). - B. 43-47.
  10. Turdiyeva, S. E. "SUN'IY INTELLEKTNI RIVOJLANISH TARIXI" // CONFERENCE ON UNIVERSAL SCIENCE RESEARCH. - 2023. - 1(1). - B. 61-63.