NAZORAT OSTIDAGI O‘QITISH ALGORITMLARI YORDAMIDA SO‘Z MA’NOSINI ANIQLASH
Axmedova X. I.
Annotatsiya
Tabiiy tilni qayta ishlash (NLP) sohasida semantik tahlil hanuz eng muhim va dolzarb yo‘nalishlardan biri hisoblanadi. Ushbu tahlilning asosiy vazifalaridan biri – so‘z ma’nolarini aniqlash (Word Sense Disambiguation, WSD) bo‘lib, omonim so‘zlarni avtomatik aniqlash jarayonida zamonaviy algoritmlardan foydalanish talab etiladi. Mazkur ishda ushbu muammoni yechish uchun K-yaqin qo‘shni (K-NN), Random Forest algoritmlari hamda SenseBERT modelidan foydalanildi. O‘zbek tilidagi omonim so‘zlarning turli ma’nolariga oid jumlalarni qamrab olgan maxsus dataset bazasi tuzildi va dastlabki ishlov berish bosqichlaridan o‘tkazildi. Ma’lumotlar tozalangach, Random Forest va SenseBERT algoritmlari asosida modellar o‘qitildi. Sinov bosqichida o‘qitilgan modellar o‘rtacha 92 % aniqlikka erishdi. Kelgusida natijalarni yanada yaxshilash uchun korpus hajmini kengaytirish hamda yuqori xotiraga ega hisoblash resurslarida modellarni qayta o‘qitish tavsiya etiladi.
Adabiyotlar
- Boltayevich, E.B., Mirdjonovna, H.S., and Ilxomovna, A.X. (2023). Methods for Creating a Morphological Analyzer. In: Zaynidinov, H., Singh, M., Tiwary, U.S., and Singh, D. (Eds.), Intelligent Human Computer Interaction. IHCI 2022, Lecture Notes in Computer Science, vol. 13741. Springer, Cham. https://doi.org/10.1007/978-3-031-27199-1_4
- Oqila Abdullayeva. O‘zbek tili matnlarida sintaktik teg va teglash masalasi. Oʻzbekiston: til va madaniyat. Kompyuter lingvistikasi. 2024 Vol. 1 (6) B. 46-58.
- Nikitina S. A. and Korzunina A. A. A neural network approach for determining the semantics of homonyms in russian-language texts. Vestnik komp iuternykh i informatsionnykh tekhnologii. February 2025, pp. 56-64
- Ayazbayev, D.; Bogdanchikov, A.; Orynbekova, K.; Varlamis, I. Defining Semantically Close Words of Kazakh Language with Distributed System Apache Spark. Big Data Cogn. Comput. 2023, 7, 160. https://doi.org/10.3390/bdcc7040160
- El-Razzaz, M., Fakhr, M. W., & Maghraby, F. A. (2021). Arabic Gloss WSD Using BERT. Applied Sciences, 11(6), 2567. https://doi.org/10.3390/app11062567
- Zhong, Z., Ng, H.T.: It makes sense: a wide-coverage word sense disambiguation system for free text. In: ACL 2010—48th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, 78–83 (2010)
- Zaripova D.A., Loukachevitch N.V. (2023) Approaches to Automatic Word Sense Disambiguation Based on Uneven Distribution of Word Senses in Corpus. Lomonosov Philology Journal. Series 9. Philology, no. 6, pp. 40–51
- Daniil Alexeyevsky and Anastasiya V. Temchenko. 2016. Word Sense Disambiguation in Monolingual Dictionaries for Building Russian WordNet. In Proceedings of the 8th Global WordNet Conference (GWC), pages 9–14, Bucharest, Romania. Global Wordnet Association.
- Elov, B., Abdurakhmonova, N., Axmedova, X., Xusainova, Z., Iskandarova, A., and Fattaxova, D. (2024). Designing Processes and Models of Semantical Differentiation for Polyfunctional Words in the Uzbek Contexts. In: Nguyen, N.T., et al. Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2024, Communications in Computer and Information Science, vol. 2145. Springer, Singapore. https://doi.org/10.1007/978-981-97-5934-7_26
- Boltayevich, E.B., Ilxomovna, A.X., Hakim Qizi, P.M., and Uktambay O‘g‘li, K.N. (2023). Semantic Differentiation of Uzbek Homonyms Using the Lesk Algorithm. 2023 8th International Conference on Computer Science and Engineering (UBMK), Burdur, Turkiye, pp. 137–140. https://doi.org/10.1109/UBMK59864.2023.10286666
- Pedregosa, F., Varoquaux, G., Gramfort, A., et al. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
- Mihalcea, R., and Moldovan, D. (2002). Word sense disambiguation with pattern learning and automatic feature selection. Natural Language Engineering, 8(4), 349–370. https://doi.org/10.1017/S1351324902002991
- Abdul-Rauf and Holger Schwenk. On the use of Comparable Corpora to improve SMT performance Sadaf. 12th Conference of the European Chapter of the ACL, pages 16–23, Athens, Greece, 30 March – 3 April 2009.pp 16-23
- Gale, K. Church, and D. Yarowsky.: A Method for Disambiguating Word Senses in a Large Corpus. Computers and Humanities, vol. 26, pp. 415-439 (1992).