DEVELOPMENT OF A MAXIMUM ENTROPY-BASED MODEL AND ALGORITHM FOR PART-OF-SPEECH TAGGING IN UZBEK TEXTS

Sharipov M. .


Annotatsiya

In this work, we consider the development of a model for solving the problem of part-of-speech (POS) tagging in Uzbek language texts. Based on a morphologically annotated dataset, a Maximum Entropy (MaxEnt) probabilistic model was developed for POS tagging. Using this model, and taking into account predefined rules, an algorithm and software were created to perform POS tagging of Uzbek language texts.


Adabiyotlar

  1. Ekbal, A., Haque, R., & Bandyopadhyay, S. (2007). Bengali part of speech tagging using conditional random field. In Proceedings of seventh international symposium on natural language processing (SNLP2007), (pp. 131–136).
  2. Brants, T. (2000). TnT: A statistical part-of-speech tagger. Sixth Applied Natural Language Processing Conference (Association for Computational Linguistics, Seattle, Washington, USA), (pp. 224–231).https://doi.org/10.3115/974147.974178.
  3. Berger, Della Pietra, & Della Pietra (1996). “A Maximum Entropy Approach to NLP”. [Computational Linguistics, 22(1)]
  4. Kazama et al. (2003). “Maximum Entropy Models with Inequality Constraints”. [EMNLP 2003]
  5. Della Pietra et al. (1997). “Inducing Features of Random Fields”. [IEEE TPAMI].
  6. Ratnaparkhi, A. (1996). “Maximum Entropy POS Tagging”. [EMNLP]
  7. Cardey, S. and Greenfield, P. (2003), Disambiguating and tagging using systemic grammar, in ‘Proceedings of the 8th International Symposium on Social Communication’, pp. 559–564
  8. Birocheau (2003), Etiquetage morphologique et contribution la dsambigusation automatique des ambiguts morphologiques sur un lexique anglais, PhD thesis, Thse de doctorat sous la dir. de Sylviane Cardey, Centre Tesnire, Universit de Franche-Comt, Besanon.
  9. Eric Brill. 1992. A Simple Rule-Based Part of Speech Tagger. In Speech and Natural Language: Proceedings of a Workshop Held at Harriman, New York, February 23-26, 1992.
  10. Sharipov M., Mattiev J., Sobirov J., Baltayev R, Creating a Morphological and Syntactic Tagged Corpus for the Uzbek Language (2022) CEUR Workshop Proceedings, 3315, pp. 93 - 98, [Online]. Available: https://www.scopus.com/record/display.uri?eid=2-s2.0-85146120658&origin=recordpage