DINAMIK OB'EKTLARNI OPTIMAL BOSHQARISH ALGORITMINI BELLMAN USULI YORDAMIDA TADQIQ ETISH: KIMYOVIY REAKTOR NAMUNAVIY MISOLI

Akromxo‘jayev Y. . & Abdusalomov A. J.


Annotatsiya

Ushbu maqolada dinamik ob'ektlarni — xususan, uzluksiz oqimli kimyoviy reaktorni (CSTR) — Bellman dinamik dasturlash usuli yordamida optimal boshqarish masalasi tadqiq etilgan. Bellman optimallik printsipi asosida cheksiz va chekli ufqli nazorat masalalari matematik jihatdan ifodalanib, ularni hal etish uchun iterativ algoritmlar ishlab chiqilgan. Natijalar shuni ko‘rsatdiki, Bellman usuli an'anaviy PID va LQR usullari bilan solishtirganda integral xarajat funksiyasini 64.7% ga kamaytiradi. Neyron tarmoq bilan birgalikda qo‘llanilganda esa tizimning real vaqt rejimida ishlash samaradorligi yanada oshirildi.


Adabiyotlar

  1. Rawlings, J.B., Mayne, D.Q., Diehl, M. (2017). Model Predictive Control: Theory, Computation, and Design. Nob Hill Publishing, 2nd ed.
  2. Bellman, R. (1957). Dynamic Programming. Princeton University Press, Princeton, NJ.
  3. Lewis, F.L., Vrabie, D., Vamvoudakis, K.G. (2012). Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers. IEEE Control Systems Magazine, 32(6), 76-105.
  4. Bertsekas, D.P. (2019). Reinforcement Learning and Optimal Control. Athena Scientific, Belmont, MA.
  5. Uppal, A., Ray, W.H., Poore, A.B. (1974). On the dynamic behavior of continuous stirred tank reactors. Chemical Engineering Science, 29(4), 967-985.
  6. Aris, R. (1965). Introduction to the Analysis of Chemical Reactors. Prentice-Hall, Englewood Cliffs, NJ.
  7. Powell, W.B. (2011). Approximate Dynamic Programming: Solving the Curses of Dimensionality. John Wiley & Sons, 2nd ed.
  8. Werbos, P.J. (1992). Approximate dynamic programming for real-time control and neural modeling. Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches. Van Nostrand Reinhold, 493-525.
  9. Si, J., Barto, A.G., Powell, W.B., Wunsch, D.C. (Eds.) (2004). Handbook of Learning and Approximate Dynamic Programming. IEEE Press/Wiley-Interscience.
  10. Vamvoudakis, K.G., Lewis, F.L. (2010). Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica, 46(5), 878-888.