A COMPREHENSIVE REVIEW ON DETECTING FRAME ERRORS IN VIDEO STREAMS THROUGH IMAGE PROCESSING

Puziy A. ., Davletova K. ., Juraeva . ., Arabboev M. . & Begmatov S. .


Annotatsiya

Video streaming has become an essential technology for applications ranging from entertainment and education to critical systems such as surveillance and telemedicine. Frame errors, including packet loss, corruption, jitter, and delay, can significantly degrade video quality and user experience. Image processing techniques have emerged as powerful tools for detecting and mitigating these errors. This paper provides a comprehensive review of state-of-the-art image processing techniques for detecting frame errors in video streams. This review categorizes existing methods into spatial domain, frequency domain, and hybrid techniques, highlighting their strengths and limitations. Additionally, the paper explores machine learning and deep learning advancements integrated with image processing, discusses performance evaluation metrics, and identifies challenges and future research directions.


Adabiyotlar

  1. M. Arabboev, S. Begmatov, and A. Puziy, “A comprehensive review of contour extraction models: classical and AI-based approaches,” Mod. Innov. Syst. Technol., vol. 4, no. 4, pp. 157–175, 2024.
  2. M. Haselmann, D. P. Gruber, and P. Tabatabai, “Anomaly Detection Using Deep Learning Based Image Completion,” Proc. - 17th IEEE Int. Conf. Mach. Learn. Appl. ICMLA 2018, pp. 1237–1242, 2018.
  3. M. Rafiei, T. P. Breckon, and A. Iosifidis, “Superpixel-based Anomaly Detection for Irregular Textures with a Focus on Pixel-level Accuracy,” in 2024 International Joint Conference on Neural Networks (IJCNN), 2024, pp. 1–8.
  4. Y. Yuan, D. Ma, and Q. Wang, “Hyperspectral anomaly detection by graph pixel selection,” IEEE Trans. Cybern., vol. 46, no. 10, pp. 3123–3134, 2015.
  5. H. Yan, K. Paynabar, and J. Shi, “Anomaly Detection in Images With Smooth Background via Smooth-Sparse Decomposition,” Technometrics, vol. 59, no. 1, pp. 102–114, 2017.
  6. H. Vu, T. D. Nguyen, T. Le, W. Luo, and D. Phung, “Robust anomaly detection in videos using multilevel representations,” 33rd AAAI Conf. Artif. Intell. AAAI 2019, 31st Innov. Appl. Artif. Intell. Conf. IAAI 2019 9th AAAI Symp. Educ. Adv. Artif. Intell. EAAI 2019, pp. 5216–5223, 2019.
  7. N. H. B. Ismail and S. Der Chen, “Detection of smooth texture in facial images for the evaluation of unnatural contrast enhancement,” J. Theor. Appl. Inf. Technol., vol. 85, no. 2, pp. 215–220, 2016.
  8. A. K. Al-Azzawi, “High Empirical Study of Edge Detection-Based Image Denoising Corrupted by the Additive White Gaussian Noise (WGN),” IOP Conf. Ser. Mater. Sci. Eng., vol. 881, no. 1, 2020.
  9. C. Liu, S. Jia, H. Wu, D. Zeng, F. Cheng, and S. Zhang, “A spatial-frequency domain associated image-optimization method for illumination-robust image matching,” Sensors (Switzerland), vol. 20, no. 22, pp. 1–23, 2020.
  10. H. Zhao, X. Li, B. Xu, and H. Liu, “Combined spatial and frequency dual stream network for face forgery detection,” PeerJ Comput. Sci., vol. 10, pp. 1–17, 2024.
  11. E. S. M. El-Alfy and M. A. Qureshi, “Combining spatial and DCT based Markov features for enhanced blind detection of image splicing,” Pattern Anal. Appl., vol. 18, no. 3, pp. 713–723, 2015.
  12. R. Jasim EASA and A. Salim YAHYA, “Detecting Anomalies Using Unsupervised Machine Learning Algorithms,” MINAR Int. J. Appl. Sci. Technol., vol. 06, no. 01, pp. 219–229, 2024.
  13. Z. X. Yong and T. T. Torrent, “Semi-supervised deep embedded clustering with anomaly detection for semantic frame induction,” Lr. 2020 - 12th Int. Conf. Lang. Resour. Eval. Conf. Proc., no. May, pp. 3509–3519, 2020.
  14. H. Huang, B. Zhao, F. Gao, P. Chen, J. Wang, and A. Hussain, “A Novel Unsupervised Video Anomaly Detection Framework Based on Optical Flow Reconstruction and Erased Frame Prediction,” Sensors, vol. 23, no. 10, pp. 1–19, 2023.
  15. B. Zhang and F. Liu, “Adaptive Video Text Tracking Based on Pixel-level Feature Extraction,” J. Eng. Sci. Technol. Rev., vol. 17, no. 5, pp. 55–61, 2024.
  16. P. K. Mishra, A. Mihailidis, and S. S. Khan, “Skeletal Video Anomaly Detection Using Deep Learning: Survey, Challenges, and Future Directions,” IEEE Trans. Emerg. Top. Comput. Intell., vol. 8, no. 2, pp. 1073–1085, 2024.
  17. W. Liu, W. Luo, D. Lian, and S. Gao, “Future Frame Prediction for Anomaly Detection - A New Baseline,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 6536–6545, 2018.
  18. F. Poirier, “Hybrid Architecture for Real-Time Video Anomaly Detection: Integrating Spatial and Temporal Analysis,” arXiv, pp. 1–12, 2024.
  19. M. Arabboev, S. Begmatov, M. Rikhsivoev, K. Nosirov, and S. Saydiakbarov, “A comprehensive review of image super-resolution metrics: classical and AI-based approaches,” Acta IMEKO, vol. 13, no. 1, pp. 1–8, 2024.
  20. A. Tanchenko, “Visual-PSNR measure of image quality,” J. Vis. Commun. Image Represent., vol. 25, no. 5, pp. 874–878, 2014.
  21. D. J. L. Botia Valderrama and N. Gaviria Gómez, “Nonintrusive Method Based on Neural Networks for Video Quality of Experience Assessment,” Adv. Multimed., vol. 2016, no. iii, 2016.