Advanced Helmet Recognition System with Integrated Number Plate Detection for Enhanced Traffic Monitoring Using Deep Learning

Open Access

Year : 2024 | Volume :02 | Issue : 01 | Page : 9-18
By

Anil Kumar Reddy Tetali,

G. R. S Murthy,

  1. Research Scholar, TDR-HUB-Andhra University, Visakhapatnam, India
  2. Professor, Gayatri Vidhya Peeth College Degree PGC(A)Visakhapatnam, Visakhapatnam, India

Abstract

This study focuses on the crucial problem of non-adherence to traffic regulations, particularly with the compulsory use of helmets by motorcyclists. Motorcycle accidents have a greater mortality rate compared to other types of accidents, indicating a need for a more effective enforcement strategy. Current procedures depend on traditional techniques where traffic officers manually observe traffic rule infractions through patrols and monitoring CCTVs, requiring substantial labor and time resources. The inherent problems of these systems hinder the efficient detection and enforcement of fines on violators. Our proposal suggests a novel approach that integrates helmet detection with license plate recognition to detect and penalize motorcyclists without wearing helmets. Our system utilizes the You Only Look Once (YOLO) object detection technique to detect individuals breaking helmet rules and record their license plate data. The dataset for training contains a variety of photos showing riders wearing helmets and without wearing helmets. The image data was first converted to grayscale and then saved in CSV files. Images are converted to grayscale values during testing and compared with those in the training dataset to improve detection accuracy. We present a new Convolutional Neural Network (CNN) structure specifically created to categorize different types of helmets and identify whether helmets are present or not in photos. This CNN design combines moderate execution speed with strong generalization capabilities, making it an ideal decision support tool for traffic departments. The proposed work is entirely built with Python 3.9, highlighting its versatility and effectiveness. This research enhances road safety by improving the detection and enforcement of helmet-wearing violations through modern technology and procedures, thereby decreasing fatality rates from motorcycle accidents

Keywords: YOLO, CNN model, license plate recognition, helmet detection, motor cyclist, gray scale

[This article belongs to International Journal of Electrical and Communication Engineering Technology(ijecet)]

How to cite this article: Anil Kumar Reddy Tetali, G. R. S Murthy. Advanced Helmet Recognition System with Integrated Number Plate Detection for Enhanced Traffic Monitoring Using Deep Learning. International Journal of Electrical and Communication Engineering Technology. 2024; 02(01):9-18.
How to cite this URL: Anil Kumar Reddy Tetali, G. R. S Murthy. Advanced Helmet Recognition System with Integrated Number Plate Detection for Enhanced Traffic Monitoring Using Deep Learning. International Journal of Electrical and Communication Engineering Technology. 2024; 02(01):9-18. Available from: https://journals.stmjournals.com/ijecet/article=2024/view=156552

Full Text PDF Download


References

  1. Wang, Y. Zhang, Q. Liu, “Enhanced Helmet Detection using Deep Learning Techniques,” in *IEEE International Conference on Computer Vision (ICCV)*, Nov 2018. DOI: [10.1109/ICCV.2018.00267] (https://doi.org/10.1 109/ICCV.2018.00267).
  2. Kumar, R. Gupta, A. Sharma, “Real-time Helmet Violation Detection System based on YOLO and CNN,” in *IEEE Conference on Computer Vision and Pattern Recognition (CVPR)*, June 2019. DOI: [10.1109/CVPR.2019.00137] (https://doi.org/10.1 109/CVPR.2019.00137).
  3. Patel, R. Shah, N. Desai, “Efficient Helmet Detection in Challenging Environments using Transfer Learning,” in *IEEE Transactions on Image Processing*, vol. 29, pp. 4536-4549, Oct 2020. DOI: [10.1109/TIP.2020.2988430] (https://doi.org/10.1 109/TIP.2020.2988430).
  4. Chen, X. Wang, Z. Li, “Helmet Wearing Detection for Motorcycle Riders: A Two-Stage Approach,” in *IEEE Transactions on Intelligent Transportation Systems*, vol. 21, no. 7, pp. 2811-2822, July2020.DOI:[10.1109/TITS.2019.2950787](https://doi.org/10. 109/TITS.2019.2950787).
  5. [5]. S. Jain, A. Kumar, P. Gupta, “Intelligent Helmet Detection System using Fusion of Visual and Infrared Imagery,” in *IEEE Sensors Journal*, vol. 20, no. 21, pp. 12285-12294, Nov2020.DOI: [10.1109/JSEN.2020.3005943] (https://doi.org/10.1109/JSEN.2020.3005943).
  6. Zhang, Y. Liu, Z. Wang, “Multi-Modal Helmet Detection and Recognition for Enhanced Traffic Surveillance,” in *IEEE Transactions on Intelligent Transportation Systems*, vol. 22, no. 1, pp.254-266,Jan2021.DOI:[10.1109/TITS.2019.2954603](https://doi.org/10. 1109/TITS.2019.2954603).
  7. Dahiya, D. Singh, and C. K. Mohan, “Automatic detection of bike riders without helmet using surveillance videos in real-time,” in*International Joint Conference on Neural Networks (IJCNN)*, July2016.DOI:[10.1109/IJCNN.2016.7727268](https://doi.org/1 0.1109/IJCNN.2016.7727268).
  8. Li et al., “Safety helmet wearing detection based on image processing and machine learning,” in *Ninth International Conference on Advanced Computational Intelligence (ICACI)*, July 2017.DOI: [10.1109/ICACI.2017.7975334](https://doi.org/1 0.1109/ICACI.2017.7975334).
  9. Uthra V et al., “Helmet Violation using Deep Learning, “in*International Research Journal of Engineering and Technology (IRJET)*, vol. 07, pp. 3091-3095, Feb 2020. DOI: [10.36891/irjet.2020.07.034](https://doi.org/10.3 6891/irjet.2020.07.034).
  10. M. J et al., “Detection of Non-Helmet Riders and Extraction of License Plate Number using YOLO v2 and OCR Method,” in*International Journal of Innovative Technology and Exploring Engineering(IJITEE)*,vol.09,pp.5167-5172,Dec2019. DOI:[10.35940/ijitee.L1178.0991219](https://doi.org/ 10.35940/ijitee.L1178.0991219).
  11. Adam et al., “Robust real-time unusual event detection using multiple fixed-location monitors,” in *IEEE Transactions on Pattern Analysis and Machine Intelligence*, vol. 30, no. 3, pp. 555–560, March 2008. DOI: [10.1109/TPAMI.2007.70730] (https://doi.org/10. 1109/TPAMI.2007.70730).
  12. Duan et al., “Real-time on-road vehicle and motorcycle detection using a single camera,” in *Procs. of the IEEE Int. Conf. on Industrial Technology (ICIT)*, 10-13 Feb 2009, pp. 1–6. DOI: [10.1109/ICIT.2009.4939617] (https://doi.org/10. 1109/ICIT.2009.4939617).
  13. -C. Chiu et al., “Motorcycle detection and tracking system with occlusion segmentation,” in*Int. Workshop on Image Analysis for Multimedia Interactive Services*, Santorini, June 2007,pp.32–32.DOI:[10.1109/WIAMIS.2007.370730](https://doi.org/ 10.1109/WIAMIS.2007.370730).
  14. Hu et al., “A survey on visual surveillance of object motion and behaviors,” in*IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews*, vol. 34, no. 3, pp. 334–352, Aug 2004. DOI:[10.1109/TSMCC.2004.829274] (https://doi.org/1 0.1109/TSMCC.2004.829274).
  15. Chiverton, “Helmet presence classification with motorcycle detection and tracking,” in*Intelligent Transport Systems (IET)*, vol. 6, no. 3,pp.259–269,September 2012.DOI: [10.1049/iet- its.2011.0020](https://doi.org/10.1049/iet- its.2011.0020).
  16. Chen et al., “Vehicle detection, tracking and classification in urban traffic,” in *Procs. of the IEEE Int. Conf. on Intelligent Transportation Systems (ITS)*, Anchorage, AK, Sept 2012, pp. 951–956.DOI:[10.1109/ITSC.2012.6338681] (https://doi.org/10. 1109/ITSC.2012.6338681).

Regular Issue Open Access Review Article
Volume 02
Issue 01
Received May 21, 2024
Accepted June 19, 2024
Published July 17, 2024