Drowsiness Sensing System of Driver Based on Behavioral Characteristics to Prevent Road Accidents Using RealTime Optimized Computer Vision

A computer vision-based system called the Drowsiness Sensing Device using OpenCV was designed to identify driver drowsiness. The technology uses video frames from a camera positioned inside a car to identify different sleepiness indicators, including the length of eye closure and head position. The Eye Aspect Ratio (EAR), which aids in trying to assess drowsiness, is determined using the OpenCV library, which is also used to extract feature points and detect eye blinks. The system also has an alarm mechanism that sounds when a certain level of drowsiness is attained, alerting the driver to take the appropriate action. The proposed approach can be possibly employed to reduce the number of accidents occurred due to driver drowsiness. The suggested system is a real-time drowsiness sensing system that makes use of OpenCV to gauge a person’s level of drowsiness. The technology employs a camera to take pictures of the driver’s face, assessing the features like the mouth and eyes to determine how sleepy they are. The system can identify drowsiness by noticing changes in the eyes, such as drooping eyelids, and mouth movements, such as yawning. When the amount of drowsiness surpasses a predetermined threshold, the system informs the driver by assessing the photos using machine learning techniques. By prompting the driver to take a break, the proposed technology may help prevent accidents brought on by drowsy driving.

Chen, D. Zhao and G. He, “Deep Learning-Based Fatigue Detection for Online Learners,” 2022 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), 2022, pp. 924-927, doi: 10.1109/PRAI55851.2022.9904096.

Gebauer, P. Šofer and M. Jurek, “The System for Fatigue Crack Propagation Detection Based on Machine Vision,” 2021 22nd International Carpathian Control Conference (ICCC), 2021, pp. 1-4, doi: 10.1109/ICCC51557.2021.9454600.

Liu, D. Yan and Z. Chen, “Research on Early Warning of Driver Fatigue Status Based on Image Processing,” 2021 33rd Chinese Control and Decision Conference (CCDC), 2021, pp. 2678-2681, doi: 10.1109/CCDC52312.2021.9601394.

Alharbey, M. M. Dessouky, A. Sedik, A. I. Siam and M. A. Elaskily, “Fatigue State Detection for Tired Persons in Presence of Driving Periods,” in IEEE Access, vol. 10, pp. 79403-79418, 2022, doi: 10.1109/ACCESS.2022.3185251.

Q. wu et al., “Detecting Fatigue Status of Pilots Based on Deep Learning Network Using EEG Signals,” in IEEE Transactions on Cognitive and Developmental Systems, vol. 13, no. 3, pp. 575-585, Sept. 2021, doi: 10.1109/TCDS.2019.2963476.

Bittner, K. Hána, L. Poušek, P. Smrka, P. Schreib and P. Vysoký, Detecting of Fatigue States of a Car Driver, ISMDA 2000, LNCS 1933, pp. 260–274, 2000.

Scharenbroch, Safety vehicles using adaptive interface technology (SAVE-IT) (Task 10): Technology Review. Delphi electronics and safety systems Tech. Rep., 2005

Qiang Ji, Zhiwei Zhu, y Peilin Lan: Real-Time Nonintrusive Monitoring and Prediction of Driver Fatigue. IEEE Transactions on Vehicular Technology, vol. 53, nº. 4, July 2004.

Mai Suzuki, Nozomi Yamamoto, Osami Yamamoto, Tomoaki Nakano, y Shin Yamamoto: Measurement of Driver’s Consciousness by Image Processing-A Method for Presuming Driver’s Drowsiness by Eye-Blinks coping with Individual Differences – 2006 IEEE International Conference on Systems, Man, and Cybernetics

Haisong Gu, Qiang Ji†, Zhiwei Zhu: Active Facial Tracking for Fatigue Detection. Applications of Computer Vision, 2002. (WACV 2002)

Galantis, K.; Wlodarski, W.; Li, Y.X.; Kalantar-Zadeh, K.: Vehicle cabin air quality monitor using gas sensors for improved safety. Optoelectronic and Microelectronic Materials and Devices, 2000. COMMAND 2000. Proceedings Conference on Volume, Issue, 2000 Page(s): 65 – 68

Drowsy Driving. Available online: https://www.nhtsa.gov/risky-driving/drowsy-driving (accessed on 17 September 2021).

Czeisler, C.A.; Wickwire, E.M.; Barger, L.K.; Dement, W.C.; Gamble, K.; Hartenbaum, N.; Ohayon, M.M.; Pelayo, R.; Phillips, B.; Strohl, K.; et al. Sleep-Deprived Motor Vehicle Operators Are Unfit to Drive: A Multidisciplinary Expert Consensus Statement on Drowsy Driving. Sleep Health 2016, 2, 94–99. [Google Scholar] [CrossRef]

Ngxande, M.; Burke, M. Driver Drowsiness Detection Using Behavioral Measures and Machine Learning Techniques: A Review of State-of-Art Techniques. Pattern Recognit. Assoc. S. Afr. Robot. Mechatron. 2017, 6, 2018. [Google Scholar]

Bajaj, J.S.; Kumar, N.; Kaushal, R.K. Comparative Study to Detect Driver Drowsiness. In Proceedings of the 2021 International Conference on Advance Computing and Innovative Technologies in Engineering, Greater Noida, India, 4–5 March 2021; pp. 678–683.

J. S. Nikhil Prakash, Shikha Rai, Sammed Sunil Patil, D. S. Manoj Kumar, “Drowsiness Sensing System of Driver Based on Behavioral Characteristics to Prevent Road Accidents Using RealTime Optimized Computer Vision”, REST Journal on Advances in Mechanical Engineering, 2(2), (2023):24-29. DOI: https://doi.org/10.46632/jame/2/2/4