A Distracted Driving Discrimination Method Based on the Facial Feature Triangle and Bayesian Network

Tianliu Feng; Lingxiang Wei; Wenjuan E; Pengfei Zhao; Zhe Li; Yuchuan Ji

doi:10.7250/bjrbe.2023-18.598

A Distracted Driving Discrimination Method Based on the Facial Feature Triangle and Bayesian Network

Authors

Tianliu Feng School of Rail Transportation, Soochow University, Suzhou, China https://orcid.org/0000-0002-9863-3839
Lingxiang Wei School of Defense Engineering, Army Engineering University of PLA, Nanjing, China School of Materials Science and Engineering, Yancheng Institute of Technology, Yancheng, China https://orcid.org/0000-0002-7117-0301
Wenjuan E School of Rail Transportation, Soochow University, Suzhou, China https://orcid.org/0000-0001-8502-6266
Pengfei Zhao School of Civil and Transportation Engineering, Beijing University of Civil Engineering and Architecture, Beijing, China https://orcid.org/0000-0001-7443-5857
Zhe Li School of Rail Transportation, Soochow University, Suzhou, China https://orcid.org/0000-0003-3211-366X
Yuchuan Ji School of Materials Science and Engineering, Yancheng Institute of Technology, Yancheng, China https://orcid.org/0000-0002-4640-6685

DOI:

https://doi.org/10.7250/bjrbe.2023-18.598

Keywords:

Bayesian network, distracted driving behaviour, facial feature triangle, feature point recognition, head posture, traffic safety

Abstract

Distracted driving is one of the main causes of road crashes. Therefore, effective distinguishing of distracted driving behaviour and its category is the key to reducing the incidence of road crashes. To identify distracted driving behaviour accurately and effectively, this paper uses the head posture as a relevant variable and realizes the classification of distracted driving behaviour based on the relevant literature and investigation. Adistracted driving discrimination algorithm based on the facial feature triangle is proposed. In the proposed algorithm, the Bayesian network is employed to judge driving behaviour categories. The proposed algorithm is verified by experiments using data from 20 volunteers. The experimental results show that the discrimination accuracy of the proposed algorithm is as high as 90%, which indicates that the head posture parameters used in this study are closely related to the distracted driving state. The results show that the proposed algorithm achieves high accuracy in the discrimination and classification of distracted driving behaviour and can effectively reduce the accident rate caused by distracted driving. Moreover, it can provide a basis for the research of distracted driving behaviour and is conducive to the formulation of the corresponding laws and regulations.

References

Aljasim, M., & Kashef, R. (2022). E2DR: A deep learning ensemble-based driver distraction detection with recommendations model. Sensors, 22, Article 1858. https://doi.org/10.3390/s22051858

Alkinani, M. H., Khan, W. Z., Arshad, Q., & Raza, M. (2022). HSDDD: A hybrid scheme for the detection of distracted driving through fusion of deep learning and handcrafted features. Sensors, 22(5), Article 1864. https://doi.org/10.3390/s22051864

Babić, D., Babić, D., Sucha, M., Stanić, V., & Toman, M. (2021). The influence of music genres on the driving behaviour of young drivers and their visual scanning of the environment. Transportation Research Part F: Psychology and Behaviour, 81, 396–407. https://doi.org/10.1016/j.trf.2021.07.001

Catalina, C.A., García, H.S., Cabrerizo, E., Herrera, S., García, P.S., Mohamadi, F., & Mariscal, M.A. (2020). Music distraction among young drivers: Analysis by gender and experience. Journal of Advanced Transportation, 2020, Article 6039762. https://doi.org/10.1155/2020/6039762

Chen, C., Chen, Y. Y., Ma, J. M., Zhang, G. H., & Walton, C. M. (2018). Driver behaviour formulation in intersection dilemma zones with phone use distraction via a logit-Bayesian network hybrid approach. Journal of Intelligent Transportation Systems, 22(4), 311–324. https://doi.org/10.1080/15472450.2017.1350921

Craig, L., Steve, B., Ward, V., & Robyn, R. (2021). Prevalence and trends of distracted driving in Canada. Journal of Safety Research, 76, 118–126. https://doi.org/10.1016/j.jsr.2020.12.005

Ding, C. X., & Tao, D. C. (2018). Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), 1002–1014. https://doi.org/10.1109/TPAMI.2017.2700390

Fasanmade, A., He, Y., Al-Bayatti, A. H., Morden, J. N., Aliyu, S. O., Alfakeeh, A. S., & Alsayed, A. O. (2020). A fuzzy-logic approach to dynamic Bayesian severity level classification of driver distraction using image recognition. IEEE Access, 8, 95197–95207. https://doi.org/10.1109/ACCESS.2020.2994811

Fice, J. B., Blouin, J. S., & Siegmund, G. P. (2018). Head postures during naturalistic driving. Traffic Injury Prevention, 19(6), 637–643. https://doi.org/10.1080/15389588.2018.1493582

Fu, X., Meng, H., Wang, X., Yang, H., & Wang, J. (2022). A hybrid neural network for driving behaviour risk prediction based on distracted driving behaviour data. PLoS ONE, 17(1), Article e0263030. https://doi.org/10.1371/journal.pone.0263030

Ghimire, D., Lee, J. W., Li, Z. N., & Jeong, S. H. (2017). Recognition of facial expressions based on salient geometric features and support vector machines. Multimedia Tools and Applications, 76(6), 7921–7946. https://doi.org/10.1007/s11042-016-3428-9

He, Q. C., Li, W., Fan, X. M., & Fei, Z. M. (2015). Driver fatigue evaluation model with integration of multi-indicators based on dynamic Bayesian network. IET Intelligent Transport Systems, 9(5), 547–554. https://doi.org/10.1049/iet-its.2014.0103

Hu, C.H., Zhang, Y., Wu, F., Lu, X.B., Liu, P., & Jing, X.Y. (2019). Toward driver face recognition in the intelligent traffic monitoring systems. IEEE Transactions on Intelligent Transportation Systems, 21(12), 4958–4971. https://doi.org/10.1109/TITS.2019.2945923

Kidd, D. G., & Chaudhary, N. K. (2019). Changes in the sources of distracted driving among Northern Virginia drivers in 2014 and 2018: A comparison of results from two roadside observation surveys. Journal of Safety Research, 68, 131–138. https://doi.org/10.1016/j.jsr.2018.12.004

Lei, J. M., Han, Q.W., Chen, L., Lai, Z. D., Zeng, L. Q., & Liu, X. (2017). A novel side face contour extraction algorithm for driving fatigue statue recognition. IEEE Access, 5, 5723–5730. https://doi.org/10.1109/ACCESS.2017.2686424

Liang, Y. L., & Lee, J. D. (2014). A hybrid Bayesian network approach to detect driver cognitive distraction. Transportation Research Part C, 38, 146–155. https://doi.org/10.1016/j.trc.2013.10.004

Née, M., Contrand, B., Orriols, L., Gil-Jardiné, C., Galéra, C., & Lagarde, E. (2019). Road safety and distraction, results from a responsibility case-control study among a sample of road users interviewed at the emergency room. Accident Analysis and Prevention, 122, 19–24. https://doi.org/10.1016/j.aap.2018.09.032

Nevin, P. E., Blannar, L., Kirk, A. P., Freedheim, A., Kaufman, R., Hitchcock, L., Maeser, J. D., & Ebel, B. E. (2017). “I wasn’t texting; I was just reading an email…: a qualitative study of distracted driving enforcement in Washington State. Injury Prevention, 23(3), 165–170. https://doi.org/10.1136/injuryprev-2016-042021

Niloufar, T., Hossein, S., & Alireza, S. (2021). Designing a glass mounted warning system to prevent drivers to fall in sleep based on neck posture and blinking duration. Journal of Medical Signals and Sensors, 11(3), 217–221. https://doi.org/10.4103/jmss.JMSS_31_20

Parr, M. N., Ross, L. A., McManus, B., Bishop H. J., Wittig S. M. O, & Stavrinos, D. (2016). Differential impact of personality traits on distracted driving behaviours in teens and older adults. Accident Analysis and Prevention, 92, 107–112. https://doi.org/10.1016/j.aap.2016.03.011

Pope, C. N., Bell, T. R., & Stavrinos, D. (2017). Mechanisms behind distracted driving behaviour: The role of age and executive function in the engagement of distracted driving. Accident Analysis and Prevention, 98, 123–129. https://doi.org/10.1016/j.aap.2016.09.030

Ruitao, S. (2021). Driver intention prediction using model-added Bayesian network. Proceedings of the Institution of Mechanical Engineers, 235(5), 1236–1244. https://doi.org/10.1177/0954407020968967

Shaaban, K., Gaweesh, S., & Ahmed, M. M. (2020). Investigating in-vehicle distracting activities and crash risks for young drivers using structural equation modeling. PLOS ONE, 15(7), Article e0235325. https://doi.org/10.1371/journal.pone.0235325

Siddiqui, H.U.R., Ali, S.A., Robert, B., Bahattin, B., Ernesto, L., Furqan, R., & Sandra, D. (2021). Non-invasive driver drowsiness detection system. Sensors, 21(14), Article 4833. https://doi.org/10.3390/s21144833

Sun, W., Zhang, X. R., Peeta, S., He, X. Z., & Li, Y. F. (2017). A real-time fatigue driving recognition method incorporating contextual features and two fusion levels. IEEE Transactions on Intelligent Transportation Systems, 18(12), 3408–3420. https://doi.org/10.1109/TITS.2017.2690914

Teyfouri, N., Shirvani, H., Shamsoddini, A. (2021). Designing a glass mounted warning system to prevent drivers to fall in sleep based on neck posture and blinking duration. Journal of Medical Signals and Sensors, 11(3), 217–221. https://doi.org/10.4103/JMSS.JMSS_31_20

Tung, L.W., & Khattak, A. (2015). Distracted motor vehicle driving at highway-rail grade crossings. Transportation Research Record, 2476(1), 77–84. https://doi.org/10.3141/2476-11

van der Zwaag, M. D., Dijksterhuis, C., de Waard, D., Mulder, B. L. J. M., Westerink, J. H. D. M., & Brookhuis, K. A. (2012). The influence of music on mood and performance while driving. Ergonomics, 55(1), 12–22. https://doi.org/10.1080/00140139.2011.638403

Wan, Y, Chen, X. L., & Shi, Y. (2017). Adaptive cost dynamic time warping distance in time series analysis for classification. Journal of Computational and Applied Mathematics, 319, 514–520. https://doi.org/10.1016/j.cam.2017.01.004

Wang, Y. K., Jung, T. P., & Lin, C. T. (2015). EEG-based attention tracking during distracted driving. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 23(6), 1085–1094. https://doi.org/10.1109/TNSRE.2015.2415520

Warren, B., & Micha, K. (2011). Exploring an alternative in-car music background designed for driver safety. Transportation Research Part F: Psychology and Behaviour, 15(2),162–173. https://doi.org/10.1016/j.trf.2011.12.001

Wei, L. X., Feng, T. L., Zhao, P. F., & Liao, M. J. (2021). Driver sleepiness detection algorithm based on relevance vector machine. The Baltic Journal of Road and Bridge Engineering, 16(1),118–139. https://doi.org/10.7250/bjrbe.2021-16.518

Yan, X. T., He, J., Wu, G., Zhang, C., & Wang, C. (2022). A proactive recognition system for detecting commercial vehicle driver’s distracted behaviour. Sensors, 22, Article 2373. https://doi.org/10.3390/s22062373

Yang, G. S., Lin, Y. Z., & Bhattacharya, P. (2010). A driver fatigue recognition model based on information fusion and dynamic Bayesian network. Information Sciences, 180(10), 1942–1954. https://doi.org/10.1016/j.ins.2010.01.011

Zhang, H. L., Tang, L. M., & He, C. J. (2019). A variational level set model for multiscale image segmentation. Information Sciences, 493, 152–175. https://doi.org/10.1016/j.ins.2019.04.048

Zhang, Y., & Hua, C. J. (2015). Driver fatigue recognition based on facial expression analysis using local binary patterns. Optik, 126(23), 4501–4505. https://doi.org/10.1016/j.ijleo.2015.08.185

Zhang, Y., Li, J. J., Guo, Y. H., Xu, C. N., Bao, J., & Song, Y. P. (2019). Vehicle driving behaviour recognition based on multi-view convolutional neural network with joint data augmentation. IEEE Transactions on Vehicular Technology, 68(5), 4223–4234. https://doi.org/10.1109/TVT.2019.2903110

Zhang, Z., Guo, Y., Fu, R., Yuan, W., & Wang, C. (2020). Linking executive functions to distracted driving, does it differ between young and mature drivers? PLOS ONE, 15(9), Article e0239596. https://doi.org/10.1371/journal.pone.0239596

Zhao, Z. P., Xia, S. L., Xu, X. Z., Zhang, L., Yan, H. L., Xu, Y., & Zhang, Z. X. (2020). Driver distraction detection method based on continuous head pose estimation. Computational Intelligence and Neuroscience, 2020(4), Article 9606908. https://doi.org/10.1155/2020/9606908

A Distracted Driving Discrimination Method Based on the Facial Feature Triangle and Bayesian Network

Authors

DOI:

Keywords:

Abstract

References

Downloads

Published

Issue

Section

License

How to Cite