Non-contact driver attentiveness monitoring system

来自世界卫生组织(WHO)的数据显示，每年约有130万人死于道路交通事故，这被确定为儿童和年轻人的主要死亡原因。根据英国交通部(DFT)的估计，2021年英国有24530人死亡或重伤。除了道路安全方面的担忧外，道路交通事故给大多数国家造成的损失占其国内生产总值的3%，给个人、家庭和整个国家造成了相当大的经济损失。与此同时，研究表明，人为错误是超过50%的交通事故的唯一因素，并在超过90%的事故中是一个促成因素。疲劳驾驶、分心驾驶、酒精或药物导致的化学损伤等常见的人为错误构成了当今道路交通状况的一部分，威胁着每个人的生命安全。然而，目前自动驾驶的发展并不能完全缓解这个问题，因为在达到SAE 5级之前，仍然需要人类司机的接管，而SAE 5级是几十年后的事。在社会压力和立法的推动下，汽车制造商推出了驾驶员监控系统(DMS)来解决这一长期存在的问题，它结合了从摄像头获取的驾驶员行为和从车辆本身获得的驾驶行为来确定驾驶员的状态。尽管现有商业系统的有效性，但缺乏直接测量仍然是进一步提高准确性的一个挑战。另一方面，已经被证明的在实验室环境中基于非接触式方法提取生命体征等生理信息的可行性开辟了一条新的途径。因此，本项目的重点是开发一种新型的非接触式驾驶员注意力监测系统，通过雷达、相机或超声波传感器等非接触式传感器进行注意力检测。首先，通过信号处理获得生理信息，然后与随身传感器获得的地面真实情况进行比较，开发出一种健壮的非接触式生命体征监测系统。在此基础上，将提取的心率、呼吸频率、皮肤温度和身体运动等特征与真实驾驶实验的观察结果和脑电测量的大脑活动相结合，建立了一种新的驾驶员注意力模型。例如，心率、呼吸频率或眨眼频率的降低可能是注意力不集中的良好指标。这项研究项目的结果有望显著减少因人为错误而发生的交通事故，从而防止死亡、受伤和相应的国家经济损失。从研究角度看，将有助于非接触式生命体征监测系统、生物信号处理、驾驶员监控、注意力模型等方面的研究。除了典型的车载驾驶员监控用例外，该系统的变体还有可能扩展到其他类似的应用场景，如航行、航空和航空航天。

Data from the World Health Organisation (WHO) shows approximately 1.3 million people die annually from road crashes, which are identified as the leading cause of death for children and young adults. In the UK, there were 24,530 people killed or seriously injured in 2021 according to the estimation of the Department for Transport (DfT). Besides concerns on the road safety aspect, road traffic crashes cost most countries 3% of their gross domestic product, leading to considerable financial loss to individuals, their families, and the entire nation. Meanwhile, study has shown that human error was the sole factor in more than 50% of road accidents, and was a contributing factor in over 90%. Commonly seen human errors such as drowsy driving, distracted driving, and chemical impairment caused by alcohol or drugs form part of today's road traffic condition, threatening everyone's life safety. However, the current development in autonomous driving can't fully mitigate this issue since the takeover by a human driver is still needed before the SAE level 5 is reached, which is decades away. Propelled by societal pressure and legislation, Driver Monitoring System (DMS) was introduced by car manufacturers to tackle this long-existing problem, combining driver behaviour obtained from a camera and driving behaviour from the vehicle itself to determine the driver's state. Despite the effectiveness of existing commercial systems, the lack of direct measurement remains a challenge to further improve the accuracy. On the other hand, the already proven feasibility of extracting physiological information such as vital signs based on contactless approaches in the lab environment opens up a new avenue. Therefore, the focus of this project is the development of a novel non-contact driver monitoring system for attentiveness detection via contactless sensors such as radar, camera, or ultrasonic sensors. Firstly, physiological information is obtained by signal processing and then compared with the ground truth from body-attached sensors to develop a robust non-contact vital sign monitoring system. On this basis, extracted features such as heart rate, respiratory rate, skin temperature, and body movements are combined with observations from real-world driving experiments and brain activity measured by EEG to develop a new model of driver attentiveness. For example, a reduction in heart rate, respiratory rate, or blink rate could be good indicators of low attentiveness.The outcome of this research project is expected to significantly reduce the number of road crashes due to human error, thus preventing death, injuries, and the corresponding economical loss to the nation as a whole. From the research perspective, it will benefit the research in the non-contact vital sign monitoring system, bio-signal processing, driver monitoring, and attentiveness model. Besides the typical onboard driver monitoring use case, variants of this system have the potential to be expanded to other similar application scenarios, such as voyage, aviation, and aerospace.