论文标题
应用时空注意力以识别视觉变压器分心和昏昏欲睡的驾驶
Applying Spatiotemporal Attention to Identify Distracted and Drowsy Driving with Vision Transformers
论文作者
论文摘要
与2020年相比，由于注意力和嗜睡增加，汽车撞车事故增长了20％。昏昏欲睡和分心的驾驶是所有车祸的45％的原因。作为减少昏昏欲睡和分心的驾驶的一种手段，使用计算机视觉的检测方法可以设计为低成本，准确和微创。这项工作调查了视觉变压器以超过3D-CNN的最先进精度。两个独立的变压器接受了嗜睡和分心。昏昏欲睡的视频变压器模型接受了全国Tsing-hua University Droly Dripy Drive Datat（NTHU-DDD）的培训，其中有一个视频Swin Transformer模型，可在两个类别上进行10个时代 - 昏昏欲睡的和非der的模拟，超过10.5个小时。分散注意力的视频变压器在驾驶员监视数据集（DMD）上接受了带有视频Swin Transformer的50个时代的培训，该时期超过9个分心相关的类。嗜睡模型的准确性达到了44％，测试集的损失值高，表明过度拟合和模型性能差。过度拟合表明有限的培训数据和应用模型体系结构缺乏可量化的参数。分散注意力的模型优于DMD上的最新模型，达到97.5％，表明有足够的数据和强大的体系结构，变压器适合不适合驾驶检测。未来的研究应使用较新的模型，例如Tokenlearner来实现更高的准确性和效率，合并现有数据集以扩展以检测酒后驾车和道路愤怒，以创建全面的解决方案，以防止交通崩溃，并部署功能性的原型以革新自动安全行业。
A 20% rise in car crashes in 2021 compared to 2020 has been observed as a result of increased distraction and drowsiness. Drowsy and distracted driving are the cause of 45% of all car crashes. As a means to decrease drowsy and distracted driving, detection methods using computer vision can be designed to be low-cost, accurate, and minimally invasive. This work investigated the use of the vision transformer to outperform state-of-the-art accuracy from 3D-CNNs. Two separate transformers were trained for drowsiness and distractedness. The drowsy video transformer model was trained on the National Tsing-Hua University Drowsy Driving Dataset (NTHU-DDD) with a Video Swin Transformer model for 10 epochs on two classes -- drowsy and non-drowsy simulated over 10.5 hours. The distracted video transformer was trained on the Driver Monitoring Dataset (DMD) with Video Swin Transformer for 50 epochs over 9 distraction-related classes. The accuracy of the drowsiness model reached 44% and a high loss value on the test set, indicating overfitting and poor model performance. Overfitting indicates limited training data and applied model architecture lacked quantifiable parameters to learn. The distracted model outperformed state-of-the-art models on DMD reaching 97.5%, indicating that with sufficient data and a strong architecture, transformers are suitable for unfit driving detection. Future research should use newer and stronger models such as TokenLearner to achieve higher accuracy and efficiency, merge existing datasets to expand to detecting drunk driving and road rage to create a comprehensive solution to prevent traffic crashes, and deploying a functioning prototype to revolutionize the automotive safety industry.
