Automotive Innovation ›› 2024, Vol. 7 ›› Issue (1): 45-58.doi: 10.1007/s42154-023-00272-x

• • 上一篇    下一篇

Driver Steering Behaviour Modelling Based on Neuromuscular Dynamics and Multi-Task Time-Series Transformer

Yang Xing1, Zhongxu Hu2, Xiaoyu Mo2, Peng Hang3, Shujing Li4, Yahui Liu5, Yifan Zhao1 & Chen Lv2   

  1. 1. School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield, MK43 0AL, United Kingdom
    2. School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, 639798, Singapore
    3. College of Transportation Engineering, Tongji University, Shanghai, 200092, China
    4. College of Computer Science and Technology, Jilin University, Changchun, 130012, China
    5. School of Vehicle and Mobility, Tsinghua University, Beijing, 100084, China
  • 出版日期:2024-02-14 发布日期:2024-02-14

Driver Steering Behaviour Modelling Based on Neuromuscular Dynamics and Multi-Task Time-Series Transformer

Yang Xing1, Zhongxu Hu2, Xiaoyu Mo2, Peng Hang3, Shujing Li4, Yahui Liu5, Yifan Zhao1 & Chen Lv2   

  1. 1. School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield, MK43 0AL, United Kingdom
    2. School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, 639798, Singapore
    3. College of Transportation Engineering, Tongji University, Shanghai, 200092, China
    4. College of Computer Science and Technology, Jilin University, Changchun, 130012, China
    5. School of Vehicle and Mobility, Tsinghua University, Beijing, 100084, China
  • Online:2024-02-14 Published:2024-02-14

摘要: Driver steering intention prediction provides an augmented solution to the design of an onboard collaboration mechanism between human driver and intelligent vehicle. In this study, a multi-task sequential learning framework is developed to predict future steering torques and steering postures based on upper limb neuromuscular electromyography signals. The joint representation learning for driving postures and steering intention provides an in-depth understanding and accurate modelling of driving steering behaviours. Regarding different testing scenarios, two driving modes, namely, both-hand and single-right-hand modes, are studied. For each driving mode, three different driving postures are further evaluated. Next, a multi-task time-series transformer network (MTS-Trans) is developed to predict the future steering torques and driving postures based on the multi-variate sequential input and the self-attention mechanism. To evaluate the multi-task learning performance and information-sharing characteristics within the network, four distinct two-branch network architectures are evaluated. Empirical validation is conducted through a driving simulator-based experiment, encompassing 21 participants. The proposed model achieves accurate prediction results on future steering torque prediction as well as driving posture recognition for both two-hand and single-hand driving modes. These findings hold significant promise for the advancement of driver steering assistance systems, fostering mutual comprehension and synergy between human drivers and intelligent vehicles.

Abstract: Driver steering intention prediction provides an augmented solution to the design of an onboard collaboration mechanism between human driver and intelligent vehicle. In this study, a multi-task sequential learning framework is developed to predict future steering torques and steering postures based on upper limb neuromuscular electromyography signals. The joint representation learning for driving postures and steering intention provides an in-depth understanding and accurate modelling of driving steering behaviours. Regarding different testing scenarios, two driving modes, namely, both-hand and single-right-hand modes, are studied. For each driving mode, three different driving postures are further evaluated. Next, a multi-task time-series transformer network (MTS-Trans) is developed to predict the future steering torques and driving postures based on the multi-variate sequential input and the self-attention mechanism. To evaluate the multi-task learning performance and information-sharing characteristics within the network, four distinct two-branch network architectures are evaluated. Empirical validation is conducted through a driving simulator-based experiment, encompassing 21 participants. The proposed model achieves accurate prediction results on future steering torque prediction as well as driving posture recognition for both two-hand and single-hand driving modes. These findings hold significant promise for the advancement of driver steering assistance systems, fostering mutual comprehension and synergy between human drivers and intelligent vehicles.