Vehicle detection, LiDAR point cloud, RGB image Fusion ,," /> Vehicle detection, LiDAR point cloud, RGB image Fusion ,,"/> Vehicle detection, LiDAR point cloud, RGB image Fusion ,,"/> <h3 style="text-align:left;"> 3D Vehicle Detection Based on LiDAR and Camera Fusion </h3>

Automotive Innovation ›› 2019, Vol. 2 ›› Issue (4): 276-283.doi: 10.1007/s42154-019-00083-z

• • 上一篇    下一篇

3D Vehicle Detection Based on LiDAR and Camera Fusion

Yingfeng Cai1, Tiantian Zhang2, Hai Wang1, Yicheng Li1, Qingchao Liu1, Xiaobo Chen1   

    1. Institute of Automative Engineering, Jiangsu University, Zhenjiang, China
    2. School of Automotive and Traffic EngineeringJiangsu University, Zhenjiang, China
  • 出版日期:2019-12-17 发布日期:2019-12-17

3D Vehicle Detection Based on LiDAR and Camera Fusion

Yingfeng Cai1, Tiantian Zhang2, Hai Wang1, Yicheng Li1, Qingchao Liu1, Xiaobo Chen1   

    1. Institute of Automative Engineering, Jiangsu University, Zhenjiang, China
    2. School of Automotive and Traffic EngineeringJiangsu University, Zhenjiang, China
  • Online:2019-12-17 Published:2019-12-17

摘要: Nowadays, the deep learning for object detection has become more popular and is widely adopted in many fields. This paper focuses on the research of LiDAR and camera sensor fusion technology for vehicle detection to ensure extremely high detection accuracy. The proposed network architecture takes full advantage of the deep information of both the LiDAR point cloud and RGB image in object detection. First, the LiDAR point cloud and RGB image are fed into the system. Then a high-resolution feature map is used to generate a reliable 3D object proposal for both the LiDAR point cloud and RGB image. Finally, 3D box regression is performed to predict the extent and orientation of vehicles in 3D space. Experiments on the challenging KITTI benchmark show that the proposed approach obtains ideal detection results and the detection time of each frame is about 0.12 s. This approach could establish a basis for further research in autonomous vehicles.

关键词: Vehicle detection, LiDAR point cloud, RGB image Fusion ')">">Vehicle detection, LiDAR point cloud, RGB image Fusion ,

Abstract: Nowadays, the deep learning for object detection has become more popular and is widely adopted in many fields. This paper focuses on the research of LiDAR and camera sensor fusion technology for vehicle detection to ensure extremely high detection accuracy. The proposed network architecture takes full advantage of the deep information of both the LiDAR point cloud and RGB image in object detection. First, the LiDAR point cloud and RGB image are fed into the system. Then a high-resolution feature map is used to generate a reliable 3D object proposal for both the LiDAR point cloud and RGB image. Finally, 3D box regression is performed to predict the extent and orientation of vehicles in 3D space. Experiments on the challenging KITTI benchmark show that the proposed approach obtains ideal detection results and the detection time of each frame is about 0.12 s. This approach could establish a basis for further research in autonomous vehicles.

Key words: Vehicle detection, LiDAR point cloud, RGB image Fusion ')">">Vehicle detection, LiDAR point cloud, RGB image Fusion ,