Vehicle detection, LiDAR point cloud, RGB image Fusion ,," /> Vehicle detection, LiDAR point cloud, RGB image Fusion ,,"/> Vehicle detection, LiDAR point cloud, RGB image Fusion ,,"/>
Automotive Innovation ›› 2019, Vol. 2 ›› Issue (4): 276-283.doi: 10.1007/s42154-019-00083-z
Yingfeng Cai1, Tiantian Zhang2, Hai Wang1, Yicheng Li1, Qingchao Liu1, Xiaobo Chen1
Yingfeng Cai1, Tiantian Zhang2, Hai Wang1, Yicheng Li1, Qingchao Liu1, Xiaobo Chen1
摘要: Nowadays, the deep learning for object detection has become more popular and is widely adopted in many fields. This paper focuses on the research of LiDAR and camera sensor fusion technology for vehicle detection to ensure extremely high detection accuracy. The proposed network architecture takes full advantage of the deep information of both the LiDAR point cloud and RGB image in object detection. First, the LiDAR point cloud and RGB image are fed into the system. Then a high-resolution feature map is used to generate a reliable 3D object proposal for both the LiDAR point cloud and RGB image. Finally, 3D box regression is performed to predict the extent and orientation of vehicles in 3D space. Experiments on the challenging KITTI benchmark show that the proposed approach obtains ideal detection results and the detection time of each frame is about 0.12 s. This approach could establish a basis for further research in autonomous vehicles.