An efficient framework for creating depth annotated image datasets with camera and Lidar fusion

Jinjiang Liu; Hao Guo; Yuanfeng Wang; Qi Qin

doi:10.1117/12.3029626

21 June 2024 An efficient framework for creating depth annotated image datasets with camera and Lidar fusion

Jinjiang Liu, Hao Guo, Yuanfeng Wang, Qi Qin

Proceedings Volume 13167, International Conference on Remote Sensing, Mapping, and Image Processing (RSMIP 2024); 131672V (2024) https://doi.org/10.1117/12.3029626
Event: International Conference on Remote Sensing, Mapping and Image Processing (RSMIP 2024), 2024, Xiamen, China

Abstract

We identified two challenges in the current creation of depth-annotated dataset for autonomous driving or 3D reconstruction: 1) The viewing angle difference between cameras and radar, causes projecting background points onto foreground objects in the Lidar-to-image projection process, leading to inaccurate depth information acquisition. 2) The substantial manpower required to eliminate occluded points during the depth dataset creation process. In addressing these challenges, we analyzed the principles behind occlusion and proposed an automated filtering method for point cloud projection images. Our method involves segmenting images into various-sized sliding windows based on different scenes to filter out occluded points. Through this approach, we achieve effective occlusion removal in diverse scenarios, encompassing structured objects like cars, buildings, pedestrians, as well as unstructured objects like trees. Moreover, the proposed algorithm automates the process, thereby significantly reducing both labor and time costs. Additionally, we proposed different schemes for creating sparse and dense depth maps based on the density of the camera depth image. We have open-sourced the code, and the repository can be found at: squirreljj/An-efficient-framework-for-creating-depthannotated-image-datasets-with-camera-and-Lidar-fusion- (github.com)

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jinjiang Liu, Hao Guo, Yuanfeng Wang, and Qi Qin "An efficient framework for creating depth annotated image datasets with camera and Lidar fusion", Proc. SPIE 13167, International Conference on Remote Sensing, Mapping, and Image Processing (RSMIP 2024), 131672V (21 June 2024); https://doi.org/10.1117/12.3029626

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available