Target recognition and range detection algorithm based on visible-depth image fusion

Wei Su; Rui Chen; Chengbo Ai; Xinyue Liu

doi:10.1117/12.3014594

4 March 2024 Target recognition and range detection algorithm based on visible-depth image fusion

Wei Su, Rui Chen, Chengbo Ai, Xinyue Liu

Proceedings Volume 13070, Speckle 2023: VIII International Conference on Speckle Metrology; 130700L (2024) https://doi.org/10.1117/12.3014594
Event: Speckle 2023: VIII International Conference on Speckle Metrology, 2023, Xi'an, China

Abstract

It is necessary to obtain the surrounding information by the sensor to realize target identification and distance detection in the unmanned situational awareness task. The sensors used to collect target information can be divided into visible light band sensors such as visible light cameras and non-visible light wavelength sensors such as Light Detection and Ranging (LiDAR) from the optical characteristics. The LiDAR focuses on acquiring target distance and reflection intensity information, but the details are limited and not conducive to human observation. The visible light cameras focus on acquiring well-structured and detailed target information, but it is difficult to obtain distance information. In this paper, a target recognition method based on visible-depth image fusion for heterogeneous sensors is studied to solve the influence of environmental, spatial and heterogeneous data factors on fusion results. The fusion of point cloud images and visible light image data into visual images incorporating distance information is achieved by employing a combination of the RANSAC algorithm-based spatial line intersection method and the least squares method. And target recognition and distance detection methods based on yolov5s algorithm were studied for fusion data. Through the establishment of dataset and the training of deep learning network, the specific target identification and distance determination are realized. The results show that the specific target recognition rate of this method is greater than 94%, and the accuracy is 2mm (at 10m distance). The results of target recognition and distance determination can be directly sent to the unmanned situation awareness platform to provide a basis for its next decision.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Wei Su, Rui Chen, Chengbo Ai, and Xinyue Liu "Target recognition and range detection algorithm based on visible-depth image fusion", Proc. SPIE 13070, Speckle 2023: VIII International Conference on Speckle Metrology, 130700L (4 March 2024); https://doi.org/10.1117/12.3014594

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Point clouds

Image fusion

Calibration

LIDAR

Cameras

Visible radiation

Target recognition

Show All Keywords

Keywords/Phrases

Search In:

Publication Years