Robot gluing localization method based on monocular vision

Jinghao Fan; Yingjie Zhang; Shihan Peng; Yuxiang Zhang; Gaoming Zhang

doi:10.1117/12.2643961

11 August 2022 Robot gluing localization method based on monocular vision

Jinghao Fan, Yingjie Zhang, Shihan Peng, Yuxiang Zhang, Gaoming Zhang

Proceedings Volume 12307, Second Optics Frontier Conference (OFS 2022); 123070G (2022) https://doi.org/10.1117/12.2643961
Event: Second Optics Frontier Conference 2022, 2022, ONLINE, China

Abstract

A localization method based on monocular vision is proposed to solve the problem of poor flexibility, high cost and unstable accuracy of glue dispensing robot. The method includes the workpiece image feature extraction method based on distribution model and the optimized PNP algorithm based on depth calibration, which can locate the threedimensional coordinates of the workpiece and further generate the gluing track. Firstly, the layout and local coordinates of feature points are determined according to the workpiece model and gluing process, and the feature distribution model and template set are established. Then the image coordinates of feature points are extracted step by step by using workpiece contour features and image gray features, combining multi template and multi angle matching with shape detection, and using acceleration strategies such as image pyramid and angle layer by layer subdivision. Finally, the PNP algorithm is optimized in the Z direction through the depth calibration method to realize the high-precision positioning of the workpiece. The localization experiments of various types of reducer shells under different imaging environments were carried out. The experimental results show that the method has better feature extraction effect for workpieces with complex structure in chaotic environment, and the maximum localization error in one direction is within ± 0.5 mm, which meets the application needs of robot glue positioning. The method can detect the offset of 6 degrees of freedom of the target workpiece at the same time, which has a wider application than the general 2D visual localization method. It can also be used for the localization of parts in other scenes.

Citation Download Citation

Jinghao Fan, Yingjie Zhang, Shihan Peng, Yuxiang Zhang, and Gaoming Zhang "Robot gluing localization method based on monocular vision", Proc. SPIE 12307, Second Optics Frontier Conference (OFS 2022), 123070G (11 August 2022); https://doi.org/10.1117/12.2643961

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Feature extraction

Cameras

Imaging systems

Calibration

Detection and tracking algorithms

Visual process modeling

Visualization

Show All Keywords

Keywords/Phrases

Search In:

Publication Years