Synthetic data generation for improvement of machine learning-based optical quality control: a practical approach in the welding context

Omar De Mitri; Andreas Frommknecht; Marco F. Huber; Felix Müller-Graf; Cosimo Distante

doi:10.1117/12.2682047

9 August 2023 Synthetic data generation for improvement of machine learning-based optical quality control: a practical approach in the welding context

Omar De Mitri, Andreas Frommknecht, Marco F. Huber, Felix Müller-Graf, Cosimo Distante

Author Affiliations +

Proceedings Volume 12621, Multimodal Sensing and Artificial Intelligence: Technologies and Applications III; 126210Y (2023) https://doi.org/10.1117/12.2682047
Event: SPIE Optical Metrology, 2023, Munich, Germany

Abstract

Weld quality inspection allows the detection of defects that may compromise the quality and strength of the weld. Although visual optical inspection offers lower reliability than other non-destructive methods, it enables weld analysis at a significantly lower cost. In this context, developing machine learning-based algorithms for automatic optical weld quality recognition requires acquiring large amounts of data for training. This entails high costs in terms of time, material and energy required for test preparation. However, one possible approach to tackling the problem with limited datasets is to use synthetic data. Using such data increases the amount and variety of data available to the detection algorithm. With a focus on the context of welding, this paper presents an approach that uses synthetic data as a form of data augmentation to improve the performance of the optical detection of weld seams. Specifically, we propose a generative neural network for semantic image synthesis using a limited starting dataset. The network generates new data instances by receiving as input a semantic map of the image to be represented. Weld defects such as porosity or weld spatter are added to the semantic map so that the network synthesizes corresponding defect images. Analysing the performance on a segmentation network, experimental results show how adding synthetic data to the original data can ensure improvements in network performance.

Conference Presentation

Citation Download Citation

Omar De Mitri, Andreas Frommknecht, Marco F. Huber, Felix Müller-Graf, and Cosimo Distante "Synthetic data generation for improvement of machine learning-based optical quality control: a practical approach in the welding context", Proc. SPIE 12621, Multimodal Sensing and Artificial Intelligence: Technologies and Applications III, 126210Y (9 August 2023); https://doi.org/10.1117/12.2682047

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available