Enhancing the quality of gauge images captured in haze and smoke scenes through deep learning

Oscar H. Ramírez-Agudelo Sr.; Akshay N. Shewatkar; Edoardo Milana Sr.; Roland C. Aydin Sr.; Kai Franke Sr.

doi:10.1117/12.2679809

4 October 2023 Enhancing the quality of gauge images captured in haze and smoke scenes through deep learning

Oscar H. Ramírez-Agudelo Sr., Akshay N. Shewatkar, Edoardo Milana Sr., Roland C. Aydin Sr., Kai Franke Sr.

Proceedings Volume 12675, Applications of Machine Learning 2023; 126750A (2023) https://doi.org/10.1117/12.2679809
Event: SPIE Optical Engineering + Applications, 2023, San Diego, California, United States

Abstract

Images captured in hazy and smoky environments suffer from reduced visibility, posing a challenge when monitoring infrastructures and hindering emergency services during critical situations. The proposed work investigates the use of the deep learning models to enhance the automatic, machine-based readability of gauge in smoky environments, with accurate gauge data interpretation serving as a valuable tool for first responders. The study utilizes two deep learning architectures, FFA-Net and AECR-Net, to improve the visibility of gauge images, corrupted with light up to dense haze and smoke. Since benchmark datasets of analog gauge images are unavailable, a new synthetic dataset, containing over 14,000 images, was generated using the Unreal Engine. The models were trained with an 80% train, 10% validation, and 10% test split for the haze and smoke dataset, respectively. For the synthetic haze dataset, the SSIM and PSNR metrics are about 0.98 and 43 dB, respectively, comparing well to state-of-the art results. Additionally, more robust results are retrieved from the AECR-Net, when compared to the FFA-Net. Although the results from the synthetic smoke dataset are poorer, the trained models achieve interesting results. In general, imaging in the presence of smoke are more difficult to enhance given the inhomogeneity and high density. Secondly, FFA-Net and AECR-Net are implemented to dehaze and not to desmoke images. This work shows that use of deep learning architectures can improve the quality of analog gauge images captured in smoke and haze scenes immensely. Finally, the enhanced output images can be successfully post-processed for automatic autonomous reading of gauges.

Conference Presentation

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Oscar H. Ramírez-Agudelo Sr., Akshay N. Shewatkar, Edoardo Milana Sr., Roland C. Aydin Sr., and Kai Franke Sr. "Enhancing the quality of gauge images captured in haze and smoke scenes through deep learning", Proc. SPIE 12675, Applications of Machine Learning 2023, 126750A (4 October 2023); https://doi.org/10.1117/12.2679809

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available