Quantifying image quality attributes for training and testing of machine learning methods

Farzaan Naeem; Samuel Vilt; Paul Brown; John M. Irvine

doi:10.1117/12.3014679

10 June 2024 Quantifying image quality attributes for training and testing of machine learning methods

Farzaan Naeem, Samuel Vilt, Paul Brown, John M. Irvine

Author Affiliations +

Proceedings Volume 13037, Geospatial Informatics XIV; 1303707 (2024) https://doi.org/10.1117/12.3014679
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

The interpretability of an image indicates its potential information value. Historically, the National Imagery Interpretability Rating Scale (NIIRS) has been the standard for quantifying the interpretability of an image. With the growing reliance on machine learning (ML) for image analysis, NIIRS fails to capture the image quality attributes relevant to ML. Empirical studies have demonstrated that the relationship between NIIRS and ML performance is weak at best. In this study, we explore several image characteristics through the relationship between the training data and the test data using two standard ML methods: TensorFlow and Detectron2. We employed quantitative methods to measure color diversity, edge density, and image texture as ways to characterize the training and test sets. A series of experiments demonstrate the utility of these measures. The results suggest that each of the proposed methods quantifies an aspect of image difficulty for the ML method. Performance is generally better for test sets with lower levels of color diversity, edge density, and texture. In addition, the experiments suggest that training on higher complexity imagery yields more resilient models. Future studies will assess the relationship among these image features and explore methods for extending them.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Farzaan Naeem, Samuel Vilt, Paul Brown, and John M. Irvine "Quantifying image quality attributes for training and testing of machine learning methods", Proc. SPIE 13037, Geospatial Informatics XIV, 1303707 (10 June 2024); https://doi.org/10.1117/12.3014679

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE