Paper
8 November 2002 Quality and automation metrics for spectral classification algorithms
Erich D. Hernandez-Baquero, Robert V. Opalecky
Author Affiliations +
Abstract
Quantitative and robust metrics are required to objectively compare the performance of algorithms within a general functional class. This is especially true for classification algorithms that cluster and label data using spectral features. This is because spectral algorithms are usually based on a finite set of assumptions about the radiative transfer phenomenology. Thus, a suite of algorithms is needed to achieve a generalized and robust processing chain that performs well under all operational scenarios of interest. An adaptive processing chain that automatically selects the optimal combination of algorithms to generate a product of prescribed quality provides a framework for operational applications. To this end, we have developed Measures of Effectiveness (MOE's) and Figures of Merit (FOM's) that can quantitatively and objectively select the appropriate algorithm automatically. The FOM's are a weighted sum of MOE's, which are performance metrics such as the tightness and dissimilarity of clusters. We have also defined scene and sensor parameters that quantify a subset of factors that affect algorithm performance. Functional relationships between FOM's and MOE's and between the FOM's/MOE's and the scene/sensor parameters were also established. These functional relationships allow users to predict the expected classification product quality given a specific operational scenario based on a performance model that also automates the processing chain. Initial results of an application of this approach to hyperspectral data indicate that FOM's can be predicted with high accuracy with choices made correctly as high as 89% of the time depending on the FOM definitions. The results were obtained over a wide range of operational scenarios.
© (2002) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Erich D. Hernandez-Baquero and Robert V. Opalecky "Quality and automation metrics for spectral classification algorithms", Proc. SPIE 4816, Imaging Spectrometry VIII, (8 November 2002); https://doi.org/10.1117/12.451657
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Sensors

Signal to noise ratio

Data modeling

Calibration

Atmospheric corrections

Evolutionary algorithms

Roads

RELATED CONTENT

Enhanced discrimination capability for UXO geophysical surveys
Proceedings of SPIE (September 11 2003)
New USDA UVB synthetic spectra algorithm
Proceedings of SPIE (September 12 2005)
The Autonomous Helicopter System
Proceedings of SPIE (June 14 1984)
Multisensorial Vision For Autonomous Vehicle Driving
Proceedings of SPIE (March 21 1989)
Invariance Techniques And High-Resolution Null Steering
Proceedings of SPIE (February 23 1988)

Back to Top