Field-based data collection techniques for the evaluation of information fusion systems

Brian Antonishek; Brian A. Weiss; Craig Schlenoff

doi:10.1117/12.818565

13 April 2009 Field-based data collection techniques for the evaluation of information fusion systems

Brian Antonishek, Brian A. Weiss, Craig Schlenoff

Proceedings Volume 7345, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2009; 73450M (2009) https://doi.org/10.1117/12.818565
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

In order to effectively evaluate information fusion systems or emerging technologies, it is critical to quickly, efficient, and accurately collect functional and observational data about such systems. One of the best ways to test a system's capabilities is to have an end user operate it in controlled but realistic field-based situations. Evaluation data of the systems' performance as well as observational data of the user's interactions can then be collected and analyzed. This analysis often gives insight into how the system may perform in the intended environment and of any potential areas for improvement. One common method for collection of this data involves an evaluator/observer generating hand-written notes, comments, and sketches. This often proves to be inefficient in complex sensor technology field-based evaluation environments. Personnel at the National Institute of Standards and Technology (NIST) have been tasked with collecting such evaluation data for emerging soldier-worn sensor systems. Lessons learned from the on-going development of efficient field-based evaluation data collection techniques will be discussed. The most recent evaluation data collection using a personal digital assistant (PDA)-style system and details of its use during an evaluation of a multi-team study will also be described.

Citation Download Citation

Brian Antonishek, Brian A. Weiss, and Craig Schlenoff "Field-based data collection techniques for the evaluation of information fusion systems", Proc. SPIE 7345, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2009, 73450M (13 April 2009); https://doi.org/10.1117/12.818565

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Personal digital assistants

Sun

Information fusion

Sensors

Facial recognition systems

Computing systems

Data fusion

Show All Keywords

Keywords/Phrases

Search In:

Publication Years