General-purpose performance evaluation tool for analysis and comparison of ATA algorithms

Bradford D. Williams; Donald R. Hulsey; Sengvieng A. Amphay; Stacey Stansbery; J. Loris Robinett

doi:10.1117/12.395572

17 August 2000 General-purpose performance evaluation tool for analysis and comparison of ATA algorithms

Bradford D. Williams, Donald R. Hulsey, Sengvieng A. Amphay, Stacey Stansbery, J. Loris Robinett

Proceedings Volume 4050, Automatic Target Recognition X; (2000) https://doi.org/10.1117/12.395572
Event: AeroSense 2000, 2000, Orlando, FL, United States

Abstract

To support Autonomous Target Acquisition (ATA) evaluation and trades analysis, the Air Force Research Laboratory, Advanced Guidance Division (AFRL/MNG) located at Eglin AFB has incorporated a general-purpose performance evaluation system into its Modular Algorithm Concept Evaluation Tool (MACET). The MACET performance evaluation system may be used for active, passive, or multi-sensor ATA analysis. It consists of two main elements: a relational, multi-user database engine and a database client application, the Performance Evaluation Tool (PET). The database engine serves a set of databases that are used to capture, catalog, and archive test results for various algorithms under varying condition and environments. The MACET PET client application is a data mining tool for exploring the ATA test results in the databases, computing standard ATA detection and classification performance metrics (e.g., detection probability, detection reliability, false alarm rate, probability of correct classification, confusion matrices) on user defined subsets of data, calculating test case parameter statistics, and generating performance comparison plots.

Citation Download Citation

Bradford D. Williams, Donald R. Hulsey, Sengvieng A. Amphay, Stacey Stansbery, and J. Loris Robinett "General-purpose performance evaluation tool for analysis and comparison of ATA algorithms", Proc. SPIE 4050, Automatic Target Recognition X, (17 August 2000); https://doi.org/10.1117/12.395572

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available