arrow
Return

A Novel Framework for Evaluating Performance-Estimation Models

delete2019-08-01
delete3
PRE
AI
D
David P. Williams *
DOI:10.1109/TGRS.2019.2898352delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A general framework for quantifying the worth of a performance-estimation model is proposed. The purpose of the model is to predict the performance of an automatic target recognition algorithm on a given set of test data, while the purpose of the framework is to quantify how well the model fulfills its task. To this end, a quantity referred to as the utility, which is based on the Kullback-Leibler divergence, is introduced. A key aspect of the framework is the inclusion of a significance function that specifies the relative importance of each point in the performance space, here assumed to be defined in terms of false alarm rate and probability of detection. Example significance functions are suggested and discussed. The functionality of the proposed framework is demonstrated on an underwater target detection application involving measured synthetic aperture sonar data. In this context, an image complexity metric is exploited to enable the development of models corresponding to different seafloor conditions and mine-hunting difficulty. The appeal of the framework is its ability to quantitatively assess the utility of competing performance-estimation models and to fairly compare the utility of a model on different test data sets.
Keywords:
Automatic target recognition (ATR)
mine countermeasures
modeling
performance-estimation
synthetic aperture sonar (SAS)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

N
nato (north atlantic treaty organisation)
Scholars:
208
Papers: 160
Citations: 0
Cited Papers

Cited Papers

Photon-field-shape effects on Rabi splitting energies in CuCl microcavities
err2013-02-25
err0
PREAI
errToshiki Kawase; Kenichi Miyazaki; DaeGwi Kim; Masaaki Nakayama
errShare
errSave
GnRH agonist long protocol versus GnRH antagonist protocol for various aged patients with diminished ovarian reserve: A retrospective study
err2018-11-07
err0
errOAAI
errMing-Chao Huang; Shu-Ling Tzeng; Chun-I Lee; Hsiu-Hui Chen; Chun-Chia Huang; Tsung-Hsien Lee; Maw-Sheng Lee
errShare
errSave
errShare
errSave
Global-scale analysis of socioeconomic impacts of coastal flooding over the 21st century
err2023-01-16
err0
errOAAI
errEbru Kirezci; Ian R. Young; Roshanka Ranasinghe; Daniel Lincke; Jochen Hinkel
errShare
errSave
no more