Measures, Metrics, and Indicators Derived from the Ubiquitous Two-by-Two Contingency Table, Part B: Examples
Published: 2021-05-14
Page: 108- 132
Issue: 2021 - Volume 4 [Issue 2]
Ali Muhammad Ali Rushdi *
Department of Electrical and Computer Engineering, King Abdulaziz University, P. O. Box 80200, Jeddah 21589, Saudi Arabia.
Sultan Mohammed Alghamdi
Department of Electrical and Computer Engineering, King Abdulaziz University, P. O. Box 80200, Jeddah 21589, Saudi Arabia.
*Author to whom correspondence should be addressed.
Abstract
This paper (the second of two sibling papers) continues the tutorial exposition presented in the first part of indicators derived from the ubiquitous two-by-two contingency table (confusion matrix). The indicators considered herein are those given in the context of clinical testing or binary classification. We present a pedagogical program that computes all important indicators based on knowledge of either (a) the set of four entries of the contingency table , , , , or (b) the set of true (pre-test) prevalence, sensitivity, and specificity , . The paper presents a potpourri of test cases to reveal and unravel many of the properties and inter-relationships among the indicators studied. All our test cases confirm the theoretical results and arguments in the sister paper. In particular, these test cases collectively assert that the Matthews correlation coefficient (MCC) is the most reliable single metric derivable from the contingency matrix. A concise classification of types of prediction is given in terms of the set of four basic indicators , , or in terms of MCC alone.
Keywords: Diagnostic testing, binary classification, sensitivity, specificity, positive predictive value, negative predictive value, Matthews correlation coefficient