Matches in SemOpenAlex for { <https://semopenalex.org/work/W2109689843> ?p ?o ?g. }
- W2109689843 endingPage "1501" @default.
- W2109689843 startingPage "1493" @default.
- W2109689843 abstract "We study consistency properties of algorithms for non-decomposable performance measures that cannot be expressed as a sum of losses on individual data points, such as the F-measure used in text retrieval and several other performance measures used in class imbalanced settings. While there has been much work on designing algorithms for such performance measures, there is limited understanding of the theoretical properties of these algorithms. Recently, Ye et al. (2012) showed consistency results for two algorithms that optimize the F-measure, but their results apply only to an idealized setting, where precise knowledge of the underlying probability distribution (in the form of the 'true' posterior class probability) is available to a learning algorithm. In this work, we consider plug-in algorithms that learn a classifier by applying an empirically determined threshold to a suitable 'estimate' of the class probability, and provide a general methodology to show consistency of these methods for any non-decomposable measure that can be expressed as a continuous function of true positive rate (TPR) and true negative rate (TNR), and for which the Bayes optimal classifier is the class probability function thresholded suitably. We use this template to derive consistency results for plug-in algorithms for the F-measure and for the geometric mean of TPR and precision; to our knowledge, these are the first such results for these measures. In addition, for continuous distributions, we show consistency of plug-in algorithms for any performance measure that is a continuous and monotonically increasing function of TPR and TNR. Experimental results confirm our theoretical findings." @default.
- W2109689843 created "2016-06-24" @default.
- W2109689843 creator A5012314340 @default.
- W2109689843 creator A5066581662 @default.
- W2109689843 creator A5077482746 @default.
- W2109689843 date "2014-12-08" @default.
- W2109689843 modified "2023-09-24" @default.
- W2109689843 title "On the Statistical Consistency of Plug-in Classifiers for Non-decomposable Performance Measures" @default.
- W2109689843 cites W13608894 @default.
- W2109689843 cites W1500890010 @default.
- W2109689843 cites W152506389 @default.
- W2109689843 cites W1532325895 @default.
- W2109689843 cites W1647645866 @default.
- W2109689843 cites W1758941703 @default.
- W2109689843 cites W1773633997 @default.
- W2109689843 cites W1969623397 @default.
- W2109689843 cites W1979495886 @default.
- W2109689843 cites W1981760905 @default.
- W2109689843 cites W1982032418 @default.
- W2109689843 cites W2005864863 @default.
- W2109689843 cites W2018187659 @default.
- W2109689843 cites W2027450543 @default.
- W2109689843 cites W2049744691 @default.
- W2109689843 cites W2069116068 @default.
- W2109689843 cites W2070771761 @default.
- W2109689843 cites W2076289673 @default.
- W2109689843 cites W2110075577 @default.
- W2109689843 cites W2116642770 @default.
- W2109689843 cites W2120497086 @default.
- W2109689843 cites W2127570136 @default.
- W2109689843 cites W2152089394 @default.
- W2109689843 cites W2153962014 @default.
- W2109689843 cites W2177508090 @default.
- W2109689843 cites W2621384249 @default.
- W2109689843 cites W3120740533 @default.
- W2109689843 cites W61851215 @default.
- W2109689843 cites W85350352 @default.
- W2109689843 cites W9828162 @default.
- W2109689843 hasPublicationYear "2014" @default.
- W2109689843 type Work @default.
- W2109689843 sameAs 2109689843 @default.
- W2109689843 citedByCount "45" @default.
- W2109689843 countsByYear W21096898432014 @default.
- W2109689843 countsByYear W21096898432015 @default.
- W2109689843 countsByYear W21096898432016 @default.
- W2109689843 countsByYear W21096898432017 @default.
- W2109689843 countsByYear W21096898432018 @default.
- W2109689843 countsByYear W21096898432019 @default.
- W2109689843 countsByYear W21096898432020 @default.
- W2109689843 countsByYear W21096898432021 @default.
- W2109689843 crossrefType "proceedings-article" @default.
- W2109689843 hasAuthorship W2109689843A5012314340 @default.
- W2109689843 hasAuthorship W2109689843A5066581662 @default.
- W2109689843 hasAuthorship W2109689843A5077482746 @default.
- W2109689843 hasConcept C105795698 @default.
- W2109689843 hasConcept C107673813 @default.
- W2109689843 hasConcept C11413529 @default.
- W2109689843 hasConcept C119857082 @default.
- W2109689843 hasConcept C124101348 @default.
- W2109689843 hasConcept C149441793 @default.
- W2109689843 hasConcept C154945302 @default.
- W2109689843 hasConcept C207201462 @default.
- W2109689843 hasConcept C2776436953 @default.
- W2109689843 hasConcept C2780009758 @default.
- W2109689843 hasConcept C33923547 @default.
- W2109689843 hasConcept C41008148 @default.
- W2109689843 hasConcept C95623464 @default.
- W2109689843 hasConceptScore W2109689843C105795698 @default.
- W2109689843 hasConceptScore W2109689843C107673813 @default.
- W2109689843 hasConceptScore W2109689843C11413529 @default.
- W2109689843 hasConceptScore W2109689843C119857082 @default.
- W2109689843 hasConceptScore W2109689843C124101348 @default.
- W2109689843 hasConceptScore W2109689843C149441793 @default.
- W2109689843 hasConceptScore W2109689843C154945302 @default.
- W2109689843 hasConceptScore W2109689843C207201462 @default.
- W2109689843 hasConceptScore W2109689843C2776436953 @default.
- W2109689843 hasConceptScore W2109689843C2780009758 @default.
- W2109689843 hasConceptScore W2109689843C33923547 @default.
- W2109689843 hasConceptScore W2109689843C41008148 @default.
- W2109689843 hasConceptScore W2109689843C95623464 @default.
- W2109689843 hasLocation W21096898431 @default.
- W2109689843 hasOpenAccess W2109689843 @default.
- W2109689843 hasPrimaryLocation W21096898431 @default.
- W2109689843 hasRelatedWork W13608894 @default.
- W2109689843 hasRelatedWork W152506389 @default.
- W2109689843 hasRelatedWork W1532325895 @default.
- W2109689843 hasRelatedWork W1564947197 @default.
- W2109689843 hasRelatedWork W1758941703 @default.
- W2109689843 hasRelatedWork W1850680945 @default.
- W2109689843 hasRelatedWork W1864426711 @default.
- W2109689843 hasRelatedWork W2018187659 @default.
- W2109689843 hasRelatedWork W2070771761 @default.
- W2109689843 hasRelatedWork W2104144433 @default.
- W2109689843 hasRelatedWork W2118978333 @default.
- W2109689843 hasRelatedWork W2120497086 @default.
- W2109689843 hasRelatedWork W2122770142 @default.
- W2109689843 hasRelatedWork W2127570136 @default.
- W2109689843 hasRelatedWork W2152089394 @default.