Matches in SemOpenAlex for { <https://semopenalex.org/work/W4299944207> ?p ?o ?g. }
Showing items 1 to 60 of
60
with 100 items per page.
- W4299944207 abstract "In this paper we propose strategies for estimating performance of a classifier when labels cannot be obtained for the whole test set. The number of test instances which can be labeled is very small compared to the whole test data size. The goal then is to obtain a precise estimate of classifier performance using as little labeling resource as possible. Specifically, we try to answer, how to select a subset of the large test set for labeling such that the performance of a classifier estimated on this subset is as close as possible to the one on the whole test set. We propose strategies based on stratified sampling for selecting this subset. We show that these strategies can reduce the variance in estimation of classifier accuracy by a significant amount compared to simple random sampling (over 65% in several cases). Hence, our proposed methods are much more precise compared to random sampling for accuracy estimation under restricted labeling resources. The reduction in number of samples required (compared to random sampling) to estimate the classifier accuracy with only 1% error is high as 60% in some cases." @default.
- W4299944207 created "2022-10-03" @default.
- W4299944207 creator A5016771874 @default.
- W4299944207 creator A5066528816 @default.
- W4299944207 date "2016-07-09" @default.
- W4299944207 modified "2023-09-28" @default.
- W4299944207 title "Classifier Risk Estimation under Limited Labeling Resources" @default.
- W4299944207 doi "https://doi.org/10.48550/arxiv.1607.02665" @default.
- W4299944207 hasPublicationYear "2016" @default.
- W4299944207 type Work @default.
- W4299944207 citedByCount "0" @default.
- W4299944207 crossrefType "posted-content" @default.
- W4299944207 hasAuthorship W4299944207A5016771874 @default.
- W4299944207 hasAuthorship W4299944207A5066528816 @default.
- W4299944207 hasBestOaLocation W42999442071 @default.
- W4299944207 hasConcept C105795698 @default.
- W4299944207 hasConcept C119857082 @default.
- W4299944207 hasConcept C124101348 @default.
- W4299944207 hasConcept C144024400 @default.
- W4299944207 hasConcept C149923435 @default.
- W4299944207 hasConcept C153180895 @default.
- W4299944207 hasConcept C154945302 @default.
- W4299944207 hasConcept C169903167 @default.
- W4299944207 hasConcept C20353970 @default.
- W4299944207 hasConcept C2908647359 @default.
- W4299944207 hasConcept C33923547 @default.
- W4299944207 hasConcept C41008148 @default.
- W4299944207 hasConcept C49898467 @default.
- W4299944207 hasConcept C95623464 @default.
- W4299944207 hasConceptScore W4299944207C105795698 @default.
- W4299944207 hasConceptScore W4299944207C119857082 @default.
- W4299944207 hasConceptScore W4299944207C124101348 @default.
- W4299944207 hasConceptScore W4299944207C144024400 @default.
- W4299944207 hasConceptScore W4299944207C149923435 @default.
- W4299944207 hasConceptScore W4299944207C153180895 @default.
- W4299944207 hasConceptScore W4299944207C154945302 @default.
- W4299944207 hasConceptScore W4299944207C169903167 @default.
- W4299944207 hasConceptScore W4299944207C20353970 @default.
- W4299944207 hasConceptScore W4299944207C2908647359 @default.
- W4299944207 hasConceptScore W4299944207C33923547 @default.
- W4299944207 hasConceptScore W4299944207C41008148 @default.
- W4299944207 hasConceptScore W4299944207C49898467 @default.
- W4299944207 hasConceptScore W4299944207C95623464 @default.
- W4299944207 hasLocation W42999442071 @default.
- W4299944207 hasLocation W42999442072 @default.
- W4299944207 hasOpenAccess W4299944207 @default.
- W4299944207 hasPrimaryLocation W42999442071 @default.
- W4299944207 hasRelatedWork W1194111141 @default.
- W4299944207 hasRelatedWork W1627097240 @default.
- W4299944207 hasRelatedWork W2056178673 @default.
- W4299944207 hasRelatedWork W2075114053 @default.
- W4299944207 hasRelatedWork W2154170647 @default.
- W4299944207 hasRelatedWork W2604259055 @default.
- W4299944207 hasRelatedWork W2605994566 @default.
- W4299944207 hasRelatedWork W3047864323 @default.
- W4299944207 hasRelatedWork W3129929765 @default.
- W4299944207 hasRelatedWork W3209070018 @default.
- W4299944207 isParatext "false" @default.
- W4299944207 isRetracted "false" @default.
- W4299944207 workType "article" @default.