FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3203109947> ?p ?o ?g. }

• W3203109947 endingPage "10714" @default.
• W3203109947 startingPage "10705" @default.
• W3203109947 abstract "For machine learning models trained with limited labeled training data, validation stands to become the main bottleneck to reducing overall annotation costs. We propose a statistical validation algorithm that accurately estimates the F-score of binary classifiers for rare categories, where finding relevant examples to evaluate on is particularly challenging. Our key insight is that simultaneous calibration and importance sampling enables accurate estimates even in the low-sample regime (< 300 samples). Critically, we also derive an accurate single-trial estimator of the variance of our method and demonstrate that this estimator is empirically accurate at low sample counts, enabling a practitioner to know how well they can trust a given low-sample estimate. When validating state-of-the-art semi-supervised models on ImageNet and iNaturalist2017, our method achieves the same estimates of model performance with up to 10x fewer labels than competing approaches. In particular, we can estimate model F1 scores with a variance of 0.005 using as few as 100 labels." @default.
• W3203109947 created "2021-10-11" @default.
• W3203109947 creator A5004353237 @default.
• W3203109947 creator A5006412542 @default.
• W3203109947 creator A5027115836 @default.
• W3203109947 creator A5037444018 @default.
• W3203109947 creator A5069897950 @default.
• W3203109947 creator A5070318397 @default.
• W3203109947 creator A5088661550 @default.
• W3203109947 date "2021-01-01" @default.
• W3203109947 modified "2023-09-27" @default.
• W3203109947 title "Low-Shot Validation: Active Importance Sampling for Estimating Classifier Performance on Rare Categories" @default.
• W3203109947 hasPublicationYear "2021" @default.
• W3203109947 type Work @default.
• W3203109947 sameAs 3203109947 @default.
• W3203109947 citedByCount "0" @default.
• W3203109947 crossrefType "proceedings-article" @default.
• W3203109947 hasAuthorship W3203109947A5004353237 @default.
• W3203109947 hasAuthorship W3203109947A5006412542 @default.
• W3203109947 hasAuthorship W3203109947A5027115836 @default.
• W3203109947 hasAuthorship W3203109947A5037444018 @default.
• W3203109947 hasAuthorship W3203109947A5069897950 @default.
• W3203109947 hasAuthorship W3203109947A5070318397 @default.
• W3203109947 hasAuthorship W3203109947A5088661550 @default.
• W3203109947 hasConcept C105795698 @default.
• W3203109947 hasConcept C119857082 @default.
• W3203109947 hasConcept C121955636 @default.
• W3203109947 hasConcept C12267149 @default.
• W3203109947 hasConcept C124101348 @default.
• W3203109947 hasConcept C129848803 @default.
• W3203109947 hasConcept C140779682 @default.
• W3203109947 hasConcept C144133560 @default.
• W3203109947 hasConcept C149635348 @default.
• W3203109947 hasConcept C153180895 @default.
• W3203109947 hasConcept C154945302 @default.
• W3203109947 hasConcept C165838908 @default.
• W3203109947 hasConcept C185429906 @default.
• W3203109947 hasConcept C185592680 @default.
• W3203109947 hasConcept C196083921 @default.
• W3203109947 hasConcept C198531522 @default.
• W3203109947 hasConcept C2780513914 @default.
• W3203109947 hasConcept C33923547 @default.
• W3203109947 hasConcept C41008148 @default.
• W3203109947 hasConcept C43617362 @default.
• W3203109947 hasConcept C66905080 @default.
• W3203109947 hasConcept C76155785 @default.
• W3203109947 hasConcept C94915269 @default.
• W3203109947 hasConcept C95623464 @default.
• W3203109947 hasConceptScore W3203109947C105795698 @default.
• W3203109947 hasConceptScore W3203109947C119857082 @default.
• W3203109947 hasConceptScore W3203109947C121955636 @default.
• W3203109947 hasConceptScore W3203109947C12267149 @default.
• W3203109947 hasConceptScore W3203109947C124101348 @default.
• W3203109947 hasConceptScore W3203109947C129848803 @default.
• W3203109947 hasConceptScore W3203109947C140779682 @default.
• W3203109947 hasConceptScore W3203109947C144133560 @default.
• W3203109947 hasConceptScore W3203109947C149635348 @default.
• W3203109947 hasConceptScore W3203109947C153180895 @default.
• W3203109947 hasConceptScore W3203109947C154945302 @default.
• W3203109947 hasConceptScore W3203109947C165838908 @default.
• W3203109947 hasConceptScore W3203109947C185429906 @default.
• W3203109947 hasConceptScore W3203109947C185592680 @default.
• W3203109947 hasConceptScore W3203109947C196083921 @default.
• W3203109947 hasConceptScore W3203109947C198531522 @default.
• W3203109947 hasConceptScore W3203109947C2780513914 @default.
• W3203109947 hasConceptScore W3203109947C33923547 @default.
• W3203109947 hasConceptScore W3203109947C41008148 @default.
• W3203109947 hasConceptScore W3203109947C43617362 @default.
• W3203109947 hasConceptScore W3203109947C66905080 @default.
• W3203109947 hasConceptScore W3203109947C76155785 @default.
• W3203109947 hasConceptScore W3203109947C94915269 @default.
• W3203109947 hasConceptScore W3203109947C95623464 @default.
• W3203109947 hasLocation W32031099471 @default.
• W3203109947 hasOpenAccess W3203109947 @default.
• W3203109947 hasPrimaryLocation W32031099471 @default.
• W3203109947 hasRelatedWork W1006028607 @default.
• W3203109947 hasRelatedWork W1792568252 @default.
• W3203109947 hasRelatedWork W1966705109 @default.
• W3203109947 hasRelatedWork W1983429559 @default.
• W3203109947 hasRelatedWork W2037758579 @default.
• W3203109947 hasRelatedWork W2075159929 @default.
• W3203109947 hasRelatedWork W2089086886 @default.
• W3203109947 hasRelatedWork W2404421265 @default.
• W3203109947 hasRelatedWork W2592734881 @default.
• W3203109947 hasRelatedWork W2618438111 @default.
• W3203109947 hasRelatedWork W2757523618 @default.
• W3203109947 hasRelatedWork W2912757738 @default.
• W3203109947 hasRelatedWork W2952786955 @default.
• W3203109947 hasRelatedWork W2979960726 @default.
• W3203109947 hasRelatedWork W2997129641 @default.
• W3203109947 hasRelatedWork W3036156650 @default.
• W3203109947 hasRelatedWork W3043506432 @default.
• W3203109947 hasRelatedWork W3084750939 @default.
• W3203109947 hasRelatedWork W3092572785 @default.
• W3203109947 hasRelatedWork W3112138688 @default.
• W3203109947 isParatext "false" @default.
• W3203109947 isRetracted "false" @default.
• W3203109947 magId "3203109947" @default.

• next