Matches in SemOpenAlex for { <https://semopenalex.org/work/W2896738927> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W2896738927 abstract "Assessing the predictive accuracy of black box classifiers is challenging in the absence of labeled test datasets. In these scenarios we may need to rely on a human oracle to evaluate individual predictions; presenting the challenge to create query algorithms to guide the search for points that provide the most information about the classifier's predictive characteristics. Previous works have focused on developing utility models and query algorithms for discovering unknown unknowns --- misclassifications with a predictive confidence above some arbitrary threshold. However, if misclassifications occur at the rate reflected by the confidence values, then these search methods reveal nothing more than a proper assessment of predictive certainty. We are unable to properly mitigate the risks associated with model deficiency when the model's confidence in prediction exceeds the actual model accuracy. We propose a facility locations utility model and corresponding greedy query algorithm that instead searches for overconfident unknown unknowns. Through robust empirical experiments we demonstrate that the greedy query algorithm with the facility locations utility model consistently results in oracle queries with superior performance in discovering overconfident unknown unknowns than previous methods." @default.
- W2896738927 created "2018-10-26" @default.
- W2896738927 creator A5055950981 @default.
- W2896738927 creator A5061392825 @default.
- W2896738927 date "2018-10-12" @default.
- W2896738927 modified "2023-09-27" @default.
- W2896738927 title "Facility Locations Utility for Uncovering Classifier Overconfidence." @default.
- W2896738927 cites W2059362837 @default.
- W2896738927 cites W2101622070 @default.
- W2896738927 cites W2114524997 @default.
- W2896738927 cites W2162651021 @default.
- W2896738927 cites W2163424852 @default.
- W2896738927 cites W2582743722 @default.
- W2896738927 cites W2583689529 @default.
- W2896738927 cites W2774008708 @default.
- W2896738927 cites W2788428929 @default.
- W2896738927 cites W2903158431 @default.
- W2896738927 cites W29471193 @default.
- W2896738927 cites W2949971241 @default.
- W2896738927 cites W2949988325 @default.
- W2896738927 cites W2952186591 @default.
- W2896738927 cites W2953027140 @default.
- W2896738927 cites W3464401 @default.
- W2896738927 hasPublicationYear "2018" @default.
- W2896738927 type Work @default.
- W2896738927 sameAs 2896738927 @default.
- W2896738927 citedByCount "0" @default.
- W2896738927 crossrefType "posted-content" @default.
- W2896738927 hasAuthorship W2896738927A5055950981 @default.
- W2896738927 hasAuthorship W2896738927A5061392825 @default.
- W2896738927 hasConcept C115903868 @default.
- W2896738927 hasConcept C119857082 @default.
- W2896738927 hasConcept C124101348 @default.
- W2896738927 hasConcept C154945302 @default.
- W2896738927 hasConcept C15744967 @default.
- W2896738927 hasConcept C41008148 @default.
- W2896738927 hasConcept C51110983 @default.
- W2896738927 hasConcept C55166926 @default.
- W2896738927 hasConcept C77805123 @default.
- W2896738927 hasConcept C95623464 @default.
- W2896738927 hasConceptScore W2896738927C115903868 @default.
- W2896738927 hasConceptScore W2896738927C119857082 @default.
- W2896738927 hasConceptScore W2896738927C124101348 @default.
- W2896738927 hasConceptScore W2896738927C154945302 @default.
- W2896738927 hasConceptScore W2896738927C15744967 @default.
- W2896738927 hasConceptScore W2896738927C41008148 @default.
- W2896738927 hasConceptScore W2896738927C51110983 @default.
- W2896738927 hasConceptScore W2896738927C55166926 @default.
- W2896738927 hasConceptScore W2896738927C77805123 @default.
- W2896738927 hasConceptScore W2896738927C95623464 @default.
- W2896738927 hasLocation W28967389271 @default.
- W2896738927 hasOpenAccess W2896738927 @default.
- W2896738927 hasPrimaryLocation W28967389271 @default.
- W2896738927 hasRelatedWork W2082063580 @default.
- W2896738927 hasRelatedWork W2204166059 @default.
- W2896738927 hasRelatedWork W2618438111 @default.
- W2896738927 hasRelatedWork W2763164305 @default.
- W2896738927 hasRelatedWork W2898721507 @default.
- W2896738927 hasRelatedWork W2908096964 @default.
- W2896738927 hasRelatedWork W2949377985 @default.
- W2896738927 hasRelatedWork W3008759574 @default.
- W2896738927 hasRelatedWork W3020564127 @default.
- W2896738927 hasRelatedWork W3029990846 @default.
- W2896738927 hasRelatedWork W3038776261 @default.
- W2896738927 hasRelatedWork W3041560869 @default.
- W2896738927 hasRelatedWork W3085378621 @default.
- W2896738927 hasRelatedWork W3091586673 @default.
- W2896738927 hasRelatedWork W3129912876 @default.
- W2896738927 hasRelatedWork W3132003610 @default.
- W2896738927 hasRelatedWork W3135386061 @default.
- W2896738927 hasRelatedWork W3181617256 @default.
- W2896738927 hasRelatedWork W3205172936 @default.
- W2896738927 hasRelatedWork W3213231108 @default.
- W2896738927 isParatext "false" @default.
- W2896738927 isRetracted "false" @default.
- W2896738927 magId "2896738927" @default.
- W2896738927 workType "article" @default.