Matches in SemOpenAlex for { <https://semopenalex.org/work/W3181617256> ?p ?o ?g. }
- W3181617256 abstract "Being uncertain when facing the unknown is key to intelligent decision making. However, machine learning algorithms lack reliable estimates about their predictive uncertainty. This leads to wrong and overly-confident decisions when encountering classes unseen during training. Despite the importance of equipping classifiers with uncertainty estimates ready for the real world, prior work has focused on small datasets and little or no class discrepancy between training and testing data. To close this gap, we introduce UIMNET: a realistic, ImageNet-scale test-bed to evaluate predictive uncertainty estimates for deep image classifiers. Our benchmark provides implementations of eight state-of-the-art algorithms, six uncertainty measures, four in-domain metrics, three out-domain metrics, and a fully automated pipeline to train, calibrate, ensemble, select, and evaluate models. Our test-bed is open-source and all of our results are reproducible from a fixed commit in our repository. Adding new datasets, algorithms, measures, or metrics is a matter of a few lines of code-in so hoping that UIMNET becomes a stepping stone towards realistic, rigorous, and reproducible research in uncertainty estimation. Our results show that ensembles of ERM classifiers as well as single MIMO classifiers are the two best alternatives currently available to measure uncertainty about both in-domain and out-domain classes." @default.
- W3181617256 created "2021-07-19" @default.
- W3181617256 creator A5038858717 @default.
- W3181617256 creator A5087642472 @default.
- W3181617256 date "2021-07-13" @default.
- W3181617256 modified "2023-10-01" @default.
- W3181617256 title "What classifiers know what they don't?" @default.
- W3181617256 cites W1533861849 @default.
- W3181617256 cites W1618905105 @default.
- W3181617256 cites W1821462560 @default.
- W3181617256 cites W1945616565 @default.
- W3181617256 cites W1955857676 @default.
- W3181617256 cites W1994616650 @default.
- W3181617256 cites W1995875735 @default.
- W3181617256 cites W2016381774 @default.
- W3181617256 cites W2095705004 @default.
- W3181617256 cites W2097998348 @default.
- W3181617256 cites W2117539524 @default.
- W3181617256 cites W2183341477 @default.
- W3181617256 cites W2194775991 @default.
- W3181617256 cites W2724701856 @default.
- W3181617256 cites W2786622092 @default.
- W3181617256 cites W2893995718 @default.
- W3181617256 cites W2899205164 @default.
- W3181617256 cites W2903158431 @default.
- W3181617256 cites W2904422658 @default.
- W3181617256 cites W2910068345 @default.
- W3181617256 cites W2910781732 @default.
- W3181617256 cites W2952053192 @default.
- W3181617256 cites W2963060032 @default.
- W3181617256 cites W2963238274 @default.
- W3181617256 cites W2963836885 @default.
- W3181617256 cites W2963995504 @default.
- W3181617256 cites W2964059111 @default.
- W3181617256 cites W2964212410 @default.
- W3181617256 cites W2970859221 @default.
- W3181617256 cites W2970971581 @default.
- W3181617256 cites W3006511999 @default.
- W3181617256 cites W3035898727 @default.
- W3181617256 cites W3039431315 @default.
- W3181617256 cites W3102100346 @default.
- W3181617256 cites W3123454130 @default.
- W3181617256 cites W3129166376 @default.
- W3181617256 cites W3131119906 @default.
- W3181617256 cites W3177096435 @default.
- W3181617256 cites W94523489 @default.
- W3181617256 hasPublicationYear "2021" @default.
- W3181617256 type Work @default.
- W3181617256 sameAs 3181617256 @default.
- W3181617256 citedByCount "0" @default.
- W3181617256 crossrefType "posted-content" @default.
- W3181617256 hasAuthorship W3181617256A5038858717 @default.
- W3181617256 hasAuthorship W3181617256A5087642472 @default.
- W3181617256 hasConcept C111919701 @default.
- W3181617256 hasConcept C119857082 @default.
- W3181617256 hasConcept C124101348 @default.
- W3181617256 hasConcept C13280743 @default.
- W3181617256 hasConcept C134306372 @default.
- W3181617256 hasConcept C153180980 @default.
- W3181617256 hasConcept C154945302 @default.
- W3181617256 hasConcept C177264268 @default.
- W3181617256 hasConcept C185798385 @default.
- W3181617256 hasConcept C199360897 @default.
- W3181617256 hasConcept C205649164 @default.
- W3181617256 hasConcept C26517878 @default.
- W3181617256 hasConcept C26713055 @default.
- W3181617256 hasConcept C2776760102 @default.
- W3181617256 hasConcept C33923547 @default.
- W3181617256 hasConcept C36503486 @default.
- W3181617256 hasConcept C38652104 @default.
- W3181617256 hasConcept C41008148 @default.
- W3181617256 hasConcept C43126263 @default.
- W3181617256 hasConcept C43521106 @default.
- W3181617256 hasConcept C45942800 @default.
- W3181617256 hasConcept C77088390 @default.
- W3181617256 hasConceptScore W3181617256C111919701 @default.
- W3181617256 hasConceptScore W3181617256C119857082 @default.
- W3181617256 hasConceptScore W3181617256C124101348 @default.
- W3181617256 hasConceptScore W3181617256C13280743 @default.
- W3181617256 hasConceptScore W3181617256C134306372 @default.
- W3181617256 hasConceptScore W3181617256C153180980 @default.
- W3181617256 hasConceptScore W3181617256C154945302 @default.
- W3181617256 hasConceptScore W3181617256C177264268 @default.
- W3181617256 hasConceptScore W3181617256C185798385 @default.
- W3181617256 hasConceptScore W3181617256C199360897 @default.
- W3181617256 hasConceptScore W3181617256C205649164 @default.
- W3181617256 hasConceptScore W3181617256C26517878 @default.
- W3181617256 hasConceptScore W3181617256C26713055 @default.
- W3181617256 hasConceptScore W3181617256C2776760102 @default.
- W3181617256 hasConceptScore W3181617256C33923547 @default.
- W3181617256 hasConceptScore W3181617256C36503486 @default.
- W3181617256 hasConceptScore W3181617256C38652104 @default.
- W3181617256 hasConceptScore W3181617256C41008148 @default.
- W3181617256 hasConceptScore W3181617256C43126263 @default.
- W3181617256 hasConceptScore W3181617256C43521106 @default.
- W3181617256 hasConceptScore W3181617256C45942800 @default.
- W3181617256 hasConceptScore W3181617256C77088390 @default.
- W3181617256 hasLocation W31816172561 @default.
- W3181617256 hasOpenAccess W3181617256 @default.
- W3181617256 hasPrimaryLocation W31816172561 @default.