Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387389915> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W4387389915 abstract "Errors in labels obtained via human annotation adversely affect a model's performance. Existing approaches propose ways to mitigate the effect of label error on a model's downstream accuracy, yet little is known about its impact on a model's disparity metrics. Here we study the effect of label error on a model's disparity metrics. We empirically characterize how varying levels of label error, in both training and test data, affect these disparity metrics. We find that group calibration and other metrics are sensitive to train-time and test-time label error -- particularly for minority groups. This disparate effect persists even for models trained with noise-aware algorithms. To mitigate the impact of training-time label error, we present an approach to estimate the influence of a training input's label on a model's group disparity metric. We empirically assess the proposed approach on a variety of datasets and find significant improvement, compared to alternative approaches, in identifying training inputs that improve a model's disparity metric. We complement the approach with an automatic relabel-and-finetune scheme that produces updated models with, provably, improved group calibration error." @default.
- W4387389915 created "2023-10-06" @default.
- W4387389915 creator A5022660879 @default.
- W4387389915 creator A5031506278 @default.
- W4387389915 creator A5036491871 @default.
- W4387389915 creator A5051670362 @default.
- W4387389915 date "2023-10-03" @default.
- W4387389915 modified "2023-10-07" @default.
- W4387389915 title "Quantifying and mitigating the impact of label errors on model disparity metrics" @default.
- W4387389915 doi "https://doi.org/10.48550/arxiv.2310.02533" @default.
- W4387389915 hasPublicationYear "2023" @default.
- W4387389915 type Work @default.
- W4387389915 citedByCount "0" @default.
- W4387389915 crossrefType "posted-content" @default.
- W4387389915 hasAuthorship W4387389915A5022660879 @default.
- W4387389915 hasAuthorship W4387389915A5031506278 @default.
- W4387389915 hasAuthorship W4387389915A5036491871 @default.
- W4387389915 hasAuthorship W4387389915A5051670362 @default.
- W4387389915 hasBestOaLocation W43873899151 @default.
- W4387389915 hasConcept C104317684 @default.
- W4387389915 hasConcept C105795698 @default.
- W4387389915 hasConcept C112313634 @default.
- W4387389915 hasConcept C115961682 @default.
- W4387389915 hasConcept C119857082 @default.
- W4387389915 hasConcept C124101348 @default.
- W4387389915 hasConcept C127716648 @default.
- W4387389915 hasConcept C136197465 @default.
- W4387389915 hasConcept C154945302 @default.
- W4387389915 hasConcept C162324750 @default.
- W4387389915 hasConcept C165838908 @default.
- W4387389915 hasConcept C176217482 @default.
- W4387389915 hasConcept C185592680 @default.
- W4387389915 hasConcept C187736073 @default.
- W4387389915 hasConcept C188082640 @default.
- W4387389915 hasConcept C21547014 @default.
- W4387389915 hasConcept C2780898871 @default.
- W4387389915 hasConcept C33923547 @default.
- W4387389915 hasConcept C41008148 @default.
- W4387389915 hasConcept C55493867 @default.
- W4387389915 hasConcept C99498987 @default.
- W4387389915 hasConceptScore W4387389915C104317684 @default.
- W4387389915 hasConceptScore W4387389915C105795698 @default.
- W4387389915 hasConceptScore W4387389915C112313634 @default.
- W4387389915 hasConceptScore W4387389915C115961682 @default.
- W4387389915 hasConceptScore W4387389915C119857082 @default.
- W4387389915 hasConceptScore W4387389915C124101348 @default.
- W4387389915 hasConceptScore W4387389915C127716648 @default.
- W4387389915 hasConceptScore W4387389915C136197465 @default.
- W4387389915 hasConceptScore W4387389915C154945302 @default.
- W4387389915 hasConceptScore W4387389915C162324750 @default.
- W4387389915 hasConceptScore W4387389915C165838908 @default.
- W4387389915 hasConceptScore W4387389915C176217482 @default.
- W4387389915 hasConceptScore W4387389915C185592680 @default.
- W4387389915 hasConceptScore W4387389915C187736073 @default.
- W4387389915 hasConceptScore W4387389915C188082640 @default.
- W4387389915 hasConceptScore W4387389915C21547014 @default.
- W4387389915 hasConceptScore W4387389915C2780898871 @default.
- W4387389915 hasConceptScore W4387389915C33923547 @default.
- W4387389915 hasConceptScore W4387389915C41008148 @default.
- W4387389915 hasConceptScore W4387389915C55493867 @default.
- W4387389915 hasConceptScore W4387389915C99498987 @default.
- W4387389915 hasLocation W43873899151 @default.
- W4387389915 hasOpenAccess W4387389915 @default.
- W4387389915 hasPrimaryLocation W43873899151 @default.
- W4387389915 hasRelatedWork W2018387840 @default.
- W4387389915 hasRelatedWork W2045629210 @default.
- W4387389915 hasRelatedWork W2087870008 @default.
- W4387389915 hasRelatedWork W2107419853 @default.
- W4387389915 hasRelatedWork W2142113611 @default.
- W4387389915 hasRelatedWork W2143024819 @default.
- W4387389915 hasRelatedWork W2162534555 @default.
- W4387389915 hasRelatedWork W2334467465 @default.
- W4387389915 hasRelatedWork W2964201926 @default.
- W4387389915 hasRelatedWork W4361804730 @default.
- W4387389915 isParatext "false" @default.
- W4387389915 isRetracted "false" @default.
- W4387389915 workType "article" @default.