Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385571444> ?p ?o ?g. }
Showing items 1 to 57 of
57
with 100 items per page.
- W4385571444 abstract "Linguistic annotations, especially for controversial topics like hate speech detection, are frequently contested due to annotator backgrounds and positionalities. In such situations, preserving this disagreement through the machine learning pipeline can be important for downstream use cases. However, capturing disagreement can increase annotation time and expense. Fortunately, for many tasks, not all examples are equally controversial; we develop an active learning approach, Disagreement Aware Active Learning (DAAL) that concentrates annotations on examples where model entropy and annotator entropy are the most different. Because we cannot know the true entropy of annotations on unlabeled examples, we estimate a model that predicts annotator entropy trained using very few multiply-labeled examples. We find that traditional uncertainty-based active learning underperforms simple passive learning on tasks with high levels of disagreement, but that our active learning approach is able to successfully improve on passive and active baselines, reducing the number of annotations required by at least 24% on average across several datasets." @default.
- W4385571444 created "2023-08-05" @default.
- W4385571444 creator A5017545687 @default.
- W4385571444 creator A5019928111 @default.
- W4385571444 creator A5023557405 @default.
- W4385571444 date "2023-01-01" @default.
- W4385571444 modified "2023-09-24" @default.
- W4385571444 title "Which Examples Should be Multiply Annotated? Active Learning When Annotators May Disagree" @default.
- W4385571444 doi "https://doi.org/10.18653/v1/2023.findings-acl.658" @default.
- W4385571444 hasPublicationYear "2023" @default.
- W4385571444 type Work @default.
- W4385571444 citedByCount "0" @default.
- W4385571444 crossrefType "proceedings-article" @default.
- W4385571444 hasAuthorship W4385571444A5017545687 @default.
- W4385571444 hasAuthorship W4385571444A5019928111 @default.
- W4385571444 hasAuthorship W4385571444A5023557405 @default.
- W4385571444 hasBestOaLocation W43855714441 @default.
- W4385571444 hasConcept C106301342 @default.
- W4385571444 hasConcept C119857082 @default.
- W4385571444 hasConcept C121332964 @default.
- W4385571444 hasConcept C154945302 @default.
- W4385571444 hasConcept C199360897 @default.
- W4385571444 hasConcept C204321447 @default.
- W4385571444 hasConcept C2776321320 @default.
- W4385571444 hasConcept C41008148 @default.
- W4385571444 hasConcept C43521106 @default.
- W4385571444 hasConcept C62520636 @default.
- W4385571444 hasConcept C77967617 @default.
- W4385571444 hasConcept C9679016 @default.
- W4385571444 hasConceptScore W4385571444C106301342 @default.
- W4385571444 hasConceptScore W4385571444C119857082 @default.
- W4385571444 hasConceptScore W4385571444C121332964 @default.
- W4385571444 hasConceptScore W4385571444C154945302 @default.
- W4385571444 hasConceptScore W4385571444C199360897 @default.
- W4385571444 hasConceptScore W4385571444C204321447 @default.
- W4385571444 hasConceptScore W4385571444C2776321320 @default.
- W4385571444 hasConceptScore W4385571444C41008148 @default.
- W4385571444 hasConceptScore W4385571444C43521106 @default.
- W4385571444 hasConceptScore W4385571444C62520636 @default.
- W4385571444 hasConceptScore W4385571444C77967617 @default.
- W4385571444 hasConceptScore W4385571444C9679016 @default.
- W4385571444 hasLocation W43855714441 @default.
- W4385571444 hasOpenAccess W4385571444 @default.
- W4385571444 hasPrimaryLocation W43855714441 @default.
- W4385571444 hasRelatedWork W2020540721 @default.
- W4385571444 hasRelatedWork W2294376144 @default.
- W4385571444 hasRelatedWork W2597787948 @default.
- W4385571444 hasRelatedWork W2624106077 @default.
- W4385571444 hasRelatedWork W2954428433 @default.
- W4385571444 hasRelatedWork W3025582806 @default.
- W4385571444 hasRelatedWork W3136151706 @default.
- W4385571444 hasRelatedWork W3196155444 @default.
- W4385571444 hasRelatedWork W3208584567 @default.
- W4385571444 hasRelatedWork W4366320140 @default.
- W4385571444 isParatext "false" @default.
- W4385571444 isRetracted "false" @default.
- W4385571444 workType "article" @default.