FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4319453786> ?p ?o ?g. }

• W4319453786 abstract "Human data labeling is an important and expensive task at the heart of supervised learning systems. Hierarchies help humans understand and organize concepts. We ask whether and how concept hierarchies can inform the design of annotation interfaces to improve labeling quality and efficiency. We study this question through annotation of vaccine misinformation, where the labeling task is difficult and highly subjective. We investigate 6 user interface designs for crowdsourcing hierarchical labels by collecting over 18,000 individual annotations. Under a fixed budget, integrating hierarchies into the design improves crowdsource workers’ F1 scores. We attribute this to (1) Grouping similar concepts, improving F1 scores by +0.16 over random groupings, (2) Strong relative performance on high-difficulty examples (relative F1 score difference of +0.40), and (3) Filtering out obvious negatives, increasing precision by +0.07. Ultimately, labeling schemes integrating the hierarchy outperform those that do not — achieving mean F1 of 0.70." @default.
• W4319453786 created "2023-02-09" @default.
• W4319453786 creator A5000189124 @default.
• W4319453786 creator A5055033421 @default.
• W4319453786 creator A5057334226 @default.
• W4319453786 date "2023-04-19" @default.
• W4319453786 modified "2023-10-18" @default.
• W4319453786 title "Interface Design for Crowdsourcing Hierarchical Multi-Label Text Annotations" @default.
• W4319453786 cites W1506491340 @default.
• W4319453786 cites W1573900212 @default.
• W4319453786 cites W1840435438 @default.
• W4319453786 cites W1973624057 @default.
• W4319453786 cites W2033354470 @default.
• W4319453786 cites W2072286734 @default.
• W4319453786 cites W2090628816 @default.
• W4319453786 cites W2103018059 @default.
• W4319453786 cites W2108598243 @default.
• W4319453786 cites W2112193291 @default.
• W4319453786 cites W2114122284 @default.
• W4319453786 cites W2120396827 @default.
• W4319453786 cites W2143890915 @default.
• W4319453786 cites W2147603330 @default.
• W4319453786 cites W2151401338 @default.
• W4319453786 cites W2161662762 @default.
• W4319453786 cites W2473938289 @default.
• W4319453786 cites W2487099897 @default.
• W4319453786 cites W2593116425 @default.
• W4319453786 cites W2611773602 @default.
• W4319453786 cites W2777095407 @default.
• W4319453786 cites W2797977484 @default.
• W4319453786 cites W2810732061 @default.
• W4319453786 cites W2941463876 @default.
• W4319453786 cites W2941505948 @default.
• W4319453786 cites W2963748441 @default.
• W4319453786 cites W2963846996 @default.
• W4319453786 cites W3028613655 @default.
• W4319453786 cites W3033305165 @default.
• W4319453786 cites W3104998832 @default.
• W4319453786 cites W4225083102 @default.
• W4319453786 cites W4288083516 @default.
• W4319453786 cites W9014458 @default.
• W4319453786 doi "https://doi.org/10.1145/3544548.3581431" @default.
• W4319453786 hasPublicationYear "2023" @default.
• W4319453786 type Work @default.
• W4319453786 citedByCount "0" @default.
• W4319453786 crossrefType "proceedings-article" @default.
• W4319453786 hasAuthorship W4319453786A5000189124 @default.
• W4319453786 hasAuthorship W4319453786A5055033421 @default.
• W4319453786 hasAuthorship W4319453786A5057334226 @default.
• W4319453786 hasBestOaLocation W43194537861 @default.
• W4319453786 hasConcept C107457646 @default.
• W4319453786 hasConcept C111472728 @default.
• W4319453786 hasConcept C113843644 @default.
• W4319453786 hasConcept C119857082 @default.
• W4319453786 hasConcept C129307140 @default.
• W4319453786 hasConcept C136264566 @default.
• W4319453786 hasConcept C136764020 @default.
• W4319453786 hasConcept C138885662 @default.
• W4319453786 hasConcept C154945302 @default.
• W4319453786 hasConcept C157915830 @default.
• W4319453786 hasConcept C162324750 @default.
• W4319453786 hasConcept C173608175 @default.
• W4319453786 hasConcept C187736073 @default.
• W4319453786 hasConcept C23123220 @default.
• W4319453786 hasConcept C2776321320 @default.
• W4319453786 hasConcept C2776990098 @default.
• W4319453786 hasConcept C2779530757 @default.
• W4319453786 hasConcept C2780451532 @default.
• W4319453786 hasConcept C31170391 @default.
• W4319453786 hasConcept C34447519 @default.
• W4319453786 hasConcept C38652104 @default.
• W4319453786 hasConcept C41008148 @default.
• W4319453786 hasConcept C62230096 @default.
• W4319453786 hasConcept C90329073 @default.
• W4319453786 hasConceptScore W4319453786C107457646 @default.
• W4319453786 hasConceptScore W4319453786C111472728 @default.
• W4319453786 hasConceptScore W4319453786C113843644 @default.
• W4319453786 hasConceptScore W4319453786C119857082 @default.
• W4319453786 hasConceptScore W4319453786C129307140 @default.
• W4319453786 hasConceptScore W4319453786C136264566 @default.
• W4319453786 hasConceptScore W4319453786C136764020 @default.
• W4319453786 hasConceptScore W4319453786C138885662 @default.
• W4319453786 hasConceptScore W4319453786C154945302 @default.
• W4319453786 hasConceptScore W4319453786C157915830 @default.
• W4319453786 hasConceptScore W4319453786C162324750 @default.
• W4319453786 hasConceptScore W4319453786C173608175 @default.
• W4319453786 hasConceptScore W4319453786C187736073 @default.
• W4319453786 hasConceptScore W4319453786C23123220 @default.
• W4319453786 hasConceptScore W4319453786C2776321320 @default.
• W4319453786 hasConceptScore W4319453786C2776990098 @default.
• W4319453786 hasConceptScore W4319453786C2779530757 @default.
• W4319453786 hasConceptScore W4319453786C2780451532 @default.
• W4319453786 hasConceptScore W4319453786C31170391 @default.
• W4319453786 hasConceptScore W4319453786C34447519 @default.
• W4319453786 hasConceptScore W4319453786C38652104 @default.
• W4319453786 hasConceptScore W4319453786C41008148 @default.
• W4319453786 hasConceptScore W4319453786C62230096 @default.
• W4319453786 hasConceptScore W4319453786C90329073 @default.
• W4319453786 hasFunder F4320306076 @default.
• W4319453786 hasFunder F4320309327 @default.

• next