Matches in SemOpenAlex for { <https://semopenalex.org/work/W4207035788> ?p ?o ?g. }
- W4207035788 abstract "Annotation quality and quantity positively affect the learning performance of sequence labeling, a vital task in Natural Language Processing. Hiring domain experts to annotate a corpus is very costly in terms of money and time. Crowdsourcing platforms, such as Amazon Mechanical Turk (AMT), have been deployed to assist in this purpose. However, the annotations collected this way are prone to human errors due to the lack of expertise of the crowd workers. Existing literature in annotation aggregation assumes that annotations are independent and thus faces challenges when handling the sequential label aggregation tasks with complex dependencies. To conquer the challenges, we propose an optimization-based method that infers the ground truth labels using annotations provided by workers for sequential labeling tasks. The proposed Aggregation method for Sequential Labels from Crowds (AggSLC) jointly considers the characteristics of sequential labeling tasks, workers’ reliabilities, and advanced machine learning techniques. Theoretical analysis on the algorithm’s convergence further demonstrates that the proposed AggSLC halts after a finite number of iterations. We evaluate AggSLC on different crowdsourced datasets for Named Entity Recognition (NER) tasks and Information Extraction tasks in biomedical (PICO), as well as a simulated dataset. Our results show that the proposed method outperforms the state-of-the-art aggregation methods. To achieve insights into the framework, we study the effectiveness of AggSLC’s components through ablation studies." @default.
- W4207035788 created "2022-01-26" @default.
- W4207035788 creator A5024785349 @default.
- W4207035788 creator A5035086694 @default.
- W4207035788 creator A5059414281 @default.
- W4207035788 creator A5086423832 @default.
- W4207035788 date "2021-12-01" @default.
- W4207035788 modified "2023-10-16" @default.
- W4207035788 title "Truth Discovery in Sequence Labels from Crowds" @default.
- W4207035788 cites W1540764732 @default.
- W4207035788 cites W1541280084 @default.
- W4207035788 cites W1607983314 @default.
- W4207035788 cites W1914338220 @default.
- W4207035788 cites W1970381522 @default.
- W4207035788 cites W1985690171 @default.
- W4207035788 cites W2006277118 @default.
- W4207035788 cites W2067633806 @default.
- W4207035788 cites W2086413055 @default.
- W4207035788 cites W2105594594 @default.
- W4207035788 cites W2112511942 @default.
- W4207035788 cites W2118388899 @default.
- W4207035788 cites W2124219775 @default.
- W4207035788 cites W2152540201 @default.
- W4207035788 cites W2167460663 @default.
- W4207035788 cites W2290431464 @default.
- W4207035788 cites W2296283641 @default.
- W4207035788 cites W2339885376 @default.
- W4207035788 cites W2475282416 @default.
- W4207035788 cites W2516936571 @default.
- W4207035788 cites W2547925235 @default.
- W4207035788 cites W2585226541 @default.
- W4207035788 cites W2740579382 @default.
- W4207035788 cites W2799272162 @default.
- W4207035788 cites W2907385172 @default.
- W4207035788 cites W2936503027 @default.
- W4207035788 cites W2951631206 @default.
- W4207035788 cites W2963509340 @default.
- W4207035788 cites W2971299805 @default.
- W4207035788 cites W2979302305 @default.
- W4207035788 cites W2981873476 @default.
- W4207035788 cites W3026908503 @default.
- W4207035788 cites W3102171573 @default.
- W4207035788 cites W4293409613 @default.
- W4207035788 cites W9014458 @default.
- W4207035788 doi "https://doi.org/10.1109/icdm51629.2021.00065" @default.
- W4207035788 hasPublicationYear "2021" @default.
- W4207035788 type Work @default.
- W4207035788 citedByCount "6" @default.
- W4207035788 countsByYear W42070357882022 @default.
- W4207035788 countsByYear W42070357882023 @default.
- W4207035788 crossrefType "proceedings-article" @default.
- W4207035788 hasAuthorship W4207035788A5024785349 @default.
- W4207035788 hasAuthorship W4207035788A5035086694 @default.
- W4207035788 hasAuthorship W4207035788A5059414281 @default.
- W4207035788 hasAuthorship W4207035788A5086423832 @default.
- W4207035788 hasBestOaLocation W42070357882 @default.
- W4207035788 hasConcept C119857082 @default.
- W4207035788 hasConcept C134306372 @default.
- W4207035788 hasConcept C136764020 @default.
- W4207035788 hasConcept C138885662 @default.
- W4207035788 hasConcept C146849305 @default.
- W4207035788 hasConcept C154945302 @default.
- W4207035788 hasConcept C162324750 @default.
- W4207035788 hasConcept C187736073 @default.
- W4207035788 hasConcept C204321447 @default.
- W4207035788 hasConcept C23123220 @default.
- W4207035788 hasConcept C2776321320 @default.
- W4207035788 hasConcept C2777852691 @default.
- W4207035788 hasConcept C2778112365 @default.
- W4207035788 hasConcept C2779135771 @default.
- W4207035788 hasConcept C2780451532 @default.
- W4207035788 hasConcept C33923547 @default.
- W4207035788 hasConcept C35639132 @default.
- W4207035788 hasConcept C36503486 @default.
- W4207035788 hasConcept C38652104 @default.
- W4207035788 hasConcept C41008148 @default.
- W4207035788 hasConcept C41895202 @default.
- W4207035788 hasConcept C54355233 @default.
- W4207035788 hasConcept C62230096 @default.
- W4207035788 hasConcept C86803240 @default.
- W4207035788 hasConcept C90805587 @default.
- W4207035788 hasConceptScore W4207035788C119857082 @default.
- W4207035788 hasConceptScore W4207035788C134306372 @default.
- W4207035788 hasConceptScore W4207035788C136764020 @default.
- W4207035788 hasConceptScore W4207035788C138885662 @default.
- W4207035788 hasConceptScore W4207035788C146849305 @default.
- W4207035788 hasConceptScore W4207035788C154945302 @default.
- W4207035788 hasConceptScore W4207035788C162324750 @default.
- W4207035788 hasConceptScore W4207035788C187736073 @default.
- W4207035788 hasConceptScore W4207035788C204321447 @default.
- W4207035788 hasConceptScore W4207035788C23123220 @default.
- W4207035788 hasConceptScore W4207035788C2776321320 @default.
- W4207035788 hasConceptScore W4207035788C2777852691 @default.
- W4207035788 hasConceptScore W4207035788C2778112365 @default.
- W4207035788 hasConceptScore W4207035788C2779135771 @default.
- W4207035788 hasConceptScore W4207035788C2780451532 @default.
- W4207035788 hasConceptScore W4207035788C33923547 @default.
- W4207035788 hasConceptScore W4207035788C35639132 @default.
- W4207035788 hasConceptScore W4207035788C36503486 @default.
- W4207035788 hasConceptScore W4207035788C38652104 @default.