FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2040557557> ?p ?o ?g. }

• W2040557557 abstract "Crowdsourcing is the de-facto standard for gathering annotated data. While, in theory, data annotation tasks are assumed to be attempted by workers independently, in practice, data annotation tasks are often grouped into batches to be presented and annotated by workers together, in order to save on the time or cost overhead of providing instructions or necessary background. Thus, even though independence is usually assumed between annotations on data items within the same batch, in most cases, a worker's judgment on a data item can still be affected by other data items within the batch, leading to additional errors in collected labels. In this paper, we study the data annotation bias when data items are presented as batches to be judged by workers simultaneously. We propose a novel worker model to characterize the annotating behavior on data batches, and present how to train the worker model on annotation data sets. We also present a debiasing technique to remove the effect of such annotation bias from adversely affecting the accuracy of labels obtained. Our experimental results on synthetic and real-world data sets demonstrate that our proposed method can achieve up to +57% improvement in F1-score compared to the standard majority voting baseline." @default.
• W2040557557 created "2016-06-24" @default.
• W2040557557 creator A5011279860 @default.
• W2040557557 creator A5013608601 @default.
• W2040557557 creator A5019539533 @default.
• W2040557557 creator A5023802054 @default.
• W2040557557 date "2015-08-10" @default.
• W2040557557 modified "2023-09-23" @default.
• W2040557557 title "Debiasing Crowdsourced Batches" @default.
• W2040557557 cites W1584070893 @default.
• W2040557557 cites W1967899171 @default.
• W2040557557 cites W1980125555 @default.
• W2040557557 cites W2010135967 @default.
• W2040557557 cites W2013784666 @default.
• W2040557557 cites W2051275384 @default.
• W2040557557 cites W2051834357 @default.
• W2040557557 cites W2058892254 @default.
• W2040557557 cites W2062236692 @default.
• W2040557557 cites W2071446250 @default.
• W2040557557 cites W2094607109 @default.
• W2040557557 cites W2125943921 @default.
• W2040557557 cites W2132232498 @default.
• W2040557557 cites W2132300069 @default.
• W2040557557 cites W2134305421 @default.
• W2040557557 cites W2141649520 @default.
• W2040557557 cites W2145492473 @default.
• W2040557557 cites W2145680575 @default.
• W2040557557 cites W2164545125 @default.
• W2040557557 cites W2170931744 @default.
• W2040557557 doi "https://doi.org/10.1145/2783258.2783316" @default.
• W2040557557 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/4691348" @default.
• W2040557557 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/26713175" @default.
• W2040557557 hasPublicationYear "2015" @default.
• W2040557557 type Work @default.
• W2040557557 sameAs 2040557557 @default.
• W2040557557 citedByCount "18" @default.
• W2040557557 countsByYear W20405575572015 @default.
• W2040557557 countsByYear W20405575572016 @default.
• W2040557557 countsByYear W20405575572017 @default.
• W2040557557 countsByYear W20405575572018 @default.
• W2040557557 countsByYear W20405575572019 @default.
• W2040557557 countsByYear W20405575572020 @default.
• W2040557557 countsByYear W20405575572021 @default.
• W2040557557 countsByYear W20405575572022 @default.
• W2040557557 crossrefType "proceedings-article" @default.
• W2040557557 hasAuthorship W2040557557A5011279860 @default.
• W2040557557 hasAuthorship W2040557557A5013608601 @default.
• W2040557557 hasAuthorship W2040557557A5019539533 @default.
• W2040557557 hasAuthorship W2040557557A5023802054 @default.
• W2040557557 hasBestOaLocation W20405575572 @default.
• W2040557557 hasConcept C111919701 @default.
• W2040557557 hasConcept C124101348 @default.
• W2040557557 hasConcept C136764020 @default.
• W2040557557 hasConcept C153668964 @default.
• W2040557557 hasConcept C154945302 @default.
• W2040557557 hasConcept C15744967 @default.
• W2040557557 hasConcept C17744445 @default.
• W2040557557 hasConcept C188147891 @default.
• W2040557557 hasConcept C199539241 @default.
• W2040557557 hasConcept C23123220 @default.
• W2040557557 hasConcept C2776321320 @default.
• W2040557557 hasConcept C2779458634 @default.
• W2040557557 hasConcept C2779960059 @default.
• W2040557557 hasConcept C41008148 @default.
• W2040557557 hasConcept C520049643 @default.
• W2040557557 hasConcept C62230096 @default.
• W2040557557 hasConcept C94625758 @default.
• W2040557557 hasConceptScore W2040557557C111919701 @default.
• W2040557557 hasConceptScore W2040557557C124101348 @default.
• W2040557557 hasConceptScore W2040557557C136764020 @default.
• W2040557557 hasConceptScore W2040557557C153668964 @default.
• W2040557557 hasConceptScore W2040557557C154945302 @default.
• W2040557557 hasConceptScore W2040557557C15744967 @default.
• W2040557557 hasConceptScore W2040557557C17744445 @default.
• W2040557557 hasConceptScore W2040557557C188147891 @default.
• W2040557557 hasConceptScore W2040557557C199539241 @default.
• W2040557557 hasConceptScore W2040557557C23123220 @default.
• W2040557557 hasConceptScore W2040557557C2776321320 @default.
• W2040557557 hasConceptScore W2040557557C2779458634 @default.
• W2040557557 hasConceptScore W2040557557C2779960059 @default.
• W2040557557 hasConceptScore W2040557557C41008148 @default.
• W2040557557 hasConceptScore W2040557557C520049643 @default.
• W2040557557 hasConceptScore W2040557557C62230096 @default.
• W2040557557 hasConceptScore W2040557557C94625758 @default.
• W2040557557 hasFunder F4320306076 @default.
• W2040557557 hasFunder F4320309327 @default.
• W2040557557 hasFunder F4320332161 @default.
• W2040557557 hasLocation W20405575571 @default.
• W2040557557 hasLocation W20405575572 @default.
• W2040557557 hasLocation W20405575573 @default.
• W2040557557 hasLocation W20405575574 @default.
• W2040557557 hasLocation W20405575575 @default.
• W2040557557 hasOpenAccess W2040557557 @default.
• W2040557557 hasPrimaryLocation W20405575571 @default.
• W2040557557 hasRelatedWork W1570705485 @default.
• W2040557557 hasRelatedWork W2040557557 @default.
• W2040557557 hasRelatedWork W2110165259 @default.
• W2040557557 hasRelatedWork W2212913949 @default.
• W2040557557 hasRelatedWork W2807634467 @default.
• W2040557557 hasRelatedWork W2962788669 @default.

• next