Matches in SemOpenAlex for { <https://semopenalex.org/work/W2564143201> ?p ?o ?g. }
- W2564143201 endingPage "273" @default.
- W2564143201 startingPage "254" @default.
- W2564143201 abstract "Although it has become an accepted lay view that when labeling objects through crowdsourcing systems, non-expert annotators often exhibit biases, this argument lacks sufficient evidential observation and systematic empirical study. This paper initially analyzes eight real-world datasets from different domains whose class labels were collected from crowdsourcing systems. Our analyses show that biased labeling is a systematic tendency for binary categorization; in other words, for a large number of annotators, their labeling qualities on the negative class (supposed to be the majority) are significantly greater than are those on the positive class (minority). Therefore, the paper empirically studies the performance of four existing EM-based consensus algorithms, DS, GLAD, RY, and ZenCrowd, on these datasets. Our investigation shows that all of these state-of-the-art algorithms ignore the potential bias characteristics of datasets and perform badly although they model the complexity of the systems. To address the issue of handling biased labeling, the paper further proposes a novel consensus algorithm, namely adaptive weighted majority voting (AWMV), based on the statistical difference between the labeling qualities of the two classes. AWMV utilizes the frequency of positive labels in the multiple noisy label set of each example to obtain a bias rate and then assigns weights derived from the bias rate to negative and positive labels. Comparison results among the five consensus algorithms (AWMV and the four existing) show that the proposed AWMV algorithm has the best overall performance. Finally, this paper notes some potential related topics for future study." @default.
- W2564143201 created "2017-01-06" @default.
- W2564143201 creator A5014482509 @default.
- W2564143201 creator A5051706630 @default.
- W2564143201 creator A5054951713 @default.
- W2564143201 creator A5080738591 @default.
- W2564143201 creator A5090335612 @default.
- W2564143201 date "2017-03-01" @default.
- W2564143201 modified "2023-10-15" @default.
- W2564143201 title "Consensus algorithms for biased labeling in crowdsourcing" @default.
- W2564143201 cites W1972178156 @default.
- W2564143201 cites W1984439870 @default.
- W2564143201 cites W1986959058 @default.
- W2564143201 cites W2003433537 @default.
- W2564143201 cites W2020740057 @default.
- W2564143201 cites W2042230250 @default.
- W2564143201 cites W2042627297 @default.
- W2564143201 cites W2051404524 @default.
- W2564143201 cites W2061240977 @default.
- W2564143201 cites W2063606769 @default.
- W2564143201 cites W2093836791 @default.
- W2564143201 cites W2103318667 @default.
- W2564143201 cites W2137165445 @default.
- W2564143201 cites W2147687736 @default.
- W2564143201 cites W2330857546 @default.
- W2564143201 cites W906603025 @default.
- W2564143201 doi "https://doi.org/10.1016/j.ins.2016.12.026" @default.
- W2564143201 hasPublicationYear "2017" @default.
- W2564143201 type Work @default.
- W2564143201 sameAs 2564143201 @default.
- W2564143201 citedByCount "25" @default.
- W2564143201 countsByYear W25641432012017 @default.
- W2564143201 countsByYear W25641432012018 @default.
- W2564143201 countsByYear W25641432012019 @default.
- W2564143201 countsByYear W25641432012020 @default.
- W2564143201 countsByYear W25641432012021 @default.
- W2564143201 countsByYear W25641432012022 @default.
- W2564143201 countsByYear W25641432012023 @default.
- W2564143201 crossrefType "journal-article" @default.
- W2564143201 hasAuthorship W2564143201A5014482509 @default.
- W2564143201 hasAuthorship W2564143201A5051706630 @default.
- W2564143201 hasAuthorship W2564143201A5054951713 @default.
- W2564143201 hasAuthorship W2564143201A5080738591 @default.
- W2564143201 hasAuthorship W2564143201A5090335612 @default.
- W2564143201 hasBestOaLocation W25641432011 @default.
- W2564143201 hasConcept C11413529 @default.
- W2564143201 hasConcept C119857082 @default.
- W2564143201 hasConcept C124101348 @default.
- W2564143201 hasConcept C136764020 @default.
- W2564143201 hasConcept C153668964 @default.
- W2564143201 hasConcept C154945302 @default.
- W2564143201 hasConcept C177264268 @default.
- W2564143201 hasConcept C17744445 @default.
- W2564143201 hasConcept C199360897 @default.
- W2564143201 hasConcept C199539241 @default.
- W2564143201 hasConcept C2777212361 @default.
- W2564143201 hasConcept C40969351 @default.
- W2564143201 hasConcept C41008148 @default.
- W2564143201 hasConcept C520049643 @default.
- W2564143201 hasConcept C62230096 @default.
- W2564143201 hasConcept C94124525 @default.
- W2564143201 hasConcept C94625758 @default.
- W2564143201 hasConceptScore W2564143201C11413529 @default.
- W2564143201 hasConceptScore W2564143201C119857082 @default.
- W2564143201 hasConceptScore W2564143201C124101348 @default.
- W2564143201 hasConceptScore W2564143201C136764020 @default.
- W2564143201 hasConceptScore W2564143201C153668964 @default.
- W2564143201 hasConceptScore W2564143201C154945302 @default.
- W2564143201 hasConceptScore W2564143201C177264268 @default.
- W2564143201 hasConceptScore W2564143201C17744445 @default.
- W2564143201 hasConceptScore W2564143201C199360897 @default.
- W2564143201 hasConceptScore W2564143201C199539241 @default.
- W2564143201 hasConceptScore W2564143201C2777212361 @default.
- W2564143201 hasConceptScore W2564143201C40969351 @default.
- W2564143201 hasConceptScore W2564143201C41008148 @default.
- W2564143201 hasConceptScore W2564143201C520049643 @default.
- W2564143201 hasConceptScore W2564143201C62230096 @default.
- W2564143201 hasConceptScore W2564143201C94124525 @default.
- W2564143201 hasConceptScore W2564143201C94625758 @default.
- W2564143201 hasFunder F4320306076 @default.
- W2564143201 hasFunder F4320309350 @default.
- W2564143201 hasFunder F4320321001 @default.
- W2564143201 hasFunder F4320321106 @default.
- W2564143201 hasFunder F4320321543 @default.
- W2564143201 hasFunder F4320322769 @default.
- W2564143201 hasFunder F4320323191 @default.
- W2564143201 hasFunder F4320327015 @default.
- W2564143201 hasFunder F4320335473 @default.
- W2564143201 hasLocation W25641432011 @default.
- W2564143201 hasOpenAccess W2564143201 @default.
- W2564143201 hasPrimaryLocation W25641432011 @default.
- W2564143201 hasRelatedWork W1570705485 @default.
- W2564143201 hasRelatedWork W2590501763 @default.
- W2564143201 hasRelatedWork W3120199763 @default.
- W2564143201 hasRelatedWork W3128226684 @default.
- W2564143201 hasRelatedWork W3214187913 @default.
- W2564143201 hasRelatedWork W4225920875 @default.
- W2564143201 hasRelatedWork W4226500680 @default.