Matches in SemOpenAlex for { <https://semopenalex.org/work/W3168591208> ?p ?o ?g. }
Showing items 1 to 97 of
97
with 100 items per page.
- W3168591208 abstract "With the increased interest in machine learning and big data problems, the need for large amounts of labelled data has also grown. However, it is often infeasible to get experts to label all of this data, which leads many practitioners to crowdsourcing solutions. In this paper, we present new techniques to improve the quality of the labels while attempting to reduce the cost. The naive approach to assigning labels is to adopt a majority vote method, however, in the context of data labelling, this is not always ideal as data labellers are not equally reliable. One might, instead, give higher priority to certain labellers through some kind of weighted vote based on past performance. This paper investigates the use of more sophisticated methods, such as Bayesian inference, to measure the performance of the labellers as well as the confidence of each label. The methods we propose follow an iterative improvement algorithm which attempts to use the least amount of workers necessary to achieve the desired confidence in the inferred label. This paper explores simulated binary classification problems with simulated workers and questions to test the proposed methods. Our methods outperform the standard voting methods in both cost and accuracy while maintaining higher reliability when there is disagreement within the crowd." @default.
- W3168591208 created "2021-06-22" @default.
- W3168591208 creator A5036726400 @default.
- W3168591208 creator A5073874507 @default.
- W3168591208 date "2020-01-01" @default.
- W3168591208 modified "2023-09-23" @default.
- W3168591208 title "Confident in the Crowd: Bayesian Inference to Improve Data Labelling in Crowdsourcing" @default.
- W3168591208 cites W1894564341 @default.
- W3168591208 cites W1970381522 @default.
- W3168591208 cites W2078503914 @default.
- W3168591208 cites W2108598243 @default.
- W3168591208 cites W2125943921 @default.
- W3168591208 cites W2129444086 @default.
- W3168591208 cites W4246070010 @default.
- W3168591208 doi "https://doi.org/10.1109/saupec/robmech/prasa48453.2020.9041099" @default.
- W3168591208 hasPublicationYear "2020" @default.
- W3168591208 type Work @default.
- W3168591208 sameAs 3168591208 @default.
- W3168591208 citedByCount "2" @default.
- W3168591208 countsByYear W31685912082021 @default.
- W3168591208 countsByYear W31685912082022 @default.
- W3168591208 crossrefType "proceedings-article" @default.
- W3168591208 hasAuthorship W3168591208A5036726400 @default.
- W3168591208 hasAuthorship W3168591208A5073874507 @default.
- W3168591208 hasBestOaLocation W31685912082 @default.
- W3168591208 hasConcept C107673813 @default.
- W3168591208 hasConcept C111472728 @default.
- W3168591208 hasConcept C119857082 @default.
- W3168591208 hasConcept C121332964 @default.
- W3168591208 hasConcept C12267149 @default.
- W3168591208 hasConcept C124101348 @default.
- W3168591208 hasConcept C136764020 @default.
- W3168591208 hasConcept C138885662 @default.
- W3168591208 hasConcept C151730666 @default.
- W3168591208 hasConcept C153668964 @default.
- W3168591208 hasConcept C154945302 @default.
- W3168591208 hasConcept C160234255 @default.
- W3168591208 hasConcept C163258240 @default.
- W3168591208 hasConcept C17744445 @default.
- W3168591208 hasConcept C199539241 @default.
- W3168591208 hasConcept C2776214188 @default.
- W3168591208 hasConcept C2779343474 @default.
- W3168591208 hasConcept C2779530757 @default.
- W3168591208 hasConcept C2780009758 @default.
- W3168591208 hasConcept C41008148 @default.
- W3168591208 hasConcept C43214815 @default.
- W3168591208 hasConcept C520049643 @default.
- W3168591208 hasConcept C62230096 @default.
- W3168591208 hasConcept C62520636 @default.
- W3168591208 hasConcept C66905080 @default.
- W3168591208 hasConcept C86803240 @default.
- W3168591208 hasConcept C94625758 @default.
- W3168591208 hasConceptScore W3168591208C107673813 @default.
- W3168591208 hasConceptScore W3168591208C111472728 @default.
- W3168591208 hasConceptScore W3168591208C119857082 @default.
- W3168591208 hasConceptScore W3168591208C121332964 @default.
- W3168591208 hasConceptScore W3168591208C12267149 @default.
- W3168591208 hasConceptScore W3168591208C124101348 @default.
- W3168591208 hasConceptScore W3168591208C136764020 @default.
- W3168591208 hasConceptScore W3168591208C138885662 @default.
- W3168591208 hasConceptScore W3168591208C151730666 @default.
- W3168591208 hasConceptScore W3168591208C153668964 @default.
- W3168591208 hasConceptScore W3168591208C154945302 @default.
- W3168591208 hasConceptScore W3168591208C160234255 @default.
- W3168591208 hasConceptScore W3168591208C163258240 @default.
- W3168591208 hasConceptScore W3168591208C17744445 @default.
- W3168591208 hasConceptScore W3168591208C199539241 @default.
- W3168591208 hasConceptScore W3168591208C2776214188 @default.
- W3168591208 hasConceptScore W3168591208C2779343474 @default.
- W3168591208 hasConceptScore W3168591208C2779530757 @default.
- W3168591208 hasConceptScore W3168591208C2780009758 @default.
- W3168591208 hasConceptScore W3168591208C41008148 @default.
- W3168591208 hasConceptScore W3168591208C43214815 @default.
- W3168591208 hasConceptScore W3168591208C520049643 @default.
- W3168591208 hasConceptScore W3168591208C62230096 @default.
- W3168591208 hasConceptScore W3168591208C62520636 @default.
- W3168591208 hasConceptScore W3168591208C66905080 @default.
- W3168591208 hasConceptScore W3168591208C86803240 @default.
- W3168591208 hasConceptScore W3168591208C94625758 @default.
- W3168591208 hasLocation W31685912081 @default.
- W3168591208 hasLocation W31685912082 @default.
- W3168591208 hasOpenAccess W3168591208 @default.
- W3168591208 hasPrimaryLocation W31685912081 @default.
- W3168591208 hasRelatedWork W1570705485 @default.
- W3168591208 hasRelatedWork W2018369380 @default.
- W3168591208 hasRelatedWork W2358243829 @default.
- W3168591208 hasRelatedWork W2807634467 @default.
- W3168591208 hasRelatedWork W2963058055 @default.
- W3168591208 hasRelatedWork W3029748970 @default.
- W3168591208 hasRelatedWork W3099352621 @default.
- W3168591208 hasRelatedWork W3161694777 @default.
- W3168591208 hasRelatedWork W3168591208 @default.
- W3168591208 hasRelatedWork W4287811188 @default.
- W3168591208 isParatext "false" @default.
- W3168591208 isRetracted "false" @default.
- W3168591208 magId "3168591208" @default.
- W3168591208 workType "article" @default.