Matches in SemOpenAlex for { <https://semopenalex.org/work/W4380837998> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W4380837998 endingPage "90" @default.
- W4380837998 startingPage "75" @default.
- W4380837998 abstract "Supervised machine learning tasks require human-labeled data. Crowdsourcing allows scaling up the labeling process, but the quality of the labels obtained can vary. To address this limitation, we propose methods for predicting label quality based on worker trajectories, i.e., on the sequence of documents workers explore during their crowdsourcing tasks. Trajectories represent a lightweight and non-intrusive form of worker behavior signal. We base our analysis on previously collected datasets composed of thousands of assessment data records including information such as workers’ trajectories, workers’ assessments, and experts’ assessments. We model such behavior sequences as embeddings, to facilitate their management. Then, we: (1) use supervised methods to predict worker performance using a given ground truth; (2) perform an unsupervised analysis to provide insight into crowdsourcing quality when no gold standard is available. We test several supervised approaches which all beat the baseline we propose. Also, we identify significant differences between trajectory clusters in terms of assessments and worker performance. The trajectory-based analysis is a promising direction for non-intrusive worker performance evaluation." @default.
- W4380837998 created "2023-06-16" @default.
- W4380837998 creator A5031640844 @default.
- W4380837998 creator A5036715668 @default.
- W4380837998 creator A5050287516 @default.
- W4380837998 date "2023-01-01" @default.
- W4380837998 modified "2023-09-25" @default.
- W4380837998 title "Predicting Crowd Workers Performance: An Information Quality Case" @default.
- W4380837998 cites W1996422672 @default.
- W4380837998 cites W2046406837 @default.
- W4380837998 cites W2064675550 @default.
- W4380837998 cites W2089350162 @default.
- W4380837998 cites W2099391294 @default.
- W4380837998 cites W2120615054 @default.
- W4380837998 cites W2133084664 @default.
- W4380837998 cites W2143539737 @default.
- W4380837998 cites W2148143831 @default.
- W4380837998 cites W2157331557 @default.
- W4380837998 cites W2170375455 @default.
- W4380837998 cites W2303924600 @default.
- W4380837998 cites W2547891607 @default.
- W4380837998 cites W2890058952 @default.
- W4380837998 cites W2903257353 @default.
- W4380837998 cites W2919575471 @default.
- W4380837998 cites W2963196014 @default.
- W4380837998 cites W2963416784 @default.
- W4380837998 cites W2984100107 @default.
- W4380837998 cites W3016244823 @default.
- W4380837998 cites W3016364344 @default.
- W4380837998 cites W3094606341 @default.
- W4380837998 cites W3105289488 @default.
- W4380837998 cites W3105472188 @default.
- W4380837998 cites W3135175332 @default.
- W4380837998 cites W3160449963 @default.
- W4380837998 cites W4247185406 @default.
- W4380837998 doi "https://doi.org/10.1007/978-3-031-34444-2_6" @default.
- W4380837998 hasPublicationYear "2023" @default.
- W4380837998 type Work @default.
- W4380837998 citedByCount "0" @default.
- W4380837998 crossrefType "book-chapter" @default.
- W4380837998 hasAuthorship W4380837998A5031640844 @default.
- W4380837998 hasAuthorship W4380837998A5036715668 @default.
- W4380837998 hasAuthorship W4380837998A5050287516 @default.
- W4380837998 hasConcept C111472728 @default.
- W4380837998 hasConcept C119857082 @default.
- W4380837998 hasConcept C121332964 @default.
- W4380837998 hasConcept C124101348 @default.
- W4380837998 hasConcept C1276947 @default.
- W4380837998 hasConcept C13662910 @default.
- W4380837998 hasConcept C136764020 @default.
- W4380837998 hasConcept C138885662 @default.
- W4380837998 hasConcept C146849305 @default.
- W4380837998 hasConcept C154945302 @default.
- W4380837998 hasConcept C2779530757 @default.
- W4380837998 hasConcept C41008148 @default.
- W4380837998 hasConcept C62230096 @default.
- W4380837998 hasConceptScore W4380837998C111472728 @default.
- W4380837998 hasConceptScore W4380837998C119857082 @default.
- W4380837998 hasConceptScore W4380837998C121332964 @default.
- W4380837998 hasConceptScore W4380837998C124101348 @default.
- W4380837998 hasConceptScore W4380837998C1276947 @default.
- W4380837998 hasConceptScore W4380837998C13662910 @default.
- W4380837998 hasConceptScore W4380837998C136764020 @default.
- W4380837998 hasConceptScore W4380837998C138885662 @default.
- W4380837998 hasConceptScore W4380837998C146849305 @default.
- W4380837998 hasConceptScore W4380837998C154945302 @default.
- W4380837998 hasConceptScore W4380837998C2779530757 @default.
- W4380837998 hasConceptScore W4380837998C41008148 @default.
- W4380837998 hasConceptScore W4380837998C62230096 @default.
- W4380837998 hasLocation W43808379981 @default.
- W4380837998 hasOpenAccess W4380837998 @default.
- W4380837998 hasPrimaryLocation W43808379981 @default.
- W4380837998 hasRelatedWork W1676177962 @default.
- W4380837998 hasRelatedWork W2293193580 @default.
- W4380837998 hasRelatedWork W2589956745 @default.
- W4380837998 hasRelatedWork W2599286794 @default.
- W4380837998 hasRelatedWork W2827818489 @default.
- W4380837998 hasRelatedWork W2961085424 @default.
- W4380837998 hasRelatedWork W3129604848 @default.
- W4380837998 hasRelatedWork W4285326024 @default.
- W4380837998 hasRelatedWork W4288280590 @default.
- W4380837998 hasRelatedWork W4312126637 @default.
- W4380837998 isParatext "false" @default.
- W4380837998 isRetracted "false" @default.
- W4380837998 workType "book-chapter" @default.