Matches in SemOpenAlex for { <https://semopenalex.org/work/W2892028841> ?p ?o ?g. }
- W2892028841 endingPage "210" @default.
- W2892028841 startingPage "198" @default.
- W2892028841 abstract "The quality of crowdsourced work varies drastically from superior to inferior. As a consequence, the problem of automatically finding high-quality crowdsourced work is of great importance. A variety of aggregation methods have been proposed for multiple-choice tasks such as item labeling with structured claims. However, they do not apply to more general tasks, such as article writing and brand design, with unstructured submissions that cannot be aggregated. Recent work tackles this problem by asking another set of crowd workers to review and grade each submission, essentially transforming unstructured submissions into structured ratings that can be aggregated. Nevertheless, such an approach incurs unnecessary monetary cost and delay. In this paper, we address this problem by exploiting task requesters’ historical feedback and directly modeling the submission quality, without the need of additional crowdsourced ratings. We first propose three sets of features, which try to characterize the submission quality from various perspectives, including the submissions themselves, the workers who make the submissions, and the interactions between task requesters and workers. We then propose two quality models, where one judges the submission quality independently and the other judges comparatively. These models not only incorporate features, but also take worker-specific factors into consideration. Experimental results on three large-scale data sets demonstrate that our models outperform general-purpose learning-to-rank methods such as Logistic Regression, RankBoost, and ListNet for finding high-quality crowdsourced submissions." @default.
- W2892028841 created "2018-09-27" @default.
- W2892028841 creator A5029998682 @default.
- W2892028841 creator A5058895300 @default.
- W2892028841 creator A5080150537 @default.
- W2892028841 creator A5085170454 @default.
- W2892028841 date "2018-01-01" @default.
- W2892028841 modified "2023-09-25" @default.
- W2892028841 title "Finding High-Quality Unstructured Submissions in General Crowdsourcing Tasks" @default.
- W2892028841 cites W2012638909 @default.
- W2892028841 cites W2040557557 @default.
- W2892028841 cites W2108862644 @default.
- W2892028841 cites W2123326341 @default.
- W2892028841 cites W2138621811 @default.
- W2892028841 cites W2141649520 @default.
- W2892028841 cites W2142537246 @default.
- W2892028841 cites W2143331230 @default.
- W2892028841 cites W2151401338 @default.
- W2892028841 cites W2170989440 @default.
- W2892028841 cites W2293794854 @default.
- W2892028841 cites W2303476400 @default.
- W2892028841 cites W2604943478 @default.
- W2892028841 cites W4302313152 @default.
- W2892028841 doi "https://doi.org/10.1007/978-3-030-01012-6_16" @default.
- W2892028841 hasPublicationYear "2018" @default.
- W2892028841 type Work @default.
- W2892028841 sameAs 2892028841 @default.
- W2892028841 citedByCount "2" @default.
- W2892028841 countsByYear W28920288412019 @default.
- W2892028841 countsByYear W28920288412021 @default.
- W2892028841 crossrefType "book-chapter" @default.
- W2892028841 hasAuthorship W2892028841A5029998682 @default.
- W2892028841 hasAuthorship W2892028841A5058895300 @default.
- W2892028841 hasAuthorship W2892028841A5080150537 @default.
- W2892028841 hasAuthorship W2892028841A5085170454 @default.
- W2892028841 hasConcept C111472728 @default.
- W2892028841 hasConcept C114614502 @default.
- W2892028841 hasConcept C119857082 @default.
- W2892028841 hasConcept C121332964 @default.
- W2892028841 hasConcept C136197465 @default.
- W2892028841 hasConcept C136764020 @default.
- W2892028841 hasConcept C138885662 @default.
- W2892028841 hasConcept C154945302 @default.
- W2892028841 hasConcept C162324750 @default.
- W2892028841 hasConcept C164226766 @default.
- W2892028841 hasConcept C177264268 @default.
- W2892028841 hasConcept C187736073 @default.
- W2892028841 hasConcept C199360897 @default.
- W2892028841 hasConcept C23123220 @default.
- W2892028841 hasConcept C2522767166 @default.
- W2892028841 hasConcept C2778755073 @default.
- W2892028841 hasConcept C2779530757 @default.
- W2892028841 hasConcept C2780451532 @default.
- W2892028841 hasConcept C33923547 @default.
- W2892028841 hasConcept C41008148 @default.
- W2892028841 hasConcept C62230096 @default.
- W2892028841 hasConcept C62520636 @default.
- W2892028841 hasConceptScore W2892028841C111472728 @default.
- W2892028841 hasConceptScore W2892028841C114614502 @default.
- W2892028841 hasConceptScore W2892028841C119857082 @default.
- W2892028841 hasConceptScore W2892028841C121332964 @default.
- W2892028841 hasConceptScore W2892028841C136197465 @default.
- W2892028841 hasConceptScore W2892028841C136764020 @default.
- W2892028841 hasConceptScore W2892028841C138885662 @default.
- W2892028841 hasConceptScore W2892028841C154945302 @default.
- W2892028841 hasConceptScore W2892028841C162324750 @default.
- W2892028841 hasConceptScore W2892028841C164226766 @default.
- W2892028841 hasConceptScore W2892028841C177264268 @default.
- W2892028841 hasConceptScore W2892028841C187736073 @default.
- W2892028841 hasConceptScore W2892028841C199360897 @default.
- W2892028841 hasConceptScore W2892028841C23123220 @default.
- W2892028841 hasConceptScore W2892028841C2522767166 @default.
- W2892028841 hasConceptScore W2892028841C2778755073 @default.
- W2892028841 hasConceptScore W2892028841C2779530757 @default.
- W2892028841 hasConceptScore W2892028841C2780451532 @default.
- W2892028841 hasConceptScore W2892028841C33923547 @default.
- W2892028841 hasConceptScore W2892028841C41008148 @default.
- W2892028841 hasConceptScore W2892028841C62230096 @default.
- W2892028841 hasConceptScore W2892028841C62520636 @default.
- W2892028841 hasLocation W28920288411 @default.
- W2892028841 hasOpenAccess W2892028841 @default.
- W2892028841 hasPrimaryLocation W28920288411 @default.
- W2892028841 hasRelatedWork W1490042757 @default.
- W2892028841 hasRelatedWork W2073887333 @default.
- W2892028841 hasRelatedWork W2125913763 @default.
- W2892028841 hasRelatedWork W2187291759 @default.
- W2892028841 hasRelatedWork W2189298492 @default.
- W2892028841 hasRelatedWork W2191247780 @default.
- W2892028841 hasRelatedWork W2563948597 @default.
- W2892028841 hasRelatedWork W2604614524 @default.
- W2892028841 hasRelatedWork W2611228204 @default.
- W2892028841 hasRelatedWork W2738412431 @default.
- W2892028841 hasRelatedWork W2773800057 @default.
- W2892028841 hasRelatedWork W2785592348 @default.
- W2892028841 hasRelatedWork W2802929914 @default.
- W2892028841 hasRelatedWork W2805618604 @default.
- W2892028841 hasRelatedWork W2912987022 @default.
- W2892028841 hasRelatedWork W2988423731 @default.