Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313429106> ?p ?o ?g. }
- W4313429106 endingPage "98" @default.
- W4313429106 startingPage "91" @default.
- W4313429106 abstract "Abstract We examined the trade-off between the cost of response redundancy and the gain in output quality on the popular crowdsourcing platform Mechanical Turk, as a partial replication of Kosinski et al. (2012) who demonstrated a significant improvement in performance by aggregating multiple responses through majority vote. We submitted single items from a validated intelligence test as Human Intelligence Tasks (HITs) and aggregated the responses from “virtual groups” consisting of 1 to 24 workers. While the original study relied on resampling from a relatively small number of responses across a range of experimental conditions, we randomly and independently sampled from a large number of HITs, focusing only on the main effect of group size. We found that – on average – a group of six MTurkers has a collective IQ one standard deviation above the mean for the general population, thus demonstrating a “wisdom of the crowd” effect. The relationship between group size and collective IQ was characterised by diminishing returns, suggesting moderately sized groups provide the best return on investment. We also analysed performance of a smaller subset of workers who had each completed all 60 test items, allowing for a direct comparison between a group’s collective IQ and the individual IQ of its members. This demonstrated that randomly selected groups collectively equalled the performance of the best-performing individual within the group. Our findings support the idea that substantial intellectual capacity can be gained through crowdsourcing, contingent on moderate redundancy built into the task request." @default.
- W4313429106 created "2023-01-06" @default.
- W4313429106 creator A5057958426 @default.
- W4313429106 creator A5058593368 @default.
- W4313429106 creator A5075577670 @default.
- W4313429106 date "2019-01-01" @default.
- W4313429106 modified "2023-10-17" @default.
- W4313429106 title "The collective intelligence of random small crowds: A partial replication of Kosinski et al. (2012)" @default.
- W4313429106 cites W1909793163 @default.
- W4313429106 cites W1973647728 @default.
- W4313429106 cites W1988027382 @default.
- W4313429106 cites W1988488214 @default.
- W4313429106 cites W1998351012 @default.
- W4313429106 cites W2022860576 @default.
- W4313429106 cites W2090021705 @default.
- W4313429106 cites W2103311328 @default.
- W4313429106 cites W2108920669 @default.
- W4313429106 cites W2110428143 @default.
- W4313429106 cites W2120220258 @default.
- W4313429106 cites W2121317744 @default.
- W4313429106 cites W2141708418 @default.
- W4313429106 cites W2194225532 @default.
- W4313429106 cites W2481585384 @default.
- W4313429106 cites W2485219250 @default.
- W4313429106 cites W2492721440 @default.
- W4313429106 cites W2602915403 @default.
- W4313429106 cites W2741638098 @default.
- W4313429106 cites W2783946743 @default.
- W4313429106 cites W2794871313 @default.
- W4313429106 cites W2964044304 @default.
- W4313429106 cites W4249247059 @default.
- W4313429106 cites W4249671859 @default.
- W4313429106 doi "https://doi.org/10.1017/s1930297500002941" @default.
- W4313429106 hasPublicationYear "2019" @default.
- W4313429106 type Work @default.
- W4313429106 citedByCount "6" @default.
- W4313429106 countsByYear W43134291062021 @default.
- W4313429106 countsByYear W43134291062022 @default.
- W4313429106 crossrefType "journal-article" @default.
- W4313429106 hasAuthorship W4313429106A5057958426 @default.
- W4313429106 hasAuthorship W4313429106A5058593368 @default.
- W4313429106 hasAuthorship W4313429106A5075577670 @default.
- W4313429106 hasBestOaLocation W43134291061 @default.
- W4313429106 hasConcept C105409693 @default.
- W4313429106 hasConcept C105795698 @default.
- W4313429106 hasConcept C12590798 @default.
- W4313429106 hasConcept C136764020 @default.
- W4313429106 hasConcept C138496976 @default.
- W4313429106 hasConcept C144024400 @default.
- W4313429106 hasConcept C149923435 @default.
- W4313429106 hasConcept C154945302 @default.
- W4313429106 hasConcept C15744967 @default.
- W4313429106 hasConcept C166047926 @default.
- W4313429106 hasConcept C169760540 @default.
- W4313429106 hasConcept C169900460 @default.
- W4313429106 hasConcept C2777852691 @default.
- W4313429106 hasConcept C2908647359 @default.
- W4313429106 hasConcept C33923547 @default.
- W4313429106 hasConcept C41008148 @default.
- W4313429106 hasConcept C62230096 @default.
- W4313429106 hasConcept C77805123 @default.
- W4313429106 hasConcept C89057211 @default.
- W4313429106 hasConceptScore W4313429106C105409693 @default.
- W4313429106 hasConceptScore W4313429106C105795698 @default.
- W4313429106 hasConceptScore W4313429106C12590798 @default.
- W4313429106 hasConceptScore W4313429106C136764020 @default.
- W4313429106 hasConceptScore W4313429106C138496976 @default.
- W4313429106 hasConceptScore W4313429106C144024400 @default.
- W4313429106 hasConceptScore W4313429106C149923435 @default.
- W4313429106 hasConceptScore W4313429106C154945302 @default.
- W4313429106 hasConceptScore W4313429106C15744967 @default.
- W4313429106 hasConceptScore W4313429106C166047926 @default.
- W4313429106 hasConceptScore W4313429106C169760540 @default.
- W4313429106 hasConceptScore W4313429106C169900460 @default.
- W4313429106 hasConceptScore W4313429106C2777852691 @default.
- W4313429106 hasConceptScore W4313429106C2908647359 @default.
- W4313429106 hasConceptScore W4313429106C33923547 @default.
- W4313429106 hasConceptScore W4313429106C41008148 @default.
- W4313429106 hasConceptScore W4313429106C62230096 @default.
- W4313429106 hasConceptScore W4313429106C77805123 @default.
- W4313429106 hasConceptScore W4313429106C89057211 @default.
- W4313429106 hasIssue "1" @default.
- W4313429106 hasLocation W43134291061 @default.
- W4313429106 hasOpenAccess W4313429106 @default.
- W4313429106 hasPrimaryLocation W43134291061 @default.
- W4313429106 hasRelatedWork W2111272196 @default.
- W4313429106 hasRelatedWork W2219884891 @default.
- W4313429106 hasRelatedWork W2396629831 @default.
- W4313429106 hasRelatedWork W2585365755 @default.
- W4313429106 hasRelatedWork W2733100391 @default.
- W4313429106 hasRelatedWork W2748952813 @default.
- W4313429106 hasRelatedWork W2899084033 @default.
- W4313429106 hasRelatedWork W3030635495 @default.
- W4313429106 hasRelatedWork W3125858509 @default.
- W4313429106 hasRelatedWork W4292974386 @default.
- W4313429106 hasVolume "14" @default.
- W4313429106 isParatext "false" @default.
- W4313429106 isRetracted "false" @default.