Matches in SemOpenAlex for { <https://semopenalex.org/work/W345618> ?p ?o ?g. }
- W345618 abstract "This paper presents crowdsourcing as a novel approach to reducing the grading burden of constructed response assessments. We find that the average rating of 10 workers from a commercial crowdsourcing service can grade student work cheaply ($0.35 per student response) and reliably (Pearson correlation with the teacher’s gold-standard scores, ρ = 0.86 ± .04 for Grade 3 to ρ = .72 ± .07 for Grade 8). The specific context of our proof-of-concept dataset is 3rd-8th grade constructed response math questions. A secondary contribution of the paper is the development of a novel subsampling procedure, which allows a large data-collection experiment to be split into many smaller pseudo-experiments in such a way as to respect within-worker and between-worker variance. The subsampling procedure plays a key role in our calculation that the average of 10 workers’ scores suffices to produce reliable scores." @default.
- W345618 created "2016-06-24" @default.
- W345618 creator A5070739168 @default.
- W345618 date "2011-01-01" @default.
- W345618 modified "2023-09-27" @default.
- W345618 title "Can the Internet grade math? Crowdsourcing a complex scoring task and picking the optimal crowd size" @default.
- W345618 cites W1586287845 @default.
- W345618 cites W1594311284 @default.
- W345618 cites W1886495499 @default.
- W345618 cites W1970381522 @default.
- W345618 cites W1973420336 @default.
- W345618 cites W1993887693 @default.
- W345618 cites W1996469193 @default.
- W345618 cites W2008962955 @default.
- W345618 cites W2017301077 @default.
- W345618 cites W2024583961 @default.
- W345618 cites W2041411104 @default.
- W345618 cites W2043458675 @default.
- W345618 cites W2077788215 @default.
- W345618 cites W2078183317 @default.
- W345618 cites W2099414765 @default.
- W345618 cites W2104749423 @default.
- W345618 cites W2106568252 @default.
- W345618 cites W2115389369 @default.
- W345618 cites W2124503193 @default.
- W345618 cites W2134305421 @default.
- W345618 cites W2137244916 @default.
- W345618 cites W2140661853 @default.
- W345618 cites W2149273804 @default.
- W345618 cites W2158240052 @default.
- W345618 cites W2339117080 @default.
- W345618 cites W2588974325 @default.
- W345618 cites W2725184918 @default.
- W345618 cites W3121522380 @default.
- W345618 cites W592881015 @default.
- W345618 cites W9014458 @default.
- W345618 hasPublicationYear "2011" @default.
- W345618 type Work @default.
- W345618 sameAs 345618 @default.
- W345618 citedByCount "2" @default.
- W345618 countsByYear W3456182015 @default.
- W345618 countsByYear W3456182017 @default.
- W345618 crossrefType "journal-article" @default.
- W345618 hasAuthorship W345618A5070739168 @default.
- W345618 hasConcept C119857082 @default.
- W345618 hasConcept C121955636 @default.
- W345618 hasConcept C127413603 @default.
- W345618 hasConcept C136764020 @default.
- W345618 hasConcept C144133560 @default.
- W345618 hasConcept C145420912 @default.
- W345618 hasConcept C147176958 @default.
- W345618 hasConcept C151730666 @default.
- W345618 hasConcept C178823583 @default.
- W345618 hasConcept C196083921 @default.
- W345618 hasConcept C201995342 @default.
- W345618 hasConcept C2522767166 @default.
- W345618 hasConcept C2777286243 @default.
- W345618 hasConcept C2779343474 @default.
- W345618 hasConcept C2780451532 @default.
- W345618 hasConcept C33923547 @default.
- W345618 hasConcept C41008148 @default.
- W345618 hasConcept C42525527 @default.
- W345618 hasConcept C62230096 @default.
- W345618 hasConcept C86803240 @default.
- W345618 hasConceptScore W345618C119857082 @default.
- W345618 hasConceptScore W345618C121955636 @default.
- W345618 hasConceptScore W345618C127413603 @default.
- W345618 hasConceptScore W345618C136764020 @default.
- W345618 hasConceptScore W345618C144133560 @default.
- W345618 hasConceptScore W345618C145420912 @default.
- W345618 hasConceptScore W345618C147176958 @default.
- W345618 hasConceptScore W345618C151730666 @default.
- W345618 hasConceptScore W345618C178823583 @default.
- W345618 hasConceptScore W345618C196083921 @default.
- W345618 hasConceptScore W345618C201995342 @default.
- W345618 hasConceptScore W345618C2522767166 @default.
- W345618 hasConceptScore W345618C2777286243 @default.
- W345618 hasConceptScore W345618C2779343474 @default.
- W345618 hasConceptScore W345618C2780451532 @default.
- W345618 hasConceptScore W345618C33923547 @default.
- W345618 hasConceptScore W345618C41008148 @default.
- W345618 hasConceptScore W345618C42525527 @default.
- W345618 hasConceptScore W345618C62230096 @default.
- W345618 hasConceptScore W345618C86803240 @default.
- W345618 hasLocation W3456181 @default.
- W345618 hasOpenAccess W345618 @default.
- W345618 hasPrimaryLocation W3456181 @default.
- W345618 hasRelatedWork W147955980 @default.
- W345618 hasRelatedWork W1491260877 @default.
- W345618 hasRelatedWork W1669461200 @default.
- W345618 hasRelatedWork W195495878 @default.
- W345618 hasRelatedWork W2113699550 @default.
- W345618 hasRelatedWork W2141638589 @default.
- W345618 hasRelatedWork W2145778770 @default.
- W345618 hasRelatedWork W2369016204 @default.
- W345618 hasRelatedWork W2553478352 @default.
- W345618 hasRelatedWork W2605994771 @default.
- W345618 hasRelatedWork W2810091567 @default.
- W345618 hasRelatedWork W2883288225 @default.
- W345618 hasRelatedWork W2915503378 @default.