Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384659495> ?p ?o ?g. }
- W4384659495 abstract "Multiple-choice questions, which are widely used in educational assessments, have the potential to negatively impact student learning and skew analytics when they contain item-writing flaws. Existing methods for evaluating multiple-choice questions in educational contexts tend to focus primarily on machine readability metrics, such as grammar, syntax, and formatting, without considering the intended use of the questions within course materials and their pedagogical implications. In this study, we present the results of crowdsourcing the evaluation of multiple-choice questions based on 15 common item-writing flaws. Through analysis of 80 crowdsourced evaluations on questions from the domains of calculus and chemistry, we found that crowdworkers were able to accurately evaluate the questions, matching 75% of the expert evaluations across multiple questions. They were able to correctly distinguish between two levels of Bloom's Taxonomy for the calculus questions, but were less accurate for chemistry questions. We discuss how to scale this question evaluation process and the implications it has across other domains. This work demonstrates how crowdworkers can be leveraged in the quality evaluation of educational questions, regardless of prior experience or domain knowledge." @default.
- W4384659495 created "2023-07-20" @default.
- W4384659495 creator A5004604253 @default.
- W4384659495 creator A5037009005 @default.
- W4384659495 creator A5052468815 @default.
- W4384659495 creator A5078792439 @default.
- W4384659495 date "2023-07-20" @default.
- W4384659495 modified "2023-09-23" @default.
- W4384659495 title "Crowdsourcing the Evaluation of Multiple-Choice Questions Using Item-Writing Flaws and Bloom's Taxonomy" @default.
- W4384659495 cites W1596610711 @default.
- W4384659495 cites W1964405501 @default.
- W4384659495 cites W2000989929 @default.
- W4384659495 cites W2003591211 @default.
- W4384659495 cites W2008478698 @default.
- W4384659495 cites W2048361073 @default.
- W4384659495 cites W2069421543 @default.
- W4384659495 cites W2106568252 @default.
- W4384659495 cites W2112630006 @default.
- W4384659495 cites W2149247676 @default.
- W4384659495 cites W2151401338 @default.
- W4384659495 cites W2158712864 @default.
- W4384659495 cites W2251648400 @default.
- W4384659495 cites W2400269077 @default.
- W4384659495 cites W2494919053 @default.
- W4384659495 cites W2525617277 @default.
- W4384659495 cites W2618975095 @default.
- W4384659495 cites W2729443486 @default.
- W4384659495 cites W2745609372 @default.
- W4384659495 cites W2770781509 @default.
- W4384659495 cites W2796929977 @default.
- W4384659495 cites W2887398393 @default.
- W4384659495 cites W2895564931 @default.
- W4384659495 cites W2902583760 @default.
- W4384659495 cites W2914954621 @default.
- W4384659495 cites W2921439108 @default.
- W4384659495 cites W2989613245 @default.
- W4384659495 cites W3003429563 @default.
- W4384659495 cites W3035248908 @default.
- W4384659495 cites W3035640233 @default.
- W4384659495 cites W3046696240 @default.
- W4384659495 cites W3117055973 @default.
- W4384659495 cites W3129460529 @default.
- W4384659495 cites W3148979044 @default.
- W4384659495 cites W3149583266 @default.
- W4384659495 cites W3167624900 @default.
- W4384659495 cites W3170429383 @default.
- W4384659495 cites W3171975780 @default.
- W4384659495 cites W4205528697 @default.
- W4384659495 cites W4211059218 @default.
- W4384659495 cites W4253897753 @default.
- W4384659495 cites W4281768524 @default.
- W4384659495 cites W4281825574 @default.
- W4384659495 cites W4307273670 @default.
- W4384659495 doi "https://doi.org/10.1145/3573051.3593396" @default.
- W4384659495 hasPublicationYear "2023" @default.
- W4384659495 type Work @default.
- W4384659495 citedByCount "0" @default.
- W4384659495 crossrefType "proceedings-article" @default.
- W4384659495 hasAuthorship W4384659495A5004604253 @default.
- W4384659495 hasAuthorship W4384659495A5037009005 @default.
- W4384659495 hasAuthorship W4384659495A5052468815 @default.
- W4384659495 hasAuthorship W4384659495A5078792439 @default.
- W4384659495 hasConcept C105795698 @default.
- W4384659495 hasConcept C111472728 @default.
- W4384659495 hasConcept C134306372 @default.
- W4384659495 hasConcept C136764020 @default.
- W4384659495 hasConcept C138885662 @default.
- W4384659495 hasConcept C145420912 @default.
- W4384659495 hasConcept C154945302 @default.
- W4384659495 hasConcept C15744967 @default.
- W4384659495 hasConcept C165064840 @default.
- W4384659495 hasConcept C169760540 @default.
- W4384659495 hasConcept C169900460 @default.
- W4384659495 hasConcept C176730311 @default.
- W4384659495 hasConcept C199360897 @default.
- W4384659495 hasConcept C204321447 @default.
- W4384659495 hasConcept C23123220 @default.
- W4384659495 hasConcept C2522767166 @default.
- W4384659495 hasConcept C26022165 @default.
- W4384659495 hasConcept C2777898490 @default.
- W4384659495 hasConcept C2778143727 @default.
- W4384659495 hasConcept C2779530757 @default.
- W4384659495 hasConcept C33923547 @default.
- W4384659495 hasConcept C36503486 @default.
- W4384659495 hasConcept C41008148 @default.
- W4384659495 hasConcept C41895202 @default.
- W4384659495 hasConcept C554936623 @default.
- W4384659495 hasConcept C58642233 @default.
- W4384659495 hasConcept C59157022 @default.
- W4384659495 hasConcept C59822182 @default.
- W4384659495 hasConcept C60048249 @default.
- W4384659495 hasConcept C62230096 @default.
- W4384659495 hasConcept C79158427 @default.
- W4384659495 hasConcept C86803240 @default.
- W4384659495 hasConceptScore W4384659495C105795698 @default.
- W4384659495 hasConceptScore W4384659495C111472728 @default.
- W4384659495 hasConceptScore W4384659495C134306372 @default.
- W4384659495 hasConceptScore W4384659495C136764020 @default.
- W4384659495 hasConceptScore W4384659495C138885662 @default.
- W4384659495 hasConceptScore W4384659495C145420912 @default.