Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387329169> ?p ?o ?g. }
- W4387329169 endingPage "26" @default.
- W4387329169 startingPage "1" @default.
- W4387329169 abstract "When groups of people are tasked with making a judgment, the issue of uncertainty often arises. Existing methods to reduce uncertainty typically focus on iteratively improving specificity in the overall task instruction. However, uncertainty can arise from multiple sources, such as ambiguity of the item being judged due to limited context, or disagreements among the participants due to different perspectives and an under-specified task. A one-size-fits-all intervention may be ineffective if it is not targeted to the right source of uncertainty. In this paper we introduce a new workflow, Judgment Sieve, to reduce uncertainty in tasks involving group judgment in a targeted manner. By utilizing measurements that separate different sources of uncertainty during an initial round of judgment elicitation, we can then select a targeted intervention adding context or deliberation to most effectively reduce uncertainty on each item being judged. We test our approach on two tasks: rating word pair similarity and toxicity of online comments, showing that targeted interventions reduced uncertainty for the most uncertain cases. In the top 10% of cases, we saw an ambiguity reduction of 21.4% and 25.7%, and a disagreement reduction of 22.2% and 11.2% for the two tasks respectively. We also found through a simulation that our targeted approach reduced the average uncertainty scores for both sources of uncertainty as opposed to uniform approaches where reductions in average uncertainty from one source came with an increase for the other." @default.
- W4387329169 created "2023-10-05" @default.
- W4387329169 creator A5037054163 @default.
- W4387329169 creator A5037569091 @default.
- W4387329169 date "2023-09-28" @default.
- W4387329169 modified "2023-10-15" @default.
- W4387329169 title "Judgment Sieve: Reducing Uncertainty in Group Judgments through Interventions Targeting Ambiguity versus Disagreement" @default.
- W4387329169 cites W1838907055 @default.
- W4387329169 cites W2026899120 @default.
- W4387329169 cites W2042674443 @default.
- W4387329169 cites W2069266605 @default.
- W4387329169 cites W2071491733 @default.
- W4387329169 cites W2081580037 @default.
- W4387329169 cites W2098865355 @default.
- W4387329169 cites W2105963649 @default.
- W4387329169 cites W2108598243 @default.
- W4387329169 cites W2111959010 @default.
- W4387329169 cites W2117539524 @default.
- W4387329169 cites W2173800084 @default.
- W4387329169 cites W2290009368 @default.
- W4387329169 cites W2295951612 @default.
- W4387329169 cites W2563826943 @default.
- W4387329169 cites W2574781439 @default.
- W4387329169 cites W2599032673 @default.
- W4387329169 cites W2605994771 @default.
- W4387329169 cites W2607311634 @default.
- W4387329169 cites W2613142859 @default.
- W4387329169 cites W2614403205 @default.
- W4387329169 cites W2726137762 @default.
- W4387329169 cites W2783946743 @default.
- W4387329169 cites W2796648593 @default.
- W4387329169 cites W2917411097 @default.
- W4387329169 cites W2946474696 @default.
- W4387329169 cites W2985347336 @default.
- W4387329169 cites W2988571156 @default.
- W4387329169 cites W3023638732 @default.
- W4387329169 cites W3031586727 @default.
- W4387329169 cites W3034951181 @default.
- W4387329169 cites W3049687886 @default.
- W4387329169 cites W3103649165 @default.
- W4387329169 cites W3123102563 @default.
- W4387329169 cites W3132811443 @default.
- W4387329169 cites W3166488533 @default.
- W4387329169 cites W3170551880 @default.
- W4387329169 cites W3205934028 @default.
- W4387329169 cites W3212368439 @default.
- W4387329169 cites W4206546829 @default.
- W4387329169 cites W4288083802 @default.
- W4387329169 cites W4293462114 @default.
- W4387329169 cites W4306694236 @default.
- W4387329169 doi "https://doi.org/10.1145/3610074" @default.
- W4387329169 hasPublicationYear "2023" @default.
- W4387329169 type Work @default.
- W4387329169 citedByCount "0" @default.
- W4387329169 crossrefType "journal-article" @default.
- W4387329169 hasAuthorship W4387329169A5037054163 @default.
- W4387329169 hasAuthorship W4387329169A5037569091 @default.
- W4387329169 hasBestOaLocation W43873291691 @default.
- W4387329169 hasConcept C105795698 @default.
- W4387329169 hasConcept C118552586 @default.
- W4387329169 hasConcept C127413603 @default.
- W4387329169 hasConcept C137209882 @default.
- W4387329169 hasConcept C151730666 @default.
- W4387329169 hasConcept C15744967 @default.
- W4387329169 hasConcept C177212765 @default.
- W4387329169 hasConcept C17744445 @default.
- W4387329169 hasConcept C199360897 @default.
- W4387329169 hasConcept C199539241 @default.
- W4387329169 hasConcept C201995342 @default.
- W4387329169 hasConcept C27415008 @default.
- W4387329169 hasConcept C2776946740 @default.
- W4387329169 hasConcept C2779343474 @default.
- W4387329169 hasConcept C2780451532 @default.
- W4387329169 hasConcept C2780522230 @default.
- W4387329169 hasConcept C2780665704 @default.
- W4387329169 hasConcept C33923547 @default.
- W4387329169 hasConcept C41008148 @default.
- W4387329169 hasConcept C77088390 @default.
- W4387329169 hasConcept C77805123 @default.
- W4387329169 hasConcept C86803240 @default.
- W4387329169 hasConcept C94361409 @default.
- W4387329169 hasConcept C94625758 @default.
- W4387329169 hasConceptScore W4387329169C105795698 @default.
- W4387329169 hasConceptScore W4387329169C118552586 @default.
- W4387329169 hasConceptScore W4387329169C127413603 @default.
- W4387329169 hasConceptScore W4387329169C137209882 @default.
- W4387329169 hasConceptScore W4387329169C151730666 @default.
- W4387329169 hasConceptScore W4387329169C15744967 @default.
- W4387329169 hasConceptScore W4387329169C177212765 @default.
- W4387329169 hasConceptScore W4387329169C17744445 @default.
- W4387329169 hasConceptScore W4387329169C199360897 @default.
- W4387329169 hasConceptScore W4387329169C199539241 @default.
- W4387329169 hasConceptScore W4387329169C201995342 @default.
- W4387329169 hasConceptScore W4387329169C27415008 @default.
- W4387329169 hasConceptScore W4387329169C2776946740 @default.
- W4387329169 hasConceptScore W4387329169C2779343474 @default.
- W4387329169 hasConceptScore W4387329169C2780451532 @default.
- W4387329169 hasConceptScore W4387329169C2780522230 @default.