Matches in SemOpenAlex for { <https://semopenalex.org/work/W3208093807> ?p ?o ?g. }
- W3208093807 abstract "Expert workers make non-trivial decisions with significant implications. Experts' decision accuracy is thus a fundamental aspect of their judgment quality, key to both management and consumers of experts' services. Yet, in many important settings, transparency in experts' decision quality is rarely possible because ground truth data for evaluating the experts' decisions is costly and available only for a limited set of decisions. Furthermore, different experts typically handle exclusive sets of decisions, and thus prior solutions that rely on the aggregation of multiple experts' decisions for the same instance are inapplicable. We first formulate the problem of estimating experts' decision accuracy in this setting and then develop a machine-learning-based framework to address it. Our method effectively leverages both abundant historical data on workers' past decisions, and scarce decision instances with ground truth information. We conduct extensive empirical evaluations of our method's performance relative to alternatives using both semi-synthetic data based on publicly available datasets, and purposefully compiled dataset on real workers' decisions. The results show that our approach is superior to existing alternatives across diverse settings, including different data domains, experts' qualities, and the amount of ground truth data. To our knowledge, this paper is the first to posit and address the problem of estimating experts' decision accuracies from historical data with scarcely available ground truth, and it is the first to offer comprehensive results for this problem setting, establishing the performances that can be achieved across settings, as well as the state-of-the-art performance on which future work can build." @default.
- W3208093807 created "2021-11-08" @default.
- W3208093807 creator A5040636767 @default.
- W3208093807 creator A5066579957 @default.
- W3208093807 creator A5074184939 @default.
- W3208093807 date "2021-10-21" @default.
- W3208093807 modified "2023-09-26" @default.
- W3208093807 title "A Machine Learning Framework Towards Transparency in Experts' Decision Quality" @default.
- W3208093807 cites W108763474 @default.
- W3208093807 cites W184632312 @default.
- W3208093807 cites W1872515333 @default.
- W3208093807 cites W1984443919 @default.
- W3208093807 cites W2024046085 @default.
- W3208093807 cites W2024711376 @default.
- W3208093807 cites W2039335540 @default.
- W3208093807 cites W2067624665 @default.
- W3208093807 cites W2078429476 @default.
- W3208093807 cites W2134305421 @default.
- W3208093807 cites W2140890285 @default.
- W3208093807 cites W2147687736 @default.
- W3208093807 cites W2150612552 @default.
- W3208093807 cites W2152009989 @default.
- W3208093807 cites W2152983331 @default.
- W3208093807 cites W2161816739 @default.
- W3208093807 cites W2163522723 @default.
- W3208093807 cites W2168396085 @default.
- W3208093807 cites W2329710600 @default.
- W3208093807 cites W2559889298 @default.
- W3208093807 cites W2582409643 @default.
- W3208093807 cites W2736119820 @default.
- W3208093807 cites W2740505281 @default.
- W3208093807 cites W2745544219 @default.
- W3208093807 cites W2772357980 @default.
- W3208093807 cites W2952173670 @default.
- W3208093807 cites W2979302305 @default.
- W3208093807 cites W2997654229 @default.
- W3208093807 cites W3045143125 @default.
- W3208093807 cites W3083423991 @default.
- W3208093807 cites W3100570787 @default.
- W3208093807 cites W3112138688 @default.
- W3208093807 cites W3120740533 @default.
- W3208093807 cites W3121257585 @default.
- W3208093807 cites W3122119771 @default.
- W3208093807 cites W3124416155 @default.
- W3208093807 cites W3144865957 @default.
- W3208093807 cites W82775311 @default.
- W3208093807 cites W9014458 @default.
- W3208093807 doi "https://doi.org/10.48550/arxiv.2110.11425" @default.
- W3208093807 hasPublicationYear "2021" @default.
- W3208093807 type Work @default.
- W3208093807 sameAs 3208093807 @default.
- W3208093807 citedByCount "0" @default.
- W3208093807 crossrefType "posted-content" @default.
- W3208093807 hasAuthorship W3208093807A5040636767 @default.
- W3208093807 hasAuthorship W3208093807A5066579957 @default.
- W3208093807 hasAuthorship W3208093807A5074184939 @default.
- W3208093807 hasBestOaLocation W32080938071 @default.
- W3208093807 hasConcept C111472728 @default.
- W3208093807 hasConcept C119857082 @default.
- W3208093807 hasConcept C127413603 @default.
- W3208093807 hasConcept C138885662 @default.
- W3208093807 hasConcept C146849305 @default.
- W3208093807 hasConcept C154945302 @default.
- W3208093807 hasConcept C176217482 @default.
- W3208093807 hasConcept C177264268 @default.
- W3208093807 hasConcept C199360897 @default.
- W3208093807 hasConcept C21547014 @default.
- W3208093807 hasConcept C24756922 @default.
- W3208093807 hasConcept C2522767166 @default.
- W3208093807 hasConcept C2779530757 @default.
- W3208093807 hasConcept C2780233690 @default.
- W3208093807 hasConcept C38652104 @default.
- W3208093807 hasConcept C41008148 @default.
- W3208093807 hasConceptScore W3208093807C111472728 @default.
- W3208093807 hasConceptScore W3208093807C119857082 @default.
- W3208093807 hasConceptScore W3208093807C127413603 @default.
- W3208093807 hasConceptScore W3208093807C138885662 @default.
- W3208093807 hasConceptScore W3208093807C146849305 @default.
- W3208093807 hasConceptScore W3208093807C154945302 @default.
- W3208093807 hasConceptScore W3208093807C176217482 @default.
- W3208093807 hasConceptScore W3208093807C177264268 @default.
- W3208093807 hasConceptScore W3208093807C199360897 @default.
- W3208093807 hasConceptScore W3208093807C21547014 @default.
- W3208093807 hasConceptScore W3208093807C24756922 @default.
- W3208093807 hasConceptScore W3208093807C2522767166 @default.
- W3208093807 hasConceptScore W3208093807C2779530757 @default.
- W3208093807 hasConceptScore W3208093807C2780233690 @default.
- W3208093807 hasConceptScore W3208093807C38652104 @default.
- W3208093807 hasConceptScore W3208093807C41008148 @default.
- W3208093807 hasLocation W32080938071 @default.
- W3208093807 hasOpenAccess W3208093807 @default.
- W3208093807 hasPrimaryLocation W32080938071 @default.
- W3208093807 hasRelatedWork W2005176141 @default.
- W3208093807 hasRelatedWork W2478661118 @default.
- W3208093807 hasRelatedWork W2620675186 @default.
- W3208093807 hasRelatedWork W2783163697 @default.
- W3208093807 hasRelatedWork W2783291455 @default.
- W3208093807 hasRelatedWork W2797388296 @default.
- W3208093807 hasRelatedWork W2891830216 @default.
- W3208093807 hasRelatedWork W3129604848 @default.