Matches in SemOpenAlex for { <https://semopenalex.org/work/W2580394589> ?p ?o ?g. }
- W2580394589 abstract "Ranking a set of objects involves establishing an order allowing for comparisons between any pair of objects in the set. Oftentimes, due to the unavailability of a ground truth of ranked orders, researchers resort to obtaining judgments from multiple annotators followed by inferring the ground truth based on the collective knowledge of the crowd. However, the aggregation is often ad-hoc and involves imposing stringent assumptions in inferring the ground truth (e.g. majority vote). In this work, we propose Expectation-Maximization (EM) based algorithms that rely on the judgments from multiple annotators and the object attributes for inferring the latent ground truth. The algorithm learns the relation between the latent ground truth and object attributes as well as annotator specific probabilities of flipping, a metric to assess annotator quality. We further extend the EM algorithm to allow for a variable probability of flipping based on the pair of objects at hand. We test our algorithms on two data sets with synthetic annotations and investigate the impact of annotator quality and quantity on the inferred ground truth. We also obtain the results on two other data sets with annotations from machine/human annotators and interpret the output trends based on the data characteristics." @default.
- W2580394589 created "2017-02-03" @default.
- W2580394589 creator A5010028928 @default.
- W2580394589 creator A5075937808 @default.
- W2580394589 date "2016-12-13" @default.
- W2580394589 modified "2023-09-27" @default.
- W2580394589 title "Inferring object rankings based on noisy pairwise comparisons from multiple annotators." @default.
- W2580394589 cites W1511986666 @default.
- W2580394589 cites W1515481220 @default.
- W2580394589 cites W1547636760 @default.
- W2580394589 cites W1663973292 @default.
- W2580394589 cites W1973196098 @default.
- W2580394589 cites W1973435495 @default.
- W2580394589 cites W1975787960 @default.
- W2580394589 cites W1989643076 @default.
- W2580394589 cites W2039118116 @default.
- W2580394589 cites W2051834357 @default.
- W2580394589 cites W2060854861 @default.
- W2580394589 cites W2092533117 @default.
- W2580394589 cites W2102705755 @default.
- W2580394589 cites W2108862644 @default.
- W2580394589 cites W2110162085 @default.
- W2580394589 cites W2128877075 @default.
- W2580394589 cites W2129479650 @default.
- W2580394589 cites W2130492741 @default.
- W2580394589 cites W2134305421 @default.
- W2580394589 cites W2143331230 @default.
- W2580394589 cites W2143806604 @default.
- W2580394589 cites W2152009989 @default.
- W2580394589 cites W2156285243 @default.
- W2580394589 cites W2164545125 @default.
- W2580394589 cites W2170344111 @default.
- W2580394589 cites W2170347328 @default.
- W2580394589 cites W2400059445 @default.
- W2580394589 cites W2407115243 @default.
- W2580394589 cites W3120740533 @default.
- W2580394589 cites W9014458 @default.
- W2580394589 hasPublicationYear "2016" @default.
- W2580394589 type Work @default.
- W2580394589 sameAs 2580394589 @default.
- W2580394589 citedByCount "0" @default.
- W2580394589 crossrefType "posted-content" @default.
- W2580394589 hasAuthorship W2580394589A5010028928 @default.
- W2580394589 hasAuthorship W2580394589A5075937808 @default.
- W2580394589 hasConcept C105795698 @default.
- W2580394589 hasConcept C111472728 @default.
- W2580394589 hasConcept C119857082 @default.
- W2580394589 hasConcept C124101348 @default.
- W2580394589 hasConcept C138885662 @default.
- W2580394589 hasConcept C146849305 @default.
- W2580394589 hasConcept C154945302 @default.
- W2580394589 hasConcept C162324750 @default.
- W2580394589 hasConcept C176217482 @default.
- W2580394589 hasConcept C177264268 @default.
- W2580394589 hasConcept C184898388 @default.
- W2580394589 hasConcept C189430467 @default.
- W2580394589 hasConcept C199360897 @default.
- W2580394589 hasConcept C21547014 @default.
- W2580394589 hasConcept C25343380 @default.
- W2580394589 hasConcept C2779530757 @default.
- W2580394589 hasConcept C2780505938 @default.
- W2580394589 hasConcept C2781238097 @default.
- W2580394589 hasConcept C33923547 @default.
- W2580394589 hasConcept C41008148 @default.
- W2580394589 hasConcept C46274116 @default.
- W2580394589 hasConceptScore W2580394589C105795698 @default.
- W2580394589 hasConceptScore W2580394589C111472728 @default.
- W2580394589 hasConceptScore W2580394589C119857082 @default.
- W2580394589 hasConceptScore W2580394589C124101348 @default.
- W2580394589 hasConceptScore W2580394589C138885662 @default.
- W2580394589 hasConceptScore W2580394589C146849305 @default.
- W2580394589 hasConceptScore W2580394589C154945302 @default.
- W2580394589 hasConceptScore W2580394589C162324750 @default.
- W2580394589 hasConceptScore W2580394589C176217482 @default.
- W2580394589 hasConceptScore W2580394589C177264268 @default.
- W2580394589 hasConceptScore W2580394589C184898388 @default.
- W2580394589 hasConceptScore W2580394589C189430467 @default.
- W2580394589 hasConceptScore W2580394589C199360897 @default.
- W2580394589 hasConceptScore W2580394589C21547014 @default.
- W2580394589 hasConceptScore W2580394589C25343380 @default.
- W2580394589 hasConceptScore W2580394589C2779530757 @default.
- W2580394589 hasConceptScore W2580394589C2780505938 @default.
- W2580394589 hasConceptScore W2580394589C2781238097 @default.
- W2580394589 hasConceptScore W2580394589C33923547 @default.
- W2580394589 hasConceptScore W2580394589C41008148 @default.
- W2580394589 hasConceptScore W2580394589C46274116 @default.
- W2580394589 hasLocation W25803945891 @default.
- W2580394589 hasOpenAccess W2580394589 @default.
- W2580394589 hasPrimaryLocation W25803945891 @default.
- W2580394589 hasRelatedWork W1488582764 @default.
- W2580394589 hasRelatedWork W2003497265 @default.
- W2580394589 hasRelatedWork W2011039951 @default.
- W2580394589 hasRelatedWork W2077119967 @default.
- W2580394589 hasRelatedWork W2078730080 @default.
- W2580394589 hasRelatedWork W2164545125 @default.
- W2580394589 hasRelatedWork W2251763817 @default.
- W2580394589 hasRelatedWork W2499321295 @default.
- W2580394589 hasRelatedWork W2535616844 @default.
- W2580394589 hasRelatedWork W2583490418 @default.
- W2580394589 hasRelatedWork W2735398688 @default.