Matches in SemOpenAlex for { <https://semopenalex.org/work/W2487227665> ?p ?o ?g. }
- W2487227665 abstract "Gathering training and evaluation data for open domain tasks, such as general question answering, is a challenging task. Typically, ground truth data is provided by human expert annotators, however, in an open domain experts are difficult to define. Moreover, the overall process for annotating examples can be lengthy and expensive. Naturally, crowdsourcing has become a mainstream approach for filling this gap, i.e. gathering human interpretation data. However, similar to the traditional expert annotation tasks, most of those methods use majority voting to measure the quality of the annotations and thus aim at identifying a single right answer for each example, despite the fact that many annotation tasks can have multiple interpretations, which results in multiple correct answers to the same question. We present a crowdsourcing-based approach for efficiently gathering ground truth data called CrowdTruth, where disagreement-based metrics are used to harness the multitude of human interpretation and measure the quality of the resulting ground truth. We exemplify our approach in two semantic interpretation use cases for answering questions." @default.
- W2487227665 created "2016-08-23" @default.
- W2487227665 creator A5016381010 @default.
- W2487227665 creator A5046133348 @default.
- W2487227665 creator A5087872177 @default.
- W2487227665 date "2015-06-28" @default.
- W2487227665 modified "2023-09-23" @default.
- W2487227665 title "Crowdsourcing ground truth for Question Answering using CrowdTruth" @default.
- W2487227665 cites W1962580118 @default.
- W2487227665 cites W1997510119 @default.
- W2487227665 cites W2132232498 @default.
- W2487227665 cites W4230282492 @default.
- W2487227665 doi "https://doi.org/10.1145/2786451.2786492" @default.
- W2487227665 hasPublicationYear "2015" @default.
- W2487227665 type Work @default.
- W2487227665 sameAs 2487227665 @default.
- W2487227665 citedByCount "2" @default.
- W2487227665 countsByYear W24872276652016 @default.
- W2487227665 countsByYear W24872276652017 @default.
- W2487227665 crossrefType "proceedings-article" @default.
- W2487227665 hasAuthorship W2487227665A5016381010 @default.
- W2487227665 hasAuthorship W2487227665A5046133348 @default.
- W2487227665 hasAuthorship W2487227665A5087872177 @default.
- W2487227665 hasConcept C111472728 @default.
- W2487227665 hasConcept C124101348 @default.
- W2487227665 hasConcept C134306372 @default.
- W2487227665 hasConcept C136764020 @default.
- W2487227665 hasConcept C138885662 @default.
- W2487227665 hasConcept C144024400 @default.
- W2487227665 hasConcept C146849305 @default.
- W2487227665 hasConcept C154945302 @default.
- W2487227665 hasConcept C162324750 @default.
- W2487227665 hasConcept C187736073 @default.
- W2487227665 hasConcept C199360897 @default.
- W2487227665 hasConcept C204321447 @default.
- W2487227665 hasConcept C23123220 @default.
- W2487227665 hasConcept C2522767166 @default.
- W2487227665 hasConcept C2776321320 @default.
- W2487227665 hasConcept C2777877512 @default.
- W2487227665 hasConcept C2779530757 @default.
- W2487227665 hasConcept C2780009758 @default.
- W2487227665 hasConcept C2780451532 @default.
- W2487227665 hasConcept C33923547 @default.
- W2487227665 hasConcept C36503486 @default.
- W2487227665 hasConcept C41008148 @default.
- W2487227665 hasConcept C44291984 @default.
- W2487227665 hasConcept C46312422 @default.
- W2487227665 hasConcept C527412718 @default.
- W2487227665 hasConcept C62230096 @default.
- W2487227665 hasConceptScore W2487227665C111472728 @default.
- W2487227665 hasConceptScore W2487227665C124101348 @default.
- W2487227665 hasConceptScore W2487227665C134306372 @default.
- W2487227665 hasConceptScore W2487227665C136764020 @default.
- W2487227665 hasConceptScore W2487227665C138885662 @default.
- W2487227665 hasConceptScore W2487227665C144024400 @default.
- W2487227665 hasConceptScore W2487227665C146849305 @default.
- W2487227665 hasConceptScore W2487227665C154945302 @default.
- W2487227665 hasConceptScore W2487227665C162324750 @default.
- W2487227665 hasConceptScore W2487227665C187736073 @default.
- W2487227665 hasConceptScore W2487227665C199360897 @default.
- W2487227665 hasConceptScore W2487227665C204321447 @default.
- W2487227665 hasConceptScore W2487227665C23123220 @default.
- W2487227665 hasConceptScore W2487227665C2522767166 @default.
- W2487227665 hasConceptScore W2487227665C2776321320 @default.
- W2487227665 hasConceptScore W2487227665C2777877512 @default.
- W2487227665 hasConceptScore W2487227665C2779530757 @default.
- W2487227665 hasConceptScore W2487227665C2780009758 @default.
- W2487227665 hasConceptScore W2487227665C2780451532 @default.
- W2487227665 hasConceptScore W2487227665C33923547 @default.
- W2487227665 hasConceptScore W2487227665C36503486 @default.
- W2487227665 hasConceptScore W2487227665C41008148 @default.
- W2487227665 hasConceptScore W2487227665C44291984 @default.
- W2487227665 hasConceptScore W2487227665C46312422 @default.
- W2487227665 hasConceptScore W2487227665C527412718 @default.
- W2487227665 hasConceptScore W2487227665C62230096 @default.
- W2487227665 hasLocation W24872276651 @default.
- W2487227665 hasOpenAccess W2487227665 @default.
- W2487227665 hasPrimaryLocation W24872276651 @default.
- W2487227665 hasRelatedWork W1488750392 @default.
- W2487227665 hasRelatedWork W2016015328 @default.
- W2487227665 hasRelatedWork W2097342019 @default.
- W2487227665 hasRelatedWork W2250951990 @default.
- W2487227665 hasRelatedWork W2251199578 @default.
- W2487227665 hasRelatedWork W2340953087 @default.
- W2487227665 hasRelatedWork W2584793944 @default.
- W2487227665 hasRelatedWork W2585653752 @default.
- W2487227665 hasRelatedWork W2891394954 @default.
- W2487227665 hasRelatedWork W2981876780 @default.
- W2487227665 hasRelatedWork W2982699810 @default.
- W2487227665 hasRelatedWork W2987955343 @default.
- W2487227665 hasRelatedWork W2997521893 @default.
- W2487227665 hasRelatedWork W3121918918 @default.
- W2487227665 hasRelatedWork W3137689663 @default.
- W2487227665 hasRelatedWork W3150804300 @default.
- W2487227665 hasRelatedWork W3157008829 @default.
- W2487227665 hasRelatedWork W3172747961 @default.
- W2487227665 hasRelatedWork W3200937366 @default.
- W2487227665 hasRelatedWork W95119558 @default.
- W2487227665 isParatext "false" @default.
- W2487227665 isRetracted "false" @default.