Matches in SemOpenAlex for { <https://semopenalex.org/work/W3155063497> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W3155063497 endingPage "74" @default.
- W3155063497 startingPage "69" @default.
- W3155063497 abstract "We outline the Great Misalignment Problem in natural language processing research, this means simply that the problem definition is not in line with the method proposed and the human evaluation is not in line with the definition nor the method. We study this misalignment problem by surveying 10 randomly sampled papers published in ACL 2020 that report results with human evaluation. Our results show that only one paper was fully in line in terms of problem definition, method and evaluation. Only two papers presented a human evaluation that was in line with what was modeled in the method. These results highlight that the Great Misalignment Problem is a major one and it affects the validity and reproducibility of results obtained by a human evaluation." @default.
- W3155063497 created "2021-04-26" @default.
- W3155063497 creator A5002214613 @default.
- W3155063497 creator A5057148063 @default.
- W3155063497 date "2021-04-01" @default.
- W3155063497 modified "2023-09-26" @default.
- W3155063497 title "The Great Misalignment Problem in Human Evaluation of NLP Methods" @default.
- W3155063497 cites W2101105183 @default.
- W3155063497 cites W2136451344 @default.
- W3155063497 cites W2147223282 @default.
- W3155063497 cites W2563072008 @default.
- W3155063497 cites W2785602402 @default.
- W3155063497 cites W2806532810 @default.
- W3155063497 cites W2889666157 @default.
- W3155063497 cites W2902230267 @default.
- W3155063497 cites W2955163189 @default.
- W3155063497 cites W2963595229 @default.
- W3155063497 cites W2963672599 @default.
- W3155063497 cites W2970425245 @default.
- W3155063497 cites W2970956481 @default.
- W3155063497 cites W2992347006 @default.
- W3155063497 cites W3034330464 @default.
- W3155063497 cites W3035281110 @default.
- W3155063497 cites W3118324981 @default.
- W3155063497 cites W3121913876 @default.
- W3155063497 cites W3147657411 @default.
- W3155063497 cites W3159794114 @default.
- W3155063497 cites W640637620 @default.
- W3155063497 hasPublicationYear "2021" @default.
- W3155063497 type Work @default.
- W3155063497 sameAs 3155063497 @default.
- W3155063497 citedByCount "4" @default.
- W3155063497 countsByYear W31550634972021 @default.
- W3155063497 crossrefType "journal-article" @default.
- W3155063497 hasAuthorship W3155063497A5002214613 @default.
- W3155063497 hasAuthorship W3155063497A5057148063 @default.
- W3155063497 hasConcept C119857082 @default.
- W3155063497 hasConcept C127413603 @default.
- W3155063497 hasConcept C154945302 @default.
- W3155063497 hasConcept C198352243 @default.
- W3155063497 hasConcept C200601418 @default.
- W3155063497 hasConcept C204321447 @default.
- W3155063497 hasConcept C2524010 @default.
- W3155063497 hasConcept C3018395757 @default.
- W3155063497 hasConcept C33923547 @default.
- W3155063497 hasConcept C41008148 @default.
- W3155063497 hasConceptScore W3155063497C119857082 @default.
- W3155063497 hasConceptScore W3155063497C127413603 @default.
- W3155063497 hasConceptScore W3155063497C154945302 @default.
- W3155063497 hasConceptScore W3155063497C198352243 @default.
- W3155063497 hasConceptScore W3155063497C200601418 @default.
- W3155063497 hasConceptScore W3155063497C204321447 @default.
- W3155063497 hasConceptScore W3155063497C2524010 @default.
- W3155063497 hasConceptScore W3155063497C3018395757 @default.
- W3155063497 hasConceptScore W3155063497C33923547 @default.
- W3155063497 hasConceptScore W3155063497C41008148 @default.
- W3155063497 hasLocation W31550634971 @default.
- W3155063497 hasOpenAccess W3155063497 @default.
- W3155063497 hasPrimaryLocation W31550634971 @default.
- W3155063497 hasRelatedWork W136473416 @default.
- W3155063497 hasRelatedWork W1532740070 @default.
- W3155063497 hasRelatedWork W1865404322 @default.
- W3155063497 hasRelatedWork W1869779040 @default.
- W3155063497 hasRelatedWork W1969760776 @default.
- W3155063497 hasRelatedWork W1992375307 @default.
- W3155063497 hasRelatedWork W2045864324 @default.
- W3155063497 hasRelatedWork W2126555612 @default.
- W3155063497 hasRelatedWork W2186216633 @default.
- W3155063497 hasRelatedWork W2268084811 @default.
- W3155063497 hasRelatedWork W2272138067 @default.
- W3155063497 hasRelatedWork W2289390140 @default.
- W3155063497 hasRelatedWork W2338208227 @default.
- W3155063497 hasRelatedWork W2593721734 @default.
- W3155063497 hasRelatedWork W2906014048 @default.
- W3155063497 hasRelatedWork W2954376350 @default.
- W3155063497 hasRelatedWork W3011710985 @default.
- W3155063497 hasRelatedWork W3153923402 @default.
- W3155063497 hasRelatedWork W798321234 @default.
- W3155063497 hasRelatedWork W2338566811 @default.
- W3155063497 isParatext "false" @default.
- W3155063497 isRetracted "false" @default.
- W3155063497 magId "3155063497" @default.
- W3155063497 workType "article" @default.