Matches in SemOpenAlex for { <https://semopenalex.org/work/W2953188497> ?p ?o ?g. }
- W2953188497 abstract "There has always been criticism for using $n$-gram based similarity metrics, such as BLEU, NIST, etc, for evaluating the performance of NLG systems. However, these metrics continue to remain popular and are recently being used for evaluating the performance of systems which automatically generate questions from documents, knowledge graphs, images, etc. Given the rising interest in such automatic question generation (AQG) systems, it is important to objectively examine whether these metrics are suitable for this task. In particular, it is important to verify whether such metrics used for evaluating AQG systems focus on answerability of the generated question by preferring questions which contain all relevant information such as question type (Wh-types), entities, relations, etc. In this work, we show that current automatic evaluation metrics based on $n$-gram similarity do not always correlate well with human judgments about answerability of a question. To alleviate this problem and as a first step towards better evaluation metrics for AQG, we introduce a scoring function to capture answerability and show that when this scoring function is integrated with existing metrics, they correlate significantly better with human judgments. The scripts and data developed as a part of this work are made publicly available at this https URL" @default.
- W2953188497 created "2019-06-27" @default.
- W2953188497 creator A5050036814 @default.
- W2953188497 creator A5072683962 @default.
- W2953188497 date "2018-08-30" @default.
- W2953188497 modified "2023-09-27" @default.
- W2953188497 title "Towards a Better Metric for Evaluating Question Generation Systems" @default.
- W2953188497 cites W1489525520 @default.
- W2953188497 cites W1531374185 @default.
- W2953188497 cites W2070150502 @default.
- W2953188497 cites W2078861931 @default.
- W2953188497 cites W2101105183 @default.
- W2953188497 cites W2143539737 @default.
- W2953188497 cites W2154652894 @default.
- W2953188497 cites W2250425483 @default.
- W2953188497 cites W2328886022 @default.
- W2953188497 cites W2409591106 @default.
- W2953188497 cites W2427527485 @default.
- W2953188497 cites W2561715562 @default.
- W2953188497 cites W2610986956 @default.
- W2953188497 cites W2612431505 @default.
- W2953188497 cites W2622069672 @default.
- W2953188497 cites W2624022918 @default.
- W2953188497 cites W2741253951 @default.
- W2953188497 cites W2757715585 @default.
- W2953188497 cites W2757978590 @default.
- W2953188497 cites W2759816466 @default.
- W2953188497 cites W2950700230 @default.
- W2953188497 cites W2950761309 @default.
- W2953188497 cites W2951293099 @default.
- W2953188497 cites W2951534261 @default.
- W2953188497 cites W2953320089 @default.
- W2953188497 cites W2963527228 @default.
- W2953188497 cites W2963717374 @default.
- W2953188497 cites W2963928014 @default.
- W2953188497 cites W2963938442 @default.
- W2953188497 cites W580074167 @default.
- W2953188497 cites W803028973 @default.
- W2953188497 hasPublicationYear "2018" @default.
- W2953188497 type Work @default.
- W2953188497 sameAs 2953188497 @default.
- W2953188497 citedByCount "5" @default.
- W2953188497 countsByYear W29531884972019 @default.
- W2953188497 countsByYear W29531884972020 @default.
- W2953188497 countsByYear W29531884972021 @default.
- W2953188497 crossrefType "posted-content" @default.
- W2953188497 hasAuthorship W2953188497A5050036814 @default.
- W2953188497 hasAuthorship W2953188497A5072683962 @default.
- W2953188497 hasConcept C103278499 @default.
- W2953188497 hasConcept C111219384 @default.
- W2953188497 hasConcept C115961682 @default.
- W2953188497 hasConcept C119857082 @default.
- W2953188497 hasConcept C120665830 @default.
- W2953188497 hasConcept C121332964 @default.
- W2953188497 hasConcept C124101348 @default.
- W2953188497 hasConcept C14036430 @default.
- W2953188497 hasConcept C154945302 @default.
- W2953188497 hasConcept C162324750 @default.
- W2953188497 hasConcept C176217482 @default.
- W2953188497 hasConcept C187736073 @default.
- W2953188497 hasConcept C192209626 @default.
- W2953188497 hasConcept C199360897 @default.
- W2953188497 hasConcept C204321447 @default.
- W2953188497 hasConcept C21547014 @default.
- W2953188497 hasConcept C23123220 @default.
- W2953188497 hasConcept C2780451532 @default.
- W2953188497 hasConcept C41008148 @default.
- W2953188497 hasConcept C61423126 @default.
- W2953188497 hasConcept C78458016 @default.
- W2953188497 hasConcept C80444323 @default.
- W2953188497 hasConcept C86803240 @default.
- W2953188497 hasConceptScore W2953188497C103278499 @default.
- W2953188497 hasConceptScore W2953188497C111219384 @default.
- W2953188497 hasConceptScore W2953188497C115961682 @default.
- W2953188497 hasConceptScore W2953188497C119857082 @default.
- W2953188497 hasConceptScore W2953188497C120665830 @default.
- W2953188497 hasConceptScore W2953188497C121332964 @default.
- W2953188497 hasConceptScore W2953188497C124101348 @default.
- W2953188497 hasConceptScore W2953188497C14036430 @default.
- W2953188497 hasConceptScore W2953188497C154945302 @default.
- W2953188497 hasConceptScore W2953188497C162324750 @default.
- W2953188497 hasConceptScore W2953188497C176217482 @default.
- W2953188497 hasConceptScore W2953188497C187736073 @default.
- W2953188497 hasConceptScore W2953188497C192209626 @default.
- W2953188497 hasConceptScore W2953188497C199360897 @default.
- W2953188497 hasConceptScore W2953188497C204321447 @default.
- W2953188497 hasConceptScore W2953188497C21547014 @default.
- W2953188497 hasConceptScore W2953188497C23123220 @default.
- W2953188497 hasConceptScore W2953188497C2780451532 @default.
- W2953188497 hasConceptScore W2953188497C41008148 @default.
- W2953188497 hasConceptScore W2953188497C61423126 @default.
- W2953188497 hasConceptScore W2953188497C78458016 @default.
- W2953188497 hasConceptScore W2953188497C80444323 @default.
- W2953188497 hasConceptScore W2953188497C86803240 @default.
- W2953188497 hasLocation W29531884971 @default.
- W2953188497 hasOpenAccess W2953188497 @default.
- W2953188497 hasPrimaryLocation W29531884971 @default.
- W2953188497 hasRelatedWork W160137612 @default.
- W2953188497 hasRelatedWork W1982897610 @default.
- W2953188497 hasRelatedWork W2101105183 @default.