Matches in SemOpenAlex for { <https://semopenalex.org/work/W4307273670> ?p ?o ?g. }
- W4307273670 endingPage "1514" @default.
- W4307273670 startingPage "1514" @default.
- W4307273670 abstract "Question Generation (QG) aims to automate the task of composing questions for a passage with a set of chosen answers found within the passage. In recent years, the introduction of neural generation models has resulted in substantial improvements of automatically generated questions in terms of quality, especially compared to traditional approaches that employ manually crafted heuristics. However, the metrics commonly applied in QG evaluations have been criticized for their low agreement with human judgement. We therefore propose a new reference-free evaluation metric that has the potential to provide a better mechanism for evaluating QG systems, called QAScore. Instead of fine-tuning a language model to maximize its correlation with human judgements, QAScore evaluates a question by computing the cross entropy according to the probability that the language model can correctly generate the masked words in the answer to that question. Furthermore, we conduct a new crowd-sourcing human evaluation experiment for the QG evaluation to investigate how QAScore and other metrics can correlate with human judgements. Experiments show that QAScore obtains a stronger correlation with the results of our proposed human evaluation method compared to existing traditional word-overlap-based metrics such as BLEU and ROUGE, as well as the existing pretrained-model-based metric BERTScore." @default.
- W4307273670 created "2022-10-31" @default.
- W4307273670 creator A5020500064 @default.
- W4307273670 creator A5043763521 @default.
- W4307273670 creator A5060984299 @default.
- W4307273670 creator A5071808662 @default.
- W4307273670 creator A5071890018 @default.
- W4307273670 date "2022-10-24" @default.
- W4307273670 modified "2023-09-30" @default.
- W4307273670 title "QAScore—An Unsupervised Unreferenced Metric for the Question Generation Evaluation" @default.
- W4307273670 cites W2101105183 @default.
- W4307273670 cites W2157331557 @default.
- W4307273670 cites W2251023345 @default.
- W4307273670 cites W2260677151 @default.
- W4307273670 cites W2470681840 @default.
- W4307273670 cites W2557764419 @default.
- W4307273670 cites W2610891036 @default.
- W4307273670 cites W2806532810 @default.
- W4307273670 cites W2888812214 @default.
- W4307273670 cites W2962717047 @default.
- W4307273670 cites W2963748441 @default.
- W4307273670 cites W2963928014 @default.
- W4307273670 cites W2963963993 @default.
- W4307273670 cites W3011993973 @default.
- W4307273670 cites W3034383728 @default.
- W4307273670 cites W3034999214 @default.
- W4307273670 cites W3035252911 @default.
- W4307273670 cites W3098267758 @default.
- W4307273670 cites W3101007570 @default.
- W4307273670 cites W3101798106 @default.
- W4307273670 cites W3104976898 @default.
- W4307273670 cites W3110038866 @default.
- W4307273670 cites W3117289850 @default.
- W4307273670 cites W3155743842 @default.
- W4307273670 cites W3201266133 @default.
- W4307273670 cites W3207095490 @default.
- W4307273670 cites W3210366802 @default.
- W4307273670 cites W3215490307 @default.
- W4307273670 cites W4221148741 @default.
- W4307273670 cites W4285110842 @default.
- W4307273670 cites W4285292592 @default.
- W4307273670 doi "https://doi.org/10.3390/e24111514" @default.
- W4307273670 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/36359608" @default.
- W4307273670 hasPublicationYear "2022" @default.
- W4307273670 type Work @default.
- W4307273670 citedByCount "5" @default.
- W4307273670 countsByYear W43072736702023 @default.
- W4307273670 crossrefType "journal-article" @default.
- W4307273670 hasAuthorship W4307273670A5020500064 @default.
- W4307273670 hasAuthorship W4307273670A5043763521 @default.
- W4307273670 hasAuthorship W4307273670A5060984299 @default.
- W4307273670 hasAuthorship W4307273670A5071808662 @default.
- W4307273670 hasAuthorship W4307273670A5071890018 @default.
- W4307273670 hasBestOaLocation W43072736701 @default.
- W4307273670 hasConcept C106301342 @default.
- W4307273670 hasConcept C111919701 @default.
- W4307273670 hasConcept C117220453 @default.
- W4307273670 hasConcept C119857082 @default.
- W4307273670 hasConcept C121332964 @default.
- W4307273670 hasConcept C127705205 @default.
- W4307273670 hasConcept C137293760 @default.
- W4307273670 hasConcept C154945302 @default.
- W4307273670 hasConcept C162324750 @default.
- W4307273670 hasConcept C176217482 @default.
- W4307273670 hasConcept C177264268 @default.
- W4307273670 hasConcept C17744445 @default.
- W4307273670 hasConcept C187736073 @default.
- W4307273670 hasConcept C199360897 @default.
- W4307273670 hasConcept C199539241 @default.
- W4307273670 hasConcept C204321447 @default.
- W4307273670 hasConcept C21547014 @default.
- W4307273670 hasConcept C2524010 @default.
- W4307273670 hasConcept C2776548248 @default.
- W4307273670 hasConcept C2780451532 @default.
- W4307273670 hasConcept C33923547 @default.
- W4307273670 hasConcept C41008148 @default.
- W4307273670 hasConcept C62520636 @default.
- W4307273670 hasConcept C90805587 @default.
- W4307273670 hasConcept C9679016 @default.
- W4307273670 hasConceptScore W4307273670C106301342 @default.
- W4307273670 hasConceptScore W4307273670C111919701 @default.
- W4307273670 hasConceptScore W4307273670C117220453 @default.
- W4307273670 hasConceptScore W4307273670C119857082 @default.
- W4307273670 hasConceptScore W4307273670C121332964 @default.
- W4307273670 hasConceptScore W4307273670C127705205 @default.
- W4307273670 hasConceptScore W4307273670C137293760 @default.
- W4307273670 hasConceptScore W4307273670C154945302 @default.
- W4307273670 hasConceptScore W4307273670C162324750 @default.
- W4307273670 hasConceptScore W4307273670C176217482 @default.
- W4307273670 hasConceptScore W4307273670C177264268 @default.
- W4307273670 hasConceptScore W4307273670C17744445 @default.
- W4307273670 hasConceptScore W4307273670C187736073 @default.
- W4307273670 hasConceptScore W4307273670C199360897 @default.
- W4307273670 hasConceptScore W4307273670C199539241 @default.
- W4307273670 hasConceptScore W4307273670C204321447 @default.
- W4307273670 hasConceptScore W4307273670C21547014 @default.
- W4307273670 hasConceptScore W4307273670C2524010 @default.
- W4307273670 hasConceptScore W4307273670C2776548248 @default.