Matches in SemOpenAlex for { <https://semopenalex.org/work/W2948628052> ?p ?o ?g. }
- W2948628052 abstract "Automatically constructed datasets for generating text from semi-structured data (tables), such as WikiBio, often contain reference texts that diverge from the information in the corresponding semi-structured data. We show that metrics which rely solely on the reference texts, such as BLEU and ROUGE, show poor correlation with human judgments when those references diverge. We propose a new metric, PARENT, which aligns n-grams from the reference and generated texts to the semi-structured data before computing their precision and recall. Through a large scale human evaluation study of table-to-text models for WikiBio, we show that PARENT correlates with human judgments better than existing text generation metrics. We also adapt and evaluate the information extraction based evaluation proposed by Wiseman et al (2017), and show that PARENT has comparable correlation to it, while being easier to use. We show that PARENT is also applicable when the reference texts are elicited from humans using the data from the WebNLG challenge." @default.
- W2948628052 created "2019-06-14" @default.
- W2948628052 creator A5014855689 @default.
- W2948628052 creator A5021055773 @default.
- W2948628052 creator A5049069749 @default.
- W2948628052 creator A5051617344 @default.
- W2948628052 creator A5055033421 @default.
- W2948628052 creator A5076904467 @default.
- W2948628052 date "2019-06-03" @default.
- W2948628052 modified "2023-09-23" @default.
- W2948628052 title "Handling Divergent Reference Texts when Evaluating Table-to-Text Generation" @default.
- W2948628052 cites W1489525520 @default.
- W2948628052 cites W1552182777 @default.
- W2948628052 cites W1570031249 @default.
- W2948628052 cites W1763968285 @default.
- W2948628052 cites W1956340063 @default.
- W2948628052 cites W1985610876 @default.
- W2948628052 cites W2003170434 @default.
- W2948628052 cites W2068390867 @default.
- W2948628052 cites W2078861931 @default.
- W2948628052 cites W2101105183 @default.
- W2948628052 cites W2104651652 @default.
- W2948628052 cites W2116716943 @default.
- W2948628052 cites W2127453322 @default.
- W2948628052 cites W2133459682 @default.
- W2948628052 cites W2147192413 @default.
- W2948628052 cites W2154652894 @default.
- W2948628052 cites W2163371195 @default.
- W2948628052 cites W2164079290 @default.
- W2948628052 cites W2250234233 @default.
- W2948628052 cites W2250539671 @default.
- W2948628052 cites W2252001469 @default.
- W2948628052 cites W2344731424 @default.
- W2948628052 cites W2534253848 @default.
- W2948628052 cites W2564590796 @default.
- W2948628052 cites W2604799547 @default.
- W2948628052 cites W2606974598 @default.
- W2948628052 cites W2729858395 @default.
- W2948628052 cites W2739046565 @default.
- W2948628052 cites W2741900445 @default.
- W2948628052 cites W2806532810 @default.
- W2948628052 cites W2888812214 @default.
- W2948628052 cites W2896780650 @default.
- W2948628052 cites W2909737760 @default.
- W2948628052 cites W2962735233 @default.
- W2948628052 cites W2963091658 @default.
- W2948628052 cites W2963672599 @default.
- W2948628052 cites W2963903950 @default.
- W2948628052 cites W2964022663 @default.
- W2948628052 cites W2525127255 @default.
- W2948628052 hasPublicationYear "2019" @default.
- W2948628052 type Work @default.
- W2948628052 sameAs 2948628052 @default.
- W2948628052 citedByCount "2" @default.
- W2948628052 countsByYear W29486280522020 @default.
- W2948628052 countsByYear W29486280522021 @default.
- W2948628052 crossrefType "posted-content" @default.
- W2948628052 hasAuthorship W2948628052A5014855689 @default.
- W2948628052 hasAuthorship W2948628052A5021055773 @default.
- W2948628052 hasAuthorship W2948628052A5049069749 @default.
- W2948628052 hasAuthorship W2948628052A5051617344 @default.
- W2948628052 hasAuthorship W2948628052A5055033421 @default.
- W2948628052 hasAuthorship W2948628052A5076904467 @default.
- W2948628052 hasConcept C100660578 @default.
- W2948628052 hasConcept C117220453 @default.
- W2948628052 hasConcept C124101348 @default.
- W2948628052 hasConcept C154945302 @default.
- W2948628052 hasConcept C15744967 @default.
- W2948628052 hasConcept C162324750 @default.
- W2948628052 hasConcept C176217482 @default.
- W2948628052 hasConcept C180747234 @default.
- W2948628052 hasConcept C204321447 @default.
- W2948628052 hasConcept C21547014 @default.
- W2948628052 hasConcept C23123220 @default.
- W2948628052 hasConcept C2524010 @default.
- W2948628052 hasConcept C2985684807 @default.
- W2948628052 hasConcept C33923547 @default.
- W2948628052 hasConcept C41008148 @default.
- W2948628052 hasConcept C45235069 @default.
- W2948628052 hasConcept C81669768 @default.
- W2948628052 hasConceptScore W2948628052C100660578 @default.
- W2948628052 hasConceptScore W2948628052C117220453 @default.
- W2948628052 hasConceptScore W2948628052C124101348 @default.
- W2948628052 hasConceptScore W2948628052C154945302 @default.
- W2948628052 hasConceptScore W2948628052C15744967 @default.
- W2948628052 hasConceptScore W2948628052C162324750 @default.
- W2948628052 hasConceptScore W2948628052C176217482 @default.
- W2948628052 hasConceptScore W2948628052C180747234 @default.
- W2948628052 hasConceptScore W2948628052C204321447 @default.
- W2948628052 hasConceptScore W2948628052C21547014 @default.
- W2948628052 hasConceptScore W2948628052C23123220 @default.
- W2948628052 hasConceptScore W2948628052C2524010 @default.
- W2948628052 hasConceptScore W2948628052C2985684807 @default.
- W2948628052 hasConceptScore W2948628052C33923547 @default.
- W2948628052 hasConceptScore W2948628052C41008148 @default.
- W2948628052 hasConceptScore W2948628052C45235069 @default.
- W2948628052 hasConceptScore W2948628052C81669768 @default.
- W2948628052 hasLocation W29486280521 @default.
- W2948628052 hasOpenAccess W2948628052 @default.
- W2948628052 hasPrimaryLocation W29486280521 @default.