Matches in SemOpenAlex for { <https://semopenalex.org/work/W4289596151> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W4289596151 abstract "Widely used evaluation metrics for text generation either do not work well with longer texts or fail to evaluate all aspects of text quality. In this paper, we introduce a new metric called SMART to mitigate such limitations. Specifically, We treat sentences as basic units of matching instead of tokens, and use a sentence matching function to soft-match candidate and reference sentences. Candidate sentences are also compared to sentences in the source documents to allow grounding (e.g., factuality) evaluation. Our results show that system-level correlations of our proposed metric with a model-based matching function outperforms all competing metrics on the SummEval summarization meta-evaluation dataset, while the same metric with a string-based matching function is competitive with current model-based metrics. The latter does not use any neural model, which is useful during model development phases where resources can be limited and fast evaluation is required. Finally, we also conducted extensive analyses showing that our proposed metrics work well with longer summaries and are less biased towards specific models." @default.
- W4289596151 created "2022-08-03" @default.
- W4289596151 creator A5009993083 @default.
- W4289596151 creator A5028127027 @default.
- W4289596151 creator A5039015273 @default.
- W4289596151 creator A5081801388 @default.
- W4289596151 date "2022-08-01" @default.
- W4289596151 modified "2023-09-23" @default.
- W4289596151 title "SMART: Sentences as Basic Units for Text Evaluation" @default.
- W4289596151 doi "https://doi.org/10.48550/arxiv.2208.01030" @default.
- W4289596151 hasPublicationYear "2022" @default.
- W4289596151 type Work @default.
- W4289596151 citedByCount "0" @default.
- W4289596151 crossrefType "posted-content" @default.
- W4289596151 hasAuthorship W4289596151A5009993083 @default.
- W4289596151 hasAuthorship W4289596151A5028127027 @default.
- W4289596151 hasAuthorship W4289596151A5039015273 @default.
- W4289596151 hasAuthorship W4289596151A5081801388 @default.
- W4289596151 hasBestOaLocation W42895961511 @default.
- W4289596151 hasConcept C105795698 @default.
- W4289596151 hasConcept C119857082 @default.
- W4289596151 hasConcept C124101348 @default.
- W4289596151 hasConcept C14036430 @default.
- W4289596151 hasConcept C154945302 @default.
- W4289596151 hasConcept C157486923 @default.
- W4289596151 hasConcept C162324750 @default.
- W4289596151 hasConcept C165064840 @default.
- W4289596151 hasConcept C170858558 @default.
- W4289596151 hasConcept C176217482 @default.
- W4289596151 hasConcept C204321447 @default.
- W4289596151 hasConcept C21547014 @default.
- W4289596151 hasConcept C22820288 @default.
- W4289596151 hasConcept C2777530160 @default.
- W4289596151 hasConcept C33923547 @default.
- W4289596151 hasConcept C37914503 @default.
- W4289596151 hasConcept C41008148 @default.
- W4289596151 hasConcept C68859911 @default.
- W4289596151 hasConcept C7757238 @default.
- W4289596151 hasConcept C78458016 @default.
- W4289596151 hasConcept C86803240 @default.
- W4289596151 hasConceptScore W4289596151C105795698 @default.
- W4289596151 hasConceptScore W4289596151C119857082 @default.
- W4289596151 hasConceptScore W4289596151C124101348 @default.
- W4289596151 hasConceptScore W4289596151C14036430 @default.
- W4289596151 hasConceptScore W4289596151C154945302 @default.
- W4289596151 hasConceptScore W4289596151C157486923 @default.
- W4289596151 hasConceptScore W4289596151C162324750 @default.
- W4289596151 hasConceptScore W4289596151C165064840 @default.
- W4289596151 hasConceptScore W4289596151C170858558 @default.
- W4289596151 hasConceptScore W4289596151C176217482 @default.
- W4289596151 hasConceptScore W4289596151C204321447 @default.
- W4289596151 hasConceptScore W4289596151C21547014 @default.
- W4289596151 hasConceptScore W4289596151C22820288 @default.
- W4289596151 hasConceptScore W4289596151C2777530160 @default.
- W4289596151 hasConceptScore W4289596151C33923547 @default.
- W4289596151 hasConceptScore W4289596151C37914503 @default.
- W4289596151 hasConceptScore W4289596151C41008148 @default.
- W4289596151 hasConceptScore W4289596151C68859911 @default.
- W4289596151 hasConceptScore W4289596151C7757238 @default.
- W4289596151 hasConceptScore W4289596151C78458016 @default.
- W4289596151 hasConceptScore W4289596151C86803240 @default.
- W4289596151 hasLocation W42895961511 @default.
- W4289596151 hasOpenAccess W4289596151 @default.
- W4289596151 hasPrimaryLocation W42895961511 @default.
- W4289596151 hasRelatedWork W13752685 @default.
- W4289596151 hasRelatedWork W1563810 @default.
- W4289596151 hasRelatedWork W2060686 @default.
- W4289596151 hasRelatedWork W3889012 @default.
- W4289596151 hasRelatedWork W4867410 @default.
- W4289596151 hasRelatedWork W5473796 @default.
- W4289596151 hasRelatedWork W5879097 @default.
- W4289596151 hasRelatedWork W803423 @default.
- W4289596151 hasRelatedWork W978549 @default.
- W4289596151 hasRelatedWork W13002482 @default.
- W4289596151 isParatext "false" @default.
- W4289596151 isRetracted "false" @default.
- W4289596151 workType "article" @default.