Matches in SemOpenAlex for { <https://semopenalex.org/work/W4378510296> ?p ?o ?g. }
Showing items 1 to 79 of
79
with 100 items per page.
- W4378510296 abstract "While there has been significant development of models for Plain Language Summarization (PLS), evaluation remains a challenge. This is in part because PLS involves multiple, interrelated language transformations (e.g., adding background explanations, removing specialized terminology). No metrics are explicitly engineered for PLS, and the suitability of other text generation evaluation metrics remains unclear. To address these concerns, our study presents a granular meta-evaluation testbed, APPLS, designed to evaluate existing metrics for PLS. Drawing on insights from previous research, we define controlled perturbations for our testbed along four criteria that a metric of plain language should capture: informativeness, simplification, coherence, and faithfulness. Our analysis of metrics using this testbed reveals that current metrics fail to capture simplification, signaling a crucial gap. In response, we introduce POMME, a novel metric designed to assess text simplification in PLS. We demonstrate its correlation with simplification perturbations and validate across a variety of datasets. Our research contributes the first meta-evaluation testbed for PLS and a comprehensive evaluation of existing metrics, offering insights with relevance to other text generation tasks." @default.
- W4378510296 created "2023-05-27" @default.
- W4378510296 creator A5001778694 @default.
- W4378510296 creator A5029563909 @default.
- W4378510296 creator A5068707543 @default.
- W4378510296 creator A5070859841 @default.
- W4378510296 creator A5071178113 @default.
- W4378510296 date "2023-05-23" @default.
- W4378510296 modified "2023-09-30" @default.
- W4378510296 title "APPLS: A Meta-evaluation Testbed for Plain Language Summarization" @default.
- W4378510296 doi "https://doi.org/10.48550/arxiv.2305.14341" @default.
- W4378510296 hasPublicationYear "2023" @default.
- W4378510296 type Work @default.
- W4378510296 citedByCount "0" @default.
- W4378510296 crossrefType "posted-content" @default.
- W4378510296 hasAuthorship W4378510296A5001778694 @default.
- W4378510296 hasAuthorship W4378510296A5029563909 @default.
- W4378510296 hasAuthorship W4378510296A5068707543 @default.
- W4378510296 hasAuthorship W4378510296A5070859841 @default.
- W4378510296 hasAuthorship W4378510296A5071178113 @default.
- W4378510296 hasBestOaLocation W43785102961 @default.
- W4378510296 hasConcept C105795698 @default.
- W4378510296 hasConcept C119857082 @default.
- W4378510296 hasConcept C124101348 @default.
- W4378510296 hasConcept C127413603 @default.
- W4378510296 hasConcept C136764020 @default.
- W4378510296 hasConcept C138885662 @default.
- W4378510296 hasConcept C154945302 @default.
- W4378510296 hasConcept C158154518 @default.
- W4378510296 hasConcept C170858558 @default.
- W4378510296 hasConcept C176217482 @default.
- W4378510296 hasConcept C17744445 @default.
- W4378510296 hasConcept C199539241 @default.
- W4378510296 hasConcept C204321447 @default.
- W4378510296 hasConcept C21547014 @default.
- W4378510296 hasConcept C23123220 @default.
- W4378510296 hasConcept C2781181686 @default.
- W4378510296 hasConcept C31395832 @default.
- W4378510296 hasConcept C33923547 @default.
- W4378510296 hasConcept C41008148 @default.
- W4378510296 hasConcept C41895202 @default.
- W4378510296 hasConcept C547195049 @default.
- W4378510296 hasConceptScore W4378510296C105795698 @default.
- W4378510296 hasConceptScore W4378510296C119857082 @default.
- W4378510296 hasConceptScore W4378510296C124101348 @default.
- W4378510296 hasConceptScore W4378510296C127413603 @default.
- W4378510296 hasConceptScore W4378510296C136764020 @default.
- W4378510296 hasConceptScore W4378510296C138885662 @default.
- W4378510296 hasConceptScore W4378510296C154945302 @default.
- W4378510296 hasConceptScore W4378510296C158154518 @default.
- W4378510296 hasConceptScore W4378510296C170858558 @default.
- W4378510296 hasConceptScore W4378510296C176217482 @default.
- W4378510296 hasConceptScore W4378510296C17744445 @default.
- W4378510296 hasConceptScore W4378510296C199539241 @default.
- W4378510296 hasConceptScore W4378510296C204321447 @default.
- W4378510296 hasConceptScore W4378510296C21547014 @default.
- W4378510296 hasConceptScore W4378510296C23123220 @default.
- W4378510296 hasConceptScore W4378510296C2781181686 @default.
- W4378510296 hasConceptScore W4378510296C31395832 @default.
- W4378510296 hasConceptScore W4378510296C33923547 @default.
- W4378510296 hasConceptScore W4378510296C41008148 @default.
- W4378510296 hasConceptScore W4378510296C41895202 @default.
- W4378510296 hasConceptScore W4378510296C547195049 @default.
- W4378510296 hasLocation W43785102961 @default.
- W4378510296 hasOpenAccess W4378510296 @default.
- W4378510296 hasPrimaryLocation W43785102961 @default.
- W4378510296 hasRelatedWork W132250100 @default.
- W4378510296 hasRelatedWork W2093597205 @default.
- W4378510296 hasRelatedWork W2099984331 @default.
- W4378510296 hasRelatedWork W2106813246 @default.
- W4378510296 hasRelatedWork W2170202678 @default.
- W4378510296 hasRelatedWork W2389846579 @default.
- W4378510296 hasRelatedWork W2392495745 @default.
- W4378510296 hasRelatedWork W2489740420 @default.
- W4378510296 hasRelatedWork W2747680751 @default.
- W4378510296 hasRelatedWork W4287166693 @default.
- W4378510296 isParatext "false" @default.
- W4378510296 isRetracted "false" @default.
- W4378510296 workType "article" @default.