Matches in SemOpenAlex for { <https://semopenalex.org/work/W3072195424> ?p ?o ?g. }
- W3072195424 abstract "Systems that generate natural language text from abstract meaning representations such as AMR are typically evaluated using automatic surface matching metrics that compare the generated texts to reference texts from which the input meaning representations were constructed. We show that besides well-known issues from which such metrics suffer, an additional problem arises when applying these metrics for AMR-to-text evaluation, since an abstract meaning representation allows for numerous surface realizations. In this work we aim to alleviate these issues by proposing $mathcal{M}mathcal{F}_beta$, a decomposable metric that builds on two pillars. The first is the principle of meaning preservation $mathcal{M}$: it measures to what extent a given AMR can be reconstructed from the generated sentence using SOTA AMR parsers and applying (fine-grained) AMR evaluation metrics to measure the distance between the original and the reconstructed AMR. The second pillar builds on a principle of (grammatical) form $mathcal{F}$ that measures the linguistic quality of the generated text, which we implement using SOTA language models. In two extensive pilot studies we show that fulfillment of both principles offers benefits for AMR-to-text evaluation, including explainability of scores. Since $mathcal{M}mathcal{F}_beta$ does not necessarily rely on gold AMRs, it may extend to other text generation tasks." @default.
- W3072195424 created "2020-08-24" @default.
- W3072195424 creator A5010534476 @default.
- W3072195424 creator A5023977688 @default.
- W3072195424 date "2020-08-20" @default.
- W3072195424 modified "2023-09-26" @default.
- W3072195424 title "Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR" @default.
- W3072195424 cites W1581218697 @default.
- W3072195424 cites W2101105183 @default.
- W3072195424 cites W2154652894 @default.
- W3072195424 cites W2158847908 @default.
- W3072195424 cites W2250213760 @default.
- W3072195424 cites W2250342921 @default.
- W3072195424 cites W2250375035 @default.
- W3072195424 cites W2251930319 @default.
- W3072195424 cites W2252123671 @default.
- W3072195424 cites W2506483933 @default.
- W3072195424 cites W2511950321 @default.
- W3072195424 cites W2606426273 @default.
- W3072195424 cites W2752446824 @default.
- W3072195424 cites W2760738985 @default.
- W3072195424 cites W2767814203 @default.
- W3072195424 cites W2786660442 @default.
- W3072195424 cites W2805583812 @default.
- W3072195424 cites W2888812214 @default.
- W3072195424 cites W2889254579 @default.
- W3072195424 cites W2916548775 @default.
- W3072195424 cites W2921792084 @default.
- W3072195424 cites W2940386657 @default.
- W3072195424 cites W2951048068 @default.
- W3072195424 cites W2951309718 @default.
- W3072195424 cites W2962947230 @default.
- W3072195424 cites W2963341956 @default.
- W3072195424 cites W2963672599 @default.
- W3072195424 cites W2963706350 @default.
- W3072195424 cites W2964035651 @default.
- W3072195424 cites W2964116568 @default.
- W3072195424 cites W2964164798 @default.
- W3072195424 cites W2965373594 @default.
- W3072195424 cites W2971187756 @default.
- W3072195424 cites W2972963535 @default.
- W3072195424 cites W2978017171 @default.
- W3072195424 cites W2996403597 @default.
- W3072195424 cites W2998702685 @default.
- W3072195424 cites W3003446182 @default.
- W3072195424 cites W3016254928 @default.
- W3072195424 cites W3022463379 @default.
- W3072195424 cites W3034723486 @default.
- W3072195424 cites W3034731179 @default.
- W3072195424 cites W3035202933 @default.
- W3072195424 cites W3035408261 @default.
- W3072195424 cites W3035586188 @default.
- W3072195424 cites W3035807844 @default.
- W3072195424 cites W3036973371 @default.
- W3072195424 cites W3080855795 @default.
- W3072195424 cites W3092180782 @default.
- W3072195424 cites W3116674942 @default.
- W3072195424 cites W3117367489 @default.
- W3072195424 hasPublicationYear "2020" @default.
- W3072195424 type Work @default.
- W3072195424 sameAs 3072195424 @default.
- W3072195424 citedByCount "1" @default.
- W3072195424 countsByYear W30721954242020 @default.
- W3072195424 crossrefType "posted-content" @default.
- W3072195424 hasAuthorship W3072195424A5010534476 @default.
- W3072195424 hasAuthorship W3072195424A5023977688 @default.
- W3072195424 hasConcept C105795698 @default.
- W3072195424 hasConcept C111472728 @default.
- W3072195424 hasConcept C124101348 @default.
- W3072195424 hasConcept C138885662 @default.
- W3072195424 hasConcept C154945302 @default.
- W3072195424 hasConcept C162324750 @default.
- W3072195424 hasConcept C165064840 @default.
- W3072195424 hasConcept C176217482 @default.
- W3072195424 hasConcept C17744445 @default.
- W3072195424 hasConcept C186644900 @default.
- W3072195424 hasConcept C199539241 @default.
- W3072195424 hasConcept C204321447 @default.
- W3072195424 hasConcept C21547014 @default.
- W3072195424 hasConcept C2776359362 @default.
- W3072195424 hasConcept C2777530160 @default.
- W3072195424 hasConcept C2779530757 @default.
- W3072195424 hasConcept C2780009758 @default.
- W3072195424 hasConcept C2780876879 @default.
- W3072195424 hasConcept C2985684807 @default.
- W3072195424 hasConcept C33923547 @default.
- W3072195424 hasConcept C41008148 @default.
- W3072195424 hasConcept C94625758 @default.
- W3072195424 hasConceptScore W3072195424C105795698 @default.
- W3072195424 hasConceptScore W3072195424C111472728 @default.
- W3072195424 hasConceptScore W3072195424C124101348 @default.
- W3072195424 hasConceptScore W3072195424C138885662 @default.
- W3072195424 hasConceptScore W3072195424C154945302 @default.
- W3072195424 hasConceptScore W3072195424C162324750 @default.
- W3072195424 hasConceptScore W3072195424C165064840 @default.
- W3072195424 hasConceptScore W3072195424C176217482 @default.
- W3072195424 hasConceptScore W3072195424C17744445 @default.
- W3072195424 hasConceptScore W3072195424C186644900 @default.
- W3072195424 hasConceptScore W3072195424C199539241 @default.
- W3072195424 hasConceptScore W3072195424C204321447 @default.