Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385570981> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4385570981 abstract "There have been several meta-evaluation studies on the correlation between human ratings and offline machine translation (MT) evaluation metrics such as BLEU, chrF2, BertScore and COMET. These metrics have been used to evaluate simultaneous speech translation (SST) but their correlations with human ratings of SST, which has been recently collected as Continuous Ratings (CR), are unclear. In this paper, we leverage the evaluations of candidate systems submitted to the English-German SST task at IWSLT 2022 and conduct an extensive correlation analysis of CR and the aforementioned metrics. Our study reveals that the offline metrics are well correlated with CR and can be reliably used for evaluating machine translation in simultaneous mode, with some limitations on the test set size. We conclude that given the current quality levels of SST, these metrics can be used as proxies for CR, alleviating the need for large scale human evaluation. Additionally, we observe that correlations of the metrics with translation as a reference is significantly higher than with simultaneous interpreting, and thus we recommend the former for reliable evaluation." @default.
- W4385570981 created "2023-08-05" @default.
- W4385570981 creator A5056031235 @default.
- W4385570981 creator A5077362985 @default.
- W4385570981 creator A5077746237 @default.
- W4385570981 date "2023-01-01" @default.
- W4385570981 modified "2023-09-24" @default.
- W4385570981 title "MT Metrics Correlate with Human Ratings of Simultaneous Speech Translation" @default.
- W4385570981 doi "https://doi.org/10.18653/v1/2023.iwslt-1.12" @default.
- W4385570981 hasPublicationYear "2023" @default.
- W4385570981 type Work @default.
- W4385570981 citedByCount "0" @default.
- W4385570981 crossrefType "proceedings-article" @default.
- W4385570981 hasAuthorship W4385570981A5056031235 @default.
- W4385570981 hasAuthorship W4385570981A5077362985 @default.
- W4385570981 hasAuthorship W4385570981A5077746237 @default.
- W4385570981 hasBestOaLocation W43855709811 @default.
- W4385570981 hasConcept C117220453 @default.
- W4385570981 hasConcept C119857082 @default.
- W4385570981 hasConcept C135784402 @default.
- W4385570981 hasConcept C148526163 @default.
- W4385570981 hasConcept C153083717 @default.
- W4385570981 hasConcept C154945302 @default.
- W4385570981 hasConcept C162324750 @default.
- W4385570981 hasConcept C177264268 @default.
- W4385570981 hasConcept C187736073 @default.
- W4385570981 hasConcept C199360897 @default.
- W4385570981 hasConcept C203005215 @default.
- W4385570981 hasConcept C204321447 @default.
- W4385570981 hasConcept C24687705 @default.
- W4385570981 hasConcept C2524010 @default.
- W4385570981 hasConcept C2780451532 @default.
- W4385570981 hasConcept C28490314 @default.
- W4385570981 hasConcept C33923547 @default.
- W4385570981 hasConcept C41008148 @default.
- W4385570981 hasConcept C622187 @default.
- W4385570981 hasConceptScore W4385570981C117220453 @default.
- W4385570981 hasConceptScore W4385570981C119857082 @default.
- W4385570981 hasConceptScore W4385570981C135784402 @default.
- W4385570981 hasConceptScore W4385570981C148526163 @default.
- W4385570981 hasConceptScore W4385570981C153083717 @default.
- W4385570981 hasConceptScore W4385570981C154945302 @default.
- W4385570981 hasConceptScore W4385570981C162324750 @default.
- W4385570981 hasConceptScore W4385570981C177264268 @default.
- W4385570981 hasConceptScore W4385570981C187736073 @default.
- W4385570981 hasConceptScore W4385570981C199360897 @default.
- W4385570981 hasConceptScore W4385570981C203005215 @default.
- W4385570981 hasConceptScore W4385570981C204321447 @default.
- W4385570981 hasConceptScore W4385570981C24687705 @default.
- W4385570981 hasConceptScore W4385570981C2524010 @default.
- W4385570981 hasConceptScore W4385570981C2780451532 @default.
- W4385570981 hasConceptScore W4385570981C28490314 @default.
- W4385570981 hasConceptScore W4385570981C33923547 @default.
- W4385570981 hasConceptScore W4385570981C41008148 @default.
- W4385570981 hasConceptScore W4385570981C622187 @default.
- W4385570981 hasLocation W43855709811 @default.
- W4385570981 hasOpenAccess W4385570981 @default.
- W4385570981 hasPrimaryLocation W43855709811 @default.
- W4385570981 hasRelatedWork W170118632 @default.
- W4385570981 hasRelatedWork W1996041053 @default.
- W4385570981 hasRelatedWork W2008544799 @default.
- W4385570981 hasRelatedWork W2132122285 @default.
- W4385570981 hasRelatedWork W2152311128 @default.
- W4385570981 hasRelatedWork W2251802443 @default.
- W4385570981 hasRelatedWork W2578135827 @default.
- W4385570981 hasRelatedWork W3182535952 @default.
- W4385570981 hasRelatedWork W4287236333 @default.
- W4385570981 hasRelatedWork W4310557741 @default.
- W4385570981 isParatext "false" @default.
- W4385570981 isRetracted "false" @default.
- W4385570981 workType "article" @default.