Matches in SemOpenAlex for { <https://semopenalex.org/work/W3180526677> ?p ?o ?g. }
- W3180526677 abstract "Speech Translation (ST) is the task of translating speech in one language into text in another language. Traditional cascaded approaches for ST, using Automatic Speech Recognition (ASR) and Machine Translation (MT) systems, are prone to error propagation. End-to-end approaches use only one system to avoid propagating error, yet are difficult to employ due to data scarcity. We explore zero-shot translation, which enables translating a pair of languages that is unseen during training, thus avoid the use of end-to-end ST data. Zero-shot translation has been shown to work for multilingual machine translation, yet has not been studied for speech translation. We attempt to build zero-shot ST models that are trained only on ASR and MT tasks but can do ST task during inference. The challenge is that the representation of text and audio is significantly different, thus the models learn ASR and MT tasks in different ways, making it non-trivial to perform zero-shot. These models tend to output the wrong language when performing zero-shot ST. We tackle the issues by including additional training data and an auxiliary loss function that minimizes the text-audio difference. Our experiment results and analysis show that the methods are promising for zero-shot ST. Moreover, our methods are particularly useful in the few-shot settings where a limited amount of ST data is available, with improvements of up to +11.8 BLEU points compared to direct end-to-end ST models and +3.9 BLEU points compared to ST models fine-tuned from pre-trained ASR model." @default.
- W3180526677 created "2021-07-19" @default.
- W3180526677 creator A5018054307 @default.
- W3180526677 date "2021-07-13" @default.
- W3180526677 modified "2023-09-27" @default.
- W3180526677 title "Zero-shot Speech Translation." @default.
- W3180526677 cites W2550821151 @default.
- W3180526677 cites W2555745756 @default.
- W3180526677 cites W2767204723 @default.
- W3180526677 cites W2770394828 @default.
- W3180526677 cites W2943493972 @default.
- W3180526677 cites W2963250244 @default.
- W3180526677 cites W2963403868 @default.
- W3180526677 cites W2963532001 @default.
- W3180526677 cites W2963834942 @default.
- W3180526677 cites W2964161387 @default.
- W3180526677 cites W2964172053 @default.
- W3180526677 cites W2971152344 @default.
- W3180526677 cites W2982129078 @default.
- W3180526677 cites W3016137827 @default.
- W3180526677 cites W3028712640 @default.
- W3180526677 cites W3034625919 @default.
- W3180526677 cites W3043665049 @default.
- W3180526677 cites W3054645415 @default.
- W3180526677 cites W3103029570 @default.
- W3180526677 cites W3116484298 @default.
- W3180526677 cites W3126770532 @default.
- W3180526677 cites W3162037819 @default.
- W3180526677 cites W3184351855 @default.
- W3180526677 cites W2493041683 @default.
- W3180526677 hasPublicationYear "2021" @default.
- W3180526677 type Work @default.
- W3180526677 sameAs 3180526677 @default.
- W3180526677 citedByCount "0" @default.
- W3180526677 crossrefType "posted-content" @default.
- W3180526677 hasAuthorship W3180526677A5018054307 @default.
- W3180526677 hasConcept C104317684 @default.
- W3180526677 hasConcept C105580179 @default.
- W3180526677 hasConcept C137293760 @default.
- W3180526677 hasConcept C138885662 @default.
- W3180526677 hasConcept C149364088 @default.
- W3180526677 hasConcept C154945302 @default.
- W3180526677 hasConcept C162324750 @default.
- W3180526677 hasConcept C17744445 @default.
- W3180526677 hasConcept C178790620 @default.
- W3180526677 hasConcept C185592680 @default.
- W3180526677 hasConcept C187736073 @default.
- W3180526677 hasConcept C199539241 @default.
- W3180526677 hasConcept C203005215 @default.
- W3180526677 hasConcept C204321447 @default.
- W3180526677 hasConcept C2776214188 @default.
- W3180526677 hasConcept C2776359362 @default.
- W3180526677 hasConcept C2778344882 @default.
- W3180526677 hasConcept C2780366754 @default.
- W3180526677 hasConcept C2780451532 @default.
- W3180526677 hasConcept C2780813799 @default.
- W3180526677 hasConcept C28490314 @default.
- W3180526677 hasConcept C40969351 @default.
- W3180526677 hasConcept C41008148 @default.
- W3180526677 hasConcept C41895202 @default.
- W3180526677 hasConcept C55493867 @default.
- W3180526677 hasConcept C622187 @default.
- W3180526677 hasConcept C94625758 @default.
- W3180526677 hasConceptScore W3180526677C104317684 @default.
- W3180526677 hasConceptScore W3180526677C105580179 @default.
- W3180526677 hasConceptScore W3180526677C137293760 @default.
- W3180526677 hasConceptScore W3180526677C138885662 @default.
- W3180526677 hasConceptScore W3180526677C149364088 @default.
- W3180526677 hasConceptScore W3180526677C154945302 @default.
- W3180526677 hasConceptScore W3180526677C162324750 @default.
- W3180526677 hasConceptScore W3180526677C17744445 @default.
- W3180526677 hasConceptScore W3180526677C178790620 @default.
- W3180526677 hasConceptScore W3180526677C185592680 @default.
- W3180526677 hasConceptScore W3180526677C187736073 @default.
- W3180526677 hasConceptScore W3180526677C199539241 @default.
- W3180526677 hasConceptScore W3180526677C203005215 @default.
- W3180526677 hasConceptScore W3180526677C204321447 @default.
- W3180526677 hasConceptScore W3180526677C2776214188 @default.
- W3180526677 hasConceptScore W3180526677C2776359362 @default.
- W3180526677 hasConceptScore W3180526677C2778344882 @default.
- W3180526677 hasConceptScore W3180526677C2780366754 @default.
- W3180526677 hasConceptScore W3180526677C2780451532 @default.
- W3180526677 hasConceptScore W3180526677C2780813799 @default.
- W3180526677 hasConceptScore W3180526677C28490314 @default.
- W3180526677 hasConceptScore W3180526677C40969351 @default.
- W3180526677 hasConceptScore W3180526677C41008148 @default.
- W3180526677 hasConceptScore W3180526677C41895202 @default.
- W3180526677 hasConceptScore W3180526677C55493867 @default.
- W3180526677 hasConceptScore W3180526677C622187 @default.
- W3180526677 hasConceptScore W3180526677C94625758 @default.
- W3180526677 hasLocation W31805266771 @default.
- W3180526677 hasOpenAccess W3180526677 @default.
- W3180526677 hasPrimaryLocation W31805266771 @default.
- W3180526677 hasRelatedWork W2804232614 @default.
- W3180526677 hasRelatedWork W2921280978 @default.
- W3180526677 hasRelatedWork W2933350699 @default.
- W3180526677 hasRelatedWork W2948697567 @default.
- W3180526677 hasRelatedWork W2952367383 @default.
- W3180526677 hasRelatedWork W2993286857 @default.
- W3180526677 hasRelatedWork W3018778770 @default.