Matches in SemOpenAlex for { <https://semopenalex.org/work/W4308165973> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4308165973 abstract "We present BERT-CTC-Transducer (BECTRA), a novel end-to-end automatic speech recognition (E2E-ASR) model formulated by the transducer with a BERT-enhanced encoder. Integrating a large-scale pre-trained language model (LM) into E2E-ASR has been actively studied, aiming to utilize versatile linguistic knowledge for generating accurate text. One crucial factor that makes this integration challenging lies in the vocabulary mismatch; the vocabulary constructed for a pre-trained LM is generally too large for E2E-ASR training and is likely to have a mismatch against a target ASR domain. To overcome such an issue, we propose BECTRA, an extended version of our previous BERT-CTC, that realizes BERT-based E2E-ASR using a vocabulary of interest. BECTRA is a transducer-based model, which adopts BERT-CTC for its encoder and trains an ASR-specific decoder using a vocabulary suitable for a target task. With the combination of the transducer and BERT-CTC, we also propose a novel inference algorithm for taking advantage of both autoregressive and non-autoregressive decoding. Experimental results on several ASR tasks, varying in amounts of data, speaking styles, and languages, demonstrate that BECTRA outperforms BERT-CTC by effectively dealing with the vocabulary mismatch while exploiting BERT knowledge." @default.
- W4308165973 created "2022-11-08" @default.
- W4308165973 creator A5067868021 @default.
- W4308165973 creator A5074595893 @default.
- W4308165973 creator A5083886640 @default.
- W4308165973 creator A5090323167 @default.
- W4308165973 date "2022-11-01" @default.
- W4308165973 modified "2023-10-16" @default.
- W4308165973 title "BECTRA: Transducer-based End-to-End ASR with BERT-Enhanced Encoder" @default.
- W4308165973 doi "https://doi.org/10.48550/arxiv.2211.00792" @default.
- W4308165973 hasPublicationYear "2022" @default.
- W4308165973 type Work @default.
- W4308165973 citedByCount "0" @default.
- W4308165973 crossrefType "posted-content" @default.
- W4308165973 hasAuthorship W4308165973A5067868021 @default.
- W4308165973 hasAuthorship W4308165973A5074595893 @default.
- W4308165973 hasAuthorship W4308165973A5083886640 @default.
- W4308165973 hasAuthorship W4308165973A5090323167 @default.
- W4308165973 hasBestOaLocation W43081659731 @default.
- W4308165973 hasConcept C111919701 @default.
- W4308165973 hasConcept C11413529 @default.
- W4308165973 hasConcept C118505674 @default.
- W4308165973 hasConcept C119599485 @default.
- W4308165973 hasConcept C127413603 @default.
- W4308165973 hasConcept C137293760 @default.
- W4308165973 hasConcept C138885662 @default.
- W4308165973 hasConcept C154945302 @default.
- W4308165973 hasConcept C201995342 @default.
- W4308165973 hasConcept C2776214188 @default.
- W4308165973 hasConcept C2777601683 @default.
- W4308165973 hasConcept C2780451532 @default.
- W4308165973 hasConcept C28490314 @default.
- W4308165973 hasConcept C41008148 @default.
- W4308165973 hasConcept C41895202 @default.
- W4308165973 hasConcept C56318395 @default.
- W4308165973 hasConcept C57273362 @default.
- W4308165973 hasConceptScore W4308165973C111919701 @default.
- W4308165973 hasConceptScore W4308165973C11413529 @default.
- W4308165973 hasConceptScore W4308165973C118505674 @default.
- W4308165973 hasConceptScore W4308165973C119599485 @default.
- W4308165973 hasConceptScore W4308165973C127413603 @default.
- W4308165973 hasConceptScore W4308165973C137293760 @default.
- W4308165973 hasConceptScore W4308165973C138885662 @default.
- W4308165973 hasConceptScore W4308165973C154945302 @default.
- W4308165973 hasConceptScore W4308165973C201995342 @default.
- W4308165973 hasConceptScore W4308165973C2776214188 @default.
- W4308165973 hasConceptScore W4308165973C2777601683 @default.
- W4308165973 hasConceptScore W4308165973C2780451532 @default.
- W4308165973 hasConceptScore W4308165973C28490314 @default.
- W4308165973 hasConceptScore W4308165973C41008148 @default.
- W4308165973 hasConceptScore W4308165973C41895202 @default.
- W4308165973 hasConceptScore W4308165973C56318395 @default.
- W4308165973 hasConceptScore W4308165973C57273362 @default.
- W4308165973 hasLocation W43081659731 @default.
- W4308165973 hasOpenAccess W4308165973 @default.
- W4308165973 hasPrimaryLocation W43081659731 @default.
- W4308165973 hasRelatedWork W1481468666 @default.
- W4308165973 hasRelatedWork W1950712214 @default.
- W4308165973 hasRelatedWork W2547835662 @default.
- W4308165973 hasRelatedWork W3080136773 @default.
- W4308165973 hasRelatedWork W3107474891 @default.
- W4308165973 hasRelatedWork W3127787589 @default.
- W4308165973 hasRelatedWork W3157428800 @default.
- W4308165973 hasRelatedWork W4285757700 @default.
- W4308165973 hasRelatedWork W4287186213 @default.
- W4308165973 hasRelatedWork W4288102732 @default.
- W4308165973 isParatext "false" @default.
- W4308165973 isRetracted "false" @default.
- W4308165973 workType "article" @default.