Matches in SemOpenAlex for { <https://semopenalex.org/work/W3201953150> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W3201953150 abstract "The attention-based encoder-decoder structure is popular in automatic speech recognition (ASR). However, it relies heavily on transcribed data. In this paper, we propose a novel pre-training strategy for the encoder-decoder sequence-to-sequence (seq2seq) model by utilizing unpaired speech and transcripts. The pre-training process consists of two stages, acoustic pre-training and linguistic pre-training. In the acoustic pre-training stage, we use a large amount of speech to pre-train the encoder by predicting masked speech feature chunks with their contexts. In the linguistic pre-training stage, we first generate synthesized speech from a large number of transcripts using a text-to-speech (TTS) system and then use the synthesized paired data to pre-train the decoder. The two-stage pre-training is conducted on the AISHELL-2 dataset, and we apply this pre-trained model to multiple subsets of AISHELL-1 and HKUST for post-training. As the size of the subset increases, we obtain relative character error rate reduction (CERR) from 38.24% to 7.88% on AISHELL-1 and from 12.00% to 1.20% on HKUST." @default.
- W3201953150 created "2021-10-11" @default.
- W3201953150 creator A5000499123 @default.
- W3201953150 creator A5027251228 @default.
- W3201953150 creator A5068469832 @default.
- W3201953150 date "2021-07-18" @default.
- W3201953150 modified "2023-09-23" @default.
- W3201953150 title "Two-Stage Pre-Training for Sequence to Sequence Speech Recognition" @default.
- W3201953150 cites W1526236009 @default.
- W3201953150 cites W2127141656 @default.
- W3201953150 cites W2157331557 @default.
- W3201953150 cites W2889213362 @default.
- W3201953150 cites W2913318911 @default.
- W3201953150 cites W2940322076 @default.
- W3201953150 cites W2948947170 @default.
- W3201953150 cites W2962826786 @default.
- W3201953150 cites W2963242190 @default.
- W3201953150 cites W2972694856 @default.
- W3201953150 cites W3003875258 @default.
- W3201953150 doi "https://doi.org/10.1109/ijcnn52387.2021.9534170" @default.
- W3201953150 hasPublicationYear "2021" @default.
- W3201953150 type Work @default.
- W3201953150 sameAs 3201953150 @default.
- W3201953150 citedByCount "1" @default.
- W3201953150 countsByYear W32019531502023 @default.
- W3201953150 crossrefType "proceedings-article" @default.
- W3201953150 hasAuthorship W3201953150A5000499123 @default.
- W3201953150 hasAuthorship W3201953150A5027251228 @default.
- W3201953150 hasAuthorship W3201953150A5068469832 @default.
- W3201953150 hasConcept C111335779 @default.
- W3201953150 hasConcept C111919701 @default.
- W3201953150 hasConcept C118505674 @default.
- W3201953150 hasConcept C121332964 @default.
- W3201953150 hasConcept C138885662 @default.
- W3201953150 hasConcept C153180895 @default.
- W3201953150 hasConcept C153294291 @default.
- W3201953150 hasConcept C154945302 @default.
- W3201953150 hasConcept C155635449 @default.
- W3201953150 hasConcept C204321447 @default.
- W3201953150 hasConcept C2524010 @default.
- W3201953150 hasConcept C2776401178 @default.
- W3201953150 hasConcept C2777211547 @default.
- W3201953150 hasConcept C2778112365 @default.
- W3201953150 hasConcept C2780861071 @default.
- W3201953150 hasConcept C28490314 @default.
- W3201953150 hasConcept C33923547 @default.
- W3201953150 hasConcept C40969351 @default.
- W3201953150 hasConcept C41008148 @default.
- W3201953150 hasConcept C41895202 @default.
- W3201953150 hasConcept C51632099 @default.
- W3201953150 hasConcept C54355233 @default.
- W3201953150 hasConcept C61328038 @default.
- W3201953150 hasConcept C86803240 @default.
- W3201953150 hasConcept C98045186 @default.
- W3201953150 hasConceptScore W3201953150C111335779 @default.
- W3201953150 hasConceptScore W3201953150C111919701 @default.
- W3201953150 hasConceptScore W3201953150C118505674 @default.
- W3201953150 hasConceptScore W3201953150C121332964 @default.
- W3201953150 hasConceptScore W3201953150C138885662 @default.
- W3201953150 hasConceptScore W3201953150C153180895 @default.
- W3201953150 hasConceptScore W3201953150C153294291 @default.
- W3201953150 hasConceptScore W3201953150C154945302 @default.
- W3201953150 hasConceptScore W3201953150C155635449 @default.
- W3201953150 hasConceptScore W3201953150C204321447 @default.
- W3201953150 hasConceptScore W3201953150C2524010 @default.
- W3201953150 hasConceptScore W3201953150C2776401178 @default.
- W3201953150 hasConceptScore W3201953150C2777211547 @default.
- W3201953150 hasConceptScore W3201953150C2778112365 @default.
- W3201953150 hasConceptScore W3201953150C2780861071 @default.
- W3201953150 hasConceptScore W3201953150C28490314 @default.
- W3201953150 hasConceptScore W3201953150C33923547 @default.
- W3201953150 hasConceptScore W3201953150C40969351 @default.
- W3201953150 hasConceptScore W3201953150C41008148 @default.
- W3201953150 hasConceptScore W3201953150C41895202 @default.
- W3201953150 hasConceptScore W3201953150C51632099 @default.
- W3201953150 hasConceptScore W3201953150C54355233 @default.
- W3201953150 hasConceptScore W3201953150C61328038 @default.
- W3201953150 hasConceptScore W3201953150C86803240 @default.
- W3201953150 hasConceptScore W3201953150C98045186 @default.
- W3201953150 hasLocation W32019531501 @default.
- W3201953150 hasOpenAccess W3201953150 @default.
- W3201953150 hasPrimaryLocation W32019531501 @default.
- W3201953150 hasRelatedWork W2285081780 @default.
- W3201953150 hasRelatedWork W2793122029 @default.
- W3201953150 hasRelatedWork W2937780860 @default.
- W3201953150 hasRelatedWork W3015547233 @default.
- W3201953150 hasRelatedWork W3129248830 @default.
- W3201953150 hasRelatedWork W3201953150 @default.
- W3201953150 hasRelatedWork W4214911529 @default.
- W3201953150 hasRelatedWork W4224916606 @default.
- W3201953150 hasRelatedWork W4321471542 @default.
- W3201953150 hasRelatedWork W4380605396 @default.
- W3201953150 isParatext "false" @default.
- W3201953150 isRetracted "false" @default.
- W3201953150 magId "3201953150" @default.
- W3201953150 workType "article" @default.