Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287239054> ?p ?o ?g. }
Showing items 1 to 64 of
64
with 100 items per page.
- W4287239054 abstract "Transducer-based models, such as RNN-Transducer and transformer-transducer, have achieved great success in speech recognition. A typical transducer model decodes the output sequence conditioned on the current acoustic state and previously predicted tokens step by step. Statistically, The number of blank tokens in the prediction results accounts for nearly 90% of all tokens. It takes a lot of computation and time to predict the blank tokens, but only the non-blank tokens will appear in the final output sequence. Therefore, we propose a method named fast-skip regularization, which tries to align the blank position predicted by a transducer with that predicted by a CTC model. During the inference, the transducer model can predict the blank tokens in advance by a simple CTC project layer without many complicated forward calculations of the transducer decoder and then skip them, which will reduce the computation and improve the inference speed greatly. All experiments are conducted on a public Chinese mandarin dataset AISHELL-1. The results show that the fast-skip regularization can indeed help the transducer model learn the blank position alignments. Besides, the inference with fast-skip can be speeded up nearly 4 times with only a little performance degradation." @default.
- W4287239054 created "2022-07-25" @default.
- W4287239054 creator A5007322337 @default.
- W4287239054 creator A5012439063 @default.
- W4287239054 creator A5015229685 @default.
- W4287239054 creator A5061191464 @default.
- W4287239054 creator A5071074705 @default.
- W4287239054 creator A5078525423 @default.
- W4287239054 date "2021-04-06" @default.
- W4287239054 modified "2023-09-29" @default.
- W4287239054 title "FSR: Accelerating the Inference Process of Transducer-Based Models by Applying Fast-Skip Regularization" @default.
- W4287239054 hasPublicationYear "2021" @default.
- W4287239054 type Work @default.
- W4287239054 citedByCount "0" @default.
- W4287239054 crossrefType "posted-content" @default.
- W4287239054 hasAuthorship W4287239054A5007322337 @default.
- W4287239054 hasAuthorship W4287239054A5012439063 @default.
- W4287239054 hasAuthorship W4287239054A5015229685 @default.
- W4287239054 hasAuthorship W4287239054A5061191464 @default.
- W4287239054 hasAuthorship W4287239054A5071074705 @default.
- W4287239054 hasAuthorship W4287239054A5078525423 @default.
- W4287239054 hasBestOaLocation W42872390541 @default.
- W4287239054 hasConcept C11413529 @default.
- W4287239054 hasConcept C121332964 @default.
- W4287239054 hasConcept C127413603 @default.
- W4287239054 hasConcept C154945302 @default.
- W4287239054 hasConcept C24890656 @default.
- W4287239054 hasConcept C2776135515 @default.
- W4287239054 hasConcept C2776214188 @default.
- W4287239054 hasConcept C2778089247 @default.
- W4287239054 hasConcept C28490314 @default.
- W4287239054 hasConcept C41008148 @default.
- W4287239054 hasConcept C45374587 @default.
- W4287239054 hasConcept C56318395 @default.
- W4287239054 hasConcept C78519656 @default.
- W4287239054 hasConceptScore W4287239054C11413529 @default.
- W4287239054 hasConceptScore W4287239054C121332964 @default.
- W4287239054 hasConceptScore W4287239054C127413603 @default.
- W4287239054 hasConceptScore W4287239054C154945302 @default.
- W4287239054 hasConceptScore W4287239054C24890656 @default.
- W4287239054 hasConceptScore W4287239054C2776135515 @default.
- W4287239054 hasConceptScore W4287239054C2776214188 @default.
- W4287239054 hasConceptScore W4287239054C2778089247 @default.
- W4287239054 hasConceptScore W4287239054C28490314 @default.
- W4287239054 hasConceptScore W4287239054C41008148 @default.
- W4287239054 hasConceptScore W4287239054C45374587 @default.
- W4287239054 hasConceptScore W4287239054C56318395 @default.
- W4287239054 hasConceptScore W4287239054C78519656 @default.
- W4287239054 hasLocation W42872390541 @default.
- W4287239054 hasOpenAccess W4287239054 @default.
- W4287239054 hasPrimaryLocation W42872390541 @default.
- W4287239054 hasRelatedWork W10389550 @default.
- W4287239054 hasRelatedWork W12293515 @default.
- W4287239054 hasRelatedWork W12532419 @default.
- W4287239054 hasRelatedWork W12563130 @default.
- W4287239054 hasRelatedWork W4251996 @default.
- W4287239054 hasRelatedWork W4354089 @default.
- W4287239054 hasRelatedWork W4853991 @default.
- W4287239054 hasRelatedWork W5498931 @default.
- W4287239054 hasRelatedWork W7374853 @default.
- W4287239054 hasRelatedWork W10827768 @default.
- W4287239054 isParatext "false" @default.
- W4287239054 isRetracted "false" @default.
- W4287239054 workType "article" @default.