Matches in SemOpenAlex for { <https://semopenalex.org/work/W4372341576> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W4372341576 abstract "SqueezeFormer has recently shown impressive performance in automatic speech recognition (ASR). However, its inference speed suffers from the quadratic complexity of softmax-attention (SA). In addition, limited by the large convolution kernel size, the local modeling ability of SqueezeFormer is insufficient. In this paper, we propose a novel method HybridFormer to improve SqueezeFormer in a fast and efficient way. Specifically, we first incorporate linear attention (LA) and propose a hybrid LASA paradigm to increase the model’s inference speed. Second, a hybrid neural architecture search (NAS) guided structural re-parameterization (SRep) mechanism, termed NSR, is proposed to enhance the ability of the model to extract local interactions. Extensive experiments conducted on the LibriSpeech dataset demonstrate that our proposed HybridFormer can achieve a 9.1% relative word error rate (WER) reduction over SqueezeFormer on the test-other dataset. Furthermore, when input speech is 30s, the HybridFormer can improve the model’s inference speed up to 18%. Our source code is available online <sup xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sup> ." @default.
- W4372341576 created "2023-05-07" @default.
- W4372341576 creator A5000925743 @default.
- W4372341576 creator A5002776728 @default.
- W4372341576 creator A5009348332 @default.
- W4372341576 creator A5027392261 @default.
- W4372341576 creator A5032321923 @default.
- W4372341576 creator A5090367911 @default.
- W4372341576 date "2023-06-04" @default.
- W4372341576 modified "2023-09-27" @default.
- W4372341576 title "Hybridformer: Improving Squeezeformer with Hybrid Attention and NSR Mechanism" @default.
- W4372341576 cites W1494198834 @default.
- W4372341576 cites W2127141656 @default.
- W4372341576 cites W2936774411 @default.
- W4372341576 cites W2963250244 @default.
- W4372341576 cites W2973215447 @default.
- W4372341576 cites W3015457435 @default.
- W4372341576 cites W3015537910 @default.
- W4372341576 cites W3016010032 @default.
- W4372341576 cites W3097777922 @default.
- W4372341576 cites W3163842642 @default.
- W4372341576 cites W3167976421 @default.
- W4372341576 cites W4225292962 @default.
- W4372341576 cites W4226191785 @default.
- W4372341576 cites W4283067311 @default.
- W4372341576 doi "https://doi.org/10.1109/icassp49357.2023.10096467" @default.
- W4372341576 hasPublicationYear "2023" @default.
- W4372341576 type Work @default.
- W4372341576 citedByCount "0" @default.
- W4372341576 crossrefType "proceedings-article" @default.
- W4372341576 hasAuthorship W4372341576A5000925743 @default.
- W4372341576 hasAuthorship W4372341576A5002776728 @default.
- W4372341576 hasAuthorship W4372341576A5009348332 @default.
- W4372341576 hasAuthorship W4372341576A5027392261 @default.
- W4372341576 hasAuthorship W4372341576A5032321923 @default.
- W4372341576 hasAuthorship W4372341576A5090367911 @default.
- W4372341576 hasBestOaLocation W43723415761 @default.
- W4372341576 hasConcept C111472728 @default.
- W4372341576 hasConcept C111919701 @default.
- W4372341576 hasConcept C11413529 @default.
- W4372341576 hasConcept C114614502 @default.
- W4372341576 hasConcept C138885662 @default.
- W4372341576 hasConcept C154945302 @default.
- W4372341576 hasConcept C177264268 @default.
- W4372341576 hasConcept C188441871 @default.
- W4372341576 hasConcept C199360897 @default.
- W4372341576 hasConcept C2524010 @default.
- W4372341576 hasConcept C2776214188 @default.
- W4372341576 hasConcept C2776760102 @default.
- W4372341576 hasConcept C28490314 @default.
- W4372341576 hasConcept C33923547 @default.
- W4372341576 hasConcept C40969351 @default.
- W4372341576 hasConcept C41008148 @default.
- W4372341576 hasConcept C43126263 @default.
- W4372341576 hasConcept C50644808 @default.
- W4372341576 hasConcept C74193536 @default.
- W4372341576 hasConcept C89611455 @default.
- W4372341576 hasConcept C90805587 @default.
- W4372341576 hasConceptScore W4372341576C111472728 @default.
- W4372341576 hasConceptScore W4372341576C111919701 @default.
- W4372341576 hasConceptScore W4372341576C11413529 @default.
- W4372341576 hasConceptScore W4372341576C114614502 @default.
- W4372341576 hasConceptScore W4372341576C138885662 @default.
- W4372341576 hasConceptScore W4372341576C154945302 @default.
- W4372341576 hasConceptScore W4372341576C177264268 @default.
- W4372341576 hasConceptScore W4372341576C188441871 @default.
- W4372341576 hasConceptScore W4372341576C199360897 @default.
- W4372341576 hasConceptScore W4372341576C2524010 @default.
- W4372341576 hasConceptScore W4372341576C2776214188 @default.
- W4372341576 hasConceptScore W4372341576C2776760102 @default.
- W4372341576 hasConceptScore W4372341576C28490314 @default.
- W4372341576 hasConceptScore W4372341576C33923547 @default.
- W4372341576 hasConceptScore W4372341576C40969351 @default.
- W4372341576 hasConceptScore W4372341576C41008148 @default.
- W4372341576 hasConceptScore W4372341576C43126263 @default.
- W4372341576 hasConceptScore W4372341576C50644808 @default.
- W4372341576 hasConceptScore W4372341576C74193536 @default.
- W4372341576 hasConceptScore W4372341576C89611455 @default.
- W4372341576 hasConceptScore W4372341576C90805587 @default.
- W4372341576 hasLocation W43723415761 @default.
- W4372341576 hasLocation W43723415762 @default.
- W4372341576 hasOpenAccess W4372341576 @default.
- W4372341576 hasPrimaryLocation W43723415761 @default.
- W4372341576 hasRelatedWork W1937192591 @default.
- W4372341576 hasRelatedWork W2019914509 @default.
- W4372341576 hasRelatedWork W2048917925 @default.
- W4372341576 hasRelatedWork W2134995938 @default.
- W4372341576 hasRelatedWork W2138093906 @default.
- W4372341576 hasRelatedWork W2787249583 @default.
- W4372341576 hasRelatedWork W3038160611 @default.
- W4372341576 hasRelatedWork W3101868899 @default.
- W4372341576 hasRelatedWork W3150750326 @default.
- W4372341576 hasRelatedWork W2116192687 @default.
- W4372341576 isParatext "false" @default.
- W4372341576 isRetracted "false" @default.
- W4372341576 workType "article" @default.