Matches in SemOpenAlex for { <https://semopenalex.org/work/W3157403457> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W3157403457 abstract "Online Transformer-based automatic speech recognition (ASR) systems have been extensively studied due to the increasing demand for streaming applications. Recently proposed Decoder-end Adaptive Computation Steps (DACS) algorithm for online Transformer ASR was shown to achieve state-of-the-art performance and outperform other existing methods. However, like any other online approach, the DACS-based attention heads in each of the Transformer decoder layers operate independently (or asynchronously) and lead to diverged attending positions. Since DACS employs a truncation threshold to determine the halting position, some of the attention weights are cut off untimely and might impact the stability and precision of decoding. To overcome these issues, here we propose a head-synchronous (HS) version of the DACS algorithm, where the boundary of attention is jointly detected by all the DACS heads in each decoder layer. ASR experiments on Wall Street Journal (WSJ), AIShell-1 and Librispeech show that the proposed method consistently outperforms vanilla DACS and achieves state-of-the-art performance. We will also demonstrate that HS-DACS has reduced decoding cost when compared to vanilla DACS." @default.
- W3157403457 created "2021-05-10" @default.
- W3157403457 creator A5044462635 @default.
- W3157403457 creator A5057188300 @default.
- W3157403457 creator A5086312107 @default.
- W3157403457 date "2021-04-26" @default.
- W3157403457 modified "2023-09-23" @default.
- W3157403457 title "Head-synchronous Decoding for Transformer-based Streaming ASR" @default.
- W3157403457 cites W1494198834 @default.
- W3157403457 cites W1828163288 @default.
- W3157403457 cites W2102113734 @default.
- W3157403457 cites W2127141656 @default.
- W3157403457 cites W2327501763 @default.
- W3157403457 cites W2913718171 @default.
- W3157403457 cites W2936078256 @default.
- W3157403457 cites W2936123380 @default.
- W3157403457 cites W2949975180 @default.
- W3157403457 cites W2962780374 @default.
- W3157403457 cites W2962784628 @default.
- W3157403457 cites W2962824709 @default.
- W3157403457 cites W2963242190 @default.
- W3157403457 cites W2963403868 @default.
- W3157403457 cites W2964272710 @default.
- W3157403457 cites W2972818416 @default.
- W3157403457 cites W2972977747 @default.
- W3157403457 cites W2981696585 @default.
- W3157403457 cites W2998814410 @default.
- W3157403457 cites W3007433671 @default.
- W3157403457 cites W3015457435 @default.
- W3157403457 cites W3015974384 @default.
- W3157403457 cites W3016167541 @default.
- W3157403457 cites W3026287411 @default.
- W3157403457 cites W3145511196 @default.
- W3157403457 cites W854541894 @default.
- W3157403457 cites W3037029661 @default.
- W3157403457 doi "https://doi.org/10.48550/arxiv.2104.12631" @default.
- W3157403457 hasPublicationYear "2021" @default.
- W3157403457 type Work @default.
- W3157403457 sameAs 3157403457 @default.
- W3157403457 citedByCount "1" @default.
- W3157403457 countsByYear W31574034572021 @default.
- W3157403457 crossrefType "posted-content" @default.
- W3157403457 hasAuthorship W3157403457A5044462635 @default.
- W3157403457 hasAuthorship W3157403457A5057188300 @default.
- W3157403457 hasAuthorship W3157403457A5086312107 @default.
- W3157403457 hasBestOaLocation W31574034571 @default.
- W3157403457 hasConcept C11413529 @default.
- W3157403457 hasConcept C119599485 @default.
- W3157403457 hasConcept C127413603 @default.
- W3157403457 hasConcept C165801399 @default.
- W3157403457 hasConcept C28490314 @default.
- W3157403457 hasConcept C41008148 @default.
- W3157403457 hasConcept C45374587 @default.
- W3157403457 hasConcept C57273362 @default.
- W3157403457 hasConcept C66322947 @default.
- W3157403457 hasConcept C79403827 @default.
- W3157403457 hasConceptScore W3157403457C11413529 @default.
- W3157403457 hasConceptScore W3157403457C119599485 @default.
- W3157403457 hasConceptScore W3157403457C127413603 @default.
- W3157403457 hasConceptScore W3157403457C165801399 @default.
- W3157403457 hasConceptScore W3157403457C28490314 @default.
- W3157403457 hasConceptScore W3157403457C41008148 @default.
- W3157403457 hasConceptScore W3157403457C45374587 @default.
- W3157403457 hasConceptScore W3157403457C57273362 @default.
- W3157403457 hasConceptScore W3157403457C66322947 @default.
- W3157403457 hasConceptScore W3157403457C79403827 @default.
- W3157403457 hasLocation W31574034571 @default.
- W3157403457 hasOpenAccess W3157403457 @default.
- W3157403457 hasPrimaryLocation W31574034571 @default.
- W3157403457 hasRelatedWork W2030492936 @default.
- W3157403457 hasRelatedWork W2146487322 @default.
- W3157403457 hasRelatedWork W2351992004 @default.
- W3157403457 hasRelatedWork W2354062721 @default.
- W3157403457 hasRelatedWork W2367936931 @default.
- W3157403457 hasRelatedWork W2383319832 @default.
- W3157403457 hasRelatedWork W2748952813 @default.
- W3157403457 hasRelatedWork W3156915121 @default.
- W3157403457 hasRelatedWork W3197898596 @default.
- W3157403457 hasRelatedWork W4281621826 @default.
- W3157403457 isParatext "false" @default.
- W3157403457 isRetracted "false" @default.
- W3157403457 magId "3157403457" @default.
- W3157403457 workType "article" @default.