Matches in SemOpenAlex for { <https://semopenalex.org/work/W4378718218> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4378718218 abstract "In end-to-end speech translation, speech and text pre-trained models improve translation quality. Recently proposed models simply connect the pre-trained models of speech and text as encoder and decoder. Therefore, only the information from the final layer of encoders is input to the decoder. Since it is clear that the speech pre-trained model outputs different information from each layer, the simple connection method cannot fully utilize the information that the speech pre-trained model has. In this study, we propose an inter-connection mechanism that aggregates the information from each layer of the speech pre-trained model by weighted sums and inputs into the decoder. This mechanism increased BLEU by approximately 2 points in en-de, en-ja, and en-zh by increasing parameters by 2K when the speech pre-trained model was frozen. Furthermore, we investigated the contribution of each layer for each language by visualizing layer weights and found that the contributions were different." @default.
- W4378718218 created "2023-05-30" @default.
- W4378718218 creator A5020994673 @default.
- W4378718218 creator A5041646524 @default.
- W4378718218 date "2023-05-26" @default.
- W4378718218 modified "2023-10-16" @default.
- W4378718218 title "Inter-connection: Effective Connection between Pre-trained Encoder and Decoder for Speech Translation" @default.
- W4378718218 doi "https://doi.org/10.48550/arxiv.2305.16897" @default.
- W4378718218 hasPublicationYear "2023" @default.
- W4378718218 type Work @default.
- W4378718218 citedByCount "0" @default.
- W4378718218 crossrefType "posted-content" @default.
- W4378718218 hasAuthorship W4378718218A5020994673 @default.
- W4378718218 hasAuthorship W4378718218A5041646524 @default.
- W4378718218 hasBestOaLocation W43787182181 @default.
- W4378718218 hasConcept C104317684 @default.
- W4378718218 hasConcept C105580179 @default.
- W4378718218 hasConcept C111919701 @default.
- W4378718218 hasConcept C11413529 @default.
- W4378718218 hasConcept C118505674 @default.
- W4378718218 hasConcept C13355873 @default.
- W4378718218 hasConcept C149364088 @default.
- W4378718218 hasConcept C154945302 @default.
- W4378718218 hasConcept C178790620 @default.
- W4378718218 hasConcept C185592680 @default.
- W4378718218 hasConcept C203005215 @default.
- W4378718218 hasConcept C204321447 @default.
- W4378718218 hasConcept C2524010 @default.
- W4378718218 hasConcept C2779227376 @default.
- W4378718218 hasConcept C2780366754 @default.
- W4378718218 hasConcept C28490314 @default.
- W4378718218 hasConcept C33923547 @default.
- W4378718218 hasConcept C41008148 @default.
- W4378718218 hasConcept C55493867 @default.
- W4378718218 hasConcept C57273362 @default.
- W4378718218 hasConceptScore W4378718218C104317684 @default.
- W4378718218 hasConceptScore W4378718218C105580179 @default.
- W4378718218 hasConceptScore W4378718218C111919701 @default.
- W4378718218 hasConceptScore W4378718218C11413529 @default.
- W4378718218 hasConceptScore W4378718218C118505674 @default.
- W4378718218 hasConceptScore W4378718218C13355873 @default.
- W4378718218 hasConceptScore W4378718218C149364088 @default.
- W4378718218 hasConceptScore W4378718218C154945302 @default.
- W4378718218 hasConceptScore W4378718218C178790620 @default.
- W4378718218 hasConceptScore W4378718218C185592680 @default.
- W4378718218 hasConceptScore W4378718218C203005215 @default.
- W4378718218 hasConceptScore W4378718218C204321447 @default.
- W4378718218 hasConceptScore W4378718218C2524010 @default.
- W4378718218 hasConceptScore W4378718218C2779227376 @default.
- W4378718218 hasConceptScore W4378718218C2780366754 @default.
- W4378718218 hasConceptScore W4378718218C28490314 @default.
- W4378718218 hasConceptScore W4378718218C33923547 @default.
- W4378718218 hasConceptScore W4378718218C41008148 @default.
- W4378718218 hasConceptScore W4378718218C55493867 @default.
- W4378718218 hasConceptScore W4378718218C57273362 @default.
- W4378718218 hasLocation W43787182181 @default.
- W4378718218 hasOpenAccess W4378718218 @default.
- W4378718218 hasPrimaryLocation W43787182181 @default.
- W4378718218 hasRelatedWork W1985007624 @default.
- W4378718218 hasRelatedWork W2096451823 @default.
- W4378718218 hasRelatedWork W2128876910 @default.
- W4378718218 hasRelatedWork W2251832051 @default.
- W4378718218 hasRelatedWork W2435130738 @default.
- W4378718218 hasRelatedWork W2606032440 @default.
- W4378718218 hasRelatedWork W2971021139 @default.
- W4378718218 hasRelatedWork W4285229778 @default.
- W4378718218 hasRelatedWork W4372270126 @default.
- W4378718218 hasRelatedWork W970670907 @default.
- W4378718218 isParatext "false" @default.
- W4378718218 isRetracted "false" @default.
- W4378718218 workType "article" @default.