Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287777607> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4287777607 abstract "Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior probability has frequently been discarded in understanding the natural language. Thus, some recent spoken language understanding (SLU) modules have utilized end-to-end structures that preserve the uncertainty information. This further reduces the propagation of speech recognition error and guarantees computational efficiency. We claim that in this process, the speech comprehension can benefit from the inference of massive pre-trained language models (LMs). We transfer the knowledge from a concrete Transformer-based text LM to an SLU module which can face a data shortage, based on recent cross-modal distillation methodologies. We demonstrate the validity of our proposal upon the performance on Fluent Speech Command, an English SLU benchmark. Thereby, we experimentally verify our hypothesis that the knowledge could be shared from the top layer of the LM to a fully speech-based module, in which the abstracted speech is expected to meet the semantic representation." @default.
- W4287777607 created "2022-07-26" @default.
- W4287777607 creator A5005340561 @default.
- W4287777607 creator A5044323454 @default.
- W4287777607 creator A5051356511 @default.
- W4287777607 creator A5085004899 @default.
- W4287777607 date "2020-05-17" @default.
- W4287777607 modified "2023-09-24" @default.
- W4287777607 title "Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation" @default.
- W4287777607 doi "https://doi.org/10.48550/arxiv.2005.08213" @default.
- W4287777607 hasPublicationYear "2020" @default.
- W4287777607 type Work @default.
- W4287777607 citedByCount "0" @default.
- W4287777607 crossrefType "posted-content" @default.
- W4287777607 hasAuthorship W4287777607A5005340561 @default.
- W4287777607 hasAuthorship W4287777607A5044323454 @default.
- W4287777607 hasAuthorship W4287777607A5051356511 @default.
- W4287777607 hasAuthorship W4287777607A5085004899 @default.
- W4287777607 hasBestOaLocation W42877776071 @default.
- W4287777607 hasConcept C111919701 @default.
- W4287777607 hasConcept C121332964 @default.
- W4287777607 hasConcept C137293760 @default.
- W4287777607 hasConcept C154945302 @default.
- W4287777607 hasConcept C165801399 @default.
- W4287777607 hasConcept C204321447 @default.
- W4287777607 hasConcept C2776214188 @default.
- W4287777607 hasConcept C2776230583 @default.
- W4287777607 hasConcept C28490314 @default.
- W4287777607 hasConcept C41008148 @default.
- W4287777607 hasConcept C62520636 @default.
- W4287777607 hasConcept C66322947 @default.
- W4287777607 hasConcept C98045186 @default.
- W4287777607 hasConceptScore W4287777607C111919701 @default.
- W4287777607 hasConceptScore W4287777607C121332964 @default.
- W4287777607 hasConceptScore W4287777607C137293760 @default.
- W4287777607 hasConceptScore W4287777607C154945302 @default.
- W4287777607 hasConceptScore W4287777607C165801399 @default.
- W4287777607 hasConceptScore W4287777607C204321447 @default.
- W4287777607 hasConceptScore W4287777607C2776214188 @default.
- W4287777607 hasConceptScore W4287777607C2776230583 @default.
- W4287777607 hasConceptScore W4287777607C28490314 @default.
- W4287777607 hasConceptScore W4287777607C41008148 @default.
- W4287777607 hasConceptScore W4287777607C62520636 @default.
- W4287777607 hasConceptScore W4287777607C66322947 @default.
- W4287777607 hasConceptScore W4287777607C98045186 @default.
- W4287777607 hasLocation W42877776071 @default.
- W4287777607 hasOpenAccess W4287777607 @default.
- W4287777607 hasPrimaryLocation W42877776071 @default.
- W4287777607 hasRelatedWork W142374489 @default.
- W4287777607 hasRelatedWork W1563618553 @default.
- W4287777607 hasRelatedWork W204968311 @default.
- W4287777607 hasRelatedWork W2160788520 @default.
- W4287777607 hasRelatedWork W2359001871 @default.
- W4287777607 hasRelatedWork W3107474891 @default.
- W4287777607 hasRelatedWork W3196747313 @default.
- W4287777607 hasRelatedWork W3211341381 @default.
- W4287777607 hasRelatedWork W4283644197 @default.
- W4287777607 hasRelatedWork W4310915510 @default.
- W4287777607 isParatext "false" @default.
- W4287777607 isRetracted "false" @default.
- W4287777607 workType "article" @default.