Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287112964> ?p ?o ?g. }
Showing items 1 to 68 of
68
with 100 items per page.
- W4287112964 abstract "Cued Speech (CS) is a visual communication system for the deaf or hearing impaired people. It combines lip movements with hand cues to obtain a complete phonetic repertoire. Current deep learning based methods on automatic CS recognition suffer from a common problem, which is the data scarcity. Until now, there are only two public single speaker datasets for French (238 sentences) and British English (97 sentences). In this work, we propose a cross-modal knowledge distillation method with teacher-student structure, which transfers audio speech information to CS to overcome the limited data problem. Firstly, we pretrain a teacher model for CS recognition with a large amount of open source audio speech data, and simultaneously pretrain the feature extractors for lips and hands using CS data. Then, we distill the knowledge from teacher model to the student model with frame-level and sequence-level distillation strategies. Importantly, for frame-level, we exploit multi-task learning to weigh losses automatically, to obtain the balance coefficient. Besides, we establish a five-speaker British English CS dataset for the first time. The proposed method is evaluated on French and British English CS datasets, showing superior CS recognition performance to the state-of-the-art (SOTA) by a large margin." @default.
- W4287112964 created "2022-07-25" @default.
- W4287112964 creator A5010906564 @default.
- W4287112964 creator A5012925910 @default.
- W4287112964 creator A5013152328 @default.
- W4287112964 creator A5063481044 @default.
- W4287112964 creator A5069354293 @default.
- W4287112964 creator A5088366112 @default.
- W4287112964 date "2021-06-25" @default.
- W4287112964 modified "2023-09-27" @default.
- W4287112964 title "Cross-Modal Knowledge Distillation Method for Automatic Cued Speech Recognition" @default.
- W4287112964 hasPublicationYear "2021" @default.
- W4287112964 type Work @default.
- W4287112964 citedByCount "0" @default.
- W4287112964 crossrefType "posted-content" @default.
- W4287112964 hasAuthorship W4287112964A5010906564 @default.
- W4287112964 hasAuthorship W4287112964A5012925910 @default.
- W4287112964 hasAuthorship W4287112964A5013152328 @default.
- W4287112964 hasAuthorship W4287112964A5063481044 @default.
- W4287112964 hasAuthorship W4287112964A5069354293 @default.
- W4287112964 hasAuthorship W4287112964A5088366112 @default.
- W4287112964 hasBestOaLocation W42871129641 @default.
- W4287112964 hasConcept C119857082 @default.
- W4287112964 hasConcept C126042441 @default.
- W4287112964 hasConcept C138885662 @default.
- W4287112964 hasConcept C154945302 @default.
- W4287112964 hasConcept C185592680 @default.
- W4287112964 hasConcept C188027245 @default.
- W4287112964 hasConcept C204321447 @default.
- W4287112964 hasConcept C2776401178 @default.
- W4287112964 hasConcept C28490314 @default.
- W4287112964 hasConcept C41008148 @default.
- W4287112964 hasConcept C41895202 @default.
- W4287112964 hasConcept C71139939 @default.
- W4287112964 hasConcept C76155785 @default.
- W4287112964 hasConcept C774472 @default.
- W4287112964 hasConcept C83195618 @default.
- W4287112964 hasConceptScore W4287112964C119857082 @default.
- W4287112964 hasConceptScore W4287112964C126042441 @default.
- W4287112964 hasConceptScore W4287112964C138885662 @default.
- W4287112964 hasConceptScore W4287112964C154945302 @default.
- W4287112964 hasConceptScore W4287112964C185592680 @default.
- W4287112964 hasConceptScore W4287112964C188027245 @default.
- W4287112964 hasConceptScore W4287112964C204321447 @default.
- W4287112964 hasConceptScore W4287112964C2776401178 @default.
- W4287112964 hasConceptScore W4287112964C28490314 @default.
- W4287112964 hasConceptScore W4287112964C41008148 @default.
- W4287112964 hasConceptScore W4287112964C41895202 @default.
- W4287112964 hasConceptScore W4287112964C71139939 @default.
- W4287112964 hasConceptScore W4287112964C76155785 @default.
- W4287112964 hasConceptScore W4287112964C774472 @default.
- W4287112964 hasConceptScore W4287112964C83195618 @default.
- W4287112964 hasLocation W42871129641 @default.
- W4287112964 hasOpenAccess W4287112964 @default.
- W4287112964 hasPrimaryLocation W42871129641 @default.
- W4287112964 hasRelatedWork W11722302 @default.
- W4287112964 hasRelatedWork W13024796 @default.
- W4287112964 hasRelatedWork W13423774 @default.
- W4287112964 hasRelatedWork W2218946 @default.
- W4287112964 hasRelatedWork W5289323 @default.
- W4287112964 hasRelatedWork W6657867 @default.
- W4287112964 hasRelatedWork W7296353 @default.
- W4287112964 hasRelatedWork W7939015 @default.
- W4287112964 hasRelatedWork W8499301 @default.
- W4287112964 hasRelatedWork W8573541 @default.
- W4287112964 isParatext "false" @default.
- W4287112964 isRetracted "false" @default.
- W4287112964 workType "article" @default.