Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204322065> ?p ?o ?g. }
Showing items 1 to 58 of
58
with 100 items per page.
- W3204322065 abstract "It is common practice to represent spoken languages at their phonetic level. However, for sign languages, this implies breaking motion into its constituent motion primitives. Avatar based Sign Language Production (SLP) has traditionally done just this, building up animation from sequences of hand motions, shapes and facial expressions. However, more recent deep learning based solutions to SLP have tackled the problem using a single network that estimates the full skeletal structure. We propose splitting the SLP task into two distinct jointly-trained sub-tasks. The first translation sub-task translates from spoken language to a latent sign language representation, with gloss supervision. Subsequently, the animation sub-task aims to produce expressive sign language sequences that closely resemble the learnt spatio-temporal representation. Using a progressive transformer for the translation sub-task, we propose a novel Mixture of Motion Primitives (MoMP) architecture for sign language animation. A set of distinct motion primitives are learnt during training, that can be temporally combined at inference to animate continuous sign language sequences. We evaluate on the challenging RWTH-PHOENIX-Weather-2014T(PHOENIX14T) dataset, presenting extensive ablation studies and showing that MoMP outperforms baselines in user evaluations. We achieve state-of-the-art back translation performance with an 11% improvement over competing results. Importantly, and for the first time, we showcase stronger performance for a full translation pipeline going from spoken language to sign, than from gloss to sign." @default.
- W3204322065 created "2021-10-11" @default.
- W3204322065 creator A5033011330 @default.
- W3204322065 creator A5044490167 @default.
- W3204322065 creator A5058880614 @default.
- W3204322065 date "2021-07-23" @default.
- W3204322065 modified "2023-09-27" @default.
- W3204322065 title "Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives" @default.
- W3204322065 doi "https://doi.org/10.48550/arxiv.2107.11317" @default.
- W3204322065 hasPublicationYear "2021" @default.
- W3204322065 type Work @default.
- W3204322065 sameAs 3204322065 @default.
- W3204322065 citedByCount "0" @default.
- W3204322065 crossrefType "posted-content" @default.
- W3204322065 hasAuthorship W3204322065A5033011330 @default.
- W3204322065 hasAuthorship W3204322065A5044490167 @default.
- W3204322065 hasAuthorship W3204322065A5058880614 @default.
- W3204322065 hasBestOaLocation W32043220651 @default.
- W3204322065 hasConcept C104114177 @default.
- W3204322065 hasConcept C121684516 @default.
- W3204322065 hasConcept C138885662 @default.
- W3204322065 hasConcept C154945302 @default.
- W3204322065 hasConcept C204321447 @default.
- W3204322065 hasConcept C28490314 @default.
- W3204322065 hasConcept C41008148 @default.
- W3204322065 hasConcept C41895202 @default.
- W3204322065 hasConcept C48007421 @default.
- W3204322065 hasConcept C502989409 @default.
- W3204322065 hasConcept C522192633 @default.
- W3204322065 hasConceptScore W3204322065C104114177 @default.
- W3204322065 hasConceptScore W3204322065C121684516 @default.
- W3204322065 hasConceptScore W3204322065C138885662 @default.
- W3204322065 hasConceptScore W3204322065C154945302 @default.
- W3204322065 hasConceptScore W3204322065C204321447 @default.
- W3204322065 hasConceptScore W3204322065C28490314 @default.
- W3204322065 hasConceptScore W3204322065C41008148 @default.
- W3204322065 hasConceptScore W3204322065C41895202 @default.
- W3204322065 hasConceptScore W3204322065C48007421 @default.
- W3204322065 hasConceptScore W3204322065C502989409 @default.
- W3204322065 hasConceptScore W3204322065C522192633 @default.
- W3204322065 hasLocation W32043220651 @default.
- W3204322065 hasLocation W32043220652 @default.
- W3204322065 hasOpenAccess W3204322065 @default.
- W3204322065 hasPrimaryLocation W32043220651 @default.
- W3204322065 hasRelatedWork W1851213814 @default.
- W3204322065 hasRelatedWork W2018882065 @default.
- W3204322065 hasRelatedWork W2354203452 @default.
- W3204322065 hasRelatedWork W2379480643 @default.
- W3204322065 hasRelatedWork W2384764527 @default.
- W3204322065 hasRelatedWork W2682927604 @default.
- W3204322065 hasRelatedWork W2756143337 @default.
- W3204322065 hasRelatedWork W2886251910 @default.
- W3204322065 hasRelatedWork W2898309900 @default.
- W3204322065 hasRelatedWork W3107474891 @default.
- W3204322065 isParatext "false" @default.
- W3204322065 isRetracted "false" @default.
- W3204322065 magId "3204322065" @default.
- W3204322065 workType "article" @default.