Matches in SemOpenAlex for { <https://semopenalex.org/work/W560256607> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W560256607 abstract "Although both speech and gesture recognition have been studied extensively, vision-based acquisition of natural gestures still remains a challenging problem. Poor recognition accuracy of spontaneous conversational gestures is one of the reasons that restricted their applications for human-computer interaction, biometrics, animated character synthesis and etc. To date, attempts to improve that accuracy have been mostly limited to multimodal frameworks exploiting gesture-word level associations. Such semantically motivated schemas inherited the complexity of natural language and gesture understanding and were found hardly applicable outside of restricted domains. This thesis proposes a new approach that explores prosodic levels of structuring during coverbal gesture production for disambiguation of and gestures. It is based on a multimodal co-analysis of hand kinematics and various prosodic manifestations in speech such as changes of intonation, loudness, and pause duration. Continuous hand movement is represented as a sequence of distinct gesture primitives extracted from the visual signal. Two types of gesticulation are considered: deictic in Weather Channel broadcast and spontaneous beats in presentation monologue videos. For deictic gestures, we define separate computational frameworks to model co-articulation phenomenon and production constraints. For conversational beats, a set of gesture-speech articulations is defined to represent different functions within a narrative discourse. In this analysis observable perturbations in vocal production are related to the concurrent beat-like gestures. The efficacy of the proposed approach is demonstrated on a large multimodal corpus by a significant improvement of gesture recognition accuracy." @default.
- W560256607 created "2016-06-24" @default.
- W560256607 creator A5058998065 @default.
- W560256607 creator A5060520833 @default.
- W560256607 date "2004-01-01" @default.
- W560256607 modified "2023-10-16" @default.
- W560256607 title "A prosody based perspective for automated understanding of coverbal gestures" @default.
- W560256607 hasPublicationYear "2004" @default.
- W560256607 type Work @default.
- W560256607 sameAs 560256607 @default.
- W560256607 citedByCount "0" @default.
- W560256607 crossrefType "book" @default.
- W560256607 hasAuthorship W560256607A5058998065 @default.
- W560256607 hasAuthorship W560256607A5060520833 @default.
- W560256607 hasConcept C13077596 @default.
- W560256607 hasConcept C138885662 @default.
- W560256607 hasConcept C154945302 @default.
- W560256607 hasConcept C159437735 @default.
- W560256607 hasConcept C204321447 @default.
- W560256607 hasConcept C207347870 @default.
- W560256607 hasConcept C28490314 @default.
- W560256607 hasConcept C41008148 @default.
- W560256607 hasConcept C41895202 @default.
- W560256607 hasConcept C542774811 @default.
- W560256607 hasConceptScore W560256607C13077596 @default.
- W560256607 hasConceptScore W560256607C138885662 @default.
- W560256607 hasConceptScore W560256607C154945302 @default.
- W560256607 hasConceptScore W560256607C159437735 @default.
- W560256607 hasConceptScore W560256607C204321447 @default.
- W560256607 hasConceptScore W560256607C207347870 @default.
- W560256607 hasConceptScore W560256607C28490314 @default.
- W560256607 hasConceptScore W560256607C41008148 @default.
- W560256607 hasConceptScore W560256607C41895202 @default.
- W560256607 hasConceptScore W560256607C542774811 @default.
- W560256607 hasLocation W5602566071 @default.
- W560256607 hasOpenAccess W560256607 @default.
- W560256607 hasPrimaryLocation W5602566071 @default.
- W560256607 hasRelatedWork W1208039178 @default.
- W560256607 hasRelatedWork W1526588624 @default.
- W560256607 hasRelatedWork W182618010 @default.
- W560256607 hasRelatedWork W1964319139 @default.
- W560256607 hasRelatedWork W1975010679 @default.
- W560256607 hasRelatedWork W1988573256 @default.
- W560256607 hasRelatedWork W1989386832 @default.
- W560256607 hasRelatedWork W1990191258 @default.
- W560256607 hasRelatedWork W2011931090 @default.
- W560256607 hasRelatedWork W2573074326 @default.
- W560256607 hasRelatedWork W2755621035 @default.
- W560256607 hasRelatedWork W3083173864 @default.
- W560256607 hasRelatedWork W3086490831 @default.
- W560256607 hasRelatedWork W3093647117 @default.
- W560256607 hasRelatedWork W3099402851 @default.
- W560256607 hasRelatedWork W3169761957 @default.
- W560256607 hasRelatedWork W3170177690 @default.
- W560256607 hasRelatedWork W3178741174 @default.
- W560256607 hasRelatedWork W3192225748 @default.
- W560256607 hasRelatedWork W3197859103 @default.
- W560256607 isParatext "false" @default.
- W560256607 isRetracted "false" @default.
- W560256607 magId "560256607" @default.
- W560256607 workType "book" @default.