Matches in SemOpenAlex for { <https://semopenalex.org/work/W4323922009> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4323922009 abstract "Accurately estimating 3D hand pose is crucial for understanding how humans interact with the world. Despite remarkable progress, existing methods often struggle to generate plausible hand poses when the hand is heavily occluded or blurred. In videos, the movements of the hand allow us to observe various parts of the hand that may be occluded or blurred in a single frame. To adaptively leverage the visual clue before and after the occlusion or blurring for robust hand pose estimation, we propose the Deformer: a framework that implicitly reasons about the relationship between hand parts within the same image (spatial dimension) and different timesteps (temporal dimension). We show that a naive application of the transformer self-attention mechanism is not sufficient because motion blur or occlusions in certain frames can lead to heavily distorted hand features and generate imprecise keys and queries. To address this challenge, we incorporate a Dynamic Fusion Module into Deformer, which predicts the deformation of the hand and warps the hand mesh predictions from nearby frames to explicitly support the current frame estimation. Furthermore, we have observed that errors are unevenly distributed across different hand parts, with vertices around fingertips having disproportionately higher errors than those around the palm. We mitigate this issue by introducing a new loss function called maxMSE that automatically adjusts the weight of every vertex to focus the model on critical hand parts. Extensive experiments show that our method significantly outperforms state-of-the-art methods by 10%, and is more robust to occlusions (over 14%)." @default.
- W4323922009 created "2023-03-12" @default.
- W4323922009 creator A5018518655 @default.
- W4323922009 creator A5026602389 @default.
- W4323922009 creator A5037322163 @default.
- W4323922009 creator A5042658750 @default.
- W4323922009 creator A5072539599 @default.
- W4323922009 date "2023-03-08" @default.
- W4323922009 modified "2023-09-25" @default.
- W4323922009 title "Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation" @default.
- W4323922009 doi "https://doi.org/10.48550/arxiv.2303.04991" @default.
- W4323922009 hasPublicationYear "2023" @default.
- W4323922009 type Work @default.
- W4323922009 citedByCount "0" @default.
- W4323922009 crossrefType "posted-content" @default.
- W4323922009 hasAuthorship W4323922009A5018518655 @default.
- W4323922009 hasAuthorship W4323922009A5026602389 @default.
- W4323922009 hasAuthorship W4323922009A5037322163 @default.
- W4323922009 hasAuthorship W4323922009A5042658750 @default.
- W4323922009 hasAuthorship W4323922009A5072539599 @default.
- W4323922009 hasBestOaLocation W43239220091 @default.
- W4323922009 hasConcept C104317684 @default.
- W4323922009 hasConcept C115961682 @default.
- W4323922009 hasConcept C153083717 @default.
- W4323922009 hasConcept C154945302 @default.
- W4323922009 hasConcept C185592680 @default.
- W4323922009 hasConcept C2777708103 @default.
- W4323922009 hasConcept C31972630 @default.
- W4323922009 hasConcept C41008148 @default.
- W4323922009 hasConcept C52102323 @default.
- W4323922009 hasConcept C55493867 @default.
- W4323922009 hasConcept C63479239 @default.
- W4323922009 hasConceptScore W4323922009C104317684 @default.
- W4323922009 hasConceptScore W4323922009C115961682 @default.
- W4323922009 hasConceptScore W4323922009C153083717 @default.
- W4323922009 hasConceptScore W4323922009C154945302 @default.
- W4323922009 hasConceptScore W4323922009C185592680 @default.
- W4323922009 hasConceptScore W4323922009C2777708103 @default.
- W4323922009 hasConceptScore W4323922009C31972630 @default.
- W4323922009 hasConceptScore W4323922009C41008148 @default.
- W4323922009 hasConceptScore W4323922009C52102323 @default.
- W4323922009 hasConceptScore W4323922009C55493867 @default.
- W4323922009 hasConceptScore W4323922009C63479239 @default.
- W4323922009 hasLocation W43239220091 @default.
- W4323922009 hasOpenAccess W4323922009 @default.
- W4323922009 hasPrimaryLocation W43239220091 @default.
- W4323922009 hasRelatedWork W2006617887 @default.
- W4323922009 hasRelatedWork W2035976912 @default.
- W4323922009 hasRelatedWork W2105508137 @default.
- W4323922009 hasRelatedWork W2120286341 @default.
- W4323922009 hasRelatedWork W2130740667 @default.
- W4323922009 hasRelatedWork W2551450270 @default.
- W4323922009 hasRelatedWork W2736638679 @default.
- W4323922009 hasRelatedWork W2992701057 @default.
- W4323922009 hasRelatedWork W2992709101 @default.
- W4323922009 hasRelatedWork W3195523115 @default.
- W4323922009 isParatext "false" @default.
- W4323922009 isRetracted "false" @default.
- W4323922009 workType "article" @default.