Matches in SemOpenAlex for { <https://semopenalex.org/work/W3094927600> ?p ?o ?g. }
- W3094927600 endingPage "16" @default.
- W3094927600 startingPage "1" @default.
- W3094927600 abstract "Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR, robotics, or sign language recognition. Existing works are either limited to simpler tracking settings ( e.g. , considering only a single hand or two spatially separated hands), or rely on less ubiquitous sensors, such as depth cameras. In contrast, in this work we present the first real-time method for motion capture of skeletal pose and 3D surface geometry of hands from a single RGB camera that explicitly considers close interactions. In order to address the inherent depth ambiguities in RGB data, we propose a novel multi-task CNN that regresses multiple complementary pieces of information, including segmentation, dense matchings to a 3D hand model, and 2D keypoint positions, together with newly proposed intra-hand relative depth and inter-hand distance maps. These predictions are subsequently used in a generative model fitting framework in order to estimate pose and shape parameters of a 3D hand model for both hands. We experimentally verify the individual components of our RGB two-hand tracking and 3D reconstruction pipeline through an extensive ablation study. Moreover, we demonstrate that our approach offers previously unseen two-hand tracking performance from RGB, and quantitatively and qualitatively outperforms existing RGB-based methods that were not explicitly designed for two-hand interactions. Moreover, our method even performs on-par with depth-based real-time methods." @default.
- W3094927600 created "2020-11-09" @default.
- W3094927600 creator A5006793940 @default.
- W3094927600 creator A5009513081 @default.
- W3094927600 creator A5020664641 @default.
- W3094927600 creator A5024553204 @default.
- W3094927600 creator A5045111379 @default.
- W3094927600 creator A5064402502 @default.
- W3094927600 creator A5071183334 @default.
- W3094927600 creator A5072277461 @default.
- W3094927600 creator A5089753465 @default.
- W3094927600 date "2020-11-27" @default.
- W3094927600 modified "2023-09-30" @default.
- W3094927600 title "RGB2Hands" @default.
- W3094927600 cites W1901129140 @default.
- W3094927600 cites W1952857803 @default.
- W3094927600 cites W1968976745 @default.
- W3094927600 cites W2051264744 @default.
- W3094927600 cites W2218414108 @default.
- W3094927600 cites W2227547437 @default.
- W3094927600 cites W2330643967 @default.
- W3094927600 cites W2423984454 @default.
- W3094927600 cites W2469784314 @default.
- W3094927600 cites W2520346623 @default.
- W3094927600 cites W2552247836 @default.
- W3094927600 cites W2559085405 @default.
- W3094927600 cites W2768466711 @default.
- W3094927600 cites W2768683308 @default.
- W3094927600 cites W2796453247 @default.
- W3094927600 cites W2799191197 @default.
- W3094927600 cites W2892644985 @default.
- W3094927600 cites W2894878561 @default.
- W3094927600 cites W2897765997 @default.
- W3094927600 cites W2962811204 @default.
- W3094927600 cites W2962926199 @default.
- W3094927600 cites W2963377353 @default.
- W3094927600 cites W2963488642 @default.
- W3094927600 cites W2963601560 @default.
- W3094927600 cites W2963873475 @default.
- W3094927600 cites W2964093990 @default.
- W3094927600 cites W2964211001 @default.
- W3094927600 cites W2968722025 @default.
- W3094927600 cites W2984612350 @default.
- W3094927600 cites W2984624776 @default.
- W3094927600 cites W2987087879 @default.
- W3094927600 cites W3098312772 @default.
- W3094927600 doi "https://doi.org/10.1145/3414685.3417852" @default.
- W3094927600 hasPublicationYear "2020" @default.
- W3094927600 type Work @default.
- W3094927600 sameAs 3094927600 @default.
- W3094927600 citedByCount "41" @default.
- W3094927600 countsByYear W30949276002020 @default.
- W3094927600 countsByYear W30949276002021 @default.
- W3094927600 countsByYear W30949276002022 @default.
- W3094927600 countsByYear W30949276002023 @default.
- W3094927600 crossrefType "journal-article" @default.
- W3094927600 hasAuthorship W3094927600A5006793940 @default.
- W3094927600 hasAuthorship W3094927600A5009513081 @default.
- W3094927600 hasAuthorship W3094927600A5020664641 @default.
- W3094927600 hasAuthorship W3094927600A5024553204 @default.
- W3094927600 hasAuthorship W3094927600A5045111379 @default.
- W3094927600 hasAuthorship W3094927600A5064402502 @default.
- W3094927600 hasAuthorship W3094927600A5071183334 @default.
- W3094927600 hasAuthorship W3094927600A5072277461 @default.
- W3094927600 hasAuthorship W3094927600A5089753465 @default.
- W3094927600 hasBestOaLocation W30949276001 @default.
- W3094927600 hasConcept C109950114 @default.
- W3094927600 hasConcept C154945302 @default.
- W3094927600 hasConcept C15744967 @default.
- W3094927600 hasConcept C19417346 @default.
- W3094927600 hasConcept C199360897 @default.
- W3094927600 hasConcept C2775936607 @default.
- W3094927600 hasConcept C31972630 @default.
- W3094927600 hasConcept C41008148 @default.
- W3094927600 hasConcept C43521106 @default.
- W3094927600 hasConcept C52102323 @default.
- W3094927600 hasConcept C82990744 @default.
- W3094927600 hasConcept C89600930 @default.
- W3094927600 hasConceptScore W3094927600C109950114 @default.
- W3094927600 hasConceptScore W3094927600C154945302 @default.
- W3094927600 hasConceptScore W3094927600C15744967 @default.
- W3094927600 hasConceptScore W3094927600C19417346 @default.
- W3094927600 hasConceptScore W3094927600C199360897 @default.
- W3094927600 hasConceptScore W3094927600C2775936607 @default.
- W3094927600 hasConceptScore W3094927600C31972630 @default.
- W3094927600 hasConceptScore W3094927600C41008148 @default.
- W3094927600 hasConceptScore W3094927600C43521106 @default.
- W3094927600 hasConceptScore W3094927600C52102323 @default.
- W3094927600 hasConceptScore W3094927600C82990744 @default.
- W3094927600 hasConceptScore W3094927600C89600930 @default.
- W3094927600 hasFunder F4320338352 @default.
- W3094927600 hasIssue "6" @default.
- W3094927600 hasLocation W30949276001 @default.
- W3094927600 hasLocation W30949276002 @default.
- W3094927600 hasLocation W30949276003 @default.
- W3094927600 hasOpenAccess W3094927600 @default.
- W3094927600 hasPrimaryLocation W30949276001 @default.
- W3094927600 hasRelatedWork W2030712947 @default.