Matches in SemOpenAlex for { <https://semopenalex.org/work/W4306175965> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W4306175965 abstract "We study embodied reference understanding, the task of locating referents using embodied gestural signals and language references. Human studies have revealed that objects referred to or pointed to do not lie on the elbow-wrist line, a common misconception; instead, they lie on the so-called virtual touch line. However, existing human pose representations fail to incorporate the virtual touch line. To tackle this problem, we devise the touch-line transformer: It takes as input tokenized visual and textual features and simultaneously predicts the referent's bounding box and a touch-line vector. Leveraging this touch-line prior, we further devise a geometric consistency loss that encourages the co-linearity between referents and touch lines. Using the touch-line as gestural information improves model performances significantly. Experiments on the YouRefIt dataset show our method achieves a +25.0% accuracy improvement under the 0.75 IoU criterion, closing 63.6% of the gap between model and human performances. Furthermore, we computationally verify prior human studies by showing that computational models more accurately locate referents when using the virtual touch line than when using the elbow-wrist line." @default.
- W4306175965 created "2022-10-14" @default.
- W4306175965 creator A5005938550 @default.
- W4306175965 creator A5011913905 @default.
- W4306175965 creator A5014558054 @default.
- W4306175965 creator A5038258771 @default.
- W4306175965 creator A5063512998 @default.
- W4306175965 creator A5064842058 @default.
- W4306175965 creator A5089973290 @default.
- W4306175965 date "2022-10-11" @default.
- W4306175965 modified "2023-09-27" @default.
- W4306175965 title "Understanding Embodied Reference with Touch-Line Transformer" @default.
- W4306175965 doi "https://doi.org/10.48550/arxiv.2210.05668" @default.
- W4306175965 hasPublicationYear "2022" @default.
- W4306175965 type Work @default.
- W4306175965 citedByCount "0" @default.
- W4306175965 crossrefType "posted-content" @default.
- W4306175965 hasAuthorship W4306175965A5005938550 @default.
- W4306175965 hasAuthorship W4306175965A5011913905 @default.
- W4306175965 hasAuthorship W4306175965A5014558054 @default.
- W4306175965 hasAuthorship W4306175965A5038258771 @default.
- W4306175965 hasAuthorship W4306175965A5063512998 @default.
- W4306175965 hasAuthorship W4306175965A5064842058 @default.
- W4306175965 hasAuthorship W4306175965A5089973290 @default.
- W4306175965 hasBestOaLocation W43061759651 @default.
- W4306175965 hasConcept C100609095 @default.
- W4306175965 hasConcept C107457646 @default.
- W4306175965 hasConcept C119599485 @default.
- W4306175965 hasConcept C127413603 @default.
- W4306175965 hasConcept C138885662 @default.
- W4306175965 hasConcept C154945302 @default.
- W4306175965 hasConcept C165801399 @default.
- W4306175965 hasConcept C171268870 @default.
- W4306175965 hasConcept C198352243 @default.
- W4306175965 hasConcept C199360897 @default.
- W4306175965 hasConcept C2524010 @default.
- W4306175965 hasConcept C2777096784 @default.
- W4306175965 hasConcept C31972630 @default.
- W4306175965 hasConcept C33923547 @default.
- W4306175965 hasConcept C41008148 @default.
- W4306175965 hasConcept C41895202 @default.
- W4306175965 hasConcept C66322947 @default.
- W4306175965 hasConceptScore W4306175965C100609095 @default.
- W4306175965 hasConceptScore W4306175965C107457646 @default.
- W4306175965 hasConceptScore W4306175965C119599485 @default.
- W4306175965 hasConceptScore W4306175965C127413603 @default.
- W4306175965 hasConceptScore W4306175965C138885662 @default.
- W4306175965 hasConceptScore W4306175965C154945302 @default.
- W4306175965 hasConceptScore W4306175965C165801399 @default.
- W4306175965 hasConceptScore W4306175965C171268870 @default.
- W4306175965 hasConceptScore W4306175965C198352243 @default.
- W4306175965 hasConceptScore W4306175965C199360897 @default.
- W4306175965 hasConceptScore W4306175965C2524010 @default.
- W4306175965 hasConceptScore W4306175965C2777096784 @default.
- W4306175965 hasConceptScore W4306175965C31972630 @default.
- W4306175965 hasConceptScore W4306175965C33923547 @default.
- W4306175965 hasConceptScore W4306175965C41008148 @default.
- W4306175965 hasConceptScore W4306175965C41895202 @default.
- W4306175965 hasConceptScore W4306175965C66322947 @default.
- W4306175965 hasLocation W43061759651 @default.
- W4306175965 hasOpenAccess W4306175965 @default.
- W4306175965 hasPrimaryLocation W43061759651 @default.
- W4306175965 hasRelatedWork W1563441844 @default.
- W4306175965 hasRelatedWork W1910101490 @default.
- W4306175965 hasRelatedWork W2389377526 @default.
- W4306175965 hasRelatedWork W2999821079 @default.
- W4306175965 hasRelatedWork W3004284873 @default.
- W4306175965 hasRelatedWork W3122736385 @default.
- W4306175965 hasRelatedWork W3185561939 @default.
- W4306175965 hasRelatedWork W3187028533 @default.
- W4306175965 hasRelatedWork W4249963983 @default.
- W4306175965 hasRelatedWork W4285005856 @default.
- W4306175965 isParatext "false" @default.
- W4306175965 isRetracted "false" @default.
- W4306175965 workType "article" @default.