Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386555959> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4386555959 abstract "Gestures serve as a fundamental and significant mode of non-verbal communication among humans. Deictic gestures (such as pointing towards an object), in particular, offer valuable means of efficiently expressing intent in situations where language is inaccessible, restricted, or highly specialized. As a result, it is essential for robots to comprehend gestures in order to infer human intentions and establish more effective coordination with them. Prior work often rely on a rigid hand-coded library of gestures along with their meanings. However, interpretation of gestures is often context-dependent, requiring more flexibility and common-sense reasoning. In this work, we propose a framework, GIRAF, for more flexibly interpreting gesture and language instructions by leveraging the power of large language models. Our framework is able to accurately infer human intent and contextualize the meaning of their gestures for more effective human-robot collaboration. We instantiate the framework for interpreting deictic gestures in table-top manipulation tasks and demonstrate that it is both effective and preferred by users, achieving 70% higher success rates than the baseline. We further demonstrate GIRAF's ability on reasoning about diverse types of gestures by curating a GestureInstruct dataset consisting of 36 different task scenarios. GIRAF achieved 81% success rate on finding the correct plan for tasks in GestureInstruct. Website: https://tinyurl.com/giraf23" @default.
- W4386555959 created "2023-09-09" @default.
- W4386555959 creator A5034674362 @default.
- W4386555959 creator A5037717179 @default.
- W4386555959 creator A5070110088 @default.
- W4386555959 creator A5072916650 @default.
- W4386555959 creator A5080725225 @default.
- W4386555959 date "2023-09-06" @default.
- W4386555959 modified "2023-09-26" @default.
- W4386555959 title "Gesture-Informed Robot Assistance via Foundation Models" @default.
- W4386555959 doi "https://doi.org/10.48550/arxiv.2309.02721" @default.
- W4386555959 hasPublicationYear "2023" @default.
- W4386555959 type Work @default.
- W4386555959 citedByCount "0" @default.
- W4386555959 crossrefType "posted-content" @default.
- W4386555959 hasAuthorship W4386555959A5034674362 @default.
- W4386555959 hasAuthorship W4386555959A5037717179 @default.
- W4386555959 hasAuthorship W4386555959A5070110088 @default.
- W4386555959 hasAuthorship W4386555959A5072916650 @default.
- W4386555959 hasAuthorship W4386555959A5080725225 @default.
- W4386555959 hasBestOaLocation W43865559591 @default.
- W4386555959 hasConcept C105795698 @default.
- W4386555959 hasConcept C107457646 @default.
- W4386555959 hasConcept C13077596 @default.
- W4386555959 hasConcept C138885662 @default.
- W4386555959 hasConcept C151730666 @default.
- W4386555959 hasConcept C154945302 @default.
- W4386555959 hasConcept C15744967 @default.
- W4386555959 hasConcept C204321447 @default.
- W4386555959 hasConcept C207347870 @default.
- W4386555959 hasConcept C2779343474 @default.
- W4386555959 hasConcept C2780598303 @default.
- W4386555959 hasConcept C2780876879 @default.
- W4386555959 hasConcept C33923547 @default.
- W4386555959 hasConcept C41008148 @default.
- W4386555959 hasConcept C41895202 @default.
- W4386555959 hasConcept C542102704 @default.
- W4386555959 hasConcept C86803240 @default.
- W4386555959 hasConceptScore W4386555959C105795698 @default.
- W4386555959 hasConceptScore W4386555959C107457646 @default.
- W4386555959 hasConceptScore W4386555959C13077596 @default.
- W4386555959 hasConceptScore W4386555959C138885662 @default.
- W4386555959 hasConceptScore W4386555959C151730666 @default.
- W4386555959 hasConceptScore W4386555959C154945302 @default.
- W4386555959 hasConceptScore W4386555959C15744967 @default.
- W4386555959 hasConceptScore W4386555959C204321447 @default.
- W4386555959 hasConceptScore W4386555959C207347870 @default.
- W4386555959 hasConceptScore W4386555959C2779343474 @default.
- W4386555959 hasConceptScore W4386555959C2780598303 @default.
- W4386555959 hasConceptScore W4386555959C2780876879 @default.
- W4386555959 hasConceptScore W4386555959C33923547 @default.
- W4386555959 hasConceptScore W4386555959C41008148 @default.
- W4386555959 hasConceptScore W4386555959C41895202 @default.
- W4386555959 hasConceptScore W4386555959C542102704 @default.
- W4386555959 hasConceptScore W4386555959C86803240 @default.
- W4386555959 hasLocation W43865559591 @default.
- W4386555959 hasOpenAccess W4386555959 @default.
- W4386555959 hasPrimaryLocation W43865559591 @default.
- W4386555959 hasRelatedWork W2047859503 @default.
- W4386555959 hasRelatedWork W2082745131 @default.
- W4386555959 hasRelatedWork W2143320230 @default.
- W4386555959 hasRelatedWork W2750031744 @default.
- W4386555959 hasRelatedWork W2800624293 @default.
- W4386555959 hasRelatedWork W2806126660 @default.
- W4386555959 hasRelatedWork W4323687855 @default.
- W4386555959 hasRelatedWork W47104313 @default.
- W4386555959 hasRelatedWork W62472983 @default.
- W4386555959 hasRelatedWork W2292435706 @default.
- W4386555959 isParatext "false" @default.
- W4386555959 isRetracted "false" @default.
- W4386555959 workType "article" @default.