Matches in SemOpenAlex for { <https://semopenalex.org/work/W3040459695> ?p ?o ?g. }
- W3040459695 abstract "Natural language object retrieval is a highly useful yet challenging task for robots in human-centric environments. Previous work has primarily focused on commands specifying the desired object's type such as scissors and/or visual attributes such as red, thus limiting the robot to only known object classes. We develop a model to retrieve objects based on descriptions of their usage. The model takes in a language command containing a verb, for example Hand me something to cut, and RGB images of candidate objects and selects the object that best satisfies the task specified by the verb. Our model directly predicts an object's appearance from the object's use specified by a verb phrase. We do not need to explicitly specify an object's class label. Our approach allows us to predict high level concepts like an object's utility based on the language query. Based on contextual information present in the language commands, our model can generalize to unseen object classes and unknown nouns in the commands. Our model correctly selects objects out of sets of five candidates to fulfill natural language commands, and achieves an average accuracy of 62.3% on a held-out test set of unseen ImageNet object classes and 53.0% on unseen object classes and unknown nouns. Our model also achieves an average accuracy of 54.7% on unseen YCB object classes, which have a different image distribution from ImageNet objects. We demonstrate our model on a KUKA LBR iiwa robot arm, enabling the robot to retrieve objects based on natural language descriptions of their usage. We also present a new dataset of 655 verb-object pairs denoting object usage over 50 verbs and 216 object classes." @default.
- W3040459695 created "2020-07-10" @default.
- W3040459695 creator A5035091959 @default.
- W3040459695 creator A5042032005 @default.
- W3040459695 creator A5053850863 @default.
- W3040459695 creator A5059273574 @default.
- W3040459695 creator A5063912971 @default.
- W3040459695 creator A5089421543 @default.
- W3040459695 date "2020-06-23" @default.
- W3040459695 modified "2023-09-27" @default.
- W3040459695 title "Robot Object Retrieval with Contextual Natural Language Queries" @default.
- W3040459695 cites W1505952289 @default.
- W3040459695 cites W1514535095 @default.
- W3040459695 cites W1522301498 @default.
- W3040459695 cites W1524405667 @default.
- W3040459695 cites W1811254738 @default.
- W3040459695 cites W1861492603 @default.
- W3040459695 cites W1895577753 @default.
- W3040459695 cites W1900424585 @default.
- W3040459695 cites W2070148066 @default.
- W3040459695 cites W2110485445 @default.
- W3040459695 cites W2117539524 @default.
- W3040459695 cites W2186283982 @default.
- W3040459695 cites W2194775991 @default.
- W3040459695 cites W2250539671 @default.
- W3040459695 cites W2736923367 @default.
- W3040459695 cites W2803801244 @default.
- W3040459695 cites W2806630426 @default.
- W3040459695 cites W2950577311 @default.
- W3040459695 cites W2962716343 @default.
- W3040459695 cites W2962984928 @default.
- W3040459695 cites W2963150697 @default.
- W3040459695 cites W2963735856 @default.
- W3040459695 cites W2964078384 @default.
- W3040459695 cites W2964207259 @default.
- W3040459695 cites W3003575346 @default.
- W3040459695 hasPublicationYear "2020" @default.
- W3040459695 type Work @default.
- W3040459695 sameAs 3040459695 @default.
- W3040459695 citedByCount "1" @default.
- W3040459695 countsByYear W30404596952021 @default.
- W3040459695 crossrefType "posted-content" @default.
- W3040459695 hasAuthorship W3040459695A5035091959 @default.
- W3040459695 hasAuthorship W3040459695A5042032005 @default.
- W3040459695 hasAuthorship W3040459695A5053850863 @default.
- W3040459695 hasAuthorship W3040459695A5059273574 @default.
- W3040459695 hasAuthorship W3040459695A5063912971 @default.
- W3040459695 hasAuthorship W3040459695A5089421543 @default.
- W3040459695 hasConcept C121934690 @default.
- W3040459695 hasConcept C154945302 @default.
- W3040459695 hasConcept C162324750 @default.
- W3040459695 hasConcept C177264268 @default.
- W3040459695 hasConcept C187736073 @default.
- W3040459695 hasConcept C195324797 @default.
- W3040459695 hasConcept C199360897 @default.
- W3040459695 hasConcept C204321447 @default.
- W3040459695 hasConcept C20894473 @default.
- W3040459695 hasConcept C2777212361 @default.
- W3040459695 hasConcept C2780451532 @default.
- W3040459695 hasConcept C2781238097 @default.
- W3040459695 hasConcept C31972630 @default.
- W3040459695 hasConcept C41008148 @default.
- W3040459695 hasConcept C90509273 @default.
- W3040459695 hasConceptScore W3040459695C121934690 @default.
- W3040459695 hasConceptScore W3040459695C154945302 @default.
- W3040459695 hasConceptScore W3040459695C162324750 @default.
- W3040459695 hasConceptScore W3040459695C177264268 @default.
- W3040459695 hasConceptScore W3040459695C187736073 @default.
- W3040459695 hasConceptScore W3040459695C195324797 @default.
- W3040459695 hasConceptScore W3040459695C199360897 @default.
- W3040459695 hasConceptScore W3040459695C204321447 @default.
- W3040459695 hasConceptScore W3040459695C20894473 @default.
- W3040459695 hasConceptScore W3040459695C2777212361 @default.
- W3040459695 hasConceptScore W3040459695C2780451532 @default.
- W3040459695 hasConceptScore W3040459695C2781238097 @default.
- W3040459695 hasConceptScore W3040459695C31972630 @default.
- W3040459695 hasConceptScore W3040459695C41008148 @default.
- W3040459695 hasConceptScore W3040459695C90509273 @default.
- W3040459695 hasLocation W30404596951 @default.
- W3040459695 hasOpenAccess W3040459695 @default.
- W3040459695 hasPrimaryLocation W30404596951 @default.
- W3040459695 hasRelatedWork W1593188841 @default.
- W3040459695 hasRelatedWork W1975050758 @default.
- W3040459695 hasRelatedWork W2022153165 @default.
- W3040459695 hasRelatedWork W2023292672 @default.
- W3040459695 hasRelatedWork W2043830258 @default.
- W3040459695 hasRelatedWork W2066652547 @default.
- W3040459695 hasRelatedWork W2097271781 @default.
- W3040459695 hasRelatedWork W2098411764 @default.
- W3040459695 hasRelatedWork W2144684827 @default.
- W3040459695 hasRelatedWork W2297368007 @default.
- W3040459695 hasRelatedWork W2408753810 @default.
- W3040459695 hasRelatedWork W2640417383 @default.
- W3040459695 hasRelatedWork W2902120528 @default.
- W3040459695 hasRelatedWork W2913937523 @default.
- W3040459695 hasRelatedWork W2944950190 @default.
- W3040459695 hasRelatedWork W2947299003 @default.
- W3040459695 hasRelatedWork W2963565375 @default.
- W3040459695 hasRelatedWork W3037369911 @default.
- W3040459695 hasRelatedWork W3095974555 @default.