Matches in SemOpenAlex for { <https://semopenalex.org/work/W2937206389> ?p ?o ?g. }
- W2937206389 abstract "Machine learning techniques have enabled robots to learn narrow, yet complex tasks and also perform broad, yet simple skills with a wide variety of objects. However, learning a model that can both perform complex tasks and generalize to previously unseen objects and goals remains a significant challenge. We study this challenge in the context of improvisational tool use: a robot is presented with novel objects and a user-specified goal (e.g., sweep some clutter into the dustpan), and must figure out, using only raw image observations, how to accomplish the goal using the available objects as tools. We approach this problem by training a model with both a visual and physical understanding of multi-object interactions, and develop a sampling-based optimizer that can leverage these interactions to accomplish tasks. We do so by combining diverse demonstration data with self-supervised interaction data, aiming to leverage the interaction data to build generalizable models and the demonstration data to guide the model-based RL planner to solve complex tasks. Our experiments show that our approach can solve a variety of complex tool use tasks from raw pixel inputs, outperforming both imitation learning and self-supervised learning individually. Furthermore, we show that the robot can perceive and use novel objects as tools, including objects that are not conventional tools, while also choosing dynamically to use or not use tools depending on whether or not they are required." @default.
- W2937206389 created "2019-04-25" @default.
- W2937206389 creator A5005431772 @default.
- W2937206389 creator A5026322200 @default.
- W2937206389 creator A5029017885 @default.
- W2937206389 creator A5082350181 @default.
- W2937206389 date "2019-06-22" @default.
- W2937206389 modified "2023-10-04" @default.
- W2937206389 title "Improvisation through Physical Understanding: Using Novel Objects As Tools with Visual Foresight" @default.
- W2937206389 cites W1410837107 @default.
- W2937206389 cites W1485009520 @default.
- W2937206389 cites W1540685400 @default.
- W2937206389 cites W1579853615 @default.
- W2937206389 cites W1584645679 @default.
- W2937206389 cites W1920293286 @default.
- W2937206389 cites W1978580730 @default.
- W2937206389 cites W1986014385 @default.
- W2937206389 cites W2016765487 @default.
- W2937206389 cites W2042408133 @default.
- W2937206389 cites W2047887570 @default.
- W2937206389 cites W2064675550 @default.
- W2937206389 cites W2082711337 @default.
- W2937206389 cites W2086807633 @default.
- W2937206389 cites W2103738037 @default.
- W2937206389 cites W2114193135 @default.
- W2937206389 cites W2116817751 @default.
- W2937206389 cites W2122840034 @default.
- W2937206389 cites W2126683783 @default.
- W2937206389 cites W2131535595 @default.
- W2937206389 cites W2134831918 @default.
- W2937206389 cites W2149860990 @default.
- W2937206389 cites W2167224731 @default.
- W2937206389 cites W2281096776 @default.
- W2937206389 cites W2369684800 @default.
- W2937206389 cites W2472385446 @default.
- W2937206389 cites W2528489519 @default.
- W2937206389 cites W2739317817 @default.
- W2937206389 cites W2796152145 @default.
- W2937206389 cites W2796303840 @default.
- W2937206389 cites W2805883505 @default.
- W2937206389 cites W2895268904 @default.
- W2937206389 cites W2896583015 @default.
- W2937206389 cites W2902125520 @default.
- W2937206389 cites W2908470496 @default.
- W2937206389 cites W2962894046 @default.
- W2937206389 cites W2963099939 @default.
- W2937206389 cites W2963149945 @default.
- W2937206389 cites W2963402657 @default.
- W2937206389 cites W2963406904 @default.
- W2937206389 cites W2963411833 @default.
- W2937206389 cites W2963430173 @default.
- W2937206389 cites W2963903764 @default.
- W2937206389 cites W2964147919 @default.
- W2937206389 cites W2964161785 @default.
- W2937206389 cites W2967936796 @default.
- W2937206389 cites W648786980 @default.
- W2937206389 doi "https://doi.org/10.15607/rss.2019.xv.001" @default.
- W2937206389 hasPublicationYear "2019" @default.
- W2937206389 type Work @default.
- W2937206389 sameAs 2937206389 @default.
- W2937206389 citedByCount "46" @default.
- W2937206389 countsByYear W29372063892019 @default.
- W2937206389 countsByYear W29372063892020 @default.
- W2937206389 countsByYear W29372063892021 @default.
- W2937206389 countsByYear W29372063892022 @default.
- W2937206389 countsByYear W29372063892023 @default.
- W2937206389 crossrefType "proceedings-article" @default.
- W2937206389 hasAuthorship W2937206389A5005431772 @default.
- W2937206389 hasAuthorship W2937206389A5026322200 @default.
- W2937206389 hasAuthorship W2937206389A5029017885 @default.
- W2937206389 hasAuthorship W2937206389A5082350181 @default.
- W2937206389 hasBestOaLocation W29372063891 @default.
- W2937206389 hasConcept C107457646 @default.
- W2937206389 hasConcept C125468537 @default.
- W2937206389 hasConcept C142362112 @default.
- W2937206389 hasConcept C153349607 @default.
- W2937206389 hasConcept C154945302 @default.
- W2937206389 hasConcept C15744967 @default.
- W2937206389 hasConcept C188147891 @default.
- W2937206389 hasConcept C41008148 @default.
- W2937206389 hasConcept C64848388 @default.
- W2937206389 hasConceptScore W2937206389C107457646 @default.
- W2937206389 hasConceptScore W2937206389C125468537 @default.
- W2937206389 hasConceptScore W2937206389C142362112 @default.
- W2937206389 hasConceptScore W2937206389C153349607 @default.
- W2937206389 hasConceptScore W2937206389C154945302 @default.
- W2937206389 hasConceptScore W2937206389C15744967 @default.
- W2937206389 hasConceptScore W2937206389C188147891 @default.
- W2937206389 hasConceptScore W2937206389C41008148 @default.
- W2937206389 hasConceptScore W2937206389C64848388 @default.
- W2937206389 hasLocation W29372063891 @default.
- W2937206389 hasLocation W29372063892 @default.
- W2937206389 hasOpenAccess W2937206389 @default.
- W2937206389 hasPrimaryLocation W29372063891 @default.
- W2937206389 hasRelatedWork W1971552797 @default.
- W2937206389 hasRelatedWork W1995032672 @default.
- W2937206389 hasRelatedWork W2026924591 @default.
- W2937206389 hasRelatedWork W2096844461 @default.
- W2937206389 hasRelatedWork W2203698149 @default.
- W2937206389 hasRelatedWork W2495111659 @default.