Matches in SemOpenAlex for { <https://semopenalex.org/work/W3122520957> ?p ?o ?g. }
- W3122520957 abstract "Learning from visual data opens the potential to accrue a large range of manipulation behaviors by leveraging human demonstrations without specifying each of them mathe-matically, but rather through natural task specification. In this paper, we present Learning by Watching (LbW), an algorithmic framework for policy learning through imitation from a single video specifying the task. The key insights of our method are two-fold. First, since the human arms may not have the same morphology as robot arms, our framework learns unsupervised human to robot translation to overcome the morphology mis-match issue. Second, to capture the details in salient regions that are crucial for learning state representations, our model performs unsupervised keypoint detection on the translated robot videos. The detected keypoints form a structured representation that contains semantically meaningful information and can be used directly for computing reward and policy learning. We evaluate the effectiveness of our LbW framework on five robot manipulation tasks, including reaching, pushing, sliding, coffee making, and drawer closing. Extensive experimental evaluations demonstrate that our method performs favorably against the state-of-the-art approaches. More results and analysis are available at pair.toronto.edu/lbw-kp/." @default.
- W3122520957 created "2021-02-01" @default.
- W3122520957 creator A5036366964 @default.
- W3122520957 creator A5053537085 @default.
- W3122520957 creator A5061193324 @default.
- W3122520957 creator A5064794691 @default.
- W3122520957 creator A5074633339 @default.
- W3122520957 creator A5084642725 @default.
- W3122520957 date "2021-09-27" @default.
- W3122520957 modified "2023-09-25" @default.
- W3122520957 title "Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos" @default.
- W3122520957 cites W2081034428 @default.
- W3122520957 cites W2160609165 @default.
- W3122520957 cites W2769112066 @default.
- W3122520957 cites W2787666871 @default.
- W3122520957 cites W2807725536 @default.
- W3122520957 cites W2894766094 @default.
- W3122520957 cites W2913937523 @default.
- W3122520957 cites W2950111065 @default.
- W3122520957 cites W2962787969 @default.
- W3122520957 cites W2962793481 @default.
- W3122520957 cites W2962981304 @default.
- W3122520957 cites W2963390419 @default.
- W3122520957 cites W2963419579 @default.
- W3122520957 cites W2963634205 @default.
- W3122520957 cites W2963669336 @default.
- W3122520957 cites W2963703448 @default.
- W3122520957 cites W2963767194 @default.
- W3122520957 cites W2963802910 @default.
- W3122520957 cites W2964021598 @default.
- W3122520957 cites W2985060393 @default.
- W3122520957 cites W3035756007 @default.
- W3122520957 cites W3038245394 @default.
- W3122520957 cites W3038298277 @default.
- W3122520957 cites W3039055967 @default.
- W3122520957 cites W3090369311 @default.
- W3122520957 doi "https://doi.org/10.1109/iros51168.2021.9636080" @default.
- W3122520957 hasPublicationYear "2021" @default.
- W3122520957 type Work @default.
- W3122520957 sameAs 3122520957 @default.
- W3122520957 citedByCount "7" @default.
- W3122520957 countsByYear W31225209572022 @default.
- W3122520957 countsByYear W31225209572023 @default.
- W3122520957 crossrefType "proceedings-article" @default.
- W3122520957 hasAuthorship W3122520957A5036366964 @default.
- W3122520957 hasAuthorship W3122520957A5053537085 @default.
- W3122520957 hasAuthorship W3122520957A5061193324 @default.
- W3122520957 hasAuthorship W3122520957A5064794691 @default.
- W3122520957 hasAuthorship W3122520957A5074633339 @default.
- W3122520957 hasAuthorship W3122520957A5084642725 @default.
- W3122520957 hasBestOaLocation W31225209572 @default.
- W3122520957 hasConcept C107457646 @default.
- W3122520957 hasConcept C108583219 @default.
- W3122520957 hasConcept C119857082 @default.
- W3122520957 hasConcept C126388530 @default.
- W3122520957 hasConcept C154945302 @default.
- W3122520957 hasConcept C15744967 @default.
- W3122520957 hasConcept C162324750 @default.
- W3122520957 hasConcept C17744445 @default.
- W3122520957 hasConcept C187736073 @default.
- W3122520957 hasConcept C199539241 @default.
- W3122520957 hasConcept C2776359362 @default.
- W3122520957 hasConcept C2780451532 @default.
- W3122520957 hasConcept C2780719617 @default.
- W3122520957 hasConcept C41008148 @default.
- W3122520957 hasConcept C77805123 @default.
- W3122520957 hasConcept C8038995 @default.
- W3122520957 hasConcept C90509273 @default.
- W3122520957 hasConcept C94625758 @default.
- W3122520957 hasConcept C97541855 @default.
- W3122520957 hasConceptScore W3122520957C107457646 @default.
- W3122520957 hasConceptScore W3122520957C108583219 @default.
- W3122520957 hasConceptScore W3122520957C119857082 @default.
- W3122520957 hasConceptScore W3122520957C126388530 @default.
- W3122520957 hasConceptScore W3122520957C154945302 @default.
- W3122520957 hasConceptScore W3122520957C15744967 @default.
- W3122520957 hasConceptScore W3122520957C162324750 @default.
- W3122520957 hasConceptScore W3122520957C17744445 @default.
- W3122520957 hasConceptScore W3122520957C187736073 @default.
- W3122520957 hasConceptScore W3122520957C199539241 @default.
- W3122520957 hasConceptScore W3122520957C2776359362 @default.
- W3122520957 hasConceptScore W3122520957C2780451532 @default.
- W3122520957 hasConceptScore W3122520957C2780719617 @default.
- W3122520957 hasConceptScore W3122520957C41008148 @default.
- W3122520957 hasConceptScore W3122520957C77805123 @default.
- W3122520957 hasConceptScore W3122520957C8038995 @default.
- W3122520957 hasConceptScore W3122520957C90509273 @default.
- W3122520957 hasConceptScore W3122520957C94625758 @default.
- W3122520957 hasConceptScore W3122520957C97541855 @default.
- W3122520957 hasLocation W31225209571 @default.
- W3122520957 hasLocation W31225209572 @default.
- W3122520957 hasOpenAccess W3122520957 @default.
- W3122520957 hasPrimaryLocation W31225209571 @default.
- W3122520957 hasRelatedWork W2908875379 @default.
- W3122520957 hasRelatedWork W3022038857 @default.
- W3122520957 hasRelatedWork W3044458868 @default.
- W3122520957 hasRelatedWork W3123344745 @default.
- W3122520957 hasRelatedWork W3161440429 @default.
- W3122520957 hasRelatedWork W3192794374 @default.
- W3122520957 hasRelatedWork W3208584567 @default.