Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386977988> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4386977988 abstract "Equipping multi-fingered robots with tactile sensing is crucial for achieving the precise, contact-rich, and dexterous manipulation that humans excel at. However, relying solely on tactile sensing fails to provide adequate cues for reasoning about objects' spatial configurations, limiting the ability to correct errors and adapt to changing situations. In this paper, we present Tactile Adaptation from Visual Incentives (TAVI), a new framework that enhances tactile-based dexterity by optimizing dexterous policies using vision-based rewards. First, we use a contrastive-based objective to learn visual representations. Next, we construct a reward function using these visual representations through optimal-transport based matching on one human demonstration. Finally, we use online reinforcement learning on our robot to optimize tactile-based policies that maximize the visual reward. On six challenging tasks, such as peg pick-and-place, unstacking bowls, and flipping slender objects, TAVI achieves a success rate of 73% using our four-fingered Allegro robot hand. The increase in performance is 108% higher than policies using tactile and vision-based rewards and 135% higher than policies without tactile observational input. Robot videos are best viewed on our project website: https://see-to-touch.github.io/." @default.
- W4386977988 created "2023-09-23" @default.
- W4386977988 creator A5002078510 @default.
- W4386977988 creator A5036995254 @default.
- W4386977988 creator A5037928241 @default.
- W4386977988 creator A5056646668 @default.
- W4386977988 creator A5081591244 @default.
- W4386977988 date "2023-09-21" @default.
- W4386977988 modified "2023-10-18" @default.
- W4386977988 title "See to Touch: Learning Tactile Dexterity through Visual Incentives" @default.
- W4386977988 doi "https://doi.org/10.48550/arxiv.2309.12300" @default.
- W4386977988 hasPublicationYear "2023" @default.
- W4386977988 type Work @default.
- W4386977988 citedByCount "0" @default.
- W4386977988 crossrefType "posted-content" @default.
- W4386977988 hasAuthorship W4386977988A5002078510 @default.
- W4386977988 hasAuthorship W4386977988A5036995254 @default.
- W4386977988 hasAuthorship W4386977988A5037928241 @default.
- W4386977988 hasAuthorship W4386977988A5056646668 @default.
- W4386977988 hasAuthorship W4386977988A5081591244 @default.
- W4386977988 hasBestOaLocation W43869779881 @default.
- W4386977988 hasConcept C105795698 @default.
- W4386977988 hasConcept C107457646 @default.
- W4386977988 hasConcept C139807058 @default.
- W4386977988 hasConcept C14036430 @default.
- W4386977988 hasConcept C154945302 @default.
- W4386977988 hasConcept C15744967 @default.
- W4386977988 hasConcept C165064840 @default.
- W4386977988 hasConcept C169760540 @default.
- W4386977988 hasConcept C31972630 @default.
- W4386977988 hasConcept C33923547 @default.
- W4386977988 hasConcept C41008148 @default.
- W4386977988 hasConcept C46722567 @default.
- W4386977988 hasConcept C78458016 @default.
- W4386977988 hasConcept C86803240 @default.
- W4386977988 hasConcept C90509273 @default.
- W4386977988 hasConcept C97541855 @default.
- W4386977988 hasConceptScore W4386977988C105795698 @default.
- W4386977988 hasConceptScore W4386977988C107457646 @default.
- W4386977988 hasConceptScore W4386977988C139807058 @default.
- W4386977988 hasConceptScore W4386977988C14036430 @default.
- W4386977988 hasConceptScore W4386977988C154945302 @default.
- W4386977988 hasConceptScore W4386977988C15744967 @default.
- W4386977988 hasConceptScore W4386977988C165064840 @default.
- W4386977988 hasConceptScore W4386977988C169760540 @default.
- W4386977988 hasConceptScore W4386977988C31972630 @default.
- W4386977988 hasConceptScore W4386977988C33923547 @default.
- W4386977988 hasConceptScore W4386977988C41008148 @default.
- W4386977988 hasConceptScore W4386977988C46722567 @default.
- W4386977988 hasConceptScore W4386977988C78458016 @default.
- W4386977988 hasConceptScore W4386977988C86803240 @default.
- W4386977988 hasConceptScore W4386977988C90509273 @default.
- W4386977988 hasConceptScore W4386977988C97541855 @default.
- W4386977988 hasLocation W43869779881 @default.
- W4386977988 hasOpenAccess W4386977988 @default.
- W4386977988 hasPrimaryLocation W43869779881 @default.
- W4386977988 hasRelatedWork W1995188412 @default.
- W4386977988 hasRelatedWork W2010282200 @default.
- W4386977988 hasRelatedWork W2121558387 @default.
- W4386977988 hasRelatedWork W2161103583 @default.
- W4386977988 hasRelatedWork W2207293383 @default.
- W4386977988 hasRelatedWork W2391245565 @default.
- W4386977988 hasRelatedWork W2786306966 @default.
- W4386977988 hasRelatedWork W4206748793 @default.
- W4386977988 hasRelatedWork W4210400012 @default.
- W4386977988 hasRelatedWork W4383337613 @default.
- W4386977988 isParatext "false" @default.
- W4386977988 isRetracted "false" @default.
- W4386977988 workType "article" @default.