Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312289535> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W4312289535 abstract "Learning representations that generalize across tasks and domains is challenging yet necessary for autonomous systems. Although task-driven approaches are appealing, de-signing models specific to each application can be difficult in the face of limited data, especially when dealing with highly variable multimodal input spaces arising from different tasks in different environments. We introduce the first general-purpose pretraining pipeline, COntrastive Multimodal Pretraining for AutonomouS Systems (COMPASS), to overcome the limitations of task-specific models and existing pretraining approaches. COMPASS constructs a multimodal graph by considering the essential information for autonomous systems and the proper-ties of different modalities. Through this graph, multimodal signals are connected and mapped into two factorized spatio-temporal latent spaces: a “motion pattern space” and a “current state space.” By learning from multimodal correspondences in each latent space, COMPASS creates state representations that models necessary information such as temporal dynamics, geometry, and semantics. We pretrain COMPASS on a large-scale multimodal simulation dataset TartanAir [1] and evaluate it on drone navigation, vehicle racing, and visual odometry tasks. The experiments indicate that COMPASS can tackle all three scenarios and can also generalize to unseen environments and real-world data. <sup xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sup> <sup xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sup> Our code implementation can be found at https://github.com/microsoft/COMPASS" @default.
- W4312289535 created "2023-01-04" @default.
- W4312289535 creator A5002351623 @default.
- W4312289535 creator A5034678137 @default.
- W4312289535 creator A5043293107 @default.
- W4312289535 creator A5050296324 @default.
- W4312289535 creator A5078150431 @default.
- W4312289535 creator A5090844434 @default.
- W4312289535 creator A5091840052 @default.
- W4312289535 date "2022-10-23" @default.
- W4312289535 modified "2023-10-16" @default.
- W4312289535 title "COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems" @default.
- W4312289535 cites W1870947790 @default.
- W4312289535 cites W2082971343 @default.
- W4312289535 cites W2115579991 @default.
- W4312289535 cites W2123086804 @default.
- W4312289535 cites W2292391751 @default.
- W4312289535 cites W2598706937 @default.
- W4312289535 cites W2619383789 @default.
- W4312289535 cites W2767290858 @default.
- W4312289535 cites W2772409766 @default.
- W4312289535 cites W2794258351 @default.
- W4312289535 cites W2816936748 @default.
- W4312289535 cites W2936608441 @default.
- W4312289535 cites W2946165673 @default.
- W4312289535 cites W2962795401 @default.
- W4312289535 cites W2962934715 @default.
- W4312289535 cites W2963583471 @default.
- W4312289535 cites W2963689319 @default.
- W4312289535 cites W2963782415 @default.
- W4312289535 cites W2964314455 @default.
- W4312289535 cites W2966287654 @default.
- W4312289535 cites W2968095426 @default.
- W4312289535 cites W2968354794 @default.
- W4312289535 cites W2969101565 @default.
- W4312289535 cites W2985076077 @default.
- W4312289535 cites W2998356391 @default.
- W4312289535 cites W3003957707 @default.
- W4312289535 cites W3009205145 @default.
- W4312289535 cites W3035056458 @default.
- W4312289535 cites W3091588028 @default.
- W4312289535 cites W3098994456 @default.
- W4312289535 cites W3099342433 @default.
- W4312289535 cites W3103648783 @default.
- W4312289535 cites W3129860168 @default.
- W4312289535 cites W3168822201 @default.
- W4312289535 doi "https://doi.org/10.1109/iros47612.2022.9982241" @default.
- W4312289535 hasPublicationYear "2022" @default.
- W4312289535 type Work @default.
- W4312289535 citedByCount "1" @default.
- W4312289535 countsByYear W43122895352022 @default.
- W4312289535 crossrefType "proceedings-article" @default.
- W4312289535 hasAuthorship W4312289535A5002351623 @default.
- W4312289535 hasAuthorship W4312289535A5034678137 @default.
- W4312289535 hasAuthorship W4312289535A5043293107 @default.
- W4312289535 hasAuthorship W4312289535A5050296324 @default.
- W4312289535 hasAuthorship W4312289535A5078150431 @default.
- W4312289535 hasAuthorship W4312289535A5090844434 @default.
- W4312289535 hasAuthorship W4312289535A5091840052 @default.
- W4312289535 hasBestOaLocation W43122895352 @default.
- W4312289535 hasConcept C107457646 @default.
- W4312289535 hasConcept C132525143 @default.
- W4312289535 hasConcept C154945302 @default.
- W4312289535 hasConcept C205649164 @default.
- W4312289535 hasConcept C2778361833 @default.
- W4312289535 hasConcept C31972630 @default.
- W4312289535 hasConcept C41008148 @default.
- W4312289535 hasConcept C58640448 @default.
- W4312289535 hasConcept C80444323 @default.
- W4312289535 hasConceptScore W4312289535C107457646 @default.
- W4312289535 hasConceptScore W4312289535C132525143 @default.
- W4312289535 hasConceptScore W4312289535C154945302 @default.
- W4312289535 hasConceptScore W4312289535C205649164 @default.
- W4312289535 hasConceptScore W4312289535C2778361833 @default.
- W4312289535 hasConceptScore W4312289535C31972630 @default.
- W4312289535 hasConceptScore W4312289535C41008148 @default.
- W4312289535 hasConceptScore W4312289535C58640448 @default.
- W4312289535 hasConceptScore W4312289535C80444323 @default.
- W4312289535 hasLocation W43122895351 @default.
- W4312289535 hasLocation W43122895352 @default.
- W4312289535 hasOpenAccess W4312289535 @default.
- W4312289535 hasPrimaryLocation W43122895351 @default.
- W4312289535 hasRelatedWork W1523257058 @default.
- W4312289535 hasRelatedWork W1891287906 @default.
- W4312289535 hasRelatedWork W1969923398 @default.
- W4312289535 hasRelatedWork W2036807459 @default.
- W4312289535 hasRelatedWork W2166024367 @default.
- W4312289535 hasRelatedWork W2229312674 @default.
- W4312289535 hasRelatedWork W2755342338 @default.
- W4312289535 hasRelatedWork W2772917594 @default.
- W4312289535 hasRelatedWork W2775347418 @default.
- W4312289535 hasRelatedWork W3116076068 @default.
- W4312289535 isParatext "false" @default.
- W4312289535 isRetracted "false" @default.
- W4312289535 workType "article" @default.