Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385768159> ?p ?o ?g. }
Showing items 1 to 57 of
57
with 100 items per page.
- W4385768159 abstract "Vision-language navigation (VLN) requires an agent to perceive visual observation in a house scene and navigate step-by-step following natural language instruction. Due to the high cost of data annotation and data collection, current VLN datasets provide limited instruction-trajectory data samples. Learning vision-language alignment for VLN from limited data is challenging since visual observation and language instruction are both complex and diverse. Previous works only generate augmented data based on original scenes while failing to generate data samples from unseen scenes, which limits the generalization ability of the navigation agent. In this paper, we introduce the Knowledge-driven Environmental Dreamer (KED), a method that leverages the knowledge of the embodied environment and generates unseen scenes for a navigation agent to learn. Generating an unseen environment with texture consistency and structure consistency is challenging. To address this problem, we incorporate three knowledge-driven regularization objectives into the KED and adopt a reweighting mechanism for self-adaptive optimization. Our KED method is able to generate unseen embodied environments without extra annotations. We use KED to successfully generate 270 houses and 500K instruction-trajectory pairs. The navigation agent with the KED method outperforms the state-of-the-art methods on various VLN benchmarks, such as R2R, R4R, and RxR. Both qualitative and quantitative experiments prove that our proposed KED method is able to high-quality augmentation data with texture consistency and structure consistency." @default.
- W4385768159 created "2023-08-12" @default.
- W4385768159 creator A5027233873 @default.
- W4385768159 creator A5034967388 @default.
- W4385768159 creator A5047878798 @default.
- W4385768159 creator A5075874422 @default.
- W4385768159 date "2023-08-01" @default.
- W4385768159 modified "2023-09-28" @default.
- W4385768159 title "Vision Language Navigation with Knowledge-driven Environmental Dreamer" @default.
- W4385768159 doi "https://doi.org/10.24963/ijcai.2023/204" @default.
- W4385768159 hasPublicationYear "2023" @default.
- W4385768159 type Work @default.
- W4385768159 citedByCount "0" @default.
- W4385768159 crossrefType "proceedings-article" @default.
- W4385768159 hasAuthorship W4385768159A5027233873 @default.
- W4385768159 hasAuthorship W4385768159A5034967388 @default.
- W4385768159 hasAuthorship W4385768159A5047878798 @default.
- W4385768159 hasAuthorship W4385768159A5075874422 @default.
- W4385768159 hasBestOaLocation W43857681591 @default.
- W4385768159 hasConcept C100609095 @default.
- W4385768159 hasConcept C107457646 @default.
- W4385768159 hasConcept C121332964 @default.
- W4385768159 hasConcept C1276947 @default.
- W4385768159 hasConcept C13662910 @default.
- W4385768159 hasConcept C154945302 @default.
- W4385768159 hasConcept C195324797 @default.
- W4385768159 hasConcept C2776321320 @default.
- W4385768159 hasConcept C2776436953 @default.
- W4385768159 hasConcept C31972630 @default.
- W4385768159 hasConcept C41008148 @default.
- W4385768159 hasConceptScore W4385768159C100609095 @default.
- W4385768159 hasConceptScore W4385768159C107457646 @default.
- W4385768159 hasConceptScore W4385768159C121332964 @default.
- W4385768159 hasConceptScore W4385768159C1276947 @default.
- W4385768159 hasConceptScore W4385768159C13662910 @default.
- W4385768159 hasConceptScore W4385768159C154945302 @default.
- W4385768159 hasConceptScore W4385768159C195324797 @default.
- W4385768159 hasConceptScore W4385768159C2776321320 @default.
- W4385768159 hasConceptScore W4385768159C2776436953 @default.
- W4385768159 hasConceptScore W4385768159C31972630 @default.
- W4385768159 hasConceptScore W4385768159C41008148 @default.
- W4385768159 hasLocation W43857681591 @default.
- W4385768159 hasOpenAccess W4385768159 @default.
- W4385768159 hasPrimaryLocation W43857681591 @default.
- W4385768159 hasRelatedWork W1529400504 @default.
- W4385768159 hasRelatedWork W1891287906 @default.
- W4385768159 hasRelatedWork W1892467659 @default.
- W4385768159 hasRelatedWork W1969923398 @default.
- W4385768159 hasRelatedWork W2000407620 @default.
- W4385768159 hasRelatedWork W2036807459 @default.
- W4385768159 hasRelatedWork W2166024367 @default.
- W4385768159 hasRelatedWork W2755342338 @default.
- W4385768159 hasRelatedWork W2772917594 @default.
- W4385768159 hasRelatedWork W2775347418 @default.
- W4385768159 isParatext "false" @default.
- W4385768159 isRetracted "false" @default.
- W4385768159 workType "article" @default.