Matches in SemOpenAlex for { <https://semopenalex.org/work/W3105521436> ?p ?o ?g. }
- W3105521436 abstract "Vision-and-language navigation requires an agent to navigate through a real 3D environment following natural language instructions. Despite significant advances, few previous works are able to fully utilize the strong correspondence between the visual and textual sequences. Meanwhile, due to the lack of intermediate supervision, the agent’s performance at following each part of the instruction cannot be assessed during navigation. In this work, we focus on the granularity of the visual and language sequences as well as the traceability of agents through the completion of an instruction. We provide agents with fine-grained annotations during training and find that they are able to follow the instruction better and have a higher chance of reaching the target at test time. We enrich the benchmark dataset Room-to-Room (R2R) with sub-instructions and their corresponding paths. To make use of this data, we propose effective sub-instruction attention and shifting modules that select and attend to a single sub-instruction at each time-step. We implement our sub-instruction modules in four state-of-the-art agents, compare with their baseline models, and show that our proposed method improves the performance of all four agents. We release the Fine-Grained R2R dataset (FGR2R) and the code at https://github.com/YicongHong/Fine-Grained-R2R." @default.
- W3105521436 created "2020-11-23" @default.
- W3105521436 creator A5030041175 @default.
- W3105521436 creator A5036105537 @default.
- W3105521436 creator A5042584066 @default.
- W3105521436 creator A5060958969 @default.
- W3105521436 date "2020-01-01" @default.
- W3105521436 modified "2023-10-16" @default.
- W3105521436 title "Sub-Instruction Aware Vision-and-Language Navigation" @default.
- W3105521436 cites W1514535095 @default.
- W3105521436 cites W2016589492 @default.
- W3105521436 cites W2117539524 @default.
- W3105521436 cites W2194775991 @default.
- W3105521436 cites W2745461083 @default.
- W3105521436 cites W2899024931 @default.
- W3105521436 cites W2901988662 @default.
- W3105521436 cites W2926977875 @default.
- W3105521436 cites W2951973805 @default.
- W3105521436 cites W2958574008 @default.
- W3105521436 cites W2962744691 @default.
- W3105521436 cites W2963082899 @default.
- W3105521436 cites W2963474587 @default.
- W3105521436 cites W2963575117 @default.
- W3105521436 cites W2963699792 @default.
- W3105521436 cites W2963726321 @default.
- W3105521436 cites W2963846044 @default.
- W3105521436 cites W2964043796 @default.
- W3105521436 cites W2964089981 @default.
- W3105521436 cites W2964276596 @default.
- W3105521436 cites W2964339842 @default.
- W3105521436 cites W2964343989 @default.
- W3105521436 cites W2964345792 @default.
- W3105521436 cites W2964935470 @default.
- W3105521436 cites W2969557970 @default.
- W3105521436 cites W2979727876 @default.
- W3105521436 cites W2981799368 @default.
- W3105521436 cites W2990397898 @default.
- W3105521436 cites W3025323587 @default.
- W3105521436 doi "https://doi.org/10.18653/v1/2020.emnlp-main.271" @default.
- W3105521436 hasPublicationYear "2020" @default.
- W3105521436 type Work @default.
- W3105521436 sameAs 3105521436 @default.
- W3105521436 citedByCount "22" @default.
- W3105521436 countsByYear W31055214362020 @default.
- W3105521436 countsByYear W31055214362021 @default.
- W3105521436 countsByYear W31055214362022 @default.
- W3105521436 countsByYear W31055214362023 @default.
- W3105521436 crossrefType "proceedings-article" @default.
- W3105521436 hasAuthorship W3105521436A5030041175 @default.
- W3105521436 hasAuthorship W3105521436A5036105537 @default.
- W3105521436 hasAuthorship W3105521436A5042584066 @default.
- W3105521436 hasAuthorship W3105521436A5060958969 @default.
- W3105521436 hasBestOaLocation W31055214361 @default.
- W3105521436 hasConcept C107457646 @default.
- W3105521436 hasConcept C115903868 @default.
- W3105521436 hasConcept C120665830 @default.
- W3105521436 hasConcept C121332964 @default.
- W3105521436 hasConcept C13280743 @default.
- W3105521436 hasConcept C153876917 @default.
- W3105521436 hasConcept C154945302 @default.
- W3105521436 hasConcept C177264268 @default.
- W3105521436 hasConcept C177774035 @default.
- W3105521436 hasConcept C185798385 @default.
- W3105521436 hasConcept C192209626 @default.
- W3105521436 hasConcept C195324797 @default.
- W3105521436 hasConcept C199360897 @default.
- W3105521436 hasConcept C205649164 @default.
- W3105521436 hasConcept C2776760102 @default.
- W3105521436 hasConcept C41008148 @default.
- W3105521436 hasConcept C49774154 @default.
- W3105521436 hasConceptScore W3105521436C107457646 @default.
- W3105521436 hasConceptScore W3105521436C115903868 @default.
- W3105521436 hasConceptScore W3105521436C120665830 @default.
- W3105521436 hasConceptScore W3105521436C121332964 @default.
- W3105521436 hasConceptScore W3105521436C13280743 @default.
- W3105521436 hasConceptScore W3105521436C153876917 @default.
- W3105521436 hasConceptScore W3105521436C154945302 @default.
- W3105521436 hasConceptScore W3105521436C177264268 @default.
- W3105521436 hasConceptScore W3105521436C177774035 @default.
- W3105521436 hasConceptScore W3105521436C185798385 @default.
- W3105521436 hasConceptScore W3105521436C192209626 @default.
- W3105521436 hasConceptScore W3105521436C195324797 @default.
- W3105521436 hasConceptScore W3105521436C199360897 @default.
- W3105521436 hasConceptScore W3105521436C205649164 @default.
- W3105521436 hasConceptScore W3105521436C2776760102 @default.
- W3105521436 hasConceptScore W3105521436C41008148 @default.
- W3105521436 hasConceptScore W3105521436C49774154 @default.
- W3105521436 hasLocation W31055214361 @default.
- W3105521436 hasLocation W31055214362 @default.
- W3105521436 hasOpenAccess W3105521436 @default.
- W3105521436 hasPrimaryLocation W31055214361 @default.
- W3105521436 hasRelatedWork W1485630101 @default.
- W3105521436 hasRelatedWork W1594844924 @default.
- W3105521436 hasRelatedWork W1966890770 @default.
- W3105521436 hasRelatedWork W2031871247 @default.
- W3105521436 hasRelatedWork W2355862304 @default.
- W3105521436 hasRelatedWork W2498017833 @default.
- W3105521436 hasRelatedWork W2559360254 @default.
- W3105521436 hasRelatedWork W2892497474 @default.
- W3105521436 hasRelatedWork W2909382770 @default.