Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385890358> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4385890358 abstract "The ability to learn from context with novel concepts, and deliver appropriate responses are essential in human conversations. Despite current Multimodal Large Language Models (MLLMs) and Large Language Models (LLMs) being trained on mega-scale datasets, recognizing unseen images or understanding novel concepts in a training-free manner remains a challenge. In-Context Learning (ICL) explores training-free few-shot learning, where models are encouraged to ``learn to learn from limited tasks and generalize to unseen tasks. In this work, we propose link-context learning (LCL), which emphasizes reasoning from cause and effect to augment the learning capabilities of MLLMs. LCL goes beyond traditional ICL by explicitly strengthening the causal relationship between the support set and the query set. By providing demonstrations with causal links, LCL guides the model to discern not only the analogy but also the underlying causal associations between data points, which empowers MLLMs to recognize unseen images and understand novel concepts more effectively. To facilitate the evaluation of this novel approach, we introduce the ISEKAI dataset, comprising exclusively of unseen generated image-label pairs designed for link-context learning. Extensive experiments show that our LCL-MLLM exhibits strong link-context learning capabilities to novel concepts over vanilla MLLMs. Code and data will be released at https://github.com/isekai-portal/Link-Context-Learning." @default.
- W4385890358 created "2023-08-17" @default.
- W4385890358 creator A5002744044 @default.
- W4385890358 creator A5020951392 @default.
- W4385890358 creator A5027750483 @default.
- W4385890358 creator A5029140686 @default.
- W4385890358 creator A5078304976 @default.
- W4385890358 creator A5079260216 @default.
- W4385890358 date "2023-08-15" @default.
- W4385890358 modified "2023-09-27" @default.
- W4385890358 title "Link-Context Learning for Multimodal LLMs" @default.
- W4385890358 doi "https://doi.org/10.48550/arxiv.2308.07891" @default.
- W4385890358 hasPublicationYear "2023" @default.
- W4385890358 type Work @default.
- W4385890358 citedByCount "0" @default.
- W4385890358 crossrefType "posted-content" @default.
- W4385890358 hasAuthorship W4385890358A5002744044 @default.
- W4385890358 hasAuthorship W4385890358A5020951392 @default.
- W4385890358 hasAuthorship W4385890358A5027750483 @default.
- W4385890358 hasAuthorship W4385890358A5029140686 @default.
- W4385890358 hasAuthorship W4385890358A5078304976 @default.
- W4385890358 hasAuthorship W4385890358A5079260216 @default.
- W4385890358 hasBestOaLocation W43858903581 @default.
- W4385890358 hasConcept C111472728 @default.
- W4385890358 hasConcept C119857082 @default.
- W4385890358 hasConcept C138885662 @default.
- W4385890358 hasConcept C151730666 @default.
- W4385890358 hasConcept C154945302 @default.
- W4385890358 hasConcept C177264268 @default.
- W4385890358 hasConcept C199360897 @default.
- W4385890358 hasConcept C2779343474 @default.
- W4385890358 hasConcept C41008148 @default.
- W4385890358 hasConcept C521332185 @default.
- W4385890358 hasConcept C86803240 @default.
- W4385890358 hasConceptScore W4385890358C111472728 @default.
- W4385890358 hasConceptScore W4385890358C119857082 @default.
- W4385890358 hasConceptScore W4385890358C138885662 @default.
- W4385890358 hasConceptScore W4385890358C151730666 @default.
- W4385890358 hasConceptScore W4385890358C154945302 @default.
- W4385890358 hasConceptScore W4385890358C177264268 @default.
- W4385890358 hasConceptScore W4385890358C199360897 @default.
- W4385890358 hasConceptScore W4385890358C2779343474 @default.
- W4385890358 hasConceptScore W4385890358C41008148 @default.
- W4385890358 hasConceptScore W4385890358C521332185 @default.
- W4385890358 hasConceptScore W4385890358C86803240 @default.
- W4385890358 hasLocation W43858903581 @default.
- W4385890358 hasOpenAccess W4385890358 @default.
- W4385890358 hasPrimaryLocation W43858903581 @default.
- W4385890358 hasRelatedWork W2961085424 @default.
- W4385890358 hasRelatedWork W3046775127 @default.
- W4385890358 hasRelatedWork W3170094116 @default.
- W4385890358 hasRelatedWork W4205958290 @default.
- W4385890358 hasRelatedWork W4285260836 @default.
- W4385890358 hasRelatedWork W4286629047 @default.
- W4385890358 hasRelatedWork W4306321456 @default.
- W4385890358 hasRelatedWork W4306674287 @default.
- W4385890358 hasRelatedWork W4386462264 @default.
- W4385890358 hasRelatedWork W4224009465 @default.
- W4385890358 isParatext "false" @default.
- W4385890358 isRetracted "false" @default.
- W4385890358 workType "article" @default.