Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387322588> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4387322588 abstract "Analogical reasoning is one of the prime abilities of humans and is linked to creativity and scientific discoveries. This ability has been studied extensively in natural language processing (NLP) as well as in cognitive psychology by proposing various benchmarks and evaluation setups. Yet, a substantial gap exists between evaluations of analogical reasoning in cognitive psychology and NLP. Our aim is to bridge this by computationally adapting theories related to analogical reasoning from cognitive psychology in the context of narratives and developing an evaluation framework large in scale. More concretely, we propose the task of matching narratives based on system mappings and release the Analogical Reasoning on Narratives (ARN) dataset. To create the dataset, we devise a framework inspired by cognitive psychology theories about analogical reasoning to utilize narratives and their components to form mappings of different abstractness levels. These mappings are then leveraged to create pairs of analogies and disanalogies/distractors with more than 1k triples of query narratives, analogies, and distractors. We cover four categories of far/near analogies and far/near distractors that allow us to study analogical reasoning in models from distinct perspectives. In this study, we evaluate different large language models (LLMs) on this task. Our results demonstrate that LLMs struggle to recognize higher-order mappings when they are not accompanied by lower-order mappings (far analogies) and show better performance when all mappings are present simultaneously (near analogies). We observe that in all the settings, the analogical reasoning abilities of LLMs can be easily impaired by near distractors that form lower-order mappings with the query narratives." @default.
- W4387322588 created "2023-10-04" @default.
- W4387322588 creator A5008608420 @default.
- W4387322588 creator A5012219972 @default.
- W4387322588 creator A5030315755 @default.
- W4387322588 date "2023-10-02" @default.
- W4387322588 modified "2023-10-05" @default.
- W4387322588 title "ARN: A Comprehensive Framework and Dataset for Analogical Reasoning on Narratives" @default.
- W4387322588 doi "https://doi.org/10.48550/arxiv.2310.00996" @default.
- W4387322588 hasPublicationYear "2023" @default.
- W4387322588 type Work @default.
- W4387322588 citedByCount "0" @default.
- W4387322588 crossrefType "posted-content" @default.
- W4387322588 hasAuthorship W4387322588A5008608420 @default.
- W4387322588 hasAuthorship W4387322588A5012219972 @default.
- W4387322588 hasAuthorship W4387322588A5030315755 @default.
- W4387322588 hasBestOaLocation W43873225881 @default.
- W4387322588 hasConcept C105795698 @default.
- W4387322588 hasConcept C11012388 @default.
- W4387322588 hasConcept C138885662 @default.
- W4387322588 hasConcept C151730666 @default.
- W4387322588 hasConcept C154945302 @default.
- W4387322588 hasConcept C15744967 @default.
- W4387322588 hasConcept C162324750 @default.
- W4387322588 hasConcept C165064840 @default.
- W4387322588 hasConcept C169760540 @default.
- W4387322588 hasConcept C169900460 @default.
- W4387322588 hasConcept C180747234 @default.
- W4387322588 hasConcept C187736073 @default.
- W4387322588 hasConcept C188147891 @default.
- W4387322588 hasConcept C199033989 @default.
- W4387322588 hasConcept C204321447 @default.
- W4387322588 hasConcept C2779343474 @default.
- W4387322588 hasConcept C2780451532 @default.
- W4387322588 hasConcept C2985612853 @default.
- W4387322588 hasConcept C33923547 @default.
- W4387322588 hasConcept C41008148 @default.
- W4387322588 hasConcept C41895202 @default.
- W4387322588 hasConcept C521332185 @default.
- W4387322588 hasConcept C77805123 @default.
- W4387322588 hasConcept C86803240 @default.
- W4387322588 hasConceptScore W4387322588C105795698 @default.
- W4387322588 hasConceptScore W4387322588C11012388 @default.
- W4387322588 hasConceptScore W4387322588C138885662 @default.
- W4387322588 hasConceptScore W4387322588C151730666 @default.
- W4387322588 hasConceptScore W4387322588C154945302 @default.
- W4387322588 hasConceptScore W4387322588C15744967 @default.
- W4387322588 hasConceptScore W4387322588C162324750 @default.
- W4387322588 hasConceptScore W4387322588C165064840 @default.
- W4387322588 hasConceptScore W4387322588C169760540 @default.
- W4387322588 hasConceptScore W4387322588C169900460 @default.
- W4387322588 hasConceptScore W4387322588C180747234 @default.
- W4387322588 hasConceptScore W4387322588C187736073 @default.
- W4387322588 hasConceptScore W4387322588C188147891 @default.
- W4387322588 hasConceptScore W4387322588C199033989 @default.
- W4387322588 hasConceptScore W4387322588C204321447 @default.
- W4387322588 hasConceptScore W4387322588C2779343474 @default.
- W4387322588 hasConceptScore W4387322588C2780451532 @default.
- W4387322588 hasConceptScore W4387322588C2985612853 @default.
- W4387322588 hasConceptScore W4387322588C33923547 @default.
- W4387322588 hasConceptScore W4387322588C41008148 @default.
- W4387322588 hasConceptScore W4387322588C41895202 @default.
- W4387322588 hasConceptScore W4387322588C521332185 @default.
- W4387322588 hasConceptScore W4387322588C77805123 @default.
- W4387322588 hasConceptScore W4387322588C86803240 @default.
- W4387322588 hasLocation W43873225881 @default.
- W4387322588 hasOpenAccess W4387322588 @default.
- W4387322588 hasPrimaryLocation W43873225881 @default.
- W4387322588 hasRelatedWork W1035131874 @default.
- W4387322588 hasRelatedWork W1585721873 @default.
- W4387322588 hasRelatedWork W1589583416 @default.
- W4387322588 hasRelatedWork W1642660396 @default.
- W4387322588 hasRelatedWork W2015035247 @default.
- W4387322588 hasRelatedWork W2357162860 @default.
- W4387322588 hasRelatedWork W2376511922 @default.
- W4387322588 hasRelatedWork W2996819463 @default.
- W4387322588 hasRelatedWork W3048321957 @default.
- W4387322588 hasRelatedWork W4297883695 @default.
- W4387322588 isParatext "false" @default.
- W4387322588 isRetracted "false" @default.
- W4387322588 workType "article" @default.