Matches in SemOpenAlex for { <https://semopenalex.org/work/W4311559374> ?p ?o ?g. }
Showing items 1 to 64 of
64
with 100 items per page.
- W4311559374 abstract "Pragmatics and non-literal language understanding are essential to human communication, and present a long-standing challenge for artificial language models. We perform a fine-grained comparison of language models and humans on seven pragmatic phenomena, using zero-shot prompting on an expert-curated set of English materials. We ask whether models (1) select pragmatic interpretations of speaker utterances, (2) make similar error patterns as humans, and (3) use similar linguistic cues as humans to solve the tasks. We find that the largest models achieve high accuracy and match human error patterns: within incorrect responses, models favor literal interpretations over heuristic-based distractors. We also find preliminary evidence that models and humans are sensitive to similar linguistic cues. Our results suggest that pragmatic behaviors can emerge in models without explicitly constructed representations of mental states. However, models tend to struggle with phenomena relying on social expectation violations." @default.
- W4311559374 created "2022-12-27" @default.
- W4311559374 creator A5021445004 @default.
- W4311559374 creator A5032945435 @default.
- W4311559374 creator A5067533298 @default.
- W4311559374 creator A5074950287 @default.
- W4311559374 creator A5081808595 @default.
- W4311559374 date "2022-12-13" @default.
- W4311559374 modified "2023-10-14" @default.
- W4311559374 title "A fine-grained comparison of pragmatic language understanding in humans and language models" @default.
- W4311559374 doi "https://doi.org/10.48550/arxiv.2212.06801" @default.
- W4311559374 hasPublicationYear "2022" @default.
- W4311559374 type Work @default.
- W4311559374 citedByCount "1" @default.
- W4311559374 countsByYear W43115593742023 @default.
- W4311559374 crossrefType "posted-content" @default.
- W4311559374 hasAuthorship W4311559374A5021445004 @default.
- W4311559374 hasAuthorship W4311559374A5032945435 @default.
- W4311559374 hasAuthorship W4311559374A5067533298 @default.
- W4311559374 hasAuthorship W4311559374A5074950287 @default.
- W4311559374 hasAuthorship W4311559374A5081808595 @default.
- W4311559374 hasBestOaLocation W43115593741 @default.
- W4311559374 hasConcept C11413529 @default.
- W4311559374 hasConcept C11693617 @default.
- W4311559374 hasConcept C137293760 @default.
- W4311559374 hasConcept C138885662 @default.
- W4311559374 hasConcept C154945302 @default.
- W4311559374 hasConcept C173801870 @default.
- W4311559374 hasConcept C177264268 @default.
- W4311559374 hasConcept C199360897 @default.
- W4311559374 hasConcept C204321447 @default.
- W4311559374 hasConcept C2780882242 @default.
- W4311559374 hasConcept C2993724205 @default.
- W4311559374 hasConcept C41008148 @default.
- W4311559374 hasConcept C41895202 @default.
- W4311559374 hasConceptScore W4311559374C11413529 @default.
- W4311559374 hasConceptScore W4311559374C11693617 @default.
- W4311559374 hasConceptScore W4311559374C137293760 @default.
- W4311559374 hasConceptScore W4311559374C138885662 @default.
- W4311559374 hasConceptScore W4311559374C154945302 @default.
- W4311559374 hasConceptScore W4311559374C173801870 @default.
- W4311559374 hasConceptScore W4311559374C177264268 @default.
- W4311559374 hasConceptScore W4311559374C199360897 @default.
- W4311559374 hasConceptScore W4311559374C204321447 @default.
- W4311559374 hasConceptScore W4311559374C2780882242 @default.
- W4311559374 hasConceptScore W4311559374C2993724205 @default.
- W4311559374 hasConceptScore W4311559374C41008148 @default.
- W4311559374 hasConceptScore W4311559374C41895202 @default.
- W4311559374 hasLocation W43115593741 @default.
- W4311559374 hasOpenAccess W4311559374 @default.
- W4311559374 hasPrimaryLocation W43115593741 @default.
- W4311559374 hasRelatedWork W142374489 @default.
- W4311559374 hasRelatedWork W1803932089 @default.
- W4311559374 hasRelatedWork W1985007624 @default.
- W4311559374 hasRelatedWork W2176369193 @default.
- W4311559374 hasRelatedWork W2351428524 @default.
- W4311559374 hasRelatedWork W2359001871 @default.
- W4311559374 hasRelatedWork W3107474891 @default.
- W4311559374 hasRelatedWork W4211027406 @default.
- W4311559374 hasRelatedWork W4311559374 @default.
- W4311559374 hasRelatedWork W2584532118 @default.
- W4311559374 isParatext "false" @default.
- W4311559374 isRetracted "false" @default.
- W4311559374 workType "article" @default.