Matches in SemOpenAlex for { <https://semopenalex.org/work/W4297436312> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W4297436312 abstract "We introduce a new in-context learning paradigm to measure Large Language Models' (LLMs) ability to learn novel words during inference. In particular, we rewrite Winograd-style co-reference resolution problems by replacing the key concept word with a synthetic but plausible word that the model must understand to complete the task. Solving this task requires the model to make use of the dictionary definition of the new word given in the prompt. This benchmark addresses word acquisition, one important aspect of the diachronic degradation known to afflict LLMs. As LLMs are frozen in time at the moment they are trained, they are normally unable to reflect the way language changes over time. We show that the accuracy of LLMs compared to the original Winograd tasks decreases radically in our benchmark, thus identifying a limitation of current models and providing a benchmark to measure future improvements in LLMs ability to do in-context learning." @default.
- W4297436312 created "2022-09-28" @default.
- W4297436312 creator A5000738730 @default.
- W4297436312 creator A5026154387 @default.
- W4297436312 creator A5051617344 @default.
- W4297436312 creator A5090951421 @default.
- W4297436312 date "2022-09-25" @default.
- W4297436312 modified "2023-09-26" @default.
- W4297436312 title "WinoDict: Probing language models for in-context word acquisition" @default.
- W4297436312 doi "https://doi.org/10.48550/arxiv.2209.12153" @default.
- W4297436312 hasPublicationYear "2022" @default.
- W4297436312 type Work @default.
- W4297436312 citedByCount "0" @default.
- W4297436312 crossrefType "posted-content" @default.
- W4297436312 hasAuthorship W4297436312A5000738730 @default.
- W4297436312 hasAuthorship W4297436312A5026154387 @default.
- W4297436312 hasAuthorship W4297436312A5051617344 @default.
- W4297436312 hasAuthorship W4297436312A5090951421 @default.
- W4297436312 hasBestOaLocation W42974363121 @default.
- W4297436312 hasConcept C13280743 @default.
- W4297436312 hasConcept C137293760 @default.
- W4297436312 hasConcept C138885662 @default.
- W4297436312 hasConcept C154945302 @default.
- W4297436312 hasConcept C15744967 @default.
- W4297436312 hasConcept C162324750 @default.
- W4297436312 hasConcept C166957645 @default.
- W4297436312 hasConcept C180747234 @default.
- W4297436312 hasConcept C185798385 @default.
- W4297436312 hasConcept C187736073 @default.
- W4297436312 hasConcept C204321447 @default.
- W4297436312 hasConcept C205649164 @default.
- W4297436312 hasConcept C26517878 @default.
- W4297436312 hasConcept C2776214188 @default.
- W4297436312 hasConcept C2779343474 @default.
- W4297436312 hasConcept C2780451532 @default.
- W4297436312 hasConcept C38652104 @default.
- W4297436312 hasConcept C41008148 @default.
- W4297436312 hasConcept C41895202 @default.
- W4297436312 hasConcept C90805587 @default.
- W4297436312 hasConcept C95457728 @default.
- W4297436312 hasConceptScore W4297436312C13280743 @default.
- W4297436312 hasConceptScore W4297436312C137293760 @default.
- W4297436312 hasConceptScore W4297436312C138885662 @default.
- W4297436312 hasConceptScore W4297436312C154945302 @default.
- W4297436312 hasConceptScore W4297436312C15744967 @default.
- W4297436312 hasConceptScore W4297436312C162324750 @default.
- W4297436312 hasConceptScore W4297436312C166957645 @default.
- W4297436312 hasConceptScore W4297436312C180747234 @default.
- W4297436312 hasConceptScore W4297436312C185798385 @default.
- W4297436312 hasConceptScore W4297436312C187736073 @default.
- W4297436312 hasConceptScore W4297436312C204321447 @default.
- W4297436312 hasConceptScore W4297436312C205649164 @default.
- W4297436312 hasConceptScore W4297436312C26517878 @default.
- W4297436312 hasConceptScore W4297436312C2776214188 @default.
- W4297436312 hasConceptScore W4297436312C2779343474 @default.
- W4297436312 hasConceptScore W4297436312C2780451532 @default.
- W4297436312 hasConceptScore W4297436312C38652104 @default.
- W4297436312 hasConceptScore W4297436312C41008148 @default.
- W4297436312 hasConceptScore W4297436312C41895202 @default.
- W4297436312 hasConceptScore W4297436312C90805587 @default.
- W4297436312 hasConceptScore W4297436312C95457728 @default.
- W4297436312 hasLocation W42974363121 @default.
- W4297436312 hasOpenAccess W4297436312 @default.
- W4297436312 hasPrimaryLocation W42974363121 @default.
- W4297436312 hasRelatedWork W1539050421 @default.
- W4297436312 hasRelatedWork W2035959783 @default.
- W4297436312 hasRelatedWork W2081647779 @default.
- W4297436312 hasRelatedWork W2883550961 @default.
- W4297436312 hasRelatedWork W3024381485 @default.
- W4297436312 hasRelatedWork W3093057136 @default.
- W4297436312 hasRelatedWork W3107474891 @default.
- W4297436312 hasRelatedWork W3114626748 @default.
- W4297436312 hasRelatedWork W3185852197 @default.
- W4297436312 hasRelatedWork W4377090803 @default.
- W4297436312 isParatext "false" @default.
- W4297436312 isRetracted "false" @default.
- W4297436312 workType "article" @default.