Matches in SemOpenAlex for { <https://semopenalex.org/work/W2996728628> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W2996728628 endingPage "392" @default.
- W2996728628 startingPage "377" @default.
- W2996728628 abstract "We introduce The Benchmark of Linguistic Minimal Pairs (BLiMP), 1 a challenge set for evaluating the linguistic knowledge of language models (LMs) on major grammatical phenomena in English. BLiMP consists of 67 individual datasets, each containing 1,000 minimal pairs—that is, pairs of minimally different sentences that contrast in grammatical acceptability and isolate specific phenomenon in syntax, morphology, or semantics. We generate the data according to linguist-crafted grammar templates, and human aggregate agreement with the labels is 96.4%. We evaluate n-gram, LSTM, and Transformer (GPT-2 and Transformer-XL) LMs by observing whether they assign a higher probability to the acceptable sentence in each minimal pair. We find that state-of-the-art models identify morphological contrasts related to agreement reliably, but they struggle with some subtle semantic and syntactic phenomena, such as negative polarity items and extraction islands." @default.
- W2996728628 created "2019-12-26" @default.
- W2996728628 creator A5007465673 @default.
- W2996728628 creator A5018785590 @default.
- W2996728628 creator A5053073532 @default.
- W2996728628 creator A5067390670 @default.
- W2996728628 creator A5082569485 @default.
- W2996728628 creator A5086643089 @default.
- W2996728628 creator A5089452138 @default.
- W2996728628 date "2020-12-01" @default.
- W2996728628 modified "2023-10-13" @default.
- W2996728628 title "BLiMP: The Benchmark of Linguistic Minimal Pairs for English" @default.
- W2996728628 cites W1974795422 @default.
- W2996728628 cites W1984471812 @default.
- W2996728628 cites W2064675550 @default.
- W2996728628 cites W2158195707 @default.
- W2996728628 cites W2163730805 @default.
- W2996728628 cites W2251930319 @default.
- W2996728628 cites W2531882892 @default.
- W2996728628 cites W2549835527 @default.
- W2996728628 cites W2770232188 @default.
- W2996728628 cites W2888922637 @default.
- W2996728628 cites W2923014074 @default.
- W2996728628 cites W2962961857 @default.
- W2996728628 cites W2963026768 @default.
- W2996728628 cites W2964117978 @default.
- W2996728628 cites W2972752636 @default.
- W2996728628 cites W2978670439 @default.
- W2996728628 cites W4245765565 @default.
- W2996728628 cites W4252209867 @default.
- W2996728628 doi "https://doi.org/10.1162/tacl_a_00321" @default.
- W2996728628 hasPublicationYear "2020" @default.
- W2996728628 type Work @default.
- W2996728628 sameAs 2996728628 @default.
- W2996728628 citedByCount "90" @default.
- W2996728628 countsByYear W29967286282020 @default.
- W2996728628 countsByYear W29967286282021 @default.
- W2996728628 countsByYear W29967286282022 @default.
- W2996728628 countsByYear W29967286282023 @default.
- W2996728628 crossrefType "journal-article" @default.
- W2996728628 hasAuthorship W2996728628A5007465673 @default.
- W2996728628 hasAuthorship W2996728628A5018785590 @default.
- W2996728628 hasAuthorship W2996728628A5053073532 @default.
- W2996728628 hasAuthorship W2996728628A5067390670 @default.
- W2996728628 hasAuthorship W2996728628A5082569485 @default.
- W2996728628 hasAuthorship W2996728628A5086643089 @default.
- W2996728628 hasAuthorship W2996728628A5089452138 @default.
- W2996728628 hasBestOaLocation W29967286281 @default.
- W2996728628 hasConcept C121332964 @default.
- W2996728628 hasConcept C13280743 @default.
- W2996728628 hasConcept C138885662 @default.
- W2996728628 hasConcept C154945302 @default.
- W2996728628 hasConcept C165801399 @default.
- W2996728628 hasConcept C185798385 @default.
- W2996728628 hasConcept C204321447 @default.
- W2996728628 hasConcept C205649164 @default.
- W2996728628 hasConcept C26022165 @default.
- W2996728628 hasConcept C2777530160 @default.
- W2996728628 hasConcept C41008148 @default.
- W2996728628 hasConcept C41895202 @default.
- W2996728628 hasConcept C60048249 @default.
- W2996728628 hasConcept C62520636 @default.
- W2996728628 hasConcept C66322947 @default.
- W2996728628 hasConceptScore W2996728628C121332964 @default.
- W2996728628 hasConceptScore W2996728628C13280743 @default.
- W2996728628 hasConceptScore W2996728628C138885662 @default.
- W2996728628 hasConceptScore W2996728628C154945302 @default.
- W2996728628 hasConceptScore W2996728628C165801399 @default.
- W2996728628 hasConceptScore W2996728628C185798385 @default.
- W2996728628 hasConceptScore W2996728628C204321447 @default.
- W2996728628 hasConceptScore W2996728628C205649164 @default.
- W2996728628 hasConceptScore W2996728628C26022165 @default.
- W2996728628 hasConceptScore W2996728628C2777530160 @default.
- W2996728628 hasConceptScore W2996728628C41008148 @default.
- W2996728628 hasConceptScore W2996728628C41895202 @default.
- W2996728628 hasConceptScore W2996728628C60048249 @default.
- W2996728628 hasConceptScore W2996728628C62520636 @default.
- W2996728628 hasConceptScore W2996728628C66322947 @default.
- W2996728628 hasLocation W29967286281 @default.
- W2996728628 hasLocation W29967286282 @default.
- W2996728628 hasLocation W29967286283 @default.
- W2996728628 hasOpenAccess W2996728628 @default.
- W2996728628 hasPrimaryLocation W29967286281 @default.
- W2996728628 hasRelatedWork W2028665553 @default.
- W2996728628 hasRelatedWork W2086519370 @default.
- W2996728628 hasRelatedWork W2087343574 @default.
- W2996728628 hasRelatedWork W2105860728 @default.
- W2996728628 hasRelatedWork W2130974462 @default.
- W2996728628 hasRelatedWork W2378211422 @default.
- W2996728628 hasRelatedWork W2535915176 @default.
- W2996728628 hasRelatedWork W4287657826 @default.
- W2996728628 hasRelatedWork W4321353415 @default.
- W2996728628 hasRelatedWork W972276598 @default.
- W2996728628 hasVolume "8" @default.
- W2996728628 isParatext "false" @default.
- W2996728628 isRetracted "false" @default.
- W2996728628 magId "2996728628" @default.
- W2996728628 workType "article" @default.