Matches in SemOpenAlex for { <https://semopenalex.org/work/W2990241049> ?p ?o ?g. }
- W2990241049 abstract "We introduce The Benchmark of Linguistic Minimal Pairs (shortened to BLiMP), a challenge set for evaluating what language models (LMs) know about major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each containing 1000 minimal pairs isolating specific contrasts in syntax, morphology, or semantics. The data is automatically generated according to expert-crafted grammars, and aggregate human agreement with the labels is 96.4%. We use it to evaluate n-gram, LSTM, and Transformer (GPT-2 and Transformer-XL) LMs. We find that state-of-the-art models identify morphological contrasts reliably, but they struggle with semantic restrictions on the distribution of quantifiers and negative polarity items and subtle syntactic phenomena such as extraction islands." @default.
- W2990241049 created "2019-12-05" @default.
- W2990241049 creator A5007465673 @default.
- W2990241049 creator A5030307018 @default.
- W2990241049 creator A5053073532 @default.
- W2990241049 creator A5067390670 @default.
- W2990241049 creator A5082569485 @default.
- W2990241049 creator A5086643089 @default.
- W2990241049 creator A5089452138 @default.
- W2990241049 date "2019-12-02" @default.
- W2990241049 modified "2023-10-11" @default.
- W2990241049 title "BLiMP: The Benchmark of Linguistic Minimal Pairs for English" @default.
- W2990241049 cites W1582487387 @default.
- W2990241049 cites W1586060904 @default.
- W2990241049 cites W179875071 @default.
- W2990241049 cites W1974795422 @default.
- W2990241049 cites W1984471812 @default.
- W2990241049 cites W1986120881 @default.
- W2990241049 cites W2024988999 @default.
- W2990241049 cites W2064675550 @default.
- W2990241049 cites W2124669395 @default.
- W2990241049 cites W2134800885 @default.
- W2990241049 cites W2141440284 @default.
- W2990241049 cites W2158195707 @default.
- W2990241049 cites W2163730805 @default.
- W2990241049 cites W2170716495 @default.
- W2990241049 cites W2251930319 @default.
- W2990241049 cites W2531882892 @default.
- W2990241049 cites W2549835527 @default.
- W2990241049 cites W2563574619 @default.
- W2990241049 cites W2770232188 @default.
- W2990241049 cites W2787560479 @default.
- W2990241049 cites W2799124508 @default.
- W2990241049 cites W2864832950 @default.
- W2990241049 cites W2888922637 @default.
- W2990241049 cites W2891399254 @default.
- W2990241049 cites W2902967615 @default.
- W2990241049 cites W2909970382 @default.
- W2990241049 cites W2918996109 @default.
- W2990241049 cites W2923014074 @default.
- W2990241049 cites W2953369973 @default.
- W2990241049 cites W2962776659 @default.
- W2990241049 cites W2962926715 @default.
- W2990241049 cites W2962961857 @default.
- W2990241049 cites W2963025830 @default.
- W2990241049 cites W2963026768 @default.
- W2990241049 cites W2963341956 @default.
- W2990241049 cites W2963403868 @default.
- W2990241049 cites W2963494889 @default.
- W2990241049 cites W2964110616 @default.
- W2990241049 cites W2964117978 @default.
- W2990241049 cites W2971044268 @default.
- W2990241049 cites W2972351548 @default.
- W2990241049 cites W2972752636 @default.
- W2990241049 cites W2973957133 @default.
- W2990241049 cites W2978670439 @default.
- W2990241049 cites W2981852735 @default.
- W2990241049 cites W2994665957 @default.
- W2990241049 cites W2995181640 @default.
- W2990241049 cites W3037191812 @default.
- W2990241049 hasPublicationYear "2019" @default.
- W2990241049 type Work @default.
- W2990241049 sameAs 2990241049 @default.
- W2990241049 citedByCount "8" @default.
- W2990241049 countsByYear W29902410492020 @default.
- W2990241049 countsByYear W29902410492021 @default.
- W2990241049 crossrefType "posted-content" @default.
- W2990241049 hasAuthorship W2990241049A5007465673 @default.
- W2990241049 hasAuthorship W2990241049A5030307018 @default.
- W2990241049 hasAuthorship W2990241049A5053073532 @default.
- W2990241049 hasAuthorship W2990241049A5067390670 @default.
- W2990241049 hasAuthorship W2990241049A5082569485 @default.
- W2990241049 hasAuthorship W2990241049A5086643089 @default.
- W2990241049 hasAuthorship W2990241049A5089452138 @default.
- W2990241049 hasConcept C119599485 @default.
- W2990241049 hasConcept C127413603 @default.
- W2990241049 hasConcept C13280743 @default.
- W2990241049 hasConcept C138885662 @default.
- W2990241049 hasConcept C154945302 @default.
- W2990241049 hasConcept C165801399 @default.
- W2990241049 hasConcept C185798385 @default.
- W2990241049 hasConcept C186644900 @default.
- W2990241049 hasConcept C204321447 @default.
- W2990241049 hasConcept C205649164 @default.
- W2990241049 hasConcept C41008148 @default.
- W2990241049 hasConcept C41895202 @default.
- W2990241049 hasConcept C53893814 @default.
- W2990241049 hasConcept C60048249 @default.
- W2990241049 hasConcept C66322947 @default.
- W2990241049 hasConceptScore W2990241049C119599485 @default.
- W2990241049 hasConceptScore W2990241049C127413603 @default.
- W2990241049 hasConceptScore W2990241049C13280743 @default.
- W2990241049 hasConceptScore W2990241049C138885662 @default.
- W2990241049 hasConceptScore W2990241049C154945302 @default.
- W2990241049 hasConceptScore W2990241049C165801399 @default.
- W2990241049 hasConceptScore W2990241049C185798385 @default.
- W2990241049 hasConceptScore W2990241049C186644900 @default.
- W2990241049 hasConceptScore W2990241049C204321447 @default.
- W2990241049 hasConceptScore W2990241049C205649164 @default.
- W2990241049 hasConceptScore W2990241049C41008148 @default.