Matches in SemOpenAlex for { <https://semopenalex.org/work/W3125915183> ?p ?o ?g. }
- W3125915183 abstract "Linguistically informed analyses of language models (LMs) contribute to the understanding and improvement of these models. Here, we introduce the corpus of Chinese linguistic minimal pairs (CLiMP), which can be used to investigate what knowledge Chinese LMs acquire. CLiMP consists of sets of 1,000 minimal pairs (MPs) for 16 syntactic contrasts in Mandarin, covering 9 major Mandarin linguistic phenomena. The MPs are semi-automatically generated, and human agreement with the labels in CLiMP is 95.8%. We evaluated 11 different LMs on CLiMP, covering n-grams, LSTMs, and Chinese BERT. We find that classifier-noun agreement and verb complement selection are the phenomena that models generally perform best at. However, models struggle the most with the ba construction, binding, and filler-gap dependencies. Overall, Chinese BERT achieves an 81.8% average accuracy, while the performances of LSTMs and 5-grams are only moderately above chance level." @default.
- W3125915183 created "2021-02-01" @default.
- W3125915183 creator A5018073672 @default.
- W3125915183 creator A5042146339 @default.
- W3125915183 creator A5055402092 @default.
- W3125915183 creator A5082874907 @default.
- W3125915183 creator A5089452138 @default.
- W3125915183 date "2021-01-26" @default.
- W3125915183 modified "2023-09-25" @default.
- W3125915183 title "CLiMP: A Benchmark for Chinese Language Model Evaluation" @default.
- W3125915183 cites W1579838312 @default.
- W3125915183 cites W2064675550 @default.
- W3125915183 cites W2549835527 @default.
- W3125915183 cites W2888922637 @default.
- W3125915183 cites W2889947987 @default.
- W3125915183 cites W2946359678 @default.
- W3125915183 cites W2950784811 @default.
- W3125915183 cites W2953369973 @default.
- W3125915183 cites W2962739339 @default.
- W3125915183 cites W2962961857 @default.
- W3125915183 cites W2963025830 @default.
- W3125915183 cites W2963341956 @default.
- W3125915183 cites W2963751529 @default.
- W3125915183 cites W2972324944 @default.
- W3125915183 cites W2978670439 @default.
- W3125915183 cites W2990391581 @default.
- W3125915183 cites W2996728628 @default.
- W3125915183 cites W3034775979 @default.
- W3125915183 cites W3035064549 @default.
- W3125915183 cites W3035390927 @default.
- W3125915183 cites W3088059392 @default.
- W3125915183 cites W3118485687 @default.
- W3125915183 cites W3168987555 @default.
- W3125915183 cites W566301461 @default.
- W3125915183 doi "https://doi.org/10.48550/arxiv.2101.11131" @default.
- W3125915183 hasPublicationYear "2021" @default.
- W3125915183 type Work @default.
- W3125915183 sameAs 3125915183 @default.
- W3125915183 citedByCount "0" @default.
- W3125915183 crossrefType "posted-content" @default.
- W3125915183 hasAuthorship W3125915183A5018073672 @default.
- W3125915183 hasAuthorship W3125915183A5042146339 @default.
- W3125915183 hasAuthorship W3125915183A5055402092 @default.
- W3125915183 hasAuthorship W3125915183A5082874907 @default.
- W3125915183 hasAuthorship W3125915183A5089452138 @default.
- W3125915183 hasBestOaLocation W31259151831 @default.
- W3125915183 hasConcept C104317684 @default.
- W3125915183 hasConcept C112313634 @default.
- W3125915183 hasConcept C121934690 @default.
- W3125915183 hasConcept C127716648 @default.
- W3125915183 hasConcept C13280743 @default.
- W3125915183 hasConcept C137293760 @default.
- W3125915183 hasConcept C138885662 @default.
- W3125915183 hasConcept C138954614 @default.
- W3125915183 hasConcept C154945302 @default.
- W3125915183 hasConcept C185592680 @default.
- W3125915183 hasConcept C185798385 @default.
- W3125915183 hasConcept C188082640 @default.
- W3125915183 hasConcept C204321447 @default.
- W3125915183 hasConcept C205649164 @default.
- W3125915183 hasConcept C2776397901 @default.
- W3125915183 hasConcept C41008148 @default.
- W3125915183 hasConcept C41895202 @default.
- W3125915183 hasConcept C55493867 @default.
- W3125915183 hasConcept C81917197 @default.
- W3125915183 hasConcept C95623464 @default.
- W3125915183 hasConceptScore W3125915183C104317684 @default.
- W3125915183 hasConceptScore W3125915183C112313634 @default.
- W3125915183 hasConceptScore W3125915183C121934690 @default.
- W3125915183 hasConceptScore W3125915183C127716648 @default.
- W3125915183 hasConceptScore W3125915183C13280743 @default.
- W3125915183 hasConceptScore W3125915183C137293760 @default.
- W3125915183 hasConceptScore W3125915183C138885662 @default.
- W3125915183 hasConceptScore W3125915183C138954614 @default.
- W3125915183 hasConceptScore W3125915183C154945302 @default.
- W3125915183 hasConceptScore W3125915183C185592680 @default.
- W3125915183 hasConceptScore W3125915183C185798385 @default.
- W3125915183 hasConceptScore W3125915183C188082640 @default.
- W3125915183 hasConceptScore W3125915183C204321447 @default.
- W3125915183 hasConceptScore W3125915183C205649164 @default.
- W3125915183 hasConceptScore W3125915183C2776397901 @default.
- W3125915183 hasConceptScore W3125915183C41008148 @default.
- W3125915183 hasConceptScore W3125915183C41895202 @default.
- W3125915183 hasConceptScore W3125915183C55493867 @default.
- W3125915183 hasConceptScore W3125915183C81917197 @default.
- W3125915183 hasConceptScore W3125915183C95623464 @default.
- W3125915183 hasLocation W31259151831 @default.
- W3125915183 hasOpenAccess W3125915183 @default.
- W3125915183 hasPrimaryLocation W31259151831 @default.
- W3125915183 hasRelatedWork W1501055685 @default.
- W3125915183 hasRelatedWork W1985007624 @default.
- W3125915183 hasRelatedWork W2118109061 @default.
- W3125915183 hasRelatedWork W2265460551 @default.
- W3125915183 hasRelatedWork W2272334159 @default.
- W3125915183 hasRelatedWork W2277290663 @default.
- W3125915183 hasRelatedWork W2358167242 @default.
- W3125915183 hasRelatedWork W2379385289 @default.
- W3125915183 hasRelatedWork W3214949261 @default.
- W3125915183 hasRelatedWork W576492366 @default.
- W3125915183 isParatext "false" @default.