Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386566493> ?p ?o ?g. }
Showing items 1 to 55 of
55
with 100 items per page.
- W4386566493 abstract "In this paper, we introduce JBLiMP (Japanese Benchmark of Linguistic Minimal Pairs), a novel dataset for targeted syntactic evaluations of language models in Japanese. JBLiMP consists of 331 minimal pairs, which are created based on acceptability judgments extracted from journal articles in theoretical linguistics. These minimal pairs are grouped into 11 categories, each covering a different linguistic phenomenon. JBLiMP is unique in that it successfully combines two important features independently observed in existing datasets: (i) coverage of complex linguistic phenomena (cf. CoLA) and (ii) presentation of sentences as minimal pairs (cf. BLiMP). In addition, JBLiMP is the first dataset for targeted syntactic evaluations of language models in Japanese, thus allowing the comparison of syntactic knowledge of language models across different languages. We then evaluate the syntactic knowledge of several language models on JBLiMP: GPT-2, LSTM, and n-gram language models. The results demonstrated that all the architectures achieved comparable overall accuracies around 75%. Error analyses by linguistic phenomenon further revealed that these language models successfully captured local dependencies like nominal structures, but not long-distance dependencies such as verbal agreement and binding." @default.
- W4386566493 created "2023-09-10" @default.
- W4386566493 creator A5008853188 @default.
- W4386566493 creator A5025796706 @default.
- W4386566493 date "2023-01-01" @default.
- W4386566493 modified "2023-10-16" @default.
- W4386566493 title "JBLiMP: Japanese Benchmark of Linguistic Minimal Pairs" @default.
- W4386566493 doi "https://doi.org/10.18653/v1/2023.findings-eacl.117" @default.
- W4386566493 hasPublicationYear "2023" @default.
- W4386566493 type Work @default.
- W4386566493 citedByCount "0" @default.
- W4386566493 crossrefType "proceedings-article" @default.
- W4386566493 hasAuthorship W4386566493A5008853188 @default.
- W4386566493 hasAuthorship W4386566493A5025796706 @default.
- W4386566493 hasBestOaLocation W43865664931 @default.
- W4386566493 hasConcept C121332964 @default.
- W4386566493 hasConcept C13280743 @default.
- W4386566493 hasConcept C137293760 @default.
- W4386566493 hasConcept C138885662 @default.
- W4386566493 hasConcept C154945302 @default.
- W4386566493 hasConcept C185798385 @default.
- W4386566493 hasConcept C204321447 @default.
- W4386566493 hasConcept C205649164 @default.
- W4386566493 hasConcept C41008148 @default.
- W4386566493 hasConcept C41895202 @default.
- W4386566493 hasConcept C50335755 @default.
- W4386566493 hasConcept C62520636 @default.
- W4386566493 hasConceptScore W4386566493C121332964 @default.
- W4386566493 hasConceptScore W4386566493C13280743 @default.
- W4386566493 hasConceptScore W4386566493C137293760 @default.
- W4386566493 hasConceptScore W4386566493C138885662 @default.
- W4386566493 hasConceptScore W4386566493C154945302 @default.
- W4386566493 hasConceptScore W4386566493C185798385 @default.
- W4386566493 hasConceptScore W4386566493C204321447 @default.
- W4386566493 hasConceptScore W4386566493C205649164 @default.
- W4386566493 hasConceptScore W4386566493C41008148 @default.
- W4386566493 hasConceptScore W4386566493C41895202 @default.
- W4386566493 hasConceptScore W4386566493C50335755 @default.
- W4386566493 hasConceptScore W4386566493C62520636 @default.
- W4386566493 hasLocation W43865664931 @default.
- W4386566493 hasOpenAccess W4386566493 @default.
- W4386566493 hasPrimaryLocation W43865664931 @default.
- W4386566493 hasRelatedWork W112744582 @default.
- W4386566493 hasRelatedWork W1485630101 @default.
- W4386566493 hasRelatedWork W1989705153 @default.
- W4386566493 hasRelatedWork W2081245617 @default.
- W4386566493 hasRelatedWork W2359001871 @default.
- W4386566493 hasRelatedWork W2496228846 @default.
- W4386566493 hasRelatedWork W2498017833 @default.
- W4386566493 hasRelatedWork W2789919619 @default.
- W4386566493 hasRelatedWork W3033750096 @default.
- W4386566493 hasRelatedWork W3116295307 @default.
- W4386566493 isParatext "false" @default.
- W4386566493 isRetracted "false" @default.
- W4386566493 workType "article" @default.