Matches in SemOpenAlex for { <https://semopenalex.org/work/W2900556903> ?p ?o ?g. }
Showing items 1 to 82 of
82
with 100 items per page.
- W2900556903 abstract "Success in natural language inference (NLI) should require a model to understand both lexical and compositional semantics. However, through adversarial evaluation, we find that several state-of-the-art models with diverse architectures are over-relying on the former and fail to use the latter. Further, this compositionality unawareness is not reflected via standard evaluation on current datasets. We show that removing RNNs in existing models or shuffling input words during training does not induce large performance loss despite the explicit removal of compositional information. Therefore, we propose a compositionality-sensitivity testing setup that analyzes models on natural examples from existing datasets that cannot be solved via lexical features alone (i.e., on which a bag-of-words model gives a high probability to one wrong label), hence revealing the models' actual compositionality awareness. We show that this setup not only highlights the limited compositional ability of current NLI models, but also differentiates model performance based on design, e.g., separating shallow bag-of-words models from deeper, linguistically-grounded tree-based models. Our evaluation setup is an important analysis tool: complementing currently existing adversarial and linguistically driven diagnostic evaluations, and exposing opportunities for future work on evaluating models' compositional understanding." @default.
- W2900556903 created "2018-11-29" @default.
- W2900556903 creator A5001987532 @default.
- W2900556903 creator A5057724465 @default.
- W2900556903 creator A5066141653 @default.
- W2900556903 date "2018-11-16" @default.
- W2900556903 modified "2023-09-27" @default.
- W2900556903 title "Analyzing Compositionality-Sensitivity of NLI Models" @default.
- W2900556903 cites W2250861254 @default.
- W2900556903 cites W2413794162 @default.
- W2900556903 cites W2427527485 @default.
- W2900556903 cites W2593833795 @default.
- W2900556903 cites W2798665661 @default.
- W2900556903 cites W2923014074 @default.
- W2900556903 cites W2950819771 @default.
- W2900556903 cites W2953084091 @default.
- W2900556903 cites W2962685628 @default.
- W2900556903 cites W2962736243 @default.
- W2900556903 cites W2962765587 @default.
- W2900556903 cites W2962843521 @default.
- W2900556903 cites W2963077723 @default.
- W2900556903 cites W2963120843 @default.
- W2900556903 cites W2963393721 @default.
- W2900556903 cites W2963491027 @default.
- W2900556903 cites W2963719234 @default.
- W2900556903 cites W2963846996 @default.
- W2900556903 cites W2963969878 @default.
- W2900556903 doi "https://doi.org/10.48550/arxiv.1811.07033" @default.
- W2900556903 hasPublicationYear "2018" @default.
- W2900556903 type Work @default.
- W2900556903 sameAs 2900556903 @default.
- W2900556903 citedByCount "2" @default.
- W2900556903 countsByYear W29005569032019 @default.
- W2900556903 crossrefType "posted-content" @default.
- W2900556903 hasAuthorship W2900556903A5001987532 @default.
- W2900556903 hasAuthorship W2900556903A5057724465 @default.
- W2900556903 hasAuthorship W2900556903A5066141653 @default.
- W2900556903 hasBestOaLocation W29005569031 @default.
- W2900556903 hasConcept C119857082 @default.
- W2900556903 hasConcept C121375916 @default.
- W2900556903 hasConcept C127413603 @default.
- W2900556903 hasConcept C154945302 @default.
- W2900556903 hasConcept C167927819 @default.
- W2900556903 hasConcept C184337299 @default.
- W2900556903 hasConcept C199360897 @default.
- W2900556903 hasConcept C204321447 @default.
- W2900556903 hasConcept C21200559 @default.
- W2900556903 hasConcept C24326235 @default.
- W2900556903 hasConcept C2776214188 @default.
- W2900556903 hasConcept C37736160 @default.
- W2900556903 hasConcept C41008148 @default.
- W2900556903 hasConceptScore W2900556903C119857082 @default.
- W2900556903 hasConceptScore W2900556903C121375916 @default.
- W2900556903 hasConceptScore W2900556903C127413603 @default.
- W2900556903 hasConceptScore W2900556903C154945302 @default.
- W2900556903 hasConceptScore W2900556903C167927819 @default.
- W2900556903 hasConceptScore W2900556903C184337299 @default.
- W2900556903 hasConceptScore W2900556903C199360897 @default.
- W2900556903 hasConceptScore W2900556903C204321447 @default.
- W2900556903 hasConceptScore W2900556903C21200559 @default.
- W2900556903 hasConceptScore W2900556903C24326235 @default.
- W2900556903 hasConceptScore W2900556903C2776214188 @default.
- W2900556903 hasConceptScore W2900556903C37736160 @default.
- W2900556903 hasConceptScore W2900556903C41008148 @default.
- W2900556903 hasLocation W29005569031 @default.
- W2900556903 hasLocation W29005569032 @default.
- W2900556903 hasOpenAccess W2900556903 @default.
- W2900556903 hasPrimaryLocation W29005569031 @default.
- W2900556903 hasRelatedWork W2385485542 @default.
- W2900556903 hasRelatedWork W2903917280 @default.
- W2900556903 hasRelatedWork W2961085424 @default.
- W2900556903 hasRelatedWork W2974723675 @default.
- W2900556903 hasRelatedWork W3046843850 @default.
- W2900556903 hasRelatedWork W4220812973 @default.
- W2900556903 hasRelatedWork W4286629047 @default.
- W2900556903 hasRelatedWork W4306674287 @default.
- W2900556903 hasRelatedWork W4386716251 @default.
- W2900556903 hasRelatedWork W4224009465 @default.
- W2900556903 isParatext "false" @default.
- W2900556903 isRetracted "false" @default.
- W2900556903 magId "2900556903" @default.
- W2900556903 workType "article" @default.