Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384264585> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4384264585 abstract "We introduce a synthetic dataset called Sentences Involving Complex Compositional Knowledge (SICCK) and a novel analysis that investigates the performance of Natural Language Inference (NLI) models to understand compositionality in logic. We produce 1,304 sentence pairs by modifying 15 examples from the SICK dataset (Marelli et al., 2014). To this end, we modify the original texts using a set of phrases - modifiers that correspond to universal quantifiers, existential quantifiers, negation, and other concept modifiers in Natural Logic (NL) (MacCartney, 2009). We use these phrases to modify the subject, verb, and object parts of the premise and hypothesis. Lastly, we annotate these modified texts with the corresponding entailment labels following NL rules. We conduct a preliminary verification of how well the change in the structural and semantic composition is captured by neural NLI models, in both zero-shot and fine-tuned scenarios. We found that the performance of NLI models under the zero-shot setting is poor, especially for modified sentences with negation and existential quantifiers. After fine-tuning this dataset, we observe that models continue to perform poorly over negation, existential and universal modifiers." @default.
- W4384264585 created "2023-07-14" @default.
- W4384264585 creator A5034807913 @default.
- W4384264585 creator A5047699502 @default.
- W4384264585 creator A5052295709 @default.
- W4384264585 creator A5084170301 @default.
- W4384264585 creator A5086951783 @default.
- W4384264585 date "2023-07-11" @default.
- W4384264585 modified "2023-09-24" @default.
- W4384264585 title "Synthetic Dataset for Evaluating Complex Compositional Knowledge for Natural Language Inference" @default.
- W4384264585 doi "https://doi.org/10.48550/arxiv.2307.05034" @default.
- W4384264585 hasPublicationYear "2023" @default.
- W4384264585 type Work @default.
- W4384264585 citedByCount "0" @default.
- W4384264585 crossrefType "posted-content" @default.
- W4384264585 hasAuthorship W4384264585A5034807913 @default.
- W4384264585 hasAuthorship W4384264585A5047699502 @default.
- W4384264585 hasAuthorship W4384264585A5052295709 @default.
- W4384264585 hasAuthorship W4384264585A5084170301 @default.
- W4384264585 hasAuthorship W4384264585A5086951783 @default.
- W4384264585 hasBestOaLocation W43842645851 @default.
- W4384264585 hasConcept C111472728 @default.
- W4384264585 hasConcept C121375916 @default.
- W4384264585 hasConcept C127882523 @default.
- W4384264585 hasConcept C134752490 @default.
- W4384264585 hasConcept C138885662 @default.
- W4384264585 hasConcept C154945302 @default.
- W4384264585 hasConcept C195324797 @default.
- W4384264585 hasConcept C199360897 @default.
- W4384264585 hasConcept C204321447 @default.
- W4384264585 hasConcept C2185349 @default.
- W4384264585 hasConcept C2777530160 @default.
- W4384264585 hasConcept C41008148 @default.
- W4384264585 hasConcept C95318506 @default.
- W4384264585 hasConceptScore W4384264585C111472728 @default.
- W4384264585 hasConceptScore W4384264585C121375916 @default.
- W4384264585 hasConceptScore W4384264585C127882523 @default.
- W4384264585 hasConceptScore W4384264585C134752490 @default.
- W4384264585 hasConceptScore W4384264585C138885662 @default.
- W4384264585 hasConceptScore W4384264585C154945302 @default.
- W4384264585 hasConceptScore W4384264585C195324797 @default.
- W4384264585 hasConceptScore W4384264585C199360897 @default.
- W4384264585 hasConceptScore W4384264585C204321447 @default.
- W4384264585 hasConceptScore W4384264585C2185349 @default.
- W4384264585 hasConceptScore W4384264585C2777530160 @default.
- W4384264585 hasConceptScore W4384264585C41008148 @default.
- W4384264585 hasConceptScore W4384264585C95318506 @default.
- W4384264585 hasLocation W43842645851 @default.
- W4384264585 hasOpenAccess W4384264585 @default.
- W4384264585 hasPrimaryLocation W43842645851 @default.
- W4384264585 hasRelatedWork W2087536156 @default.
- W4384264585 hasRelatedWork W2139596890 @default.
- W4384264585 hasRelatedWork W2411652523 @default.
- W4384264585 hasRelatedWork W2798760246 @default.
- W4384264585 hasRelatedWork W2959628155 @default.
- W4384264585 hasRelatedWork W2996550874 @default.
- W4384264585 hasRelatedWork W4287642269 @default.
- W4384264585 hasRelatedWork W4297803820 @default.
- W4384264585 hasRelatedWork W4312107467 @default.
- W4384264585 hasRelatedWork W4375928289 @default.
- W4384264585 isParatext "false" @default.
- W4384264585 isRetracted "false" @default.
- W4384264585 workType "article" @default.