Matches in SemOpenAlex for { <https://semopenalex.org/work/W4378473770> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W4378473770 abstract "Entity bias widely affects pretrained (large) language models, causing them to excessively rely on (biased) parametric knowledge to make unfaithful predictions. Although causality-inspired methods have shown great potential to mitigate entity bias, it is hard to precisely estimate the parameters of underlying causal models in practice. The rise of black-box LLMs also makes the situation even worse, because of their inaccessible parameters and uncalibrated logits. To address these problems, we propose a specific structured causal model (SCM) whose parameters are comparatively easier to estimate. Building upon this SCM, we propose causal intervention techniques to mitigate entity bias for both white-box and black-box settings. The proposed causal intervention perturbs the original entity with neighboring entities. This intervention reduces specific biasing information pertaining to the original entity while still preserving sufficient common predictive information from similar entities. When evaluated on the relation extraction task, our training-time intervention significantly improves the F1 score of RoBERTa by 5.7 points on EntRED, in which spurious shortcuts between entities and labels are removed. Meanwhile, our in-context intervention effectively reduces the knowledge conflicts between parametric knowledge and contextual knowledge in GPT-3.5 and improves the F1 score by 9.14 points on a challenging test set derived from Re-TACRED." @default.
- W4378473770 created "2023-05-27" @default.
- W4378473770 creator A5024788962 @default.
- W4378473770 creator A5029147424 @default.
- W4378473770 creator A5049486408 @default.
- W4378473770 creator A5080937886 @default.
- W4378473770 creator A5086529957 @default.
- W4378473770 date "2023-05-23" @default.
- W4378473770 modified "2023-10-17" @default.
- W4378473770 title "A Causal View of Entity Bias in (Large) Language Models" @default.
- W4378473770 doi "https://doi.org/10.48550/arxiv.2305.14695" @default.
- W4378473770 hasPublicationYear "2023" @default.
- W4378473770 type Work @default.
- W4378473770 citedByCount "0" @default.
- W4378473770 crossrefType "posted-content" @default.
- W4378473770 hasAuthorship W4378473770A5024788962 @default.
- W4378473770 hasAuthorship W4378473770A5029147424 @default.
- W4378473770 hasAuthorship W4378473770A5049486408 @default.
- W4378473770 hasAuthorship W4378473770A5080937886 @default.
- W4378473770 hasAuthorship W4378473770A5086529957 @default.
- W4378473770 hasBestOaLocation W43784737701 @default.
- W4378473770 hasConcept C105795698 @default.
- W4378473770 hasConcept C117251300 @default.
- W4378473770 hasConcept C118552586 @default.
- W4378473770 hasConcept C119857082 @default.
- W4378473770 hasConcept C121332964 @default.
- W4378473770 hasConcept C127413603 @default.
- W4378473770 hasConcept C149782125 @default.
- W4378473770 hasConcept C151730666 @default.
- W4378473770 hasConcept C154945302 @default.
- W4378473770 hasConcept C15744967 @default.
- W4378473770 hasConcept C158600405 @default.
- W4378473770 hasConcept C177264268 @default.
- W4378473770 hasConcept C199360897 @default.
- W4378473770 hasConcept C201995342 @default.
- W4378473770 hasConcept C204321447 @default.
- W4378473770 hasConcept C2779343474 @default.
- W4378473770 hasConcept C2780451532 @default.
- W4378473770 hasConcept C2780665704 @default.
- W4378473770 hasConcept C33923547 @default.
- W4378473770 hasConcept C41008148 @default.
- W4378473770 hasConcept C62520636 @default.
- W4378473770 hasConcept C64357122 @default.
- W4378473770 hasConcept C86803240 @default.
- W4378473770 hasConcept C94966114 @default.
- W4378473770 hasConcept C97256817 @default.
- W4378473770 hasConceptScore W4378473770C105795698 @default.
- W4378473770 hasConceptScore W4378473770C117251300 @default.
- W4378473770 hasConceptScore W4378473770C118552586 @default.
- W4378473770 hasConceptScore W4378473770C119857082 @default.
- W4378473770 hasConceptScore W4378473770C121332964 @default.
- W4378473770 hasConceptScore W4378473770C127413603 @default.
- W4378473770 hasConceptScore W4378473770C149782125 @default.
- W4378473770 hasConceptScore W4378473770C151730666 @default.
- W4378473770 hasConceptScore W4378473770C154945302 @default.
- W4378473770 hasConceptScore W4378473770C15744967 @default.
- W4378473770 hasConceptScore W4378473770C158600405 @default.
- W4378473770 hasConceptScore W4378473770C177264268 @default.
- W4378473770 hasConceptScore W4378473770C199360897 @default.
- W4378473770 hasConceptScore W4378473770C201995342 @default.
- W4378473770 hasConceptScore W4378473770C204321447 @default.
- W4378473770 hasConceptScore W4378473770C2779343474 @default.
- W4378473770 hasConceptScore W4378473770C2780451532 @default.
- W4378473770 hasConceptScore W4378473770C2780665704 @default.
- W4378473770 hasConceptScore W4378473770C33923547 @default.
- W4378473770 hasConceptScore W4378473770C41008148 @default.
- W4378473770 hasConceptScore W4378473770C62520636 @default.
- W4378473770 hasConceptScore W4378473770C64357122 @default.
- W4378473770 hasConceptScore W4378473770C86803240 @default.
- W4378473770 hasConceptScore W4378473770C94966114 @default.
- W4378473770 hasConceptScore W4378473770C97256817 @default.
- W4378473770 hasLocation W43784737701 @default.
- W4378473770 hasOpenAccess W4378473770 @default.
- W4378473770 hasPrimaryLocation W43784737701 @default.
- W4378473770 hasRelatedWork W1987706094 @default.
- W4378473770 hasRelatedWork W2023012826 @default.
- W4378473770 hasRelatedWork W2081647779 @default.
- W4378473770 hasRelatedWork W2117259173 @default.
- W4378473770 hasRelatedWork W2765246049 @default.
- W4378473770 hasRelatedWork W3185852197 @default.
- W4378473770 hasRelatedWork W4213447687 @default.
- W4378473770 hasRelatedWork W4247414892 @default.
- W4378473770 hasRelatedWork W4255971252 @default.
- W4378473770 hasRelatedWork W4321440760 @default.
- W4378473770 isParatext "false" @default.
- W4378473770 isRetracted "false" @default.
- W4378473770 workType "article" @default.