Matches in SemOpenAlex for { <https://semopenalex.org/work/W4306704610> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W4306704610 abstract "Detecting out-of-distribution (OOD) instances is significant for the safe deployment of NLP models. Among recent textual OOD detection works based on pretrained language models (PLMs), distance-based methods have shown superior performance. However, they estimate sample distance scores in the last-layer CLS embedding space and thus do not make full use of linguistic information underlying in PLMs. To address the issue, we propose to boost OOD detection by deriving more holistic sentence embeddings. On the basis of the observations that token averaging and layer combination contribute to improving OOD detection, we propose a simple embedding approach named Avg-Avg, which averages all token representations from each intermediate layer as the sentence embedding and significantly surpasses the state-of-the-art on a comprehensive suite of benchmarks by a 9.33% FAR95 margin. Furthermore, our analysis demonstrates that it indeed helps preserve general linguistic knowledge in fine-tuned PLMs and substantially benefits detecting background shifts. The simple yet effective embedding method can be applied to fine-tuned PLMs with negligible extra costs, providing a free gain in OOD detection. Our code is available at https://github.com/lancopku/Avg-Avg." @default.
- W4306704610 created "2022-10-19" @default.
- W4306704610 creator A5015423519 @default.
- W4306704610 creator A5044689489 @default.
- W4306704610 creator A5054124315 @default.
- W4306704610 creator A5065386402 @default.
- W4306704610 date "2022-10-13" @default.
- W4306704610 modified "2023-09-26" @default.
- W4306704610 title "Holistic Sentence Embeddings for Better Out-of-Distribution Detection" @default.
- W4306704610 doi "https://doi.org/10.48550/arxiv.2210.07485" @default.
- W4306704610 hasPublicationYear "2022" @default.
- W4306704610 type Work @default.
- W4306704610 citedByCount "0" @default.
- W4306704610 crossrefType "posted-content" @default.
- W4306704610 hasAuthorship W4306704610A5015423519 @default.
- W4306704610 hasAuthorship W4306704610A5044689489 @default.
- W4306704610 hasAuthorship W4306704610A5054124315 @default.
- W4306704610 hasAuthorship W4306704610A5065386402 @default.
- W4306704610 hasBestOaLocation W43067046101 @default.
- W4306704610 hasConcept C111472728 @default.
- W4306704610 hasConcept C119857082 @default.
- W4306704610 hasConcept C138885662 @default.
- W4306704610 hasConcept C154945302 @default.
- W4306704610 hasConcept C177264268 @default.
- W4306704610 hasConcept C178790620 @default.
- W4306704610 hasConcept C185592680 @default.
- W4306704610 hasConcept C198531522 @default.
- W4306704610 hasConcept C199360897 @default.
- W4306704610 hasConcept C204321447 @default.
- W4306704610 hasConcept C2776760102 @default.
- W4306704610 hasConcept C2777530160 @default.
- W4306704610 hasConcept C2779227376 @default.
- W4306704610 hasConcept C2780586882 @default.
- W4306704610 hasConcept C38652104 @default.
- W4306704610 hasConcept C41008148 @default.
- W4306704610 hasConcept C41608201 @default.
- W4306704610 hasConcept C43617362 @default.
- W4306704610 hasConcept C48145219 @default.
- W4306704610 hasConcept C774472 @default.
- W4306704610 hasConceptScore W4306704610C111472728 @default.
- W4306704610 hasConceptScore W4306704610C119857082 @default.
- W4306704610 hasConceptScore W4306704610C138885662 @default.
- W4306704610 hasConceptScore W4306704610C154945302 @default.
- W4306704610 hasConceptScore W4306704610C177264268 @default.
- W4306704610 hasConceptScore W4306704610C178790620 @default.
- W4306704610 hasConceptScore W4306704610C185592680 @default.
- W4306704610 hasConceptScore W4306704610C198531522 @default.
- W4306704610 hasConceptScore W4306704610C199360897 @default.
- W4306704610 hasConceptScore W4306704610C204321447 @default.
- W4306704610 hasConceptScore W4306704610C2776760102 @default.
- W4306704610 hasConceptScore W4306704610C2777530160 @default.
- W4306704610 hasConceptScore W4306704610C2779227376 @default.
- W4306704610 hasConceptScore W4306704610C2780586882 @default.
- W4306704610 hasConceptScore W4306704610C38652104 @default.
- W4306704610 hasConceptScore W4306704610C41008148 @default.
- W4306704610 hasConceptScore W4306704610C41608201 @default.
- W4306704610 hasConceptScore W4306704610C43617362 @default.
- W4306704610 hasConceptScore W4306704610C48145219 @default.
- W4306704610 hasConceptScore W4306704610C774472 @default.
- W4306704610 hasLocation W43067046101 @default.
- W4306704610 hasOpenAccess W4306704610 @default.
- W4306704610 hasPrimaryLocation W43067046101 @default.
- W4306704610 hasRelatedWork W1517743118 @default.
- W4306704610 hasRelatedWork W1567338489 @default.
- W4306704610 hasRelatedWork W159132833 @default.
- W4306704610 hasRelatedWork W1978971213 @default.
- W4306704610 hasRelatedWork W3039695075 @default.
- W4306704610 hasRelatedWork W3040301513 @default.
- W4306704610 hasRelatedWork W38394648 @default.
- W4306704610 hasRelatedWork W4299574851 @default.
- W4306704610 hasRelatedWork W4312046383 @default.
- W4306704610 hasRelatedWork W4376653016 @default.
- W4306704610 isParatext "false" @default.
- W4306704610 isRetracted "false" @default.
- W4306704610 workType "article" @default.