Matches in SemOpenAlex for { <https://semopenalex.org/work/W4382202605> ?p ?o ?g. }
Showing items 1 to 79 of
79
with 100 items per page.
- W4382202605 endingPage "12871" @default.
- W4382202605 startingPage "12863" @default.
- W4382202605 abstract "Contrastive learning-based methods, such as unsup-SimCSE, have achieved state-of-the-art (SOTA) performances in learning unsupervised sentence embeddings. However, in previous studies, each embedding used for contrastive learning only derived from one sentence instance, and we call these embeddings instance-level embeddings. In other words, each embedding is regarded as a unique class of its own, which may hurt the generalization performance. In this study, we propose IS-CSE (instance smoothing contrastive sentence embedding) to smooth the boundaries of embeddings in the feature space. Specifically, we retrieve embeddings from a dynamic memory buffer according to the semantic similarity to get a positive embedding group. Then embeddings in the group are aggregated by a self-attention operation to produce a smoothed instance embedding for further analysis. We evaluate our method on standard semantic text similarity (STS) tasks and achieve an average of 78.30%, 79.47%, 77.73%, and 79.42% Spearman’s correlation on the base of BERT-base, BERT-large, RoBERTa-base, and RoBERTa-large respectively, a 2.05%, 1.06%, 1.16% and 0.52% improvement compared to unsup-SimCSE." @default.
- W4382202605 created "2023-06-28" @default.
- W4382202605 creator A5010776860 @default.
- W4382202605 creator A5041664650 @default.
- W4382202605 creator A5059834120 @default.
- W4382202605 creator A5084577958 @default.
- W4382202605 date "2023-06-26" @default.
- W4382202605 modified "2023-10-16" @default.
- W4382202605 title "Instance Smoothed Contrastive Learning for Unsupervised Sentence Embedding" @default.
- W4382202605 doi "https://doi.org/10.1609/aaai.v37i11.26512" @default.
- W4382202605 hasPublicationYear "2023" @default.
- W4382202605 type Work @default.
- W4382202605 citedByCount "0" @default.
- W4382202605 crossrefType "journal-article" @default.
- W4382202605 hasAuthorship W4382202605A5010776860 @default.
- W4382202605 hasAuthorship W4382202605A5041664650 @default.
- W4382202605 hasAuthorship W4382202605A5059834120 @default.
- W4382202605 hasAuthorship W4382202605A5084577958 @default.
- W4382202605 hasBestOaLocation W43822026051 @default.
- W4382202605 hasConcept C103278499 @default.
- W4382202605 hasConcept C115961682 @default.
- W4382202605 hasConcept C134306372 @default.
- W4382202605 hasConcept C138885662 @default.
- W4382202605 hasConcept C153180895 @default.
- W4382202605 hasConcept C154945302 @default.
- W4382202605 hasConcept C177148314 @default.
- W4382202605 hasConcept C178790620 @default.
- W4382202605 hasConcept C185592680 @default.
- W4382202605 hasConcept C204321447 @default.
- W4382202605 hasConcept C2776401178 @default.
- W4382202605 hasConcept C2777212361 @default.
- W4382202605 hasConcept C2777530160 @default.
- W4382202605 hasConcept C2781311116 @default.
- W4382202605 hasConcept C31972630 @default.
- W4382202605 hasConcept C33923547 @default.
- W4382202605 hasConcept C3770464 @default.
- W4382202605 hasConcept C41008148 @default.
- W4382202605 hasConcept C41608201 @default.
- W4382202605 hasConcept C41895202 @default.
- W4382202605 hasConceptScore W4382202605C103278499 @default.
- W4382202605 hasConceptScore W4382202605C115961682 @default.
- W4382202605 hasConceptScore W4382202605C134306372 @default.
- W4382202605 hasConceptScore W4382202605C138885662 @default.
- W4382202605 hasConceptScore W4382202605C153180895 @default.
- W4382202605 hasConceptScore W4382202605C154945302 @default.
- W4382202605 hasConceptScore W4382202605C177148314 @default.
- W4382202605 hasConceptScore W4382202605C178790620 @default.
- W4382202605 hasConceptScore W4382202605C185592680 @default.
- W4382202605 hasConceptScore W4382202605C204321447 @default.
- W4382202605 hasConceptScore W4382202605C2776401178 @default.
- W4382202605 hasConceptScore W4382202605C2777212361 @default.
- W4382202605 hasConceptScore W4382202605C2777530160 @default.
- W4382202605 hasConceptScore W4382202605C2781311116 @default.
- W4382202605 hasConceptScore W4382202605C31972630 @default.
- W4382202605 hasConceptScore W4382202605C33923547 @default.
- W4382202605 hasConceptScore W4382202605C3770464 @default.
- W4382202605 hasConceptScore W4382202605C41008148 @default.
- W4382202605 hasConceptScore W4382202605C41608201 @default.
- W4382202605 hasConceptScore W4382202605C41895202 @default.
- W4382202605 hasIssue "11" @default.
- W4382202605 hasLocation W43822026051 @default.
- W4382202605 hasOpenAccess W4382202605 @default.
- W4382202605 hasPrimaryLocation W43822026051 @default.
- W4382202605 hasRelatedWork W1567338489 @default.
- W4382202605 hasRelatedWork W159132833 @default.
- W4382202605 hasRelatedWork W1978971213 @default.
- W4382202605 hasRelatedWork W2096020108 @default.
- W4382202605 hasRelatedWork W2116838603 @default.
- W4382202605 hasRelatedWork W2178080893 @default.
- W4382202605 hasRelatedWork W2186284405 @default.
- W4382202605 hasRelatedWork W3146119319 @default.
- W4382202605 hasRelatedWork W4312046383 @default.
- W4382202605 hasRelatedWork W2178852694 @default.
- W4382202605 hasVolume "37" @default.
- W4382202605 isParatext "false" @default.
- W4382202605 isRetracted "false" @default.
- W4382202605 workType "article" @default.