Matches in SemOpenAlex for { <https://semopenalex.org/work/W4283797513> ?p ?o ?g. }
Showing items 1 to 82 of
82
with 100 items per page.
- W4283797513 endingPage "11738" @default.
- W4283797513 startingPage "11730" @default.
- W4283797513 abstract "Unsupervised sentence representation learning is a fundamental problem in natural language processing. Recently, contrastive learning has made great success on this task. Existing constrastive learning based models usually apply random sampling to select negative examples for training. Previous work in computer vision has shown that hard negative examples help contrastive learning to achieve faster convergency and better optimization for representation learning. However, the importance of hard negatives in contrastive learning for sentence representation is yet to be explored. In this study, we prove that hard negatives are essential for maintaining strong gradient signals in the training process while random sampling negative examples is ineffective for sentence representation. Accordingly, we present a contrastive model, MixCSE, that extends the current state-of-the-art SimCSE by continually constructing hard negatives via mixing both positive and negative features. The superior performance of the proposed approach is demonstrated via empirical studies on Semantic Textual Similarity datasets and Transfer task datasets." @default.
- W4283797513 created "2022-07-05" @default.
- W4283797513 creator A5004793184 @default.
- W4283797513 creator A5022746945 @default.
- W4283797513 creator A5027015677 @default.
- W4283797513 creator A5064857650 @default.
- W4283797513 creator A5089184655 @default.
- W4283797513 date "2022-06-28" @default.
- W4283797513 modified "2023-10-16" @default.
- W4283797513 title "Unsupervised Sentence Representation via Contrastive Learning with Mixing Negatives" @default.
- W4283797513 doi "https://doi.org/10.1609/aaai.v36i10.21428" @default.
- W4283797513 hasPublicationYear "2022" @default.
- W4283797513 type Work @default.
- W4283797513 citedByCount "6" @default.
- W4283797513 countsByYear W42837975132023 @default.
- W4283797513 crossrefType "journal-article" @default.
- W4283797513 hasAuthorship W4283797513A5004793184 @default.
- W4283797513 hasAuthorship W4283797513A5022746945 @default.
- W4283797513 hasAuthorship W4283797513A5027015677 @default.
- W4283797513 hasAuthorship W4283797513A5064857650 @default.
- W4283797513 hasAuthorship W4283797513A5089184655 @default.
- W4283797513 hasBestOaLocation W42837975131 @default.
- W4283797513 hasConcept C103278499 @default.
- W4283797513 hasConcept C111919701 @default.
- W4283797513 hasConcept C115961682 @default.
- W4283797513 hasConcept C119857082 @default.
- W4283797513 hasConcept C150899416 @default.
- W4283797513 hasConcept C153180895 @default.
- W4283797513 hasConcept C154945302 @default.
- W4283797513 hasConcept C162324750 @default.
- W4283797513 hasConcept C17744445 @default.
- W4283797513 hasConcept C187736073 @default.
- W4283797513 hasConcept C199539241 @default.
- W4283797513 hasConcept C204321447 @default.
- W4283797513 hasConcept C2776359362 @default.
- W4283797513 hasConcept C2777530160 @default.
- W4283797513 hasConcept C2780451532 @default.
- W4283797513 hasConcept C41008148 @default.
- W4283797513 hasConcept C59404180 @default.
- W4283797513 hasConcept C8038995 @default.
- W4283797513 hasConcept C94625758 @default.
- W4283797513 hasConcept C98045186 @default.
- W4283797513 hasConceptScore W4283797513C103278499 @default.
- W4283797513 hasConceptScore W4283797513C111919701 @default.
- W4283797513 hasConceptScore W4283797513C115961682 @default.
- W4283797513 hasConceptScore W4283797513C119857082 @default.
- W4283797513 hasConceptScore W4283797513C150899416 @default.
- W4283797513 hasConceptScore W4283797513C153180895 @default.
- W4283797513 hasConceptScore W4283797513C154945302 @default.
- W4283797513 hasConceptScore W4283797513C162324750 @default.
- W4283797513 hasConceptScore W4283797513C17744445 @default.
- W4283797513 hasConceptScore W4283797513C187736073 @default.
- W4283797513 hasConceptScore W4283797513C199539241 @default.
- W4283797513 hasConceptScore W4283797513C204321447 @default.
- W4283797513 hasConceptScore W4283797513C2776359362 @default.
- W4283797513 hasConceptScore W4283797513C2777530160 @default.
- W4283797513 hasConceptScore W4283797513C2780451532 @default.
- W4283797513 hasConceptScore W4283797513C41008148 @default.
- W4283797513 hasConceptScore W4283797513C59404180 @default.
- W4283797513 hasConceptScore W4283797513C8038995 @default.
- W4283797513 hasConceptScore W4283797513C94625758 @default.
- W4283797513 hasConceptScore W4283797513C98045186 @default.
- W4283797513 hasIssue "10" @default.
- W4283797513 hasLocation W42837975131 @default.
- W4283797513 hasOpenAccess W4283797513 @default.
- W4283797513 hasPrimaryLocation W42837975131 @default.
- W4283797513 hasRelatedWork W159132833 @default.
- W4283797513 hasRelatedWork W2292254049 @default.
- W4283797513 hasRelatedWork W2441160157 @default.
- W4283797513 hasRelatedWork W2592385986 @default.
- W4283797513 hasRelatedWork W2999247481 @default.
- W4283797513 hasRelatedWork W3105747907 @default.
- W4283797513 hasRelatedWork W3196155444 @default.
- W4283797513 hasRelatedWork W3209574120 @default.
- W4283797513 hasRelatedWork W4221142651 @default.
- W4283797513 hasRelatedWork W4308262314 @default.
- W4283797513 hasVolume "36" @default.
- W4283797513 isParatext "false" @default.
- W4283797513 isRetracted "false" @default.
- W4283797513 workType "article" @default.