Matches in SemOpenAlex for { <https://semopenalex.org/work/W4377130770> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4377130770 abstract "In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning methods generalize only to one positive and multiple negatives per anchor. A recent state-of-the-art, supervised contrastive (SupCon) loss, extends self-supervised contrastive learning to supervised setting by generalizing to multiple positives and negatives in a batch and improves upon the cross-entropy loss. In this paper, we propose a novel contrastive loss function -- Tuned Contrastive Learning (TCL) loss, that generalizes to multiple positives and negatives in a batch and offers parameters to tune and improve the gradient responses from hard positives and hard negatives. We provide theoretical analysis of our loss function's gradient response and show mathematically how it is better than that of SupCon loss. We empirically compare our loss function with SupCon loss and cross-entropy loss in supervised setting on multiple classification-task datasets to show its effectiveness. We also show the stability of our loss function to a range of hyper-parameter settings. Unlike SupCon loss which is only applied to supervised setting, we show how to extend TCL to self-supervised setting and empirically compare it with various SOTA self-supervised learning methods. Hence, we show that TCL loss achieves performance on par with SOTA methods in both supervised and self-supervised settings." @default.
- W4377130770 created "2023-05-21" @default.
- W4377130770 creator A5004540588 @default.
- W4377130770 creator A5046609009 @default.
- W4377130770 date "2023-05-17" @default.
- W4377130770 modified "2023-09-26" @default.
- W4377130770 title "Tuned Contrastive Learning" @default.
- W4377130770 doi "https://doi.org/10.48550/arxiv.2305.10675" @default.
- W4377130770 hasPublicationYear "2023" @default.
- W4377130770 type Work @default.
- W4377130770 citedByCount "0" @default.
- W4377130770 crossrefType "posted-content" @default.
- W4377130770 hasAuthorship W4377130770A5004540588 @default.
- W4377130770 hasAuthorship W4377130770A5046609009 @default.
- W4377130770 hasBestOaLocation W43771307701 @default.
- W4377130770 hasConcept C106301342 @default.
- W4377130770 hasConcept C112972136 @default.
- W4377130770 hasConcept C119857082 @default.
- W4377130770 hasConcept C121332964 @default.
- W4377130770 hasConcept C136389625 @default.
- W4377130770 hasConcept C14036430 @default.
- W4377130770 hasConcept C153180895 @default.
- W4377130770 hasConcept C154945302 @default.
- W4377130770 hasConcept C167981619 @default.
- W4377130770 hasConcept C2988416141 @default.
- W4377130770 hasConcept C41008148 @default.
- W4377130770 hasConcept C50644808 @default.
- W4377130770 hasConcept C62520636 @default.
- W4377130770 hasConcept C64869954 @default.
- W4377130770 hasConcept C78458016 @default.
- W4377130770 hasConcept C86803240 @default.
- W4377130770 hasConceptScore W4377130770C106301342 @default.
- W4377130770 hasConceptScore W4377130770C112972136 @default.
- W4377130770 hasConceptScore W4377130770C119857082 @default.
- W4377130770 hasConceptScore W4377130770C121332964 @default.
- W4377130770 hasConceptScore W4377130770C136389625 @default.
- W4377130770 hasConceptScore W4377130770C14036430 @default.
- W4377130770 hasConceptScore W4377130770C153180895 @default.
- W4377130770 hasConceptScore W4377130770C154945302 @default.
- W4377130770 hasConceptScore W4377130770C167981619 @default.
- W4377130770 hasConceptScore W4377130770C2988416141 @default.
- W4377130770 hasConceptScore W4377130770C41008148 @default.
- W4377130770 hasConceptScore W4377130770C50644808 @default.
- W4377130770 hasConceptScore W4377130770C62520636 @default.
- W4377130770 hasConceptScore W4377130770C64869954 @default.
- W4377130770 hasConceptScore W4377130770C78458016 @default.
- W4377130770 hasConceptScore W4377130770C86803240 @default.
- W4377130770 hasLocation W43771307701 @default.
- W4377130770 hasOpenAccess W4377130770 @default.
- W4377130770 hasPrimaryLocation W43771307701 @default.
- W4377130770 hasRelatedWork W3012978760 @default.
- W4377130770 hasRelatedWork W3086857729 @default.
- W4377130770 hasRelatedWork W3094076422 @default.
- W4377130770 hasRelatedWork W3162567751 @default.
- W4377130770 hasRelatedWork W3210156800 @default.
- W4377130770 hasRelatedWork W4221088574 @default.
- W4377130770 hasRelatedWork W4226172683 @default.
- W4377130770 hasRelatedWork W4285260836 @default.
- W4377130770 hasRelatedWork W4319453009 @default.
- W4377130770 hasRelatedWork W4377130770 @default.
- W4377130770 isParatext "false" @default.
- W4377130770 isRetracted "false" @default.
- W4377130770 workType "article" @default.