Matches in SemOpenAlex for { <https://semopenalex.org/work/W4285483460> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4285483460 abstract "In this paper, we propose a genuine group-level contrastive visual representation learning method whose linear evaluation performance on ImageNet surpasses the vanilla supervised learning. Two mainstream unsupervised learning schemes are the instance-level contrastive framework and clustering-based schemes. The former adopts the extremely fine-grained instance-level discrimination whose supervisory signal is not efficient due to the false negatives. Though the latter solves this, they commonly come with some restrictions affecting the performance. To integrate their advantages, we design the SMoG method. SMoG follows the framework of contrastive learning but replaces the contrastive unit from instance to group, mimicking clustering-based methods. To achieve this, we propose the momentum grouping scheme which synchronously conducts feature grouping with representation learning. In this way, SMoG solves the problem of supervisory signal hysteresis which the clustering-based method usually faces, and reduces the false negatives of instance contrastive methods. We conduct exhaustive experiments to show that SMoG works well on both CNN and Transformer backbones. Results prove that SMoG has surpassed the current SOTA unsupervised representation learning methods. Moreover, its linear evaluation results surpass the performances obtained by vanilla supervised learning and the representation can be well transferred to downstream tasks." @default.
- W4285483460 created "2022-07-15" @default.
- W4285483460 creator A5010726528 @default.
- W4285483460 creator A5036658104 @default.
- W4285483460 creator A5044309490 @default.
- W4285483460 creator A5058655480 @default.
- W4285483460 creator A5061130250 @default.
- W4285483460 date "2022-07-13" @default.
- W4285483460 modified "2023-09-29" @default.
- W4285483460 title "Unsupervised Visual Representation Learning by Synchronous Momentum Grouping" @default.
- W4285483460 doi "https://doi.org/10.48550/arxiv.2207.06167" @default.
- W4285483460 hasPublicationYear "2022" @default.
- W4285483460 type Work @default.
- W4285483460 citedByCount "0" @default.
- W4285483460 crossrefType "posted-content" @default.
- W4285483460 hasAuthorship W4285483460A5010726528 @default.
- W4285483460 hasAuthorship W4285483460A5036658104 @default.
- W4285483460 hasAuthorship W4285483460A5044309490 @default.
- W4285483460 hasAuthorship W4285483460A5058655480 @default.
- W4285483460 hasAuthorship W4285483460A5061130250 @default.
- W4285483460 hasBestOaLocation W42854834601 @default.
- W4285483460 hasConcept C119857082 @default.
- W4285483460 hasConcept C138885662 @default.
- W4285483460 hasConcept C153180895 @default.
- W4285483460 hasConcept C154945302 @default.
- W4285483460 hasConcept C17744445 @default.
- W4285483460 hasConcept C199539241 @default.
- W4285483460 hasConcept C2776359362 @default.
- W4285483460 hasConcept C2776401178 @default.
- W4285483460 hasConcept C41008148 @default.
- W4285483460 hasConcept C41895202 @default.
- W4285483460 hasConcept C59404180 @default.
- W4285483460 hasConcept C73555534 @default.
- W4285483460 hasConcept C8038995 @default.
- W4285483460 hasConcept C94625758 @default.
- W4285483460 hasConceptScore W4285483460C119857082 @default.
- W4285483460 hasConceptScore W4285483460C138885662 @default.
- W4285483460 hasConceptScore W4285483460C153180895 @default.
- W4285483460 hasConceptScore W4285483460C154945302 @default.
- W4285483460 hasConceptScore W4285483460C17744445 @default.
- W4285483460 hasConceptScore W4285483460C199539241 @default.
- W4285483460 hasConceptScore W4285483460C2776359362 @default.
- W4285483460 hasConceptScore W4285483460C2776401178 @default.
- W4285483460 hasConceptScore W4285483460C41008148 @default.
- W4285483460 hasConceptScore W4285483460C41895202 @default.
- W4285483460 hasConceptScore W4285483460C59404180 @default.
- W4285483460 hasConceptScore W4285483460C73555534 @default.
- W4285483460 hasConceptScore W4285483460C8038995 @default.
- W4285483460 hasConceptScore W4285483460C94625758 @default.
- W4285483460 hasLocation W42854834601 @default.
- W4285483460 hasOpenAccess W4285483460 @default.
- W4285483460 hasPrimaryLocation W42854834601 @default.
- W4285483460 hasRelatedWork W2592385986 @default.
- W4285483460 hasRelatedWork W2608244370 @default.
- W4285483460 hasRelatedWork W2695951553 @default.
- W4285483460 hasRelatedWork W2775464024 @default.
- W4285483460 hasRelatedWork W2785535669 @default.
- W4285483460 hasRelatedWork W2902482704 @default.
- W4285483460 hasRelatedWork W2908875379 @default.
- W4285483460 hasRelatedWork W2970216048 @default.
- W4285483460 hasRelatedWork W3093564170 @default.
- W4285483460 hasRelatedWork W4221136938 @default.
- W4285483460 isParatext "false" @default.
- W4285483460 isRetracted "false" @default.
- W4285483460 workType "article" @default.