Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312771814> ?p ?o ?g. }
- W4312771814 endingPage "122" @default.
- W4312771814 startingPage "105" @default.
- W4312771814 abstract "In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model’s ability to effectively represent prior classes in the feature space, while adapting it to represent incoming new classes. We propose two distillation-based objectives for class incremental learning that leverage the structure of the feature space to maintain accuracy on previous classes, as well as enable learning the new classes. In our first objective, termed cross-space clustering (CSC), we propose to use the feature space structure of the previous model to characterize directions of optimization that maximally preserve the class - directions that all instances of a specific class should collectively optimize towards, and those directions that they should collectively optimize away from. Apart from minimizing forgetting, such a class-level constraint indirectly encourages the model to reliably cluster all instances of a class in the current feature space, and further gives rise to a sense of “herd-immunity”, allowing all samples of a class to jointly combat the model from forgetting the class. Our second objective termed controlled transfer (CT) tackles incremental learning from an important and understudied perspective of inter-class transfer. CT explicitly approximates and conditions the current model on the semantic similarities between incrementally arriving classes and prior classes. This allows the model to learn the incoming classes in such a way that it maximizes positive forward transfer from similar prior classes, thus increasing plasticity, and minimizes negative backward transfer on dissimilar prior classes, whereby strengthening stability. We perform extensive experiments on two benchmark datasets, adding our method (CSCCT) on top of three prominent class-incremental learning methods. We observe consistent performance improvement on a variety of experimental settings." @default.
- W4312771814 created "2023-01-05" @default.
- W4312771814 creator A5035656808 @default.
- W4312771814 creator A5038020125 @default.
- W4312771814 creator A5052381961 @default.
- W4312771814 date "2022-01-01" @default.
- W4312771814 modified "2023-10-09" @default.
- W4312771814 title "Class-Incremental Learning with Cross-Space Clustering and Controlled Transfer" @default.
- W4312771814 cites W2037979274 @default.
- W4312771814 cites W2060277733 @default.
- W4312771814 cites W2108598243 @default.
- W4312771814 cites W2473930607 @default.
- W4312771814 cites W2560647685 @default.
- W4312771814 cites W2739879705 @default.
- W4312771814 cites W2786446225 @default.
- W4312771814 cites W2884282566 @default.
- W4312771814 cites W2936864631 @default.
- W4312771814 cites W2948734064 @default.
- W4312771814 cites W2954929116 @default.
- W4312771814 cites W2963140444 @default.
- W4312771814 cites W2963588172 @default.
- W4312771814 cites W2964189064 @default.
- W4312771814 cites W2972313371 @default.
- W4312771814 cites W2981864462 @default.
- W4312771814 cites W2982220706 @default.
- W4312771814 cites W2982242214 @default.
- W4312771814 cites W2986015886 @default.
- W4312771814 cites W2986349107 @default.
- W4312771814 cites W3034867292 @default.
- W4312771814 cites W3034957837 @default.
- W4312771814 cites W3100156920 @default.
- W4312771814 cites W3107810305 @default.
- W4312771814 cites W3163939464 @default.
- W4312771814 cites W3173747377 @default.
- W4312771814 cites W3175516982 @default.
- W4312771814 cites W3176709420 @default.
- W4312771814 cites W3180392831 @default.
- W4312771814 cites W4214662032 @default.
- W4312771814 cites W4214924370 @default.
- W4312771814 cites W4312813479 @default.
- W4312771814 doi "https://doi.org/10.1007/978-3-031-19812-0_7" @default.
- W4312771814 hasPublicationYear "2022" @default.
- W4312771814 type Work @default.
- W4312771814 citedByCount "2" @default.
- W4312771814 countsByYear W43127718142023 @default.
- W4312771814 crossrefType "book-chapter" @default.
- W4312771814 hasAuthorship W4312771814A5035656808 @default.
- W4312771814 hasAuthorship W4312771814A5038020125 @default.
- W4312771814 hasAuthorship W4312771814A5052381961 @default.
- W4312771814 hasBestOaLocation W43127718142 @default.
- W4312771814 hasConcept C111919701 @default.
- W4312771814 hasConcept C119857082 @default.
- W4312771814 hasConcept C134306372 @default.
- W4312771814 hasConcept C138885662 @default.
- W4312771814 hasConcept C150899416 @default.
- W4312771814 hasConcept C153083717 @default.
- W4312771814 hasConcept C154945302 @default.
- W4312771814 hasConcept C177148314 @default.
- W4312771814 hasConcept C2524010 @default.
- W4312771814 hasConcept C2776036281 @default.
- W4312771814 hasConcept C2776401178 @default.
- W4312771814 hasConcept C2777212361 @default.
- W4312771814 hasConcept C2778572836 @default.
- W4312771814 hasConcept C33923547 @default.
- W4312771814 hasConcept C41008148 @default.
- W4312771814 hasConcept C41895202 @default.
- W4312771814 hasConcept C7149132 @default.
- W4312771814 hasConcept C73555534 @default.
- W4312771814 hasConcept C80444323 @default.
- W4312771814 hasConcept C83665646 @default.
- W4312771814 hasConceptScore W4312771814C111919701 @default.
- W4312771814 hasConceptScore W4312771814C119857082 @default.
- W4312771814 hasConceptScore W4312771814C134306372 @default.
- W4312771814 hasConceptScore W4312771814C138885662 @default.
- W4312771814 hasConceptScore W4312771814C150899416 @default.
- W4312771814 hasConceptScore W4312771814C153083717 @default.
- W4312771814 hasConceptScore W4312771814C154945302 @default.
- W4312771814 hasConceptScore W4312771814C177148314 @default.
- W4312771814 hasConceptScore W4312771814C2524010 @default.
- W4312771814 hasConceptScore W4312771814C2776036281 @default.
- W4312771814 hasConceptScore W4312771814C2776401178 @default.
- W4312771814 hasConceptScore W4312771814C2777212361 @default.
- W4312771814 hasConceptScore W4312771814C2778572836 @default.
- W4312771814 hasConceptScore W4312771814C33923547 @default.
- W4312771814 hasConceptScore W4312771814C41008148 @default.
- W4312771814 hasConceptScore W4312771814C41895202 @default.
- W4312771814 hasConceptScore W4312771814C7149132 @default.
- W4312771814 hasConceptScore W4312771814C73555534 @default.
- W4312771814 hasConceptScore W4312771814C80444323 @default.
- W4312771814 hasConceptScore W4312771814C83665646 @default.
- W4312771814 hasLocation W43127718141 @default.
- W4312771814 hasLocation W43127718142 @default.
- W4312771814 hasOpenAccess W4312771814 @default.
- W4312771814 hasPrimaryLocation W43127718141 @default.
- W4312771814 hasRelatedWork W2096020108 @default.
- W4312771814 hasRelatedWork W2117297561 @default.
- W4312771814 hasRelatedWork W2177773744 @default.
- W4312771814 hasRelatedWork W2178080893 @default.