Matches in SemOpenAlex for { <https://semopenalex.org/work/W3164094559> ?p ?o ?g. }
- W3164094559 abstract "We present an architecture that is effective for continual learning in an especially demanding setting, where task boundaries do not exist or are unknown. Our architecture comprises an encoder, pre-trained on a separate dataset, and an ensemble of simple one-layer classifiers. Two main innovations are required to make this combination work. First, the provision of suitably generic pre-trained encoders has been made possible thanks to recent progress in self-supervised training methods. Second, pairing each classifier in the ensemble with a key, where the key-space is identical to the latent space of the encoder, allows them to be used collectively, yet selectively, via k-nearest neighbour lookup. We show that models trained with the encoders-and-ensembles architecture are state-of-the-art for the task-free setting on standard image classification continual learning benchmarks, and improve on prior state-of-the-art by a large margin in the most challenging cases. We also show that the architecture learns well in a fully incremental setting, where one class is learned at a time, and we demonstrate its effectiveness in this setting with up to 100 classes. Finally, we show that the architecture works in a task-free continual learning context where the data distribution changes gradually, and existing approaches requiring knowledge of task boundaries cannot be applied." @default.
- W3164094559 created "2021-06-07" @default.
- W3164094559 creator A5057371744 @default.
- W3164094559 creator A5065295907 @default.
- W3164094559 creator A5072322524 @default.
- W3164094559 date "2021-05-27" @default.
- W3164094559 modified "2023-09-27" @default.
- W3164094559 title "Encoders and Ensembles for Task-Free Continual Learning." @default.
- W3164094559 cites W1682403713 @default.
- W3164094559 cites W1959608418 @default.
- W3164094559 cites W1966109336 @default.
- W3164094559 cites W2060277733 @default.
- W3164094559 cites W2095705004 @default.
- W3164094559 cites W2108598243 @default.
- W3164094559 cites W2112796928 @default.
- W3164094559 cites W2113839990 @default.
- W3164094559 cites W2116871363 @default.
- W3164094559 cites W2150884987 @default.
- W3164094559 cites W2194321275 @default.
- W3164094559 cites W2194775991 @default.
- W3164094559 cites W2215343611 @default.
- W3164094559 cites W2554616628 @default.
- W3164094559 cites W2560647685 @default.
- W3164094559 cites W2575352823 @default.
- W3164094559 cites W2583761661 @default.
- W3164094559 cites W2737492962 @default.
- W3164094559 cites W2765895026 @default.
- W3164094559 cites W2789758093 @default.
- W3164094559 cites W2899063268 @default.
- W3164094559 cites W2902417425 @default.
- W3164094559 cites W2939137134 @default.
- W3164094559 cites W2950184636 @default.
- W3164094559 cites W2962724315 @default.
- W3164094559 cites W2962897886 @default.
- W3164094559 cites W2963559848 @default.
- W3164094559 cites W2963970953 @default.
- W3164094559 cites W2964048876 @default.
- W3164094559 cites W2964189064 @default.
- W3164094559 cites W2970066656 @default.
- W3164094559 cites W2970502342 @default.
- W3164094559 cites W2970505118 @default.
- W3164094559 cites W2970586779 @default.
- W3164094559 cites W2971176100 @default.
- W3164094559 cites W2982701845 @default.
- W3164094559 cites W2994797252 @default.
- W3164094559 cites W2996472503 @default.
- W3164094559 cites W3030364939 @default.
- W3164094559 cites W3034978746 @default.
- W3164094559 cites W3037967334 @default.
- W3164094559 cites W3090618925 @default.
- W3164094559 cites W3097784654 @default.
- W3164094559 cites W3097816393 @default.
- W3164094559 cites W3101821705 @default.
- W3164094559 cites W3118608800 @default.
- W3164094559 cites W3120542573 @default.
- W3164094559 cites W3122135088 @default.
- W3164094559 hasPublicationYear "2021" @default.
- W3164094559 type Work @default.
- W3164094559 sameAs 3164094559 @default.
- W3164094559 citedByCount "0" @default.
- W3164094559 crossrefType "posted-content" @default.
- W3164094559 hasAuthorship W3164094559A5057371744 @default.
- W3164094559 hasAuthorship W3164094559A5065295907 @default.
- W3164094559 hasAuthorship W3164094559A5072322524 @default.
- W3164094559 hasConcept C111919701 @default.
- W3164094559 hasConcept C118505674 @default.
- W3164094559 hasConcept C119857082 @default.
- W3164094559 hasConcept C123657996 @default.
- W3164094559 hasConcept C127413603 @default.
- W3164094559 hasConcept C136389625 @default.
- W3164094559 hasConcept C142362112 @default.
- W3164094559 hasConcept C151730666 @default.
- W3164094559 hasConcept C153349607 @default.
- W3164094559 hasConcept C154945302 @default.
- W3164094559 hasConcept C201995342 @default.
- W3164094559 hasConcept C26517878 @default.
- W3164094559 hasConcept C2779343474 @default.
- W3164094559 hasConcept C2780451532 @default.
- W3164094559 hasConcept C28006648 @default.
- W3164094559 hasConcept C38652104 @default.
- W3164094559 hasConcept C41008148 @default.
- W3164094559 hasConcept C50644808 @default.
- W3164094559 hasConcept C774472 @default.
- W3164094559 hasConcept C86803240 @default.
- W3164094559 hasConcept C95623464 @default.
- W3164094559 hasConceptScore W3164094559C111919701 @default.
- W3164094559 hasConceptScore W3164094559C118505674 @default.
- W3164094559 hasConceptScore W3164094559C119857082 @default.
- W3164094559 hasConceptScore W3164094559C123657996 @default.
- W3164094559 hasConceptScore W3164094559C127413603 @default.
- W3164094559 hasConceptScore W3164094559C136389625 @default.
- W3164094559 hasConceptScore W3164094559C142362112 @default.
- W3164094559 hasConceptScore W3164094559C151730666 @default.
- W3164094559 hasConceptScore W3164094559C153349607 @default.
- W3164094559 hasConceptScore W3164094559C154945302 @default.
- W3164094559 hasConceptScore W3164094559C201995342 @default.
- W3164094559 hasConceptScore W3164094559C26517878 @default.
- W3164094559 hasConceptScore W3164094559C2779343474 @default.
- W3164094559 hasConceptScore W3164094559C2780451532 @default.
- W3164094559 hasConceptScore W3164094559C28006648 @default.