Matches in SemOpenAlex for { <https://semopenalex.org/work/W3115484476> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W3115484476 abstract "Supervised deep neural networks are known to undergo a sharp decline in the accuracy of older tasks when new tasks are learned, termed catastrophic forgetting. Many state-of-the-art solutions to continual learning rely on biasing and/or partitioning a model to accommodate successive tasks incrementally. However, these methods largely depend on the availability of a task-oracle to confer task identities to each test sample, without which the models are entirely unable to perform. To address this shortcoming, we propose and compare several candidate task-assigning mappers which require very little memory overhead: (1) Incremental unsupervised prototype assignment using either nearest means, Gaussian Mixture Models or fuzzy ART backbones; (2) Supervised incremental prototype assignment with fast fuzzy ARTMAP; (3) Shallow perceptron trained via a dynamic coreset. Our proposed model variants are trained either from pre-trained feature extractors or task-dependent feature embeddings of the main classifier network. We apply these pipeline variants to continual learning benchmarks, comprised of either sequences of several datasets or within one single dataset. Overall, these methods, despite their simplicity and compactness, perform very close to a ground truth oracle, especially in experiments of inter-dataset task assignment. Moreover, best-performing variants only impose an average cost of 1.7% parameter memory increase." @default.
- W3115484476 created "2021-01-05" @default.
- W3115484476 creator A5032637143 @default.
- W3115484476 creator A5054494771 @default.
- W3115484476 date "2020-11-09" @default.
- W3115484476 modified "2023-10-14" @default.
- W3115484476 title "Lifelong Learning Without a Task Oracle" @default.
- W3115484476 cites W1605959661 @default.
- W3115484476 cites W2012611887 @default.
- W3115484476 cites W2060277733 @default.
- W3115484476 cites W2115256808 @default.
- W3115484476 cites W2554616628 @default.
- W3115484476 cites W2560647685 @default.
- W3115484476 cites W2737492962 @default.
- W3115484476 cites W2788388592 @default.
- W3115484476 cites W2791091755 @default.
- W3115484476 cites W2902391267 @default.
- W3115484476 cites W2939137134 @default.
- W3115484476 cites W2962724315 @default.
- W3115484476 cites W2963559848 @default.
- W3115484476 cites W2963588172 @default.
- W3115484476 cites W2964189064 @default.
- W3115484476 cites W2965661443 @default.
- W3115484476 cites W2967821093 @default.
- W3115484476 cites W2971246930 @default.
- W3115484476 cites W2995589713 @default.
- W3115484476 cites W2996144997 @default.
- W3115484476 cites W3091210526 @default.
- W3115484476 hasPublicationYear "2020" @default.
- W3115484476 type Work @default.
- W3115484476 sameAs 3115484476 @default.
- W3115484476 citedByCount "0" @default.
- W3115484476 crossrefType "posted-content" @default.
- W3115484476 hasAuthorship W3115484476A5032637143 @default.
- W3115484476 hasAuthorship W3115484476A5054494771 @default.
- W3115484476 hasConcept C108583219 @default.
- W3115484476 hasConcept C115903868 @default.
- W3115484476 hasConcept C119857082 @default.
- W3115484476 hasConcept C138885662 @default.
- W3115484476 hasConcept C153180895 @default.
- W3115484476 hasConcept C154945302 @default.
- W3115484476 hasConcept C162324750 @default.
- W3115484476 hasConcept C187736073 @default.
- W3115484476 hasConcept C188441871 @default.
- W3115484476 hasConcept C2776401178 @default.
- W3115484476 hasConcept C2778827112 @default.
- W3115484476 hasConcept C2780451532 @default.
- W3115484476 hasConcept C41008148 @default.
- W3115484476 hasConcept C41895202 @default.
- W3115484476 hasConcept C50644808 @default.
- W3115484476 hasConcept C55166926 @default.
- W3115484476 hasConcept C60908668 @default.
- W3115484476 hasConcept C7149132 @default.
- W3115484476 hasConcept C95623464 @default.
- W3115484476 hasConceptScore W3115484476C108583219 @default.
- W3115484476 hasConceptScore W3115484476C115903868 @default.
- W3115484476 hasConceptScore W3115484476C119857082 @default.
- W3115484476 hasConceptScore W3115484476C138885662 @default.
- W3115484476 hasConceptScore W3115484476C153180895 @default.
- W3115484476 hasConceptScore W3115484476C154945302 @default.
- W3115484476 hasConceptScore W3115484476C162324750 @default.
- W3115484476 hasConceptScore W3115484476C187736073 @default.
- W3115484476 hasConceptScore W3115484476C188441871 @default.
- W3115484476 hasConceptScore W3115484476C2776401178 @default.
- W3115484476 hasConceptScore W3115484476C2778827112 @default.
- W3115484476 hasConceptScore W3115484476C2780451532 @default.
- W3115484476 hasConceptScore W3115484476C41008148 @default.
- W3115484476 hasConceptScore W3115484476C41895202 @default.
- W3115484476 hasConceptScore W3115484476C50644808 @default.
- W3115484476 hasConceptScore W3115484476C55166926 @default.
- W3115484476 hasConceptScore W3115484476C60908668 @default.
- W3115484476 hasConceptScore W3115484476C7149132 @default.
- W3115484476 hasConceptScore W3115484476C95623464 @default.
- W3115484476 hasLocation W31154844761 @default.
- W3115484476 hasOpenAccess W3115484476 @default.
- W3115484476 hasPrimaryLocation W31154844761 @default.
- W3115484476 hasRelatedWork W109724011 @default.
- W3115484476 hasRelatedWork W2110994494 @default.
- W3115484476 hasRelatedWork W2753672731 @default.
- W3115484476 hasRelatedWork W2948734064 @default.
- W3115484476 hasRelatedWork W2959424724 @default.
- W3115484476 hasRelatedWork W2963571818 @default.
- W3115484476 hasRelatedWork W2970656679 @default.
- W3115484476 hasRelatedWork W3003445221 @default.
- W3115484476 hasRelatedWork W3034911677 @default.
- W3115484476 hasRelatedWork W3091617927 @default.
- W3115484476 hasRelatedWork W3091689422 @default.
- W3115484476 hasRelatedWork W3095266318 @default.
- W3115484476 hasRelatedWork W3104454588 @default.
- W3115484476 hasRelatedWork W3105216938 @default.
- W3115484476 hasRelatedWork W3134309133 @default.
- W3115484476 hasRelatedWork W3137257446 @default.
- W3115484476 hasRelatedWork W3153597994 @default.
- W3115484476 hasRelatedWork W3173986289 @default.
- W3115484476 hasRelatedWork W3177494822 @default.
- W3115484476 hasRelatedWork W3205106000 @default.
- W3115484476 isParatext "false" @default.
- W3115484476 isRetracted "false" @default.
- W3115484476 magId "3115484476" @default.
- W3115484476 workType "article" @default.