Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385800747> ?p ?o ?g. }
- W4385800747 abstract "The ability to acquire new skills and knowledge continually is one of the defining qualities of the human brain, which is critically missing in most modern machine vision systems. In this work, we focus on knowledge transfer in the lifelong learning setting. We propose a lifelong learner that models the similarities between the optimal weight spaces of tasks and exploits this in order to enable knowledge transfer across tasks in a continual learning setting. To characterize the task-parameter relationships, we propose a metric called adaptation rate integral (ARI), which measures the expected rate of adaptation over a finite number of steps for a (task, parameter) pair. These task-parameter relationships are learned using an auxiliary network trained on guided explorations of parameter space. The learned auxiliary network is then used to heuristically select the best parameter sets on seen tasks, which are consolidated using a hypernetwork. Given a new (unseen) task, knowledge transfer occurs through the selection of the most suitable parameter set from the hypernetwork that can be rapidly finetuned. We show that the proposed approach can improve knowledge transfer between tasks across standard benchmarks without any increase in overall model capacity, while naturally mitigating catastrophic forgetting." @default.
- W4385800747 created "2023-08-15" @default.
- W4385800747 creator A5044270814 @default.
- W4385800747 creator A5059676452 @default.
- W4385800747 creator A5088282276 @default.
- W4385800747 date "2023-06-01" @default.
- W4385800747 modified "2023-09-27" @default.
- W4385800747 title "Lifelong Learning of Task-Parameter Relationships for Knowledge Transfer" @default.
- W4385800747 cites W1682403713 @default.
- W4385800747 cites W1948390204 @default.
- W4385800747 cites W1993521400 @default.
- W4385800747 cites W2060277733 @default.
- W4385800747 cites W2071290167 @default.
- W4385800747 cites W2095755534 @default.
- W4385800747 cites W2151554678 @default.
- W4385800747 cites W2166822816 @default.
- W4385800747 cites W2194775991 @default.
- W4385800747 cites W2424347275 @default.
- W4385800747 cites W2560647685 @default.
- W4385800747 cites W2963072899 @default.
- W4385800747 cites W2964189064 @default.
- W4385800747 cites W2965736624 @default.
- W4385800747 doi "https://doi.org/10.1109/cvprw59228.2023.00251" @default.
- W4385800747 hasPublicationYear "2023" @default.
- W4385800747 type Work @default.
- W4385800747 citedByCount "0" @default.
- W4385800747 crossrefType "proceedings-article" @default.
- W4385800747 hasAuthorship W4385800747A5044270814 @default.
- W4385800747 hasAuthorship W4385800747A5059676452 @default.
- W4385800747 hasAuthorship W4385800747A5088282276 @default.
- W4385800747 hasConcept C108771440 @default.
- W4385800747 hasConcept C119857082 @default.
- W4385800747 hasConcept C120665830 @default.
- W4385800747 hasConcept C121332964 @default.
- W4385800747 hasConcept C138885662 @default.
- W4385800747 hasConcept C139807058 @default.
- W4385800747 hasConcept C150899416 @default.
- W4385800747 hasConcept C154945302 @default.
- W4385800747 hasConcept C15744967 @default.
- W4385800747 hasConcept C162324750 @default.
- W4385800747 hasConcept C165696696 @default.
- W4385800747 hasConcept C171041071 @default.
- W4385800747 hasConcept C176217482 @default.
- W4385800747 hasConcept C177264268 @default.
- W4385800747 hasConcept C187736073 @default.
- W4385800747 hasConcept C192209626 @default.
- W4385800747 hasConcept C19417346 @default.
- W4385800747 hasConcept C199360897 @default.
- W4385800747 hasConcept C21547014 @default.
- W4385800747 hasConcept C2776960227 @default.
- W4385800747 hasConcept C2779178101 @default.
- W4385800747 hasConcept C2780451532 @default.
- W4385800747 hasConcept C38652104 @default.
- W4385800747 hasConcept C41008148 @default.
- W4385800747 hasConcept C41895202 @default.
- W4385800747 hasConcept C56739046 @default.
- W4385800747 hasConcept C7149132 @default.
- W4385800747 hasConcept C80444323 @default.
- W4385800747 hasConcept C81917197 @default.
- W4385800747 hasConceptScore W4385800747C108771440 @default.
- W4385800747 hasConceptScore W4385800747C119857082 @default.
- W4385800747 hasConceptScore W4385800747C120665830 @default.
- W4385800747 hasConceptScore W4385800747C121332964 @default.
- W4385800747 hasConceptScore W4385800747C138885662 @default.
- W4385800747 hasConceptScore W4385800747C139807058 @default.
- W4385800747 hasConceptScore W4385800747C150899416 @default.
- W4385800747 hasConceptScore W4385800747C154945302 @default.
- W4385800747 hasConceptScore W4385800747C15744967 @default.
- W4385800747 hasConceptScore W4385800747C162324750 @default.
- W4385800747 hasConceptScore W4385800747C165696696 @default.
- W4385800747 hasConceptScore W4385800747C171041071 @default.
- W4385800747 hasConceptScore W4385800747C176217482 @default.
- W4385800747 hasConceptScore W4385800747C177264268 @default.
- W4385800747 hasConceptScore W4385800747C187736073 @default.
- W4385800747 hasConceptScore W4385800747C192209626 @default.
- W4385800747 hasConceptScore W4385800747C19417346 @default.
- W4385800747 hasConceptScore W4385800747C199360897 @default.
- W4385800747 hasConceptScore W4385800747C21547014 @default.
- W4385800747 hasConceptScore W4385800747C2776960227 @default.
- W4385800747 hasConceptScore W4385800747C2779178101 @default.
- W4385800747 hasConceptScore W4385800747C2780451532 @default.
- W4385800747 hasConceptScore W4385800747C38652104 @default.
- W4385800747 hasConceptScore W4385800747C41008148 @default.
- W4385800747 hasConceptScore W4385800747C41895202 @default.
- W4385800747 hasConceptScore W4385800747C56739046 @default.
- W4385800747 hasConceptScore W4385800747C7149132 @default.
- W4385800747 hasConceptScore W4385800747C80444323 @default.
- W4385800747 hasConceptScore W4385800747C81917197 @default.
- W4385800747 hasLocation W43858007471 @default.
- W4385800747 hasOpenAccess W4385800747 @default.
- W4385800747 hasPrimaryLocation W43858007471 @default.
- W4385800747 hasRelatedWork W2184474799 @default.
- W4385800747 hasRelatedWork W2578423033 @default.
- W4385800747 hasRelatedWork W2612814713 @default.
- W4385800747 hasRelatedWork W3035521292 @default.
- W4385800747 hasRelatedWork W3036730856 @default.
- W4385800747 hasRelatedWork W3093610498 @default.
- W4385800747 hasRelatedWork W4292102013 @default.
- W4385800747 hasRelatedWork W4308165858 @default.
- W4385800747 hasRelatedWork W4382202689 @default.