FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2768412495> ?p ?o ?g. }

• W2768412495 abstract "Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten by new incoming information while important, frequently used knowledge is prevented from being erased. In artificial learning systems, lifelong learning so far has focused mainly on accumulating knowledge over tasks and overcoming catastrophic forgetting. In this paper, we argue that, given the limited model capacity and the unlimited new information to be learned, knowledge has to be preserved or erased selectively. Inspired by neuroplasticity, we propose a novel approach for lifelong learning, coined Memory Aware Synapses (MAS). It computes the importance of the parameters of a neural network in an unsupervised and online manner. Given a new sample which is fed to the network, MAS accumulates an importance measure for each parameter of the network, based on how sensitive the predicted output function is to a change in this parameter. When learning a new task, changes to important parameters can then be penalized, effectively preventing important knowledge related to previous tasks from being overwritten. Further, we show an interesting connection between a local version of our method and Hebb's rule,which is a model for the learning process in the brain. We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting $ $ triplets. We show state-of-the-art performance and, for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions." @default.
• W2768412495 created "2017-12-04" @default.
• W2768412495 creator A5021198356 @default.
• W2768412495 creator A5024481540 @default.
• W2768412495 creator A5051613830 @default.
• W2768412495 creator A5074816094 @default.
• W2768412495 creator A5085089542 @default.
• W2768412495 date "2017-11-27" @default.
• W2768412495 modified "2023-10-01" @default.
• W2768412495 title "Memory Aware Synapses: Learning what (not) to forget" @default.
• W2768412495 cites W1579279110 @default.
• W2768412495 cites W1579705726 @default.
• W2768412495 cites W1598866093 @default.
• W2768412495 cites W1682403713 @default.
• W2768412495 cites W1686810756 @default.
• W2768412495 cites W2036963181 @default.
• W2768412495 cites W2047057213 @default.
• W2768412495 cites W2060277733 @default.
• W2768412495 cites W2113839990 @default.
• W2768412495 cites W2117539524 @default.
• W2768412495 cites W2120501001 @default.
• W2768412495 cites W2152161678 @default.
• W2768412495 cites W22297218 @default.
• W2768412495 cites W2335728318 @default.
• W2768412495 cites W2554863749 @default.
• W2768412495 cites W2583761661 @default.
• W2768412495 cites W2599437901 @default.
• W2768412495 cites W2734314755 @default.
• W2768412495 cites W2747206364 @default.
• W2768412495 cites W2792568620 @default.
• W2768412495 cites W2949819354 @default.
• W2768412495 cites W2949995560 @default.
• W2768412495 cites W2950510923 @default.
• W2768412495 cites W2950577311 @default.
• W2768412495 cites W2951775809 @default.
• W2768412495 cites W2963775850 @default.
• W2768412495 cites W3021931813 @default.
• W2768412495 cites W3103800629 @default.
• W2768412495 cites W2426267443 @default.
• W2768412495 hasPublicationYear "2017" @default.
• W2768412495 type Work @default.
• W2768412495 sameAs 2768412495 @default.
• W2768412495 citedByCount "14" @default.
• W2768412495 countsByYear W27684124952018 @default.
• W2768412495 countsByYear W27684124952019 @default.
• W2768412495 countsByYear W27684124952020 @default.
• W2768412495 countsByYear W27684124952021 @default.
• W2768412495 crossrefType "posted-content" @default.
• W2768412495 hasAuthorship W2768412495A5021198356 @default.
• W2768412495 hasAuthorship W2768412495A5024481540 @default.
• W2768412495 hasAuthorship W2768412495A5051613830 @default.
• W2768412495 hasAuthorship W2768412495A5074816094 @default.
• W2768412495 hasAuthorship W2768412495A5085089542 @default.
• W2768412495 hasConcept C108771440 @default.
• W2768412495 hasConcept C111919701 @default.
• W2768412495 hasConcept C119857082 @default.
• W2768412495 hasConcept C134306372 @default.
• W2768412495 hasConcept C14036430 @default.
• W2768412495 hasConcept C154945302 @default.
• W2768412495 hasConcept C15744967 @default.
• W2768412495 hasConcept C162324750 @default.
• W2768412495 hasConcept C177148314 @default.
• W2768412495 hasConcept C180747234 @default.
• W2768412495 hasConcept C187736073 @default.
• W2768412495 hasConcept C19417346 @default.
• W2768412495 hasConcept C2778112365 @default.
• W2768412495 hasConcept C2780451532 @default.
• W2768412495 hasConcept C33923547 @default.
• W2768412495 hasConcept C40506919 @default.
• W2768412495 hasConcept C41008148 @default.
• W2768412495 hasConcept C41608201 @default.
• W2768412495 hasConcept C50644808 @default.
• W2768412495 hasConcept C54355233 @default.
• W2768412495 hasConcept C7149132 @default.
• W2768412495 hasConcept C78458016 @default.
• W2768412495 hasConcept C8038995 @default.
• W2768412495 hasConcept C86803240 @default.
• W2768412495 hasConcept C98045186 @default.
• W2768412495 hasConceptScore W2768412495C108771440 @default.
• W2768412495 hasConceptScore W2768412495C111919701 @default.
• W2768412495 hasConceptScore W2768412495C119857082 @default.
• W2768412495 hasConceptScore W2768412495C134306372 @default.
• W2768412495 hasConceptScore W2768412495C14036430 @default.
• W2768412495 hasConceptScore W2768412495C154945302 @default.
• W2768412495 hasConceptScore W2768412495C15744967 @default.
• W2768412495 hasConceptScore W2768412495C162324750 @default.
• W2768412495 hasConceptScore W2768412495C177148314 @default.
• W2768412495 hasConceptScore W2768412495C180747234 @default.
• W2768412495 hasConceptScore W2768412495C187736073 @default.
• W2768412495 hasConceptScore W2768412495C19417346 @default.
• W2768412495 hasConceptScore W2768412495C2778112365 @default.
• W2768412495 hasConceptScore W2768412495C2780451532 @default.
• W2768412495 hasConceptScore W2768412495C33923547 @default.
• W2768412495 hasConceptScore W2768412495C40506919 @default.
• W2768412495 hasConceptScore W2768412495C41008148 @default.
• W2768412495 hasConceptScore W2768412495C41608201 @default.
• W2768412495 hasConceptScore W2768412495C50644808 @default.
• W2768412495 hasConceptScore W2768412495C54355233 @default.
• W2768412495 hasConceptScore W2768412495C7149132 @default.
• W2768412495 hasConceptScore W2768412495C78458016 @default.

• next