FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2782276075> ?p ?o ?g. }

• W2782276075 abstract "Catastrophic forgetting occurs when a neural network loses the information learned in a previous task after training on subsequent tasks. This problem remains a hurdle for artificial intelligence systems with sequential learning capabilities. In this paper, we propose a task-based hard attention mechanism that preserves previous tasks' information without affecting the current task's learning. A hard attention mask is learned concurrently to every task, through stochastic gradient descent, and previous masks are exploited to condition such learning. We show that the proposed mechanism is effective for reducing catastrophic forgetting, cutting current rates by 45 to 80%. We also show that it is robust to different hyperparameter choices, and that it offers a number of monitoring capabilities. The approach features the possibility to control both the stability and compactness of the learned knowledge, which we believe makes it also attractive for online learning or network compression applications." @default.
• W2782276075 created "2018-01-12" @default.
• W2782276075 creator A5019293578 @default.
• W2782276075 creator A5039915904 @default.
• W2782276075 creator A5061340672 @default.
• W2782276075 creator A5082408006 @default.
• W2782276075 date "2018-01-04" @default.
• W2782276075 modified "2023-10-16" @default.
• W2782276075 title "Overcoming catastrophic forgetting with hard attention to the task" @default.
• W2782276075 cites W1649754194 @default.
• W2782276075 cites W1682403713 @default.
• W2782276075 cites W1991564165 @default.
• W2782276075 cites W1995341919 @default.
• W2782276075 cites W2024922353 @default.
• W2782276075 cites W2099049980 @default.
• W2782276075 cites W2112796928 @default.
• W2782276075 cites W2116522068 @default.
• W2782276075 cites W2119187866 @default.
• W2782276075 cites W2143104527 @default.
• W2782276075 cites W2164724958 @default.
• W2782276075 cites W2335728318 @default.
• W2782276075 cites W2474280151 @default.
• W2782276075 cites W2560647685 @default.
• W2782276075 cites W2583761661 @default.
• W2782276075 cites W2592484110 @default.
• W2782276075 cites W2599437901 @default.
• W2782276075 cites W2618767506 @default.
• W2782276075 cites W2738110777 @default.
• W2782276075 cites W2744654301 @default.
• W2782276075 cites W2750384547 @default.
• W2782276075 cites W2765101016 @default.
• W2782276075 cites W2770882886 @default.
• W2782276075 cites W2785567898 @default.
• W2782276075 cites W2786465559 @default.
• W2782276075 cites W2899771611 @default.
• W2782276075 cites W2949995560 @default.
• W2782276075 cites W2963671154 @default.
• W2782276075 cites W2963813679 @default.
• W2782276075 cites W2964067969 @default.
• W2782276075 cites W2964121744 @default.
• W2782276075 cites W3021931813 @default.
• W2782276075 cites W3118608800 @default.
• W2782276075 cites W2426267443 @default.
• W2782276075 hasPublicationYear "2018" @default.
• W2782276075 type Work @default.
• W2782276075 sameAs 2782276075 @default.
• W2782276075 citedByCount "57" @default.
• W2782276075 countsByYear W27822760752018 @default.
• W2782276075 countsByYear W27822760752019 @default.
• W2782276075 countsByYear W27822760752020 @default.
• W2782276075 countsByYear W27822760752021 @default.
• W2782276075 crossrefType "posted-content" @default.
• W2782276075 hasAuthorship W2782276075A5019293578 @default.
• W2782276075 hasAuthorship W2782276075A5039915904 @default.
• W2782276075 hasAuthorship W2782276075A5061340672 @default.
• W2782276075 hasAuthorship W2782276075A5082408006 @default.
• W2782276075 hasConcept C111472728 @default.
• W2782276075 hasConcept C119857082 @default.
• W2782276075 hasConcept C127413603 @default.
• W2782276075 hasConcept C138885662 @default.
• W2782276075 hasConcept C154945302 @default.
• W2782276075 hasConcept C15744967 @default.
• W2782276075 hasConcept C180747234 @default.
• W2782276075 hasConcept C201995342 @default.
• W2782276075 hasConcept C206688291 @default.
• W2782276075 hasConcept C2780451532 @default.
• W2782276075 hasConcept C41008148 @default.
• W2782276075 hasConcept C50644808 @default.
• W2782276075 hasConcept C7149132 @default.
• W2782276075 hasConcept C8642999 @default.
• W2782276075 hasConcept C89611455 @default.
• W2782276075 hasConceptScore W2782276075C111472728 @default.
• W2782276075 hasConceptScore W2782276075C119857082 @default.
• W2782276075 hasConceptScore W2782276075C127413603 @default.
• W2782276075 hasConceptScore W2782276075C138885662 @default.
• W2782276075 hasConceptScore W2782276075C154945302 @default.
• W2782276075 hasConceptScore W2782276075C15744967 @default.
• W2782276075 hasConceptScore W2782276075C180747234 @default.
• W2782276075 hasConceptScore W2782276075C201995342 @default.
• W2782276075 hasConceptScore W2782276075C206688291 @default.
• W2782276075 hasConceptScore W2782276075C2780451532 @default.
• W2782276075 hasConceptScore W2782276075C41008148 @default.
• W2782276075 hasConceptScore W2782276075C50644808 @default.
• W2782276075 hasConceptScore W2782276075C7149132 @default.
• W2782276075 hasConceptScore W2782276075C8642999 @default.
• W2782276075 hasConceptScore W2782276075C89611455 @default.
• W2782276075 hasLocation W27822760751 @default.
• W2782276075 hasOpenAccess W2782276075 @default.
• W2782276075 hasPrimaryLocation W27822760751 @default.
• W2782276075 hasRelatedWork W1682403713 @default.
• W2782276075 hasRelatedWork W1821462560 @default.
• W2782276075 hasRelatedWork W2060277733 @default.
• W2782276075 hasRelatedWork W2113839990 @default.
• W2782276075 hasRelatedWork W2116522068 @default.
• W2782276075 hasRelatedWork W2194775991 @default.
• W2782276075 hasRelatedWork W2473930607 @default.
• W2782276075 hasRelatedWork W2560647685 @default.
• W2782276075 hasRelatedWork W2583761661 @default.
• W2782276075 hasRelatedWork W2605043629 @default.
• W2782276075 hasRelatedWork W2737492962 @default.

• next