FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3126543146> ?p ?o ?g. }

• W3126543146 abstract "Quadratic regularizers are often used for mitigating catastrophic forgetting in deep neural networks (DNNs), but are unable to compete with recent continual learning methods. To understand this behavior, we analyze parameter updates under quadratic regularization and demonstrate such regularizers prevent forgetting of past tasks by implicitly performing a weighted average between current and previous values of model parameters. Our analysis shows the inferior performance of quadratic regularizers arises from (a) dependence of weighted averaging on training hyperparameters, which often results in unstable training and (b) assignment of lower importance to deeper layers, which are generally the cause for forgetting in DNNs. To address these limitations, we propose Explicit Movement Regularization (EMR), a continual learning algorithm that modifies quadratic regularization to remove the dependence of weighted averaging on training hyperparameters and uses a relative measure for importance to avoid problems caused by lower importance assignment to deeper layers. Compared to quadratic regularization, EMR achieves 6.2% higher average accuracy and 4.5% lower average forgetting." @default.
• W3126543146 created "2021-02-15" @default.
• W3126543146 creator A5042391338 @default.
• W3126543146 creator A5068224304 @default.
• W3126543146 creator A5069090559 @default.
• W3126543146 date "2021-02-04" @default.
• W3126543146 modified "2023-09-27" @default.
• W3126543146 title "Rethinking Quadratic Regularizers: Explicit Movement Regularization for Continual Learning." @default.
• W3126543146 cites W2473930607 @default.
• W3126543146 cites W2560647685 @default.
• W3126543146 cites W2618767506 @default.
• W3126543146 cites W2734314755 @default.
• W3126543146 cites W2737492962 @default.
• W3126543146 cites W2786446225 @default.
• W3126543146 cites W2786462443 @default.
• W3126543146 cites W2803552920 @default.
• W3126543146 cites W2804746922 @default.
• W3126543146 cites W2806265408 @default.
• W3126543146 cites W2908510526 @default.
• W3126543146 cites W2932484476 @default.
• W3126543146 cites W2947461406 @default.
• W3126543146 cites W2949558627 @default.
• W3126543146 cites W2963390791 @default.
• W3126543146 cites W2963540014 @default.
• W3126543146 cites W2963588172 @default.
• W3126543146 cites W2970066656 @default.
• W3126543146 cites W2995795252 @default.
• W3126543146 cites W3035081900 @default.
• W3126543146 cites W3036362369 @default.
• W3126543146 cites W3037967334 @default.
• W3126543146 cites W3038041907 @default.
• W3126543146 cites W3130138360 @default.
• W3126543146 cites W2426267443 @default.
• W3126543146 cites W3034877463 @default.
• W3126543146 hasPublicationYear "2021" @default.
• W3126543146 type Work @default.
• W3126543146 sameAs 3126543146 @default.
• W3126543146 citedByCount "1" @default.
• W3126543146 countsByYear W31265431462021 @default.
• W3126543146 crossrefType "posted-content" @default.
• W3126543146 hasAuthorship W3126543146A5042391338 @default.
• W3126543146 hasAuthorship W3126543146A5068224304 @default.
• W3126543146 hasAuthorship W3126543146A5069090559 @default.
• W3126543146 hasConcept C119857082 @default.
• W3126543146 hasConcept C126255220 @default.
• W3126543146 hasConcept C129844170 @default.
• W3126543146 hasConcept C154945302 @default.
• W3126543146 hasConcept C15744967 @default.
• W3126543146 hasConcept C180747234 @default.
• W3126543146 hasConcept C2524010 @default.
• W3126543146 hasConcept C2776135515 @default.
• W3126543146 hasConcept C28826006 @default.
• W3126543146 hasConcept C2984842247 @default.
• W3126543146 hasConcept C33923547 @default.
• W3126543146 hasConcept C41008148 @default.
• W3126543146 hasConcept C50644808 @default.
• W3126543146 hasConcept C7149132 @default.
• W3126543146 hasConcept C81845259 @default.
• W3126543146 hasConcept C8642999 @default.
• W3126543146 hasConceptScore W3126543146C119857082 @default.
• W3126543146 hasConceptScore W3126543146C126255220 @default.
• W3126543146 hasConceptScore W3126543146C129844170 @default.
• W3126543146 hasConceptScore W3126543146C154945302 @default.
• W3126543146 hasConceptScore W3126543146C15744967 @default.
• W3126543146 hasConceptScore W3126543146C180747234 @default.
• W3126543146 hasConceptScore W3126543146C2524010 @default.
• W3126543146 hasConceptScore W3126543146C2776135515 @default.
• W3126543146 hasConceptScore W3126543146C28826006 @default.
• W3126543146 hasConceptScore W3126543146C2984842247 @default.
• W3126543146 hasConceptScore W3126543146C33923547 @default.
• W3126543146 hasConceptScore W3126543146C41008148 @default.
• W3126543146 hasConceptScore W3126543146C50644808 @default.
• W3126543146 hasConceptScore W3126543146C7149132 @default.
• W3126543146 hasConceptScore W3126543146C81845259 @default.
• W3126543146 hasConceptScore W3126543146C8642999 @default.
• W3126543146 hasLocation W31265431461 @default.
• W3126543146 hasOpenAccess W3126543146 @default.
• W3126543146 hasPrimaryLocation W31265431461 @default.
• W3126543146 hasRelatedWork W1535357773 @default.
• W3126543146 hasRelatedWork W1946718419 @default.
• W3126543146 hasRelatedWork W2121974477 @default.
• W3126543146 hasRelatedWork W2521284735 @default.
• W3126543146 hasRelatedWork W2612930941 @default.
• W3126543146 hasRelatedWork W2765904043 @default.
• W3126543146 hasRelatedWork W2787972513 @default.
• W3126543146 hasRelatedWork W2792024940 @default.
• W3126543146 hasRelatedWork W2810268014 @default.
• W3126543146 hasRelatedWork W2963574404 @default.
• W3126543146 hasRelatedWork W2963828549 @default.
• W3126543146 hasRelatedWork W3009559573 @default.
• W3126543146 hasRelatedWork W3042470307 @default.
• W3126543146 hasRelatedWork W3126459120 @default.
• W3126543146 hasRelatedWork W3132545688 @default.
• W3126543146 hasRelatedWork W3152522792 @default.
• W3126543146 hasRelatedWork W3154315030 @default.
• W3126543146 hasRelatedWork W3179076679 @default.
• W3126543146 hasRelatedWork W3180258270 @default.
• W3126543146 hasRelatedWork W3202354099 @default.
• W3126543146 isParatext "false" @default.
• W3126543146 isRetracted "false" @default.

• next