Matches in SemOpenAlex for { <https://semopenalex.org/work/W4380206392> ?p ?o ?g. }
Showing items 1 to 86 of
86
with 100 items per page.
- W4380206392 abstract "In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new data, has emerged as a simple and effective learning strategy. In this work, we focus on the change in representations of observed data that arises when previously unobserved classes appear in the incoming data stream, and new classes must be distinguished from previous ones. We shed new light on this question by showing that applying ER causes the newly added classes' representations to overlap significantly with the previous classes, leading to highly disruptive parameter updates. Based on this empirical analysis, we propose a new method which mitigates this issue by shielding the learned representations from drastic adaptation to accommodate new classes. We show that using an asymmetric update rule pushes new classes to adapt to the older ones (rather than the reverse), which is more effective especially at task boundaries, where much of the forgetting typically occurs. Empirical results show significant gains over strong baselines on standard continual learning benchmarks" @default.
- W4380206392 created "2023-06-11" @default.
- W4380206392 creator A5021198356 @default.
- W4380206392 creator A5025113992 @default.
- W4380206392 creator A5035384485 @default.
- W4380206392 creator A5051723523 @default.
- W4380206392 creator A5074816094 @default.
- W4380206392 creator A5080591144 @default.
- W4380206392 date "2022-03-07" @default.
- W4380206392 modified "2023-10-04" @default.
- W4380206392 title "New Insights on Reducing Abrupt Representation Change in Online Continual Learning" @default.
- W4380206392 doi "https://doi.org/10.48550/arxiv.2203.03798" @default.
- W4380206392 hasPublicationYear "2022" @default.
- W4380206392 type Work @default.
- W4380206392 citedByCount "0" @default.
- W4380206392 crossrefType "posted-content" @default.
- W4380206392 hasAuthorship W4380206392A5021198356 @default.
- W4380206392 hasAuthorship W4380206392A5025113992 @default.
- W4380206392 hasAuthorship W4380206392A5035384485 @default.
- W4380206392 hasAuthorship W4380206392A5051723523 @default.
- W4380206392 hasAuthorship W4380206392A5074816094 @default.
- W4380206392 hasAuthorship W4380206392A5080591144 @default.
- W4380206392 hasBestOaLocation W43802063921 @default.
- W4380206392 hasConcept C111472728 @default.
- W4380206392 hasConcept C119857082 @default.
- W4380206392 hasConcept C120665830 @default.
- W4380206392 hasConcept C121332964 @default.
- W4380206392 hasConcept C138885662 @default.
- W4380206392 hasConcept C139807058 @default.
- W4380206392 hasConcept C154945302 @default.
- W4380206392 hasConcept C15744967 @default.
- W4380206392 hasConcept C162324750 @default.
- W4380206392 hasConcept C166052673 @default.
- W4380206392 hasConcept C169760540 @default.
- W4380206392 hasConcept C17744445 @default.
- W4380206392 hasConcept C180747234 @default.
- W4380206392 hasConcept C187736073 @default.
- W4380206392 hasConcept C192209626 @default.
- W4380206392 hasConcept C199539241 @default.
- W4380206392 hasConcept C2776359362 @default.
- W4380206392 hasConcept C2780451532 @default.
- W4380206392 hasConcept C2780586882 @default.
- W4380206392 hasConcept C41008148 @default.
- W4380206392 hasConcept C7149132 @default.
- W4380206392 hasConcept C80444323 @default.
- W4380206392 hasConcept C94625758 @default.
- W4380206392 hasConceptScore W4380206392C111472728 @default.
- W4380206392 hasConceptScore W4380206392C119857082 @default.
- W4380206392 hasConceptScore W4380206392C120665830 @default.
- W4380206392 hasConceptScore W4380206392C121332964 @default.
- W4380206392 hasConceptScore W4380206392C138885662 @default.
- W4380206392 hasConceptScore W4380206392C139807058 @default.
- W4380206392 hasConceptScore W4380206392C154945302 @default.
- W4380206392 hasConceptScore W4380206392C15744967 @default.
- W4380206392 hasConceptScore W4380206392C162324750 @default.
- W4380206392 hasConceptScore W4380206392C166052673 @default.
- W4380206392 hasConceptScore W4380206392C169760540 @default.
- W4380206392 hasConceptScore W4380206392C17744445 @default.
- W4380206392 hasConceptScore W4380206392C180747234 @default.
- W4380206392 hasConceptScore W4380206392C187736073 @default.
- W4380206392 hasConceptScore W4380206392C192209626 @default.
- W4380206392 hasConceptScore W4380206392C199539241 @default.
- W4380206392 hasConceptScore W4380206392C2776359362 @default.
- W4380206392 hasConceptScore W4380206392C2780451532 @default.
- W4380206392 hasConceptScore W4380206392C2780586882 @default.
- W4380206392 hasConceptScore W4380206392C41008148 @default.
- W4380206392 hasConceptScore W4380206392C7149132 @default.
- W4380206392 hasConceptScore W4380206392C80444323 @default.
- W4380206392 hasConceptScore W4380206392C94625758 @default.
- W4380206392 hasLocation W43802063921 @default.
- W4380206392 hasLocation W43802063922 @default.
- W4380206392 hasOpenAccess W4380206392 @default.
- W4380206392 hasPrimaryLocation W43802063921 @default.
- W4380206392 hasRelatedWork W1522515376 @default.
- W4380206392 hasRelatedWork W189527659 @default.
- W4380206392 hasRelatedWork W2076610045 @default.
- W4380206392 hasRelatedWork W2135470563 @default.
- W4380206392 hasRelatedWork W2952844618 @default.
- W4380206392 hasRelatedWork W2961085424 @default.
- W4380206392 hasRelatedWork W2979626747 @default.
- W4380206392 hasRelatedWork W3021857098 @default.
- W4380206392 hasRelatedWork W4306674287 @default.
- W4380206392 hasRelatedWork W4362598752 @default.
- W4380206392 isParatext "false" @default.
- W4380206392 isRetracted "false" @default.
- W4380206392 workType "article" @default.