Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387561025> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W4387561025 abstract "Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified the severe performance decrease on analogous classes as a key factor for catastrophic forgetting. In this paper, through an in-depth exploration of the representation learning process in CL, we discover that the compression effect of the information bottleneck leads to confusion on analogous classes. To enable the model learn more sufficient representations, we propose a novel replay-based continual text classification method, InfoCL. Our approach utilizes fast-slow and current-past contrastive learning to perform mutual information maximization and better recover the previously learned representations. In addition, InfoCL incorporates an adversarial memory augmentation strategy to alleviate the overfitting problem of replay. Experimental results demonstrate that InfoCL effectively mitigates forgetting and achieves state-of-the-art performance on three text classification tasks. The code is publicly available at https://github.com/Yifan-Song793/InfoCL." @default.
- W4387561025 created "2023-10-12" @default.
- W4387561025 creator A5007956930 @default.
- W4387561025 creator A5038032242 @default.
- W4387561025 creator A5039534961 @default.
- W4387561025 creator A5058353424 @default.
- W4387561025 creator A5058808692 @default.
- W4387561025 creator A5065232236 @default.
- W4387561025 creator A5090622915 @default.
- W4387561025 date "2023-10-10" @default.
- W4387561025 modified "2023-10-13" @default.
- W4387561025 title "InfoCL: Alleviating Catastrophic Forgetting in Continual Text Classification from An Information Theoretic Perspective" @default.
- W4387561025 doi "https://doi.org/10.48550/arxiv.2310.06362" @default.
- W4387561025 hasPublicationYear "2023" @default.
- W4387561025 type Work @default.
- W4387561025 citedByCount "0" @default.
- W4387561025 crossrefType "posted-content" @default.
- W4387561025 hasAuthorship W4387561025A5007956930 @default.
- W4387561025 hasAuthorship W4387561025A5038032242 @default.
- W4387561025 hasAuthorship W4387561025A5039534961 @default.
- W4387561025 hasAuthorship W4387561025A5058353424 @default.
- W4387561025 hasAuthorship W4387561025A5058808692 @default.
- W4387561025 hasAuthorship W4387561025A5065232236 @default.
- W4387561025 hasAuthorship W4387561025A5090622915 @default.
- W4387561025 hasBestOaLocation W43875610251 @default.
- W4387561025 hasConcept C111919701 @default.
- W4387561025 hasConcept C119857082 @default.
- W4387561025 hasConcept C12713177 @default.
- W4387561025 hasConcept C149635348 @default.
- W4387561025 hasConcept C152139883 @default.
- W4387561025 hasConcept C154945302 @default.
- W4387561025 hasConcept C15744967 @default.
- W4387561025 hasConcept C177264268 @default.
- W4387561025 hasConcept C180747234 @default.
- W4387561025 hasConcept C199360897 @default.
- W4387561025 hasConcept C22019652 @default.
- W4387561025 hasConcept C26517878 @default.
- W4387561025 hasConcept C2776760102 @default.
- W4387561025 hasConcept C2777212361 @default.
- W4387561025 hasConcept C2780513914 @default.
- W4387561025 hasConcept C38652104 @default.
- W4387561025 hasConcept C41008148 @default.
- W4387561025 hasConcept C50644808 @default.
- W4387561025 hasConcept C60008888 @default.
- W4387561025 hasConcept C7149132 @default.
- W4387561025 hasConcept C98045186 @default.
- W4387561025 hasConceptScore W4387561025C111919701 @default.
- W4387561025 hasConceptScore W4387561025C119857082 @default.
- W4387561025 hasConceptScore W4387561025C12713177 @default.
- W4387561025 hasConceptScore W4387561025C149635348 @default.
- W4387561025 hasConceptScore W4387561025C152139883 @default.
- W4387561025 hasConceptScore W4387561025C154945302 @default.
- W4387561025 hasConceptScore W4387561025C15744967 @default.
- W4387561025 hasConceptScore W4387561025C177264268 @default.
- W4387561025 hasConceptScore W4387561025C180747234 @default.
- W4387561025 hasConceptScore W4387561025C199360897 @default.
- W4387561025 hasConceptScore W4387561025C22019652 @default.
- W4387561025 hasConceptScore W4387561025C26517878 @default.
- W4387561025 hasConceptScore W4387561025C2776760102 @default.
- W4387561025 hasConceptScore W4387561025C2777212361 @default.
- W4387561025 hasConceptScore W4387561025C2780513914 @default.
- W4387561025 hasConceptScore W4387561025C38652104 @default.
- W4387561025 hasConceptScore W4387561025C41008148 @default.
- W4387561025 hasConceptScore W4387561025C50644808 @default.
- W4387561025 hasConceptScore W4387561025C60008888 @default.
- W4387561025 hasConceptScore W4387561025C7149132 @default.
- W4387561025 hasConceptScore W4387561025C98045186 @default.
- W4387561025 hasLocation W43875610251 @default.
- W4387561025 hasOpenAccess W4387561025 @default.
- W4387561025 hasPrimaryLocation W43875610251 @default.
- W4387561025 hasRelatedWork W1504394672 @default.
- W4387561025 hasRelatedWork W2304083841 @default.
- W4387561025 hasRelatedWork W2362448732 @default.
- W4387561025 hasRelatedWork W2622284819 @default.
- W4387561025 hasRelatedWork W2741297526 @default.
- W4387561025 hasRelatedWork W3034190530 @default.
- W4387561025 hasRelatedWork W3089381707 @default.
- W4387561025 hasRelatedWork W3129794609 @default.
- W4387561025 hasRelatedWork W4283080061 @default.
- W4387561025 hasRelatedWork W4285254085 @default.
- W4387561025 isParatext "false" @default.
- W4387561025 isRetracted "false" @default.
- W4387561025 workType "article" @default.