Matches in SemOpenAlex for { <https://semopenalex.org/work/W3152651027> ?p ?o ?g. }
- W3152651027 abstract "Multimodal representations and continual learning are two areas closely related to human intelligence. The former considers the learning of shared representation spaces where information from different modalities can be compared and integrated (we focus on cross-modal retrieval between language and visual representations). The latter studies how to prevent forgetting a previously learned task when learning a new one. While humans excel in these two aspects, deep neural networks are still quite limited. In this paper, we propose a combination of both problems into a continual cross-modal retrieval setting, where we study how the catastrophic interference caused by new tasks impacts the embedding spaces and their cross-modal alignment required for effective retrieval. We propose a general framework that decouples the training, indexing and querying stages. We also identify and study different factors that may lead to forgetting, and propose tools to alleviate it. We found that the indexing stage pays an important role and that simply avoiding reindexing the database with updated embedding networks can lead to significant gains. We evaluated our methods in two image-text retrieval datasets, obtaining significant gains with respect to the fine tuning baseline." @default.
- W3152651027 created "2021-04-26" @default.
- W3152651027 creator A5073531557 @default.
- W3152651027 creator A5079201773 @default.
- W3152651027 creator A5081872084 @default.
- W3152651027 date "2021-04-14" @default.
- W3152651027 modified "2023-09-27" @default.
- W3152651027 title "Continual learning in cross-modal retrieval." @default.
- W3152651027 cites W1522301498 @default.
- W3152651027 cites W1523385540 @default.
- W3152651027 cites W1527575280 @default.
- W3152651027 cites W1682403713 @default.
- W3152651027 cites W1821462560 @default.
- W3152651027 cites W1861492603 @default.
- W3152651027 cites W1869500417 @default.
- W3152651027 cites W1883346539 @default.
- W3152651027 cites W1931795219 @default.
- W3152651027 cites W1964073652 @default.
- W3152651027 cites W1970055505 @default.
- W3152651027 cites W1997460147 @default.
- W3152651027 cites W2025341678 @default.
- W3152651027 cites W2061524864 @default.
- W3152651027 cites W21006490 @default.
- W3152651027 cites W2116522068 @default.
- W3152651027 cites W2121949863 @default.
- W3152651027 cites W2127589108 @default.
- W3152651027 cites W2138621090 @default.
- W3152651027 cites W2149557440 @default.
- W3152651027 cites W2187089797 @default.
- W3152651027 cites W2266728343 @default.
- W3152651027 cites W2277195237 @default.
- W3152651027 cites W2340690086 @default.
- W3152651027 cites W2388114291 @default.
- W3152651027 cites W2473930607 @default.
- W3152651027 cites W2520774990 @default.
- W3152651027 cites W2560647685 @default.
- W3152651027 cites W2562417371 @default.
- W3152651027 cites W2564591810 @default.
- W3152651027 cites W2605102252 @default.
- W3152651027 cites W2606372327 @default.
- W3152651027 cites W2606473278 @default.
- W3152651027 cites W2608460891 @default.
- W3152651027 cites W2619383789 @default.
- W3152651027 cites W2619508703 @default.
- W3152651027 cites W2737041163 @default.
- W3152651027 cites W2737492962 @default.
- W3152651027 cites W2744654301 @default.
- W3152651027 cites W2765101016 @default.
- W3152651027 cites W2782276075 @default.
- W3152651027 cites W2891707612 @default.
- W3152651027 cites W2963026686 @default.
- W3152651027 cites W2963047368 @default.
- W3152651027 cites W2963559848 @default.
- W3152651027 cites W2963588172 @default.
- W3152651027 cites W2963775347 @default.
- W3152651027 cites W2963788399 @default.
- W3152651027 cites W2963850662 @default.
- W3152651027 cites W2963975576 @default.
- W3152651027 cites W2964024144 @default.
- W3152651027 cites W2964093801 @default.
- W3152651027 cites W2964189064 @default.
- W3152651027 cites W3002497460 @default.
- W3152651027 cites W3033665206 @default.
- W3152651027 cites W3034655362 @default.
- W3152651027 cites W3035160838 @default.
- W3152651027 cites W3035212740 @default.
- W3152651027 cites W3035284526 @default.
- W3152651027 cites W3035400313 @default.
- W3152651027 cites W3035454331 @default.
- W3152651027 cites W3035497460 @default.
- W3152651027 cites W3035501943 @default.
- W3152651027 cites W3035517717 @default.
- W3152651027 cites W3035644209 @default.
- W3152651027 cites W3037765293 @default.
- W3152651027 cites W3041113823 @default.
- W3152651027 cites W3103800629 @default.
- W3152651027 cites W3119064788 @default.
- W3152651027 cites W3153660122 @default.
- W3152651027 cites W3163939464 @default.
- W3152651027 cites W877909479 @default.
- W3152651027 cites W92662927 @default.
- W3152651027 cites W2426267443 @default.
- W3152651027 hasPublicationYear "2021" @default.
- W3152651027 type Work @default.
- W3152651027 sameAs 3152651027 @default.
- W3152651027 citedByCount "0" @default.
- W3152651027 crossrefType "posted-content" @default.
- W3152651027 hasAuthorship W3152651027A5073531557 @default.
- W3152651027 hasAuthorship W3152651027A5079201773 @default.
- W3152651027 hasAuthorship W3152651027A5081872084 @default.
- W3152651027 hasConcept C108583219 @default.
- W3152651027 hasConcept C119857082 @default.
- W3152651027 hasConcept C120665830 @default.
- W3152651027 hasConcept C121332964 @default.
- W3152651027 hasConcept C138885662 @default.
- W3152651027 hasConcept C144024400 @default.
- W3152651027 hasConcept C154945302 @default.
- W3152651027 hasConcept C162324750 @default.
- W3152651027 hasConcept C17744445 @default.
- W3152651027 hasConcept C185592680 @default.