FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3037853434> ?p ?o ?g. }

• W3037853434 abstract "We present the Supermasks in Superposition (SupSup) model, capable of sequentially learning thousands of tasks without catastrophic forgetting. Our approach uses a randomly initialized, fixed base network and for each task finds a subnetwork (supermask) that achieves good performance. If task identity is given at test time, the correct subnetwork can be retrieved with minimal memory usage. If not provided, SupSup can infer the task using gradient-based optimization to find a linear superposition of learned supermasks which minimizes the output entropy. In practice we find that a single gradient step is often sufficient to identify the correct mask, even among 2500 tasks. We also showcase two promising extensions. First, SupSup models can be trained entirely without task identity information, as they may detect when they are uncertain about new data and allocate an additional supermask for the new training distribution. Finally the entire, growing set of supermasks can be stored in a constant-sized reservoir by implicitly storing them as attractors in a fixed-sized Hopfield network." @default.
• W3037853434 created "2020-07-02" @default.
• W3037853434 creator A5001590363 @default.
• W3037853434 creator A5018421415 @default.
• W3037853434 creator A5026171268 @default.
• W3037853434 creator A5049659753 @default.
• W3037853434 creator A5056246621 @default.
• W3037853434 creator A5060895155 @default.
• W3037853434 creator A5062174486 @default.
• W3037853434 date "2020-06-26" @default.
• W3037853434 modified "2023-09-27" @default.
• W3037853434 title "Supermasks in Superposition" @default.
• W3037853434 cites W12277440 @default.
• W3037853434 cites W1522301498 @default.
• W3037853434 cites W1677182931 @default.
• W3037853434 cites W1682403713 @default.
• W3037853434 cites W1841080724 @default.
• W3037853434 cites W2060277733 @default.
• W3037853434 cites W2108598243 @default.
• W3037853434 cites W2113839990 @default.
• W3037853434 cites W2126204609 @default.
• W3037853434 cites W2128084896 @default.
• W3037853434 cites W2136885855 @default.
• W3037853434 cites W2147800946 @default.
• W3037853434 cites W2167967601 @default.
• W3037853434 cites W2194775991 @default.
• W3037853434 cites W2556206701 @default.
• W3037853434 cites W2560647685 @default.
• W3037853434 cites W2737492962 @default.
• W3037853434 cites W2744654301 @default.
• W3037853434 cites W2767286248 @default.
• W3037853434 cites W2787295326 @default.
• W3037853434 cites W2788481061 @default.
• W3037853434 cites W2791091755 @default.
• W3037853434 cites W2805003733 @default.
• W3037853434 cites W2902417425 @default.
• W3037853434 cites W2922466325 @default.
• W3037853434 cites W2939137134 @default.
• W3037853434 cites W2949117887 @default.
• W3037853434 cites W2952053192 @default.
• W3037853434 cites W2952677972 @default.
• W3037853434 cites W2956434358 @default.
• W3037853434 cites W2962724315 @default.
• W3037853434 cites W2963072899 @default.
• W3037853434 cites W2963559848 @default.
• W3037853434 cites W2964088867 @default.
• W3037853434 cites W2964189064 @default.
• W3037853434 cites W2964212410 @default.
• W3037853434 cites W2964309400 @default.
• W3037853434 cites W2970586779 @default.
• W3037853434 cites W2970971581 @default.
• W3037853434 cites W2971246930 @default.
• W3037853434 cites W2987283559 @default.
• W3037853434 cites W2990461664 @default.
• W3037853434 cites W2994434574 @default.
• W3037853434 cites W2996144997 @default.
• W3037853434 cites W3004334800 @default.
• W3037853434 cites W3005861412 @default.
• W3037853434 cites W3007700590 @default.
• W3037853434 cites W3100279624 @default.
• W3037853434 cites W3118608800 @default.
• W3037853434 cites W2426267443 @default.
• W3037853434 hasPublicationYear "2020" @default.
• W3037853434 type Work @default.
• W3037853434 sameAs 3037853434 @default.
• W3037853434 citedByCount "7" @default.
• W3037853434 countsByYear W30378534342020 @default.
• W3037853434 countsByYear W30378534342021 @default.
• W3037853434 crossrefType "posted-content" @default.
• W3037853434 hasAuthorship W3037853434A5001590363 @default.
• W3037853434 hasAuthorship W3037853434A5018421415 @default.
• W3037853434 hasAuthorship W3037853434A5026171268 @default.
• W3037853434 hasAuthorship W3037853434A5049659753 @default.
• W3037853434 hasAuthorship W3037853434A5056246621 @default.
• W3037853434 hasAuthorship W3037853434A5060895155 @default.
• W3037853434 hasAuthorship W3037853434A5062174486 @default.
• W3037853434 hasConcept C11413529 @default.
• W3037853434 hasConcept C121332964 @default.
• W3037853434 hasConcept C134306372 @default.
• W3037853434 hasConcept C138885662 @default.
• W3037853434 hasConcept C154945302 @default.
• W3037853434 hasConcept C162324750 @default.
• W3037853434 hasConcept C177264268 @default.
• W3037853434 hasConcept C187736073 @default.
• W3037853434 hasConcept C199360897 @default.
• W3037853434 hasConcept C24890656 @default.
• W3037853434 hasConcept C27753989 @default.
• W3037853434 hasConcept C2778355321 @default.
• W3037853434 hasConcept C2780186347 @default.
• W3037853434 hasConcept C2780451532 @default.
• W3037853434 hasConcept C31258907 @default.
• W3037853434 hasConcept C33923547 @default.
• W3037853434 hasConcept C41008148 @default.
• W3037853434 hasConcept C41895202 @default.
• W3037853434 hasConcept C46421273 @default.
• W3037853434 hasConcept C50644808 @default.
• W3037853434 hasConcept C7149132 @default.
• W3037853434 hasConcept C80444323 @default.
• W3037853434 hasConceptScore W3037853434C11413529 @default.
• W3037853434 hasConceptScore W3037853434C121332964 @default.

• next