FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3111133652> ?p ?o ?g. }

• W3111133652 abstract "Events in the real world are correlated across nearby points in time, and we must learn from this temporally “smooth” data. However, when neural networks are trained to categorize or reconstruct single items, the common practice is to randomize the order of training items. What are the effects of temporally smooth training data on the efficiency of learning? We first tested the effects of smoothness in training data on incremental learning in feedforward nets and found that smoother data slowed learning. Moreover, sampling so as to minimize temporal smoothness produced more efficient learning than sampling randomly. If smoothness generally impairs incremental learning, then how can networks be modified to benefit from smoothness in the training data? We hypothesized that two simple brain-inspired mechanisms -- leaky memory in activation units and memory-gating -- could enable networks to exploit the redundancies in smooth data. Across all levels of data smoothness, these brain-inspired architectures achieved more efficient category learning than feedforward networks. Finally, we investigated how these brain-inspired mechanisms altered the internal representations learned by the networks. We found that networks with multi-scale leaky memory and memory-gating could learn internal representations that “un-mixed” data sources which vary on fast and slow timescales across training samples. Altogether, we identified simple mechanisms enabling neural networks to learn more quickly from temporally smooth data, and to generate internal representations that separate timescales in the training signal." @default.
• W3111133652 created "2020-12-21" @default.
• W3111133652 creator A5019919905 @default.
• W3111133652 creator A5037309858 @default.
• W3111133652 creator A5060098545 @default.
• W3111133652 date "2021-05-04" @default.
• W3111133652 modified "2023-09-23" @default.
• W3111133652 title "Learning representations from temporally smooth data" @default.
• W3111133652 cites W1533861849 @default.
• W3111133652 cites W1780272748 @default.
• W3111133652 cites W1855112655 @default.
• W3111133652 cites W2020051759 @default.
• W3111133652 cites W2060277733 @default.
• W3111133652 cites W2066835186 @default.
• W3111133652 cites W2104384154 @default.
• W3111133652 cites W2128499899 @default.
• W3111133652 cites W2132984949 @default.
• W3111133652 cites W2139630667 @default.
• W3111133652 cites W2146444479 @default.
• W3111133652 cites W2151834591 @default.
• W3111133652 cites W2152009360 @default.
• W3111133652 cites W2156689847 @default.
• W3111133652 cites W2158951270 @default.
• W3111133652 cites W2252143850 @default.
• W3111133652 cites W2296073425 @default.
• W3111133652 cites W2523246573 @default.
• W3111133652 cites W2750384547 @default.
• W3111133652 cites W2750869205 @default.
• W3111133652 cites W2752295241 @default.
• W3111133652 cites W2753248866 @default.
• W3111133652 cites W2922004937 @default.
• W3111133652 cites W2941161300 @default.
• W3111133652 cites W2944546415 @default.
• W3111133652 cites W2950457889 @default.
• W3111133652 cites W2970971581 @default.
• W3111133652 cites W3012102178 @default.
• W3111133652 cites W3028938632 @default.
• W3111133652 cites W3039049025 @default.
• W3111133652 cites W3047556643 @default.
• W3111133652 cites W3048423161 @default.
• W3111133652 cites W3097816393 @default.
• W3111133652 cites W3098692095 @default.
• W3111133652 hasPublicationYear "2021" @default.
• W3111133652 type Work @default.
• W3111133652 sameAs 3111133652 @default.
• W3111133652 citedByCount "0" @default.
• W3111133652 crossrefType "journal-article" @default.
• W3111133652 hasAuthorship W3111133652A5019919905 @default.
• W3111133652 hasAuthorship W3111133652A5037309858 @default.
• W3111133652 hasAuthorship W3111133652A5060098545 @default.
• W3111133652 hasConcept C102634674 @default.
• W3111133652 hasConcept C106131492 @default.
• W3111133652 hasConcept C119857082 @default.
• W3111133652 hasConcept C127413603 @default.
• W3111133652 hasConcept C133731056 @default.
• W3111133652 hasConcept C134306372 @default.
• W3111133652 hasConcept C140779682 @default.
• W3111133652 hasConcept C153180895 @default.
• W3111133652 hasConcept C154945302 @default.
• W3111133652 hasConcept C165696696 @default.
• W3111133652 hasConcept C31972630 @default.
• W3111133652 hasConcept C33923547 @default.
• W3111133652 hasConcept C38652104 @default.
• W3111133652 hasConcept C38858127 @default.
• W3111133652 hasConcept C41008148 @default.
• W3111133652 hasConcept C50644808 @default.
• W3111133652 hasConcept C94124525 @default.
• W3111133652 hasConceptScore W3111133652C102634674 @default.
• W3111133652 hasConceptScore W3111133652C106131492 @default.
• W3111133652 hasConceptScore W3111133652C119857082 @default.
• W3111133652 hasConceptScore W3111133652C127413603 @default.
• W3111133652 hasConceptScore W3111133652C133731056 @default.
• W3111133652 hasConceptScore W3111133652C134306372 @default.
• W3111133652 hasConceptScore W3111133652C140779682 @default.
• W3111133652 hasConceptScore W3111133652C153180895 @default.
• W3111133652 hasConceptScore W3111133652C154945302 @default.
• W3111133652 hasConceptScore W3111133652C165696696 @default.
• W3111133652 hasConceptScore W3111133652C31972630 @default.
• W3111133652 hasConceptScore W3111133652C33923547 @default.
• W3111133652 hasConceptScore W3111133652C38652104 @default.
• W3111133652 hasConceptScore W3111133652C38858127 @default.
• W3111133652 hasConceptScore W3111133652C41008148 @default.
• W3111133652 hasConceptScore W3111133652C50644808 @default.
• W3111133652 hasConceptScore W3111133652C94124525 @default.
• W3111133652 hasOpenAccess W3111133652 @default.
• W3111133652 hasRelatedWork W2119828147 @default.
• W3111133652 hasRelatedWork W2128367023 @default.
• W3111133652 hasRelatedWork W2181328046 @default.
• W3111133652 hasRelatedWork W2210787820 @default.
• W3111133652 hasRelatedWork W2219376140 @default.
• W3111133652 hasRelatedWork W2336061657 @default.
• W3111133652 hasRelatedWork W2527459149 @default.
• W3111133652 hasRelatedWork W2589532588 @default.
• W3111133652 hasRelatedWork W2626740116 @default.
• W3111133652 hasRelatedWork W2789667046 @default.
• W3111133652 hasRelatedWork W2903443033 @default.
• W3111133652 hasRelatedWork W2910069423 @default.
• W3111133652 hasRelatedWork W2955395817 @default.
• W3111133652 hasRelatedWork W3022218535 @default.
• W3111133652 hasRelatedWork W3087227179 @default.

• next