FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3170244987> ?p ?o ?g. }

• W3170244987 abstract "Recent works have examined how deep neural networks, which can solve a variety of difficult problems, incorporate the statistics of training data to achieve their success. However, existing results have been established only in limited settings. In this work, we derive the layerwise weight dynamics of infinite-width neural networks with nonlinear activations trained by gradient descent. We show theoretically that weight updates are aligned with input correlations from intermediate layers weighted by error, and demonstrate empirically that the result also holds in finite-width wide networks. The alignment result allows us to formulate backpropagation-free learning rules, named Align-zero and Align-ada, that theoretically achieve the same alignment as backpropagation. Finally, we test these learning rules on benchmark problems in feedforward and recurrent neural networks and demonstrate, in wide networks, comparable performance to backpropagation." @default.
• W3170244987 created "2021-06-22" @default.
• W3170244987 creator A5032821156 @default.
• W3170244987 creator A5050777430 @default.
• W3170244987 date "2021-06-15" @default.
• W3170244987 modified "2023-09-27" @default.
• W3170244987 title "Gradient-trained Weights in Wide Neural Networks Align Layerwise to Error-scaled Input Correlations." @default.
• W3170244987 cites W1520121841 @default.
• W3170244987 cites W2041176801 @default.
• W3170244987 cites W2061897041 @default.
• W3170244987 cites W2117539524 @default.
• W3170244987 cites W2507556850 @default.
• W3170244987 cites W2552737632 @default.
• W3170244987 cites W2785626633 @default.
• W3170244987 cites W2809090039 @default.
• W3170244987 cites W2898365215 @default.
• W3170244987 cites W2902986194 @default.
• W3170244987 cites W2910655610 @default.
• W3170244987 cites W2917518595 @default.
• W3170244987 cites W2942810103 @default.
• W3170244987 cites W2949667497 @default.
• W3170244987 cites W2951401169 @default.
• W3170244987 cites W2952448932 @default.
• W3170244987 cites W2963337368 @default.
• W3170244987 cites W2964052793 @default.
• W3170244987 cites W2970935073 @default.
• W3170244987 cites W2971043187 @default.
• W3170244987 cites W2978368159 @default.
• W3170244987 cites W3043133474 @default.
• W3170244987 cites W3082258058 @default.
• W3170244987 cites W3101069636 @default.
• W3170244987 cites W3118608800 @default.
• W3170244987 cites W3127775241 @default.
• W3170244987 cites W3137695714 @default.
• W3170244987 cites W3181384422 @default.
• W3170244987 hasPublicationYear "2021" @default.
• W3170244987 type Work @default.
• W3170244987 sameAs 3170244987 @default.
• W3170244987 citedByCount "1" @default.
• W3170244987 countsByYear W31702449872021 @default.
• W3170244987 crossrefType "posted-content" @default.
• W3170244987 hasAuthorship W3170244987A5032821156 @default.
• W3170244987 hasAuthorship W3170244987A5050777430 @default.
• W3170244987 hasConcept C11413529 @default.
• W3170244987 hasConcept C119857082 @default.
• W3170244987 hasConcept C121332964 @default.
• W3170244987 hasConcept C127413603 @default.
• W3170244987 hasConcept C13280743 @default.
• W3170244987 hasConcept C133731056 @default.
• W3170244987 hasConcept C153258448 @default.
• W3170244987 hasConcept C154945302 @default.
• W3170244987 hasConcept C155032097 @default.
• W3170244987 hasConcept C158622935 @default.
• W3170244987 hasConcept C185798385 @default.
• W3170244987 hasConcept C205649164 @default.
• W3170244987 hasConcept C38858127 @default.
• W3170244987 hasConcept C41008148 @default.
• W3170244987 hasConcept C47702885 @default.
• W3170244987 hasConcept C50644808 @default.
• W3170244987 hasConcept C62520636 @default.
• W3170244987 hasConceptScore W3170244987C11413529 @default.
• W3170244987 hasConceptScore W3170244987C119857082 @default.
• W3170244987 hasConceptScore W3170244987C121332964 @default.
• W3170244987 hasConceptScore W3170244987C127413603 @default.
• W3170244987 hasConceptScore W3170244987C13280743 @default.
• W3170244987 hasConceptScore W3170244987C133731056 @default.
• W3170244987 hasConceptScore W3170244987C153258448 @default.
• W3170244987 hasConceptScore W3170244987C154945302 @default.
• W3170244987 hasConceptScore W3170244987C155032097 @default.
• W3170244987 hasConceptScore W3170244987C158622935 @default.
• W3170244987 hasConceptScore W3170244987C185798385 @default.
• W3170244987 hasConceptScore W3170244987C205649164 @default.
• W3170244987 hasConceptScore W3170244987C38858127 @default.
• W3170244987 hasConceptScore W3170244987C41008148 @default.
• W3170244987 hasConceptScore W3170244987C47702885 @default.
• W3170244987 hasConceptScore W3170244987C50644808 @default.
• W3170244987 hasConceptScore W3170244987C62520636 @default.
• W3170244987 hasLocation W31702449871 @default.
• W3170244987 hasOpenAccess W3170244987 @default.
• W3170244987 hasPrimaryLocation W31702449871 @default.
• W3170244987 hasRelatedWork W122801842 @default.
• W3170244987 hasRelatedWork W2130841312 @default.
• W3170244987 hasRelatedWork W2135719924 @default.
• W3170244987 hasRelatedWork W2161758346 @default.
• W3170244987 hasRelatedWork W2169923338 @default.
• W3170244987 hasRelatedWork W2218946286 @default.
• W3170244987 hasRelatedWork W2237132896 @default.
• W3170244987 hasRelatedWork W2413005285 @default.
• W3170244987 hasRelatedWork W2890311316 @default.
• W3170244987 hasRelatedWork W2892899012 @default.
• W3170244987 hasRelatedWork W2912648029 @default.
• W3170244987 hasRelatedWork W2914317573 @default.
• W3170244987 hasRelatedWork W2962998014 @default.
• W3170244987 hasRelatedWork W2993367001 @default.
• W3170244987 hasRelatedWork W3090180249 @default.
• W3170244987 hasRelatedWork W3098895240 @default.
• W3170244987 hasRelatedWork W3129819231 @default.
• W3170244987 hasRelatedWork W335810718 @default.
• W3170244987 hasRelatedWork W46764353 @default.
• W3170244987 hasRelatedWork W3022571137 @default.

• next