Matches in SemOpenAlex for { <https://semopenalex.org/work/W3119471704> ?p ?o ?g. }
- W3119471704 abstract "Infinite width limits of deep neural networks often have tractable forms. They have been used to analyse the behaviour of finite networks, as well as being useful methods in their own right. When investigating infinitely wide convolutional neural networks (CNNs), it was observed that the correlations arising from spatial weight sharing disappear in the infinite limit. This is undesirable, as spatial correlation is the main motivation behind CNNs. We show that the loss of this property is not a consequence of the infinite limit, but rather of choosing an independent weight prior. Correlating the weights maintains the correlations in the activations. Varying the amount of correlation interpolates between independent-weight limits and mean-pooling. Empirical evaluation of the infinitely wide network shows that optimal performance is achieved between the extremes, indicating that correlations can be useful." @default.
- W3119471704 created "2021-01-18" @default.
- W3119471704 creator A5030860008 @default.
- W3119471704 creator A5044945258 @default.
- W3119471704 date "2021-01-11" @default.
- W3119471704 modified "2023-09-27" @default.
- W3119471704 title "Correlated Weights in Infinite Limits of Deep Convolutional Neural Networks" @default.
- W3119471704 cites W1493856275 @default.
- W3119471704 cites W169539560 @default.
- W3119471704 cites W1746819321 @default.
- W3119471704 cites W2065274576 @default.
- W3119471704 cites W2123872146 @default.
- W3119471704 cites W2130283669 @default.
- W3119471704 cites W2154087390 @default.
- W3119471704 cites W2161767008 @default.
- W3119471704 cites W2167608136 @default.
- W3119471704 cites W2212676342 @default.
- W3119471704 cites W2557283755 @default.
- W3119471704 cites W2809090039 @default.
- W3119471704 cites W2910655610 @default.
- W3119471704 cites W2912279788 @default.
- W3119471704 cites W2951897614 @default.
- W3119471704 cites W2962685794 @default.
- W3119471704 cites W2962731272 @default.
- W3119471704 cites W2962804662 @default.
- W3119471704 cites W2962941879 @default.
- W3119471704 cites W2963323437 @default.
- W3119471704 cites W2964052793 @default.
- W3119471704 cites W2970889419 @default.
- W3119471704 cites W2971043187 @default.
- W3119471704 cites W2994747787 @default.
- W3119471704 cites W2994872659 @default.
- W3119471704 cites W3010154184 @default.
- W3119471704 cites W3035433747 @default.
- W3119471704 cites W3037333676 @default.
- W3119471704 cites W14377099 @default.
- W3119471704 hasPublicationYear "2021" @default.
- W3119471704 type Work @default.
- W3119471704 sameAs 3119471704 @default.
- W3119471704 citedByCount "2" @default.
- W3119471704 countsByYear W31194717042021 @default.
- W3119471704 crossrefType "posted-content" @default.
- W3119471704 hasAuthorship W3119471704A5030860008 @default.
- W3119471704 hasAuthorship W3119471704A5044945258 @default.
- W3119471704 hasConcept C111472728 @default.
- W3119471704 hasConcept C11413529 @default.
- W3119471704 hasConcept C117220453 @default.
- W3119471704 hasConcept C134306372 @default.
- W3119471704 hasConcept C138885662 @default.
- W3119471704 hasConcept C151201525 @default.
- W3119471704 hasConcept C153180895 @default.
- W3119471704 hasConcept C154945302 @default.
- W3119471704 hasConcept C189950617 @default.
- W3119471704 hasConcept C2524010 @default.
- W3119471704 hasConcept C33923547 @default.
- W3119471704 hasConcept C41008148 @default.
- W3119471704 hasConcept C50644808 @default.
- W3119471704 hasConcept C70437156 @default.
- W3119471704 hasConcept C81363708 @default.
- W3119471704 hasConceptScore W3119471704C111472728 @default.
- W3119471704 hasConceptScore W3119471704C11413529 @default.
- W3119471704 hasConceptScore W3119471704C117220453 @default.
- W3119471704 hasConceptScore W3119471704C134306372 @default.
- W3119471704 hasConceptScore W3119471704C138885662 @default.
- W3119471704 hasConceptScore W3119471704C151201525 @default.
- W3119471704 hasConceptScore W3119471704C153180895 @default.
- W3119471704 hasConceptScore W3119471704C154945302 @default.
- W3119471704 hasConceptScore W3119471704C189950617 @default.
- W3119471704 hasConceptScore W3119471704C2524010 @default.
- W3119471704 hasConceptScore W3119471704C33923547 @default.
- W3119471704 hasConceptScore W3119471704C41008148 @default.
- W3119471704 hasConceptScore W3119471704C50644808 @default.
- W3119471704 hasConceptScore W3119471704C70437156 @default.
- W3119471704 hasConceptScore W3119471704C81363708 @default.
- W3119471704 hasLocation W31194717041 @default.
- W3119471704 hasOpenAccess W3119471704 @default.
- W3119471704 hasPrimaryLocation W31194717041 @default.
- W3119471704 hasRelatedWork W2154087390 @default.
- W3119471704 hasRelatedWork W2573520116 @default.
- W3119471704 hasRelatedWork W2787696442 @default.
- W3119471704 hasRelatedWork W2809468328 @default.
- W3119471704 hasRelatedWork W2811254153 @default.
- W3119471704 hasRelatedWork W2889737445 @default.
- W3119471704 hasRelatedWork W2950618860 @default.
- W3119471704 hasRelatedWork W2958880144 @default.
- W3119471704 hasRelatedWork W2963008124 @default.
- W3119471704 hasRelatedWork W2963097630 @default.
- W3119471704 hasRelatedWork W2970769658 @default.
- W3119471704 hasRelatedWork W2995100839 @default.
- W3119471704 hasRelatedWork W2998636660 @default.
- W3119471704 hasRelatedWork W3008036111 @default.
- W3119471704 hasRelatedWork W3008104080 @default.
- W3119471704 hasRelatedWork W3094965745 @default.
- W3119471704 hasRelatedWork W3135796249 @default.
- W3119471704 hasRelatedWork W3165175542 @default.
- W3119471704 hasRelatedWork W3174558417 @default.
- W3119471704 hasRelatedWork W3191292730 @default.
- W3119471704 isParatext "false" @default.
- W3119471704 isRetracted "false" @default.
- W3119471704 magId "3119471704" @default.