Matches in SemOpenAlex for { <https://semopenalex.org/work/W2921763838> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W2921763838 abstract "Following the recent work on capacity allocation, we formulate the conjecture that the shattering problem in deep neural networks can only be avoided if the capacity propagation through layers has a non-degenerate continuous limit when the number of layers tends to infinity. This allows us to study a number of commonly used architectures and determine which scaling relations should be enforced in practice as the number of layers grows large. In particular, we recover the conditions of Xavier initialization in the multi-channel case, and we find that weights and biases should be scaled down as the inverse square root of the number of layers for deep residual networks and as the inverse square root of the desired memory length for recurrent networks." @default.
- W2921763838 created "2019-03-22" @default.
- W2921763838 creator A5048773916 @default.
- W2921763838 date "2019-03-11" @default.
- W2921763838 modified "2023-09-27" @default.
- W2921763838 title "Scaling up deep neural networks: a capacity allocation perspective" @default.
- W2921763838 cites W1533861849 @default.
- W2921763838 cites W2194775991 @default.
- W2921763838 cites W2519091744 @default.
- W2921763838 cites W2556967412 @default.
- W2921763838 cites W2904367110 @default.
- W2921763838 cites W2912030092 @default.
- W2921763838 cites W2928158086 @default.
- W2921763838 cites W2952626150 @default.
- W2921763838 hasPublicationYear "2019" @default.
- W2921763838 type Work @default.
- W2921763838 sameAs 2921763838 @default.
- W2921763838 citedByCount "0" @default.
- W2921763838 crossrefType "posted-content" @default.
- W2921763838 hasAuthorship W2921763838A5048773916 @default.
- W2921763838 hasConcept C11413529 @default.
- W2921763838 hasConcept C114466953 @default.
- W2921763838 hasConcept C11577676 @default.
- W2921763838 hasConcept C118615104 @default.
- W2921763838 hasConcept C126255220 @default.
- W2921763838 hasConcept C12713177 @default.
- W2921763838 hasConcept C134306372 @default.
- W2921763838 hasConcept C135692309 @default.
- W2921763838 hasConcept C151201525 @default.
- W2921763838 hasConcept C154945302 @default.
- W2921763838 hasConcept C155512373 @default.
- W2921763838 hasConcept C199360897 @default.
- W2921763838 hasConcept C207467116 @default.
- W2921763838 hasConcept C2524010 @default.
- W2921763838 hasConcept C2780990831 @default.
- W2921763838 hasConcept C28826006 @default.
- W2921763838 hasConcept C33923547 @default.
- W2921763838 hasConcept C41008148 @default.
- W2921763838 hasConcept C50644808 @default.
- W2921763838 hasConcept C7321624 @default.
- W2921763838 hasConcept C99844830 @default.
- W2921763838 hasConceptScore W2921763838C11413529 @default.
- W2921763838 hasConceptScore W2921763838C114466953 @default.
- W2921763838 hasConceptScore W2921763838C11577676 @default.
- W2921763838 hasConceptScore W2921763838C118615104 @default.
- W2921763838 hasConceptScore W2921763838C126255220 @default.
- W2921763838 hasConceptScore W2921763838C12713177 @default.
- W2921763838 hasConceptScore W2921763838C134306372 @default.
- W2921763838 hasConceptScore W2921763838C135692309 @default.
- W2921763838 hasConceptScore W2921763838C151201525 @default.
- W2921763838 hasConceptScore W2921763838C154945302 @default.
- W2921763838 hasConceptScore W2921763838C155512373 @default.
- W2921763838 hasConceptScore W2921763838C199360897 @default.
- W2921763838 hasConceptScore W2921763838C207467116 @default.
- W2921763838 hasConceptScore W2921763838C2524010 @default.
- W2921763838 hasConceptScore W2921763838C2780990831 @default.
- W2921763838 hasConceptScore W2921763838C28826006 @default.
- W2921763838 hasConceptScore W2921763838C33923547 @default.
- W2921763838 hasConceptScore W2921763838C41008148 @default.
- W2921763838 hasConceptScore W2921763838C50644808 @default.
- W2921763838 hasConceptScore W2921763838C7321624 @default.
- W2921763838 hasConceptScore W2921763838C99844830 @default.
- W2921763838 hasLocation W29217638381 @default.
- W2921763838 hasOpenAccess W2921763838 @default.
- W2921763838 hasPrimaryLocation W29217638381 @default.
- W2921763838 hasRelatedWork W1705588077 @default.
- W2921763838 hasRelatedWork W2118833474 @default.
- W2921763838 hasRelatedWork W2781204213 @default.
- W2921763838 hasRelatedWork W2900591790 @default.
- W2921763838 hasRelatedWork W2910114055 @default.
- W2921763838 hasRelatedWork W2910155483 @default.
- W2921763838 hasRelatedWork W2922277331 @default.
- W2921763838 hasRelatedWork W2947319091 @default.
- W2921763838 hasRelatedWork W2947328134 @default.
- W2921763838 hasRelatedWork W2959176742 @default.
- W2921763838 hasRelatedWork W2963674255 @default.
- W2921763838 hasRelatedWork W3037508544 @default.
- W2921763838 hasRelatedWork W3041499691 @default.
- W2921763838 hasRelatedWork W3125582976 @default.
- W2921763838 hasRelatedWork W3126161456 @default.
- W2921763838 hasRelatedWork W3172740255 @default.
- W2921763838 hasRelatedWork W3174067674 @default.
- W2921763838 hasRelatedWork W3183830840 @default.
- W2921763838 hasRelatedWork W3184374416 @default.
- W2921763838 hasRelatedWork W3031369584 @default.
- W2921763838 isParatext "false" @default.
- W2921763838 isRetracted "false" @default.
- W2921763838 magId "2921763838" @default.
- W2921763838 workType "article" @default.