Matches in SemOpenAlex for { <https://semopenalex.org/work/W4294560781> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W4294560781 abstract "We prove new upper and lower bounds on the VC-dimension of deep neural networks with the ReLU activation function. These bounds are tight for almost the entire range of parameters. Letting $W$ be the number of weights and $L$ be the number of layers, we prove that the VC-dimension is $O(W L log(W))$, and provide examples with VC-dimension $Omega( W L log(W/L) )$. This improves both the previously known upper bounds and lower bounds. In terms of the number $U$ of non-linear units, we prove a tight bound $Theta(W U)$ on the VC-dimension. All of these bounds generalize to arbitrary piecewise linear activation functions, and also hold for the pseudodimensions of these function classes. Combined with previous results, this gives an intriguing range of dependencies of the VC-dimension on depth for networks with different non-linearities: there is no dependence for piecewise-constant, linear dependence for piecewise-linear, and no more than quadratic dependence for general piecewise-polynomial." @default.
- W4294560781 created "2022-09-04" @default.
- W4294560781 creator A5030261391 @default.
- W4294560781 creator A5047582694 @default.
- W4294560781 creator A5057585286 @default.
- W4294560781 creator A5089076722 @default.
- W4294560781 date "2017-03-08" @default.
- W4294560781 modified "2023-09-26" @default.
- W4294560781 title "Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks" @default.
- W4294560781 doi "https://doi.org/10.48550/arxiv.1703.02930" @default.
- W4294560781 hasPublicationYear "2017" @default.
- W4294560781 type Work @default.
- W4294560781 citedByCount "0" @default.
- W4294560781 crossrefType "posted-content" @default.
- W4294560781 hasAuthorship W4294560781A5030261391 @default.
- W4294560781 hasAuthorship W4294560781A5047582694 @default.
- W4294560781 hasAuthorship W4294560781A5057585286 @default.
- W4294560781 hasAuthorship W4294560781A5089076722 @default.
- W4294560781 hasBestOaLocation W42945607811 @default.
- W4294560781 hasConcept C114614502 @default.
- W4294560781 hasConcept C118615104 @default.
- W4294560781 hasConcept C119322782 @default.
- W4294560781 hasConcept C121332964 @default.
- W4294560781 hasConcept C129844170 @default.
- W4294560781 hasConcept C134306372 @default.
- W4294560781 hasConcept C14036430 @default.
- W4294560781 hasConcept C159985019 @default.
- W4294560781 hasConcept C164660894 @default.
- W4294560781 hasConcept C17095337 @default.
- W4294560781 hasConcept C192562407 @default.
- W4294560781 hasConcept C199360897 @default.
- W4294560781 hasConcept C204323151 @default.
- W4294560781 hasConcept C2524010 @default.
- W4294560781 hasConcept C2777027219 @default.
- W4294560781 hasConcept C2779557605 @default.
- W4294560781 hasConcept C33676613 @default.
- W4294560781 hasConcept C33923547 @default.
- W4294560781 hasConcept C41008148 @default.
- W4294560781 hasConcept C62520636 @default.
- W4294560781 hasConcept C77553402 @default.
- W4294560781 hasConcept C78458016 @default.
- W4294560781 hasConcept C86803240 @default.
- W4294560781 hasConcept C90119067 @default.
- W4294560781 hasConceptScore W4294560781C114614502 @default.
- W4294560781 hasConceptScore W4294560781C118615104 @default.
- W4294560781 hasConceptScore W4294560781C119322782 @default.
- W4294560781 hasConceptScore W4294560781C121332964 @default.
- W4294560781 hasConceptScore W4294560781C129844170 @default.
- W4294560781 hasConceptScore W4294560781C134306372 @default.
- W4294560781 hasConceptScore W4294560781C14036430 @default.
- W4294560781 hasConceptScore W4294560781C159985019 @default.
- W4294560781 hasConceptScore W4294560781C164660894 @default.
- W4294560781 hasConceptScore W4294560781C17095337 @default.
- W4294560781 hasConceptScore W4294560781C192562407 @default.
- W4294560781 hasConceptScore W4294560781C199360897 @default.
- W4294560781 hasConceptScore W4294560781C204323151 @default.
- W4294560781 hasConceptScore W4294560781C2524010 @default.
- W4294560781 hasConceptScore W4294560781C2777027219 @default.
- W4294560781 hasConceptScore W4294560781C2779557605 @default.
- W4294560781 hasConceptScore W4294560781C33676613 @default.
- W4294560781 hasConceptScore W4294560781C33923547 @default.
- W4294560781 hasConceptScore W4294560781C41008148 @default.
- W4294560781 hasConceptScore W4294560781C62520636 @default.
- W4294560781 hasConceptScore W4294560781C77553402 @default.
- W4294560781 hasConceptScore W4294560781C78458016 @default.
- W4294560781 hasConceptScore W4294560781C86803240 @default.
- W4294560781 hasConceptScore W4294560781C90119067 @default.
- W4294560781 hasLocation W42945607811 @default.
- W4294560781 hasOpenAccess W4294560781 @default.
- W4294560781 hasPrimaryLocation W42945607811 @default.
- W4294560781 hasRelatedWork W2017621581 @default.
- W4294560781 hasRelatedWork W2115881141 @default.
- W4294560781 hasRelatedWork W2154946043 @default.
- W4294560781 hasRelatedWork W2370489162 @default.
- W4294560781 hasRelatedWork W2596625124 @default.
- W4294560781 hasRelatedWork W2800415562 @default.
- W4294560781 hasRelatedWork W2952127252 @default.
- W4294560781 hasRelatedWork W2963241012 @default.
- W4294560781 hasRelatedWork W4294560781 @default.
- W4294560781 hasRelatedWork W1592122239 @default.
- W4294560781 isParatext "false" @default.
- W4294560781 isRetracted "false" @default.
- W4294560781 workType "article" @default.