Matches in SemOpenAlex for { <https://semopenalex.org/work/W2806891045> ?p ?o ?g. }
- W2806891045 abstract "We present a framework to derive upper bounds on the number of regions that feed-forward neural networks with ReLU activation functions are affine linear on. It is based on an inductive analysis that keeps track of the number of such regions per dimensionality of their images within the layers. More precisely, the information about the number regions per dimensionality is pushed through the layers starting with one region of the input dimension of the neural network and using a recursion based on an analysis of how many regions per output dimensionality a subsequent layer with a certain width can induce on an input region with a given dimensionality. The final bound on the number of regions depends on the number and widths of the layers of the neural network and on some additional parameters that were used for the recursion. It is stated in terms of the $L1$-norm of the last column of a product of matrices and provides a unifying treatment of several previously known bounds: Depending on the choice of the recursion parameters that determine these matrices, it is possible to obtain the bounds from Montufar (2014), (2017) and Serra et. al. (2017) as special cases. For the latter, which is the strongest of these bounds, the formulation in terms of matrices provides new insight. In particular, by using explicit formulas for a Jordan-like decomposition of the involved matrices, we achieve new tighter results for the asymptotic setting, where the number of layers of the same fixed width tends to infinity." @default.
- W2806891045 created "2018-06-13" @default.
- W2806891045 creator A5033661683 @default.
- W2806891045 creator A5072024304 @default.
- W2806891045 date "2018-06-05" @default.
- W2806891045 modified "2023-09-27" @default.
- W2806891045 title "A Framework for the construction of upper bounds on the number of affine linear regions of ReLU feed-forward neural networks" @default.
- W2806891045 cites W2039415399 @default.
- W2806891045 cites W2161388792 @default.
- W2806891045 cites W2767609493 @default.
- W2806891045 cites W2963982496 @default.
- W2806891045 cites W2964137095 @default.
- W2806891045 cites W3187217851 @default.
- W2806891045 cites W391985582 @default.
- W2806891045 cites W917503 @default.
- W2806891045 hasPublicationYear "2018" @default.
- W2806891045 type Work @default.
- W2806891045 sameAs 2806891045 @default.
- W2806891045 citedByCount "1" @default.
- W2806891045 countsByYear W28068910452020 @default.
- W2806891045 crossrefType "posted-content" @default.
- W2806891045 hasAuthorship W2806891045A5033661683 @default.
- W2806891045 hasAuthorship W2806891045A5072024304 @default.
- W2806891045 hasConcept C105795698 @default.
- W2806891045 hasConcept C111030470 @default.
- W2806891045 hasConcept C11413529 @default.
- W2806891045 hasConcept C114614502 @default.
- W2806891045 hasConcept C118615104 @default.
- W2806891045 hasConcept C121332964 @default.
- W2806891045 hasConcept C13355873 @default.
- W2806891045 hasConcept C134306372 @default.
- W2806891045 hasConcept C154945302 @default.
- W2806891045 hasConcept C168773036 @default.
- W2806891045 hasConcept C17349429 @default.
- W2806891045 hasConcept C17744445 @default.
- W2806891045 hasConcept C191795146 @default.
- W2806891045 hasConcept C199539241 @default.
- W2806891045 hasConcept C202444582 @default.
- W2806891045 hasConcept C2524010 @default.
- W2806891045 hasConcept C2780551164 @default.
- W2806891045 hasConcept C33676613 @default.
- W2806891045 hasConcept C33923547 @default.
- W2806891045 hasConcept C41008148 @default.
- W2806891045 hasConcept C50644808 @default.
- W2806891045 hasConcept C62520636 @default.
- W2806891045 hasConcept C77553402 @default.
- W2806891045 hasConcept C84114770 @default.
- W2806891045 hasConcept C90673727 @default.
- W2806891045 hasConcept C92757383 @default.
- W2806891045 hasConceptScore W2806891045C105795698 @default.
- W2806891045 hasConceptScore W2806891045C111030470 @default.
- W2806891045 hasConceptScore W2806891045C11413529 @default.
- W2806891045 hasConceptScore W2806891045C114614502 @default.
- W2806891045 hasConceptScore W2806891045C118615104 @default.
- W2806891045 hasConceptScore W2806891045C121332964 @default.
- W2806891045 hasConceptScore W2806891045C13355873 @default.
- W2806891045 hasConceptScore W2806891045C134306372 @default.
- W2806891045 hasConceptScore W2806891045C154945302 @default.
- W2806891045 hasConceptScore W2806891045C168773036 @default.
- W2806891045 hasConceptScore W2806891045C17349429 @default.
- W2806891045 hasConceptScore W2806891045C17744445 @default.
- W2806891045 hasConceptScore W2806891045C191795146 @default.
- W2806891045 hasConceptScore W2806891045C199539241 @default.
- W2806891045 hasConceptScore W2806891045C202444582 @default.
- W2806891045 hasConceptScore W2806891045C2524010 @default.
- W2806891045 hasConceptScore W2806891045C2780551164 @default.
- W2806891045 hasConceptScore W2806891045C33676613 @default.
- W2806891045 hasConceptScore W2806891045C33923547 @default.
- W2806891045 hasConceptScore W2806891045C41008148 @default.
- W2806891045 hasConceptScore W2806891045C50644808 @default.
- W2806891045 hasConceptScore W2806891045C62520636 @default.
- W2806891045 hasConceptScore W2806891045C77553402 @default.
- W2806891045 hasConceptScore W2806891045C84114770 @default.
- W2806891045 hasConceptScore W2806891045C90673727 @default.
- W2806891045 hasConceptScore W2806891045C92757383 @default.
- W2806891045 hasLocation W28068910451 @default.
- W2806891045 hasOpenAccess W2806891045 @default.
- W2806891045 hasPrimaryLocation W28068910451 @default.
- W2806891045 hasRelatedWork W2107822587 @default.
- W2806891045 hasRelatedWork W2109004851 @default.
- W2806891045 hasRelatedWork W2751060898 @default.
- W2806891045 hasRelatedWork W2767609493 @default.
- W2806891045 hasRelatedWork W2781204213 @default.
- W2806891045 hasRelatedWork W2787438119 @default.
- W2806891045 hasRelatedWork W2803710049 @default.
- W2806891045 hasRelatedWork W2900591790 @default.
- W2806891045 hasRelatedWork W2913010492 @default.
- W2806891045 hasRelatedWork W2951348672 @default.
- W2806891045 hasRelatedWork W2966363981 @default.
- W2806891045 hasRelatedWork W2998329861 @default.
- W2806891045 hasRelatedWork W3088153346 @default.
- W2806891045 hasRelatedWork W3101563662 @default.
- W2806891045 hasRelatedWork W3125854851 @default.
- W2806891045 hasRelatedWork W3147318565 @default.
- W2806891045 hasRelatedWork W3153809844 @default.
- W2806891045 hasRelatedWork W3169353662 @default.
- W2806891045 hasRelatedWork W3182153751 @default.
- W2806891045 hasRelatedWork W3212971542 @default.
- W2806891045 isParatext "false" @default.
- W2806891045 isRetracted "false" @default.