Matches in SemOpenAlex for { <https://semopenalex.org/work/W2034276439> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W2034276439 abstract "Abstract: This paper explores the complexity of deep feed forward networks with linear pre-synaptic couplings and rectified linear activations. This is a contribution to the growing body of work contrasting the representational power of deep and shallow network architectures. In particular, we offer a framework for comparing deep and shallow models that belong to the family of piecewise linear functions based on computational geometry. We look at a deep rectifier multi-layer perceptron (MLP) with linear outputs units and compare it with a single layer version of the model. In the asymptotic regime, when the number of inputs stays constant, if the shallow model has $kn$ hidden units and $n_0$ inputs, then the number of linear regions is $O(k^{n_0}n^{n_0})$. For a $k$ layer model with $n$ hidden units on each layer it is $Omega(left( {n}/{n_0}right)^{k-1}n^{n_0})$. $left({n}/{n_0}right)^{k-1}$ grows faster then $k^{n_0}$ when either $n$ goes to infinity or $k$ goes to infinity and $n > 2n_0$. We consider this as a first step towards understanding the complexity of these models and specifically towards providing suitable mathematical tools for future analysis." @default.
- W2034276439 created "2016-06-24" @default.
- W2034276439 creator A5043910056 @default.
- W2034276439 creator A5072280192 @default.
- W2034276439 creator A5086198262 @default.
- W2034276439 date "2014-01-01" @default.
- W2034276439 modified "2023-10-01" @default.
- W2034276439 title "On the number of inference regions of deep feed forward networks with piece-wise linear activations" @default.
- W2034276439 hasPublicationYear "2014" @default.
- W2034276439 type Work @default.
- W2034276439 sameAs 2034276439 @default.
- W2034276439 citedByCount "37" @default.
- W2034276439 countsByYear W20342764392014 @default.
- W2034276439 countsByYear W20342764392015 @default.
- W2034276439 countsByYear W20342764392016 @default.
- W2034276439 countsByYear W20342764392017 @default.
- W2034276439 countsByYear W20342764392018 @default.
- W2034276439 countsByYear W20342764392019 @default.
- W2034276439 countsByYear W20342764392020 @default.
- W2034276439 countsByYear W20342764392021 @default.
- W2034276439 countsByYear W20342764392022 @default.
- W2034276439 crossrefType "proceedings-article" @default.
- W2034276439 hasAuthorship W2034276439A5043910056 @default.
- W2034276439 hasAuthorship W2034276439A5072280192 @default.
- W2034276439 hasAuthorship W2034276439A5086198262 @default.
- W2034276439 hasConcept C105795698 @default.
- W2034276439 hasConcept C108583219 @default.
- W2034276439 hasConcept C11413529 @default.
- W2034276439 hasConcept C114614502 @default.
- W2034276439 hasConcept C121332964 @default.
- W2034276439 hasConcept C134306372 @default.
- W2034276439 hasConcept C147168706 @default.
- W2034276439 hasConcept C154945302 @default.
- W2034276439 hasConcept C163175372 @default.
- W2034276439 hasConcept C17095337 @default.
- W2034276439 hasConcept C199360897 @default.
- W2034276439 hasConcept C2776214188 @default.
- W2034276439 hasConcept C2777027219 @default.
- W2034276439 hasConcept C2779557605 @default.
- W2034276439 hasConcept C33923547 @default.
- W2034276439 hasConcept C41008148 @default.
- W2034276439 hasConcept C50100734 @default.
- W2034276439 hasConcept C50644808 @default.
- W2034276439 hasConcept C60908668 @default.
- W2034276439 hasConcept C62520636 @default.
- W2034276439 hasConcept C7321624 @default.
- W2034276439 hasConcept C86582703 @default.
- W2034276439 hasConceptScore W2034276439C105795698 @default.
- W2034276439 hasConceptScore W2034276439C108583219 @default.
- W2034276439 hasConceptScore W2034276439C11413529 @default.
- W2034276439 hasConceptScore W2034276439C114614502 @default.
- W2034276439 hasConceptScore W2034276439C121332964 @default.
- W2034276439 hasConceptScore W2034276439C134306372 @default.
- W2034276439 hasConceptScore W2034276439C147168706 @default.
- W2034276439 hasConceptScore W2034276439C154945302 @default.
- W2034276439 hasConceptScore W2034276439C163175372 @default.
- W2034276439 hasConceptScore W2034276439C17095337 @default.
- W2034276439 hasConceptScore W2034276439C199360897 @default.
- W2034276439 hasConceptScore W2034276439C2776214188 @default.
- W2034276439 hasConceptScore W2034276439C2777027219 @default.
- W2034276439 hasConceptScore W2034276439C2779557605 @default.
- W2034276439 hasConceptScore W2034276439C33923547 @default.
- W2034276439 hasConceptScore W2034276439C41008148 @default.
- W2034276439 hasConceptScore W2034276439C50100734 @default.
- W2034276439 hasConceptScore W2034276439C50644808 @default.
- W2034276439 hasConceptScore W2034276439C60908668 @default.
- W2034276439 hasConceptScore W2034276439C62520636 @default.
- W2034276439 hasConceptScore W2034276439C7321624 @default.
- W2034276439 hasConceptScore W2034276439C86582703 @default.
- W2034276439 hasLocation W20342764391 @default.
- W2034276439 hasOpenAccess W2034276439 @default.
- W2034276439 hasPrimaryLocation W20342764391 @default.
- W2034276439 hasRelatedWork W1665214252 @default.
- W2034276439 hasRelatedWork W1677182931 @default.
- W2034276439 hasRelatedWork W1981530182 @default.
- W2034276439 hasRelatedWork W2095705004 @default.
- W2034276439 hasRelatedWork W2097117768 @default.
- W2034276439 hasRelatedWork W2103496339 @default.
- W2034276439 hasRelatedWork W2112796928 @default.
- W2034276439 hasRelatedWork W2141473882 @default.
- W2034276439 hasRelatedWork W2156387975 @default.
- W2034276439 hasRelatedWork W2161388792 @default.
- W2034276439 hasRelatedWork W2163605009 @default.
- W2034276439 hasRelatedWork W2194775991 @default.
- W2034276439 hasRelatedWork W2528305538 @default.
- W2034276439 hasRelatedWork W2962742960 @default.
- W2034276439 hasRelatedWork W2962782102 @default.
- W2034276439 hasRelatedWork W2962990163 @default.
- W2034276439 hasRelatedWork W2963950090 @default.
- W2034276439 hasRelatedWork W2963982496 @default.
- W2034276439 hasRelatedWork W3118608800 @default.
- W2034276439 hasRelatedWork W3146803896 @default.
- W2034276439 isParatext "false" @default.
- W2034276439 isRetracted "false" @default.
- W2034276439 magId "2034276439" @default.
- W2034276439 workType "article" @default.