FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3186138228> ?p ?o ?g. }

• W3186138228 abstract "We explore convergence of deep neural networks with the popular ReLU activation function, as the depth of the networks tends to infinity. To this end, we introduce the notion of activation domains and activation matrices of a ReLU network. By replacing applications of the ReLU activation function by multiplications with activation matrices on activation domains, we obtain an explicit expression of the ReLU network. We then identify the convergence of the ReLU networks as convergence of a class of infinite products of matrices. Sufficient and necessary conditions for convergence of these infinite products of matrices are studied. As a result, we establish necessary conditions for ReLU networks to converge that the sequence of weight matrices converges to the identity matrix and the sequence of the bias vectors converges to zero as the depth of ReLU networks increases to infinity. Moreover, we obtain sufficient conditions in terms of the weight matrices and bias vectors at hidden layers for pointwise convergence of deep ReLU networks. These results provide mathematical insights to the design strategy of the well-known deep residual networks in image classification." @default.
• W3186138228 created "2021-08-02" @default.
• W3186138228 creator A5023682610 @default.
• W3186138228 creator A5026572582 @default.
• W3186138228 date "2021-07-26" @default.
• W3186138228 modified "2023-09-25" @default.
• W3186138228 title "Convergence of Deep ReLU Networks" @default.
• W3186138228 cites W1544013721 @default.
• W3186138228 cites W1924935520 @default.
• W3186138228 cites W2039415399 @default.
• W3186138228 cites W2062024414 @default.
• W3186138228 cites W2194775991 @default.
• W3186138228 cites W2302255633 @default.
• W3186138228 cites W2528305538 @default.
• W3186138228 cites W2557283755 @default.
• W3186138228 cites W2780503584 @default.
• W3186138228 cites W2910155483 @default.
• W3186138228 cites W2919115771 @default.
• W3186138228 cites W2944394121 @default.
• W3186138228 cites W2963172624 @default.
• W3186138228 cites W2963626582 @default.
• W3186138228 cites W3031010353 @default.
• W3186138228 cites W3048707547 @default.
• W3186138228 cites W3082434559 @default.
• W3186138228 cites W3101996726 @default.
• W3186138228 cites W3115781672 @default.
• W3186138228 cites W3135609499 @default.
• W3186138228 cites W3186605155 @default.
• W3186138228 doi "https://doi.org/10.48550/arxiv.2107.12530" @default.
• W3186138228 hasPublicationYear "2021" @default.
• W3186138228 type Work @default.
• W3186138228 sameAs 3186138228 @default.
• W3186138228 citedByCount "1" @default.
• W3186138228 countsByYear W31861382282021 @default.
• W3186138228 crossrefType "posted-content" @default.
• W3186138228 hasAuthorship W3186138228A5023682610 @default.
• W3186138228 hasAuthorship W3186138228A5026572582 @default.
• W3186138228 hasBestOaLocation W31861382281 @default.
• W3186138228 hasConcept C106487976 @default.
• W3186138228 hasConcept C111919701 @default.
• W3186138228 hasConcept C11413529 @default.
• W3186138228 hasConcept C118615104 @default.
• W3186138228 hasConcept C134306372 @default.
• W3186138228 hasConcept C14036430 @default.
• W3186138228 hasConcept C154945302 @default.
• W3186138228 hasConcept C159985019 @default.
• W3186138228 hasConcept C162324750 @default.
• W3186138228 hasConcept C192562407 @default.
• W3186138228 hasConcept C199845137 @default.
• W3186138228 hasConcept C27156116 @default.
• W3186138228 hasConcept C2777303404 @default.
• W3186138228 hasConcept C2777984123 @default.
• W3186138228 hasConcept C2778112365 @default.
• W3186138228 hasConcept C28826006 @default.
• W3186138228 hasConcept C33923547 @default.
• W3186138228 hasConcept C38365724 @default.
• W3186138228 hasConcept C41008148 @default.
• W3186138228 hasConcept C50522688 @default.
• W3186138228 hasConcept C50644808 @default.
• W3186138228 hasConcept C54355233 @default.
• W3186138228 hasConcept C78458016 @default.
• W3186138228 hasConcept C86803240 @default.
• W3186138228 hasConceptScore W3186138228C106487976 @default.
• W3186138228 hasConceptScore W3186138228C111919701 @default.
• W3186138228 hasConceptScore W3186138228C11413529 @default.
• W3186138228 hasConceptScore W3186138228C118615104 @default.
• W3186138228 hasConceptScore W3186138228C134306372 @default.
• W3186138228 hasConceptScore W3186138228C14036430 @default.
• W3186138228 hasConceptScore W3186138228C154945302 @default.
• W3186138228 hasConceptScore W3186138228C159985019 @default.
• W3186138228 hasConceptScore W3186138228C162324750 @default.
• W3186138228 hasConceptScore W3186138228C192562407 @default.
• W3186138228 hasConceptScore W3186138228C199845137 @default.
• W3186138228 hasConceptScore W3186138228C27156116 @default.
• W3186138228 hasConceptScore W3186138228C2777303404 @default.
• W3186138228 hasConceptScore W3186138228C2777984123 @default.
• W3186138228 hasConceptScore W3186138228C2778112365 @default.
• W3186138228 hasConceptScore W3186138228C28826006 @default.
• W3186138228 hasConceptScore W3186138228C33923547 @default.
• W3186138228 hasConceptScore W3186138228C38365724 @default.
• W3186138228 hasConceptScore W3186138228C41008148 @default.
• W3186138228 hasConceptScore W3186138228C50522688 @default.
• W3186138228 hasConceptScore W3186138228C50644808 @default.
• W3186138228 hasConceptScore W3186138228C54355233 @default.
• W3186138228 hasConceptScore W3186138228C78458016 @default.
• W3186138228 hasConceptScore W3186138228C86803240 @default.
• W3186138228 hasLocation W31861382281 @default.
• W3186138228 hasOpenAccess W3186138228 @default.
• W3186138228 hasPrimaryLocation W31861382281 @default.
• W3186138228 hasRelatedWork W2013203606 @default.
• W3186138228 hasRelatedWork W2014434717 @default.
• W3186138228 hasRelatedWork W2028883544 @default.
• W3186138228 hasRelatedWork W2134127056 @default.
• W3186138228 hasRelatedWork W2157943005 @default.
• W3186138228 hasRelatedWork W2164692126 @default.
• W3186138228 hasRelatedWork W2555447031 @default.
• W3186138228 hasRelatedWork W3199620675 @default.
• W3186138228 hasRelatedWork W4246959100 @default.
• W3186138228 hasRelatedWork W4285682802 @default.
• W3186138228 isParatext "false" @default.

• next