FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2619069683> ?p ?o ?g. }

• W2619069683 abstract "This paper studies the landscape of empirical risk of deep neural networks by theoretically analyzing its convergence behavior to the population risk as well as its stationary points and properties. For an $l$-layer linear neural network, we prove its empirical risk uniformly converges to its population risk at the rate of $mathcal{O}(r^{2l}sqrt{dlog(l)}/sqrt{n})$ with training sample size of $n$, the total weight dimension of $d$ and the magnitude bound $r$ of weight of each layer. We then derive the stability and generalization bounds for the empirical risk based on this result. Besides, we establish the uniform convergence of gradient of the empirical risk to its population counterpart. We prove the one-to-one correspondence of the non-degenerate stationary points between the empirical and population risks with convergence guarantees, which describes the landscape of deep neural networks. In addition, we analyze these properties for deep nonlinear neural networks with sigmoid activation functions. We prove similar results for convergence behavior of their empirical risks as well as the gradients and analyze properties of their non-degenerate stationary points. To our best knowledge, this work is the first one theoretically characterizing landscapes of deep learning algorithms. Besides, our results provide the sample complexity of training a good deep neural network. We also provide theoretical understanding on how the neural network depth $l$, the layer width, the network size $d$ and parameter magnitude determine the neural network landscapes." @default.
• W2619069683 created "2017-06-05" @default.
• W2619069683 creator A5010883708 @default.
• W2619069683 creator A5033884558 @default.
• W2619069683 date "2017-05-19" @default.
• W2619069683 modified "2023-09-27" @default.
• W2619069683 title "The Landscape of Deep Learning Algorithms." @default.
• W2619069683 cites W1892947258 @default.
• W2619069683 cites W1899249567 @default.
• W2619069683 cites W2012903341 @default.
• W2619069683 cites W2041424410 @default.
• W2619069683 cites W2094633476 @default.
• W2619069683 cites W2097117768 @default.
• W2619069683 cites W2117130368 @default.
• W2619069683 cites W2128882956 @default.
• W2619069683 cites W2136922672 @default.
• W2619069683 cites W2143612262 @default.
• W2619069683 cites W2146989110 @default.
• W2619069683 cites W2160815625 @default.
• W2619069683 cites W2194775991 @default.
• W2619069683 cites W2399994860 @default.
• W2619069683 cites W2514392868 @default.
• W2619069683 cites W2516287206 @default.
• W2619069683 cites W2578732588 @default.
• W2619069683 cites W2601424732 @default.
• W2619069683 cites W2608609325 @default.
• W2619069683 cites W2618003483 @default.
• W2619069683 cites W2623127191 @default.
• W2619069683 cites W27434444 @default.
• W2619069683 cites W2750924312 @default.
• W2619069683 cites W2962742960 @default.
• W2619069683 cites W2963446085 @default.
• W2619069683 cites W2965497096 @default.
• W2619069683 cites W607505555 @default.
• W2619069683 hasPublicationYear "2017" @default.
• W2619069683 type Work @default.
• W2619069683 sameAs 2619069683 @default.
• W2619069683 citedByCount "12" @default.
• W2619069683 countsByYear W26190696832017 @default.
• W2619069683 countsByYear W26190696832018 @default.
• W2619069683 countsByYear W26190696832019 @default.
• W2619069683 countsByYear W26190696832020 @default.
• W2619069683 crossrefType "posted-content" @default.
• W2619069683 hasAuthorship W2619069683A5010883708 @default.
• W2619069683 hasAuthorship W2619069683A5033884558 @default.
• W2619069683 hasConcept C105795698 @default.
• W2619069683 hasConcept C11413529 @default.
• W2619069683 hasConcept C114614502 @default.
• W2619069683 hasConcept C120936955 @default.
• W2619069683 hasConcept C121332964 @default.
• W2619069683 hasConcept C134306372 @default.
• W2619069683 hasConcept C144024400 @default.
• W2619069683 hasConcept C149923435 @default.
• W2619069683 hasConcept C154945302 @default.
• W2619069683 hasConcept C162324750 @default.
• W2619069683 hasConcept C177148314 @default.
• W2619069683 hasConcept C189237950 @default.
• W2619069683 hasConcept C2777303404 @default.
• W2619069683 hasConcept C28826006 @default.
• W2619069683 hasConcept C2908647359 @default.
• W2619069683 hasConcept C33676613 @default.
• W2619069683 hasConcept C33923547 @default.
• W2619069683 hasConcept C41008148 @default.
• W2619069683 hasConcept C50522688 @default.
• W2619069683 hasConcept C50644808 @default.
• W2619069683 hasConcept C62520636 @default.
• W2619069683 hasConcept C72319582 @default.
• W2619069683 hasConcept C81388566 @default.
• W2619069683 hasConceptScore W2619069683C105795698 @default.
• W2619069683 hasConceptScore W2619069683C11413529 @default.
• W2619069683 hasConceptScore W2619069683C114614502 @default.
• W2619069683 hasConceptScore W2619069683C120936955 @default.
• W2619069683 hasConceptScore W2619069683C121332964 @default.
• W2619069683 hasConceptScore W2619069683C134306372 @default.
• W2619069683 hasConceptScore W2619069683C144024400 @default.
• W2619069683 hasConceptScore W2619069683C149923435 @default.
• W2619069683 hasConceptScore W2619069683C154945302 @default.
• W2619069683 hasConceptScore W2619069683C162324750 @default.
• W2619069683 hasConceptScore W2619069683C177148314 @default.
• W2619069683 hasConceptScore W2619069683C189237950 @default.
• W2619069683 hasConceptScore W2619069683C2777303404 @default.
• W2619069683 hasConceptScore W2619069683C28826006 @default.
• W2619069683 hasConceptScore W2619069683C2908647359 @default.
• W2619069683 hasConceptScore W2619069683C33676613 @default.
• W2619069683 hasConceptScore W2619069683C33923547 @default.
• W2619069683 hasConceptScore W2619069683C41008148 @default.
• W2619069683 hasConceptScore W2619069683C50522688 @default.
• W2619069683 hasConceptScore W2619069683C50644808 @default.
• W2619069683 hasConceptScore W2619069683C62520636 @default.
• W2619069683 hasConceptScore W2619069683C72319582 @default.
• W2619069683 hasConceptScore W2619069683C81388566 @default.
• W2619069683 hasLocation W26190696831 @default.
• W2619069683 hasOpenAccess W2619069683 @default.
• W2619069683 hasPrimaryLocation W26190696831 @default.
• W2619069683 hasRelatedWork W1576544743 @default.
• W2619069683 hasRelatedWork W1839868949 @default.
• W2619069683 hasRelatedWork W1899249567 @default.
• W2619069683 hasRelatedWork W1914062059 @default.
• W2619069683 hasRelatedWork W2625063094 @default.
• W2619069683 hasRelatedWork W2758053331 @default.

• next