Matches in SemOpenAlex for { <https://semopenalex.org/work/W2913443752> ?p ?o ?g. }
Showing items 1 to 78 of
78
with 100 items per page.
- W2913443752 abstract "Batch Normalization (BN) improves both convergence and generalization in training neural networks. This work understands these phenomena theoretically. We analyze BN by using a basic block of neural networks, consisting of a kernel layer, a BN layer, and a nonlinear activation function. This basic network helps us understand the impacts of BN in three aspects. First, by viewing BN as an implicit regularizer, BN can be decomposed into population normalization (PN) and gamma decay as an explicit regularization. Second, learning dynamics of BN and the regularization show that training converged with large maximum and effective learning rate. Third, generalization of BN is explored by using statistical mechanics. Experiments demonstrate that BN in convolutional neural networks share the same traits of regularization as the above analyses." @default.
- W2913443752 created "2019-02-21" @default.
- W2913443752 creator A5059138390 @default.
- W2913443752 creator A5062676523 @default.
- W2913443752 creator A5067765750 @default.
- W2913443752 creator A5075158591 @default.
- W2913443752 date "2018-09-04" @default.
- W2913443752 modified "2023-09-23" @default.
- W2913443752 title "Understanding Regularization in Batch Normalization" @default.
- W2913443752 hasPublicationYear "2018" @default.
- W2913443752 type Work @default.
- W2913443752 sameAs 2913443752 @default.
- W2913443752 citedByCount "3" @default.
- W2913443752 countsByYear W29134437522019 @default.
- W2913443752 crossrefType "posted-content" @default.
- W2913443752 hasAuthorship W2913443752A5059138390 @default.
- W2913443752 hasAuthorship W2913443752A5062676523 @default.
- W2913443752 hasAuthorship W2913443752A5067765750 @default.
- W2913443752 hasAuthorship W2913443752A5075158591 @default.
- W2913443752 hasConcept C11413529 @default.
- W2913443752 hasConcept C119857082 @default.
- W2913443752 hasConcept C121332964 @default.
- W2913443752 hasConcept C126255220 @default.
- W2913443752 hasConcept C136886441 @default.
- W2913443752 hasConcept C144024400 @default.
- W2913443752 hasConcept C154945302 @default.
- W2913443752 hasConcept C158622935 @default.
- W2913443752 hasConcept C19165224 @default.
- W2913443752 hasConcept C2776135515 @default.
- W2913443752 hasConcept C28826006 @default.
- W2913443752 hasConcept C33923547 @default.
- W2913443752 hasConcept C41008148 @default.
- W2913443752 hasConcept C50644808 @default.
- W2913443752 hasConcept C62520636 @default.
- W2913443752 hasConcept C81363708 @default.
- W2913443752 hasConceptScore W2913443752C11413529 @default.
- W2913443752 hasConceptScore W2913443752C119857082 @default.
- W2913443752 hasConceptScore W2913443752C121332964 @default.
- W2913443752 hasConceptScore W2913443752C126255220 @default.
- W2913443752 hasConceptScore W2913443752C136886441 @default.
- W2913443752 hasConceptScore W2913443752C144024400 @default.
- W2913443752 hasConceptScore W2913443752C154945302 @default.
- W2913443752 hasConceptScore W2913443752C158622935 @default.
- W2913443752 hasConceptScore W2913443752C19165224 @default.
- W2913443752 hasConceptScore W2913443752C2776135515 @default.
- W2913443752 hasConceptScore W2913443752C28826006 @default.
- W2913443752 hasConceptScore W2913443752C33923547 @default.
- W2913443752 hasConceptScore W2913443752C41008148 @default.
- W2913443752 hasConceptScore W2913443752C50644808 @default.
- W2913443752 hasConceptScore W2913443752C62520636 @default.
- W2913443752 hasConceptScore W2913443752C81363708 @default.
- W2913443752 hasLocation W29134437521 @default.
- W2913443752 hasOpenAccess W2913443752 @default.
- W2913443752 hasPrimaryLocation W29134437521 @default.
- W2913443752 hasRelatedWork W1526387848 @default.
- W2913443752 hasRelatedWork W1604331306 @default.
- W2913443752 hasRelatedWork W2014985172 @default.
- W2913443752 hasRelatedWork W2128660912 @default.
- W2913443752 hasRelatedWork W2787442904 @default.
- W2913443752 hasRelatedWork W2891172060 @default.
- W2913443752 hasRelatedWork W2919767206 @default.
- W2913443752 hasRelatedWork W2942568041 @default.
- W2913443752 hasRelatedWork W2960269556 @default.
- W2913443752 hasRelatedWork W3008040735 @default.
- W2913443752 hasRelatedWork W3014013215 @default.
- W2913443752 hasRelatedWork W3035751893 @default.
- W2913443752 hasRelatedWork W3037353226 @default.
- W2913443752 hasRelatedWork W3046476838 @default.
- W2913443752 hasRelatedWork W3046739385 @default.
- W2913443752 hasRelatedWork W3095344139 @default.
- W2913443752 hasRelatedWork W3096372795 @default.
- W2913443752 hasRelatedWork W3110443240 @default.
- W2913443752 hasRelatedWork W3191734561 @default.
- W2913443752 hasRelatedWork W3207208954 @default.
- W2913443752 isParatext "false" @default.
- W2913443752 isRetracted "false" @default.
- W2913443752 magId "2913443752" @default.
- W2913443752 workType "article" @default.