Matches in SemOpenAlex for { <https://semopenalex.org/work/W4302772059> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4302772059 abstract "We address the problem of estimating statistics of hidden units in a neural network using a method of analytic moment propagation. These statistics are useful for approximate whitening of the inputs in front of saturating non-linearities such as a sigmoid function. This is important for initialization of training and for reducing the accumulated scale and bias dependencies (compensating covariate shift), which presumably eases the learning. In batch normalization, which is currently a very widely applied technique, sample estimates of statistics of hidden units over a batch are used. The proposed estimation uses an analytic propagation of mean and variance of the training set through the network. The result depends on the network structure and its current weights but not on the specific batch input. The estimates are suitable for initialization and normalization, efficient to compute and independent of the batch size. The experimental verification well supports these claims. However, the method does not share the generalization properties of BN, to which our experiments give some additional insight." @default.
- W4302772059 created "2022-10-07" @default.
- W4302772059 creator A5068080640 @default.
- W4302772059 creator A5077472871 @default.
- W4302772059 date "2018-03-28" @default.
- W4302772059 modified "2023-10-18" @default.
- W4302772059 title "Normalization of Neural Networks using Analytic Variance Propagation" @default.
- W4302772059 doi "https://doi.org/10.48550/arxiv.1803.10560" @default.
- W4302772059 hasPublicationYear "2018" @default.
- W4302772059 type Work @default.
- W4302772059 citedByCount "0" @default.
- W4302772059 crossrefType "posted-content" @default.
- W4302772059 hasAuthorship W4302772059A5068080640 @default.
- W4302772059 hasAuthorship W4302772059A5077472871 @default.
- W4302772059 hasBestOaLocation W43027720591 @default.
- W4302772059 hasConcept C105795698 @default.
- W4302772059 hasConcept C11413529 @default.
- W4302772059 hasConcept C114466953 @default.
- W4302772059 hasConcept C121955636 @default.
- W4302772059 hasConcept C124101348 @default.
- W4302772059 hasConcept C129848803 @default.
- W4302772059 hasConcept C134306372 @default.
- W4302772059 hasConcept C136886441 @default.
- W4302772059 hasConcept C144024400 @default.
- W4302772059 hasConcept C144133560 @default.
- W4302772059 hasConcept C154945302 @default.
- W4302772059 hasConcept C155032097 @default.
- W4302772059 hasConcept C177148314 @default.
- W4302772059 hasConcept C19165224 @default.
- W4302772059 hasConcept C196083921 @default.
- W4302772059 hasConcept C199360897 @default.
- W4302772059 hasConcept C33923547 @default.
- W4302772059 hasConcept C41008148 @default.
- W4302772059 hasConcept C50644808 @default.
- W4302772059 hasConcept C81388566 @default.
- W4302772059 hasConceptScore W4302772059C105795698 @default.
- W4302772059 hasConceptScore W4302772059C11413529 @default.
- W4302772059 hasConceptScore W4302772059C114466953 @default.
- W4302772059 hasConceptScore W4302772059C121955636 @default.
- W4302772059 hasConceptScore W4302772059C124101348 @default.
- W4302772059 hasConceptScore W4302772059C129848803 @default.
- W4302772059 hasConceptScore W4302772059C134306372 @default.
- W4302772059 hasConceptScore W4302772059C136886441 @default.
- W4302772059 hasConceptScore W4302772059C144024400 @default.
- W4302772059 hasConceptScore W4302772059C144133560 @default.
- W4302772059 hasConceptScore W4302772059C154945302 @default.
- W4302772059 hasConceptScore W4302772059C155032097 @default.
- W4302772059 hasConceptScore W4302772059C177148314 @default.
- W4302772059 hasConceptScore W4302772059C19165224 @default.
- W4302772059 hasConceptScore W4302772059C196083921 @default.
- W4302772059 hasConceptScore W4302772059C199360897 @default.
- W4302772059 hasConceptScore W4302772059C33923547 @default.
- W4302772059 hasConceptScore W4302772059C41008148 @default.
- W4302772059 hasConceptScore W4302772059C50644808 @default.
- W4302772059 hasConceptScore W4302772059C81388566 @default.
- W4302772059 hasLocation W43027720591 @default.
- W4302772059 hasOpenAccess W4302772059 @default.
- W4302772059 hasPrimaryLocation W43027720591 @default.
- W4302772059 hasRelatedWork W1564317318 @default.
- W4302772059 hasRelatedWork W1971541091 @default.
- W4302772059 hasRelatedWork W2240896738 @default.
- W4302772059 hasRelatedWork W246564837 @default.
- W4302772059 hasRelatedWork W2795358072 @default.
- W4302772059 hasRelatedWork W2904803257 @default.
- W4302772059 hasRelatedWork W2986094345 @default.
- W4302772059 hasRelatedWork W3123157847 @default.
- W4302772059 hasRelatedWork W3180497743 @default.
- W4302772059 hasRelatedWork W4302772059 @default.
- W4302772059 isParatext "false" @default.
- W4302772059 isRetracted "false" @default.
- W4302772059 workType "article" @default.