Matches in SemOpenAlex for { <https://semopenalex.org/work/W2022042912> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W2022042912 endingPage "159" @default.
- W2022042912 startingPage "151" @default.
- W2022042912 abstract "In this study, we theoretically analyze two essential training schemes for gradient descent learning in neural networks: batch and on-line training. The convergence properties of the two schemes applied to quadratic loss functions are analytically investigated. We quantify the convergence of each training scheme to the optimal weight using the absolute value of the expected difference (Measure 1) and the expected squared difference (Measure 2) between the optimal weight and the weight computed by the scheme. Although on-line training has several advantages over batch training with respect to the first measure, it does not converge to the optimal weight with respect to the second measure if the variance of the per-instance gradient remains constant. However, if the variance decays exponentially, then on-line training converges to the optimal weight with respect to Measure 2. Our analysis reveals the exact degrees to which the training set size, the variance of the per-instance gradient, and the learning rate affect the rate of convergence for each scheme." @default.
- W2022042912 created "2016-06-24" @default.
- W2022042912 creator A5045872629 @default.
- W2022042912 date "2009-12-01" @default.
- W2022042912 modified "2023-10-17" @default.
- W2022042912 title "Theoretical analysis of batch and on-line training for gradient descent learning in neural networks" @default.
- W2022042912 cites W1994616650 @default.
- W2022042912 cites W2028461624 @default.
- W2022042912 cites W2080525614 @default.
- W2022042912 cites W2099005356 @default.
- W2022042912 cites W2133042373 @default.
- W2022042912 cites W2151767444 @default.
- W2022042912 cites W2154987621 @default.
- W2022042912 cites W2169762136 @default.
- W2022042912 doi "https://doi.org/10.1016/j.neucom.2009.05.017" @default.
- W2022042912 hasPublicationYear "2009" @default.
- W2022042912 type Work @default.
- W2022042912 sameAs 2022042912 @default.
- W2022042912 citedByCount "49" @default.
- W2022042912 countsByYear W20220429122012 @default.
- W2022042912 countsByYear W20220429122013 @default.
- W2022042912 countsByYear W20220429122014 @default.
- W2022042912 countsByYear W20220429122015 @default.
- W2022042912 countsByYear W20220429122016 @default.
- W2022042912 countsByYear W20220429122017 @default.
- W2022042912 countsByYear W20220429122018 @default.
- W2022042912 countsByYear W20220429122019 @default.
- W2022042912 countsByYear W20220429122020 @default.
- W2022042912 countsByYear W20220429122021 @default.
- W2022042912 countsByYear W20220429122022 @default.
- W2022042912 crossrefType "journal-article" @default.
- W2022042912 hasAuthorship W2022042912A5045872629 @default.
- W2022042912 hasConcept C121955636 @default.
- W2022042912 hasConcept C124101348 @default.
- W2022042912 hasConcept C126255220 @default.
- W2022042912 hasConcept C129844170 @default.
- W2022042912 hasConcept C144133560 @default.
- W2022042912 hasConcept C153258448 @default.
- W2022042912 hasConcept C154945302 @default.
- W2022042912 hasConcept C162324750 @default.
- W2022042912 hasConcept C196083921 @default.
- W2022042912 hasConcept C198352243 @default.
- W2022042912 hasConcept C199360897 @default.
- W2022042912 hasConcept C2524010 @default.
- W2022042912 hasConcept C26517878 @default.
- W2022042912 hasConcept C2777027219 @default.
- W2022042912 hasConcept C2777303404 @default.
- W2022042912 hasConcept C2780009758 @default.
- W2022042912 hasConcept C28826006 @default.
- W2022042912 hasConcept C33923547 @default.
- W2022042912 hasConcept C38652104 @default.
- W2022042912 hasConcept C41008148 @default.
- W2022042912 hasConcept C50522688 @default.
- W2022042912 hasConcept C50644808 @default.
- W2022042912 hasConcept C57869625 @default.
- W2022042912 hasConceptScore W2022042912C121955636 @default.
- W2022042912 hasConceptScore W2022042912C124101348 @default.
- W2022042912 hasConceptScore W2022042912C126255220 @default.
- W2022042912 hasConceptScore W2022042912C129844170 @default.
- W2022042912 hasConceptScore W2022042912C144133560 @default.
- W2022042912 hasConceptScore W2022042912C153258448 @default.
- W2022042912 hasConceptScore W2022042912C154945302 @default.
- W2022042912 hasConceptScore W2022042912C162324750 @default.
- W2022042912 hasConceptScore W2022042912C196083921 @default.
- W2022042912 hasConceptScore W2022042912C198352243 @default.
- W2022042912 hasConceptScore W2022042912C199360897 @default.
- W2022042912 hasConceptScore W2022042912C2524010 @default.
- W2022042912 hasConceptScore W2022042912C26517878 @default.
- W2022042912 hasConceptScore W2022042912C2777027219 @default.
- W2022042912 hasConceptScore W2022042912C2777303404 @default.
- W2022042912 hasConceptScore W2022042912C2780009758 @default.
- W2022042912 hasConceptScore W2022042912C28826006 @default.
- W2022042912 hasConceptScore W2022042912C33923547 @default.
- W2022042912 hasConceptScore W2022042912C38652104 @default.
- W2022042912 hasConceptScore W2022042912C41008148 @default.
- W2022042912 hasConceptScore W2022042912C50522688 @default.
- W2022042912 hasConceptScore W2022042912C50644808 @default.
- W2022042912 hasConceptScore W2022042912C57869625 @default.
- W2022042912 hasIssue "1-3" @default.
- W2022042912 hasLocation W20220429121 @default.
- W2022042912 hasOpenAccess W2022042912 @default.
- W2022042912 hasPrimaryLocation W20220429121 @default.
- W2022042912 hasRelatedWork W2021319679 @default.
- W2022042912 hasRelatedWork W2082482750 @default.
- W2022042912 hasRelatedWork W2103042052 @default.
- W2022042912 hasRelatedWork W2167914958 @default.
- W2022042912 hasRelatedWork W2544122622 @default.
- W2022042912 hasRelatedWork W2766590049 @default.
- W2022042912 hasRelatedWork W3108589306 @default.
- W2022042912 hasRelatedWork W3114199884 @default.
- W2022042912 hasRelatedWork W3214743202 @default.
- W2022042912 hasRelatedWork W4309210394 @default.
- W2022042912 hasVolume "73" @default.
- W2022042912 isParatext "false" @default.
- W2022042912 isRetracted "false" @default.
- W2022042912 magId "2022042912" @default.
- W2022042912 workType "article" @default.