Matches in SemOpenAlex for { <https://semopenalex.org/work/W4321472491> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4321472491 abstract "In recent years, deep learning has achieved remarkable success in various fields such as image recognition, natural language processing, and speech recognition. The effectiveness of deep learning largely depends on the optimization methods used to train deep neural networks. In this paper, we provide an overview of first-order optimization methods such as Stochastic Gradient Descent, Adagrad, Adadelta, and RMSprop, as well as recent momentum-based and adaptive gradient methods such as Nesterov accelerated gradient, Adam, Nadam, AdaMax, and AMSGrad. We also discuss the challenges associated with optimization in deep learning and explore techniques for addressing these challenges, including weight initialization, batch normalization, and layer normalization. Finally, we provide recommendations for selecting optimization methods for different deep learning tasks and datasets. This paper serves as a comprehensive guide to optimization methods in deep learning and can be used as a reference for researchers and practitioners in the field." @default.
- W4321472491 created "2023-02-22" @default.
- W4321472491 creator A5087424585 @default.
- W4321472491 date "2023-02-19" @default.
- W4321472491 modified "2023-10-01" @default.
- W4321472491 title "Optimization Methods in Deep Learning: A Comprehensive Overview" @default.
- W4321472491 doi "https://doi.org/10.48550/arxiv.2302.09566" @default.
- W4321472491 hasPublicationYear "2023" @default.
- W4321472491 type Work @default.
- W4321472491 citedByCount "0" @default.
- W4321472491 crossrefType "posted-content" @default.
- W4321472491 hasAuthorship W4321472491A5087424585 @default.
- W4321472491 hasBestOaLocation W43214724911 @default.
- W4321472491 hasConcept C108583219 @default.
- W4321472491 hasConcept C114466953 @default.
- W4321472491 hasConcept C119857082 @default.
- W4321472491 hasConcept C126255220 @default.
- W4321472491 hasConcept C136886441 @default.
- W4321472491 hasConcept C144024400 @default.
- W4321472491 hasConcept C153258448 @default.
- W4321472491 hasConcept C154945302 @default.
- W4321472491 hasConcept C19165224 @default.
- W4321472491 hasConcept C194387892 @default.
- W4321472491 hasConcept C199360897 @default.
- W4321472491 hasConcept C202444582 @default.
- W4321472491 hasConcept C206688291 @default.
- W4321472491 hasConcept C2984842247 @default.
- W4321472491 hasConcept C33923547 @default.
- W4321472491 hasConcept C41008148 @default.
- W4321472491 hasConcept C50644808 @default.
- W4321472491 hasConcept C9652623 @default.
- W4321472491 hasConceptScore W4321472491C108583219 @default.
- W4321472491 hasConceptScore W4321472491C114466953 @default.
- W4321472491 hasConceptScore W4321472491C119857082 @default.
- W4321472491 hasConceptScore W4321472491C126255220 @default.
- W4321472491 hasConceptScore W4321472491C136886441 @default.
- W4321472491 hasConceptScore W4321472491C144024400 @default.
- W4321472491 hasConceptScore W4321472491C153258448 @default.
- W4321472491 hasConceptScore W4321472491C154945302 @default.
- W4321472491 hasConceptScore W4321472491C19165224 @default.
- W4321472491 hasConceptScore W4321472491C194387892 @default.
- W4321472491 hasConceptScore W4321472491C199360897 @default.
- W4321472491 hasConceptScore W4321472491C202444582 @default.
- W4321472491 hasConceptScore W4321472491C206688291 @default.
- W4321472491 hasConceptScore W4321472491C2984842247 @default.
- W4321472491 hasConceptScore W4321472491C33923547 @default.
- W4321472491 hasConceptScore W4321472491C41008148 @default.
- W4321472491 hasConceptScore W4321472491C50644808 @default.
- W4321472491 hasConceptScore W4321472491C9652623 @default.
- W4321472491 hasLocation W43214724911 @default.
- W4321472491 hasOpenAccess W4321472491 @default.
- W4321472491 hasPrimaryLocation W43214724911 @default.
- W4321472491 hasRelatedWork W2792987183 @default.
- W4321472491 hasRelatedWork W2945697643 @default.
- W4321472491 hasRelatedWork W2950066684 @default.
- W4321472491 hasRelatedWork W3118104903 @default.
- W4321472491 hasRelatedWork W3206007214 @default.
- W4321472491 hasRelatedWork W4248390167 @default.
- W4321472491 hasRelatedWork W4287755480 @default.
- W4321472491 hasRelatedWork W4298388782 @default.
- W4321472491 hasRelatedWork W4312831135 @default.
- W4321472491 hasRelatedWork W4321472491 @default.
- W4321472491 isParatext "false" @default.
- W4321472491 isRetracted "false" @default.
- W4321472491 workType "article" @default.