Matches in SemOpenAlex for { <https://semopenalex.org/work/W4299291264> ?p ?o ?g. }
Showing items 1 to 74 of
74
with 100 items per page.
- W4299291264 abstract "Deep learning methods achieve state-of-the-art performance in many application scenarios. Yet, these methods require a significant amount of hyperparameters tuning in order to achieve the best results. In particular, tuning the learning rates in the stochastic optimization process is still one of the main bottlenecks. In this paper, we propose a new stochastic gradient descent procedure for deep networks that does not require any learning rate setting. Contrary to previous methods, we do not adapt the learning rates nor we make use of the assumed curvature of the objective function. Instead, we reduce the optimization process to a game of betting on a coin and propose a learning-rate-free optimal algorithm for this scenario. Theoretical convergence is proven for convex and quasi-convex functions and empirical evidence shows the advantage of our algorithm over popular stochastic gradient algorithms." @default.
- W4299291264 created "2022-10-02" @default.
- W4299291264 creator A5004857169 @default.
- W4299291264 creator A5044260265 @default.
- W4299291264 date "2017-05-22" @default.
- W4299291264 modified "2023-09-28" @default.
- W4299291264 title "Training Deep Networks without Learning Rates Through Coin Betting" @default.
- W4299291264 doi "https://doi.org/10.48550/arxiv.1705.07795" @default.
- W4299291264 hasPublicationYear "2017" @default.
- W4299291264 type Work @default.
- W4299291264 citedByCount "0" @default.
- W4299291264 crossrefType "posted-content" @default.
- W4299291264 hasAuthorship W4299291264A5004857169 @default.
- W4299291264 hasAuthorship W4299291264A5044260265 @default.
- W4299291264 hasBestOaLocation W42992912641 @default.
- W4299291264 hasConcept C108583219 @default.
- W4299291264 hasConcept C111919701 @default.
- W4299291264 hasConcept C112680207 @default.
- W4299291264 hasConcept C119857082 @default.
- W4299291264 hasConcept C126255220 @default.
- W4299291264 hasConcept C145446738 @default.
- W4299291264 hasConcept C153258448 @default.
- W4299291264 hasConcept C154945302 @default.
- W4299291264 hasConcept C162324750 @default.
- W4299291264 hasConcept C206688291 @default.
- W4299291264 hasConcept C2524010 @default.
- W4299291264 hasConcept C26517878 @default.
- W4299291264 hasConcept C2777303404 @default.
- W4299291264 hasConcept C33923547 @default.
- W4299291264 hasConcept C38652104 @default.
- W4299291264 hasConcept C41008148 @default.
- W4299291264 hasConcept C50522688 @default.
- W4299291264 hasConcept C50644808 @default.
- W4299291264 hasConcept C57869625 @default.
- W4299291264 hasConcept C8642999 @default.
- W4299291264 hasConcept C98045186 @default.
- W4299291264 hasConceptScore W4299291264C108583219 @default.
- W4299291264 hasConceptScore W4299291264C111919701 @default.
- W4299291264 hasConceptScore W4299291264C112680207 @default.
- W4299291264 hasConceptScore W4299291264C119857082 @default.
- W4299291264 hasConceptScore W4299291264C126255220 @default.
- W4299291264 hasConceptScore W4299291264C145446738 @default.
- W4299291264 hasConceptScore W4299291264C153258448 @default.
- W4299291264 hasConceptScore W4299291264C154945302 @default.
- W4299291264 hasConceptScore W4299291264C162324750 @default.
- W4299291264 hasConceptScore W4299291264C206688291 @default.
- W4299291264 hasConceptScore W4299291264C2524010 @default.
- W4299291264 hasConceptScore W4299291264C26517878 @default.
- W4299291264 hasConceptScore W4299291264C2777303404 @default.
- W4299291264 hasConceptScore W4299291264C33923547 @default.
- W4299291264 hasConceptScore W4299291264C38652104 @default.
- W4299291264 hasConceptScore W4299291264C41008148 @default.
- W4299291264 hasConceptScore W4299291264C50522688 @default.
- W4299291264 hasConceptScore W4299291264C50644808 @default.
- W4299291264 hasConceptScore W4299291264C57869625 @default.
- W4299291264 hasConceptScore W4299291264C8642999 @default.
- W4299291264 hasConceptScore W4299291264C98045186 @default.
- W4299291264 hasLocation W42992912641 @default.
- W4299291264 hasLocation W42992912642 @default.
- W4299291264 hasOpenAccess W4299291264 @default.
- W4299291264 hasPrimaryLocation W42992912641 @default.
- W4299291264 hasRelatedWork W2767441931 @default.
- W4299291264 hasRelatedWork W2808489849 @default.
- W4299291264 hasRelatedWork W2891735383 @default.
- W4299291264 hasRelatedWork W2928207644 @default.
- W4299291264 hasRelatedWork W2952134824 @default.
- W4299291264 hasRelatedWork W2963985749 @default.
- W4299291264 hasRelatedWork W4221162243 @default.
- W4299291264 hasRelatedWork W4283697347 @default.
- W4299291264 hasRelatedWork W4301774174 @default.
- W4299291264 hasRelatedWork W4302420970 @default.
- W4299291264 isParatext "false" @default.
- W4299291264 isRetracted "false" @default.
- W4299291264 workType "article" @default.