Matches in SemOpenAlex for { <https://semopenalex.org/work/W3033376635> ?p ?o ?g. }
- W3033376635 abstract "The regret bound of dynamic online learning algorithms is often expressed in terms of the variation in the function sequence ($V_T$) and/or the path-length of the minimizer sequence after $T$ rounds. For strongly convex and smooth functions, , Zhang et al. establish the squared path-length of the minimizer sequence ($C^*_{2,T}$) as a lower bound on regret. They also show that online gradient descent (OGD) achieves this lower bound using multiple gradient queries per round. In this paper, we focus on unconstrained online optimization. We first show that a preconditioned variant of OGD achieves $O(C^*_{2,T})$ with one gradient query per round. We then propose online optimistic Newton (OON) method for the case when the first and second order information of the function sequence is predictable. The regret bound of OON is captured via the quartic path-length of the minimizer sequence ($C^*_{4,T}$), which can be much smaller than $C^*_{2,T}$. We finally show that by using multiple gradients for OGD, we can achieve an upper bound of $O(min{C^*_{2,T},V_T})$ on regret." @default.
- W3033376635 created "2020-06-12" @default.
- W3033376635 creator A5040922600 @default.
- W3033376635 creator A5087313193 @default.
- W3033376635 date "2020-06-06" @default.
- W3033376635 modified "2023-09-25" @default.
- W3033376635 title "Unconstrained Online Optimization: Dynamic Regret Analysis of Strongly Convex and Smooth Problems" @default.
- W3033376635 cites W1878322007 @default.
- W3033376635 cites W1979289676 @default.
- W3033376635 cites W2129160848 @default.
- W3033376635 cites W2143343660 @default.
- W3033376635 cites W2148825261 @default.
- W3033376635 cites W2186453173 @default.
- W3033376635 cites W2513180554 @default.
- W3033376635 cites W2804869728 @default.
- W3033376635 cites W2914336508 @default.
- W3033376635 cites W2941337889 @default.
- W3033376635 cites W2951445759 @default.
- W3033376635 cites W2963201118 @default.
- W3033376635 cites W2963903516 @default.
- W3033376635 cites W2964188247 @default.
- W3033376635 cites W2964309292 @default.
- W3033376635 cites W2971615422 @default.
- W3033376635 cites W3004342364 @default.
- W3033376635 cites W3004552127 @default.
- W3033376635 cites W3123661679 @default.
- W3033376635 cites W36041826 @default.
- W3033376635 doi "https://doi.org/10.48550/arxiv.2006.03912" @default.
- W3033376635 hasPublicationYear "2020" @default.
- W3033376635 type Work @default.
- W3033376635 sameAs 3033376635 @default.
- W3033376635 citedByCount "0" @default.
- W3033376635 crossrefType "posted-content" @default.
- W3033376635 hasAuthorship W3033376635A5040922600 @default.
- W3033376635 hasAuthorship W3033376635A5087313193 @default.
- W3033376635 hasBestOaLocation W30333766351 @default.
- W3033376635 hasConcept C10138342 @default.
- W3033376635 hasConcept C105795698 @default.
- W3033376635 hasConcept C112680207 @default.
- W3033376635 hasConcept C114614502 @default.
- W3033376635 hasConcept C126255220 @default.
- W3033376635 hasConcept C130432447 @default.
- W3033376635 hasConcept C134306372 @default.
- W3033376635 hasConcept C14036430 @default.
- W3033376635 hasConcept C145446738 @default.
- W3033376635 hasConcept C153258448 @default.
- W3033376635 hasConcept C154945302 @default.
- W3033376635 hasConcept C162324750 @default.
- W3033376635 hasConcept C182306322 @default.
- W3033376635 hasConcept C199360897 @default.
- W3033376635 hasConcept C202444582 @default.
- W3033376635 hasConcept C2524010 @default.
- W3033376635 hasConcept C2777735758 @default.
- W3033376635 hasConcept C2778112365 @default.
- W3033376635 hasConcept C33923547 @default.
- W3033376635 hasConcept C41008148 @default.
- W3033376635 hasConcept C50644808 @default.
- W3033376635 hasConcept C50817715 @default.
- W3033376635 hasConcept C54355233 @default.
- W3033376635 hasConcept C77553402 @default.
- W3033376635 hasConcept C78458016 @default.
- W3033376635 hasConcept C86803240 @default.
- W3033376635 hasConceptScore W3033376635C10138342 @default.
- W3033376635 hasConceptScore W3033376635C105795698 @default.
- W3033376635 hasConceptScore W3033376635C112680207 @default.
- W3033376635 hasConceptScore W3033376635C114614502 @default.
- W3033376635 hasConceptScore W3033376635C126255220 @default.
- W3033376635 hasConceptScore W3033376635C130432447 @default.
- W3033376635 hasConceptScore W3033376635C134306372 @default.
- W3033376635 hasConceptScore W3033376635C14036430 @default.
- W3033376635 hasConceptScore W3033376635C145446738 @default.
- W3033376635 hasConceptScore W3033376635C153258448 @default.
- W3033376635 hasConceptScore W3033376635C154945302 @default.
- W3033376635 hasConceptScore W3033376635C162324750 @default.
- W3033376635 hasConceptScore W3033376635C182306322 @default.
- W3033376635 hasConceptScore W3033376635C199360897 @default.
- W3033376635 hasConceptScore W3033376635C202444582 @default.
- W3033376635 hasConceptScore W3033376635C2524010 @default.
- W3033376635 hasConceptScore W3033376635C2777735758 @default.
- W3033376635 hasConceptScore W3033376635C2778112365 @default.
- W3033376635 hasConceptScore W3033376635C33923547 @default.
- W3033376635 hasConceptScore W3033376635C41008148 @default.
- W3033376635 hasConceptScore W3033376635C50644808 @default.
- W3033376635 hasConceptScore W3033376635C50817715 @default.
- W3033376635 hasConceptScore W3033376635C54355233 @default.
- W3033376635 hasConceptScore W3033376635C77553402 @default.
- W3033376635 hasConceptScore W3033376635C78458016 @default.
- W3033376635 hasConceptScore W3033376635C86803240 @default.
- W3033376635 hasLocation W30333766351 @default.
- W3033376635 hasOpenAccess W3033376635 @default.
- W3033376635 hasPrimaryLocation W30333766351 @default.
- W3033376635 hasRelatedWork W2108763700 @default.
- W3033376635 hasRelatedWork W2197235258 @default.
- W3033376635 hasRelatedWork W3033376635 @default.
- W3033376635 hasRelatedWork W3132009460 @default.
- W3033376635 hasRelatedWork W3138687421 @default.
- W3033376635 hasRelatedWork W3173442999 @default.
- W3033376635 hasRelatedWork W3176081970 @default.
- W3033376635 hasRelatedWork W4287761512 @default.
- W3033376635 hasRelatedWork W4294691466 @default.