Matches in SemOpenAlex for { <https://semopenalex.org/work/W3132614086> ?p ?o ?g. }
- W3132614086 abstract "A recent line of ground-breaking results for permutation-based SGD has corroborated a widely observed phenomenon: random permutations offer faster convergence than with-replacement sampling. However, is random optimal? We show that this depends heavily on what functions we are optimizing, and the convergence gap between optimal and random permutations can vary from exponential to nonexistent. We first show that for 1-dimensional strongly convex functions, with smooth second derivatives, there exist optimal permutations that offer exponentially faster convergence compared to random. However, for general strongly convex functions, random permutations are optimal. Finally, we show that for quadratic, strongly-convex functions, there are easy-to-construct permutations that lead to accelerated convergence compared to random. Our results suggest that a general convergence characterization of optimal permutations cannot capture the nuances of individual function classes, and can mistakenly indicate that one cannot do much better than random." @default.
- W3132614086 created "2021-03-01" @default.
- W3132614086 creator A5018630988 @default.
- W3132614086 creator A5046093647 @default.
- W3132614086 creator A5073193050 @default.
- W3132614086 date "2021-02-19" @default.
- W3132614086 modified "2023-09-27" @default.
- W3132614086 title "Permutation-Based SGD: Is Random Optimal?" @default.
- W3132614086 cites W1600587676 @default.
- W3132614086 cites W2105767123 @default.
- W3132614086 cites W2134130436 @default.
- W3132614086 cites W2409483509 @default.
- W3132614086 cites W2557191228 @default.
- W3132614086 cites W2918941755 @default.
- W3132614086 cites W2950397435 @default.
- W3132614086 cites W2962970252 @default.
- W3132614086 cites W2963326510 @default.
- W3132614086 cites W2965500152 @default.
- W3132614086 cites W2980820424 @default.
- W3132614086 cites W3006380006 @default.
- W3132614086 cites W3007986655 @default.
- W3132614086 cites W3008438679 @default.
- W3132614086 cites W3034163554 @default.
- W3132614086 cites W3034697819 @default.
- W3132614086 cites W3098677710 @default.
- W3132614086 cites W3101271792 @default.
- W3132614086 cites W3106152900 @default.
- W3132614086 cites W3110645490 @default.
- W3132614086 cites W3141595720 @default.
- W3132614086 cites W3168795298 @default.
- W3132614086 cites W3171966211 @default.
- W3132614086 hasPublicationYear "2021" @default.
- W3132614086 type Work @default.
- W3132614086 sameAs 3132614086 @default.
- W3132614086 citedByCount "1" @default.
- W3132614086 countsByYear W31326140862021 @default.
- W3132614086 crossrefType "posted-content" @default.
- W3132614086 hasAuthorship W3132614086A5018630988 @default.
- W3132614086 hasAuthorship W3132614086A5046093647 @default.
- W3132614086 hasAuthorship W3132614086A5073193050 @default.
- W3132614086 hasConcept C105795698 @default.
- W3132614086 hasConcept C112680207 @default.
- W3132614086 hasConcept C114614502 @default.
- W3132614086 hasConcept C118615104 @default.
- W3132614086 hasConcept C121332964 @default.
- W3132614086 hasConcept C122123141 @default.
- W3132614086 hasConcept C126255220 @default.
- W3132614086 hasConcept C128622974 @default.
- W3132614086 hasConcept C129844170 @default.
- W3132614086 hasConcept C130402806 @default.
- W3132614086 hasConcept C134306372 @default.
- W3132614086 hasConcept C13929819 @default.
- W3132614086 hasConcept C14036430 @default.
- W3132614086 hasConcept C145446738 @default.
- W3132614086 hasConcept C151376022 @default.
- W3132614086 hasConcept C162324750 @default.
- W3132614086 hasConcept C200985842 @default.
- W3132614086 hasConcept C21308566 @default.
- W3132614086 hasConcept C24890656 @default.
- W3132614086 hasConcept C2524010 @default.
- W3132614086 hasConcept C2777303404 @default.
- W3132614086 hasConcept C28826006 @default.
- W3132614086 hasConcept C33923547 @default.
- W3132614086 hasConcept C50522688 @default.
- W3132614086 hasConcept C78458016 @default.
- W3132614086 hasConcept C86803240 @default.
- W3132614086 hasConcept C95763700 @default.
- W3132614086 hasConceptScore W3132614086C105795698 @default.
- W3132614086 hasConceptScore W3132614086C112680207 @default.
- W3132614086 hasConceptScore W3132614086C114614502 @default.
- W3132614086 hasConceptScore W3132614086C118615104 @default.
- W3132614086 hasConceptScore W3132614086C121332964 @default.
- W3132614086 hasConceptScore W3132614086C122123141 @default.
- W3132614086 hasConceptScore W3132614086C126255220 @default.
- W3132614086 hasConceptScore W3132614086C128622974 @default.
- W3132614086 hasConceptScore W3132614086C129844170 @default.
- W3132614086 hasConceptScore W3132614086C130402806 @default.
- W3132614086 hasConceptScore W3132614086C134306372 @default.
- W3132614086 hasConceptScore W3132614086C13929819 @default.
- W3132614086 hasConceptScore W3132614086C14036430 @default.
- W3132614086 hasConceptScore W3132614086C145446738 @default.
- W3132614086 hasConceptScore W3132614086C151376022 @default.
- W3132614086 hasConceptScore W3132614086C162324750 @default.
- W3132614086 hasConceptScore W3132614086C200985842 @default.
- W3132614086 hasConceptScore W3132614086C21308566 @default.
- W3132614086 hasConceptScore W3132614086C24890656 @default.
- W3132614086 hasConceptScore W3132614086C2524010 @default.
- W3132614086 hasConceptScore W3132614086C2777303404 @default.
- W3132614086 hasConceptScore W3132614086C28826006 @default.
- W3132614086 hasConceptScore W3132614086C33923547 @default.
- W3132614086 hasConceptScore W3132614086C50522688 @default.
- W3132614086 hasConceptScore W3132614086C78458016 @default.
- W3132614086 hasConceptScore W3132614086C86803240 @default.
- W3132614086 hasConceptScore W3132614086C95763700 @default.
- W3132614086 hasLocation W31326140861 @default.
- W3132614086 hasOpenAccess W3132614086 @default.
- W3132614086 hasPrimaryLocation W31326140861 @default.
- W3132614086 hasRelatedWork W2007966243 @default.
- W3132614086 hasRelatedWork W2044318215 @default.
- W3132614086 hasRelatedWork W2547989012 @default.