Matches in SemOpenAlex for { <https://semopenalex.org/work/W2604451472> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W2604451472 endingPage "2824" @default.
- W2604451472 startingPage "2815" @default.
- W2604451472 abstract "We establish a data-dependent notion of algorithmic stability for Stochastic Gradient Descent (SGD), and employ it to develop novel generalization bounds. This is in contrast to previous distribution-free algorithmic stability results for SGD which depend on the worst-case constants. By virtue of the data-dependent argument, our bounds provide new insights into learning with SGD on convex and non-convex problems. In the convex case, we show that the bound on the generalization error depends on the risk at the initialization point. In the non-convex case, we prove that the expected curvature of the objective function around the initialization point has crucial influence on the generalization error. In both cases, our results suggest a simple data-driven strategy to stabilize SGD by pre-screening its initialization. As a corollary, our results allow us to show optimistic generalization bounds that exhibit fast convergence rates for SGD subject to a vanishing empirical risk and low noise of stochastic gradient." @default.
- W2604451472 created "2017-04-14" @default.
- W2604451472 creator A5041854594 @default.
- W2604451472 creator A5068085751 @default.
- W2604451472 date "2017-03-05" @default.
- W2604451472 modified "2023-09-24" @default.
- W2604451472 title "Data-Dependent Stability of Stochastic Gradient Descent" @default.
- W2604451472 hasPublicationYear "2017" @default.
- W2604451472 type Work @default.
- W2604451472 sameAs 2604451472 @default.
- W2604451472 citedByCount "49" @default.
- W2604451472 countsByYear W26044514722017 @default.
- W2604451472 countsByYear W26044514722018 @default.
- W2604451472 countsByYear W26044514722019 @default.
- W2604451472 countsByYear W26044514722020 @default.
- W2604451472 countsByYear W26044514722021 @default.
- W2604451472 crossrefType "proceedings-article" @default.
- W2604451472 hasAuthorship W2604451472A5041854594 @default.
- W2604451472 hasAuthorship W2604451472A5068085751 @default.
- W2604451472 hasConcept C112680207 @default.
- W2604451472 hasConcept C112972136 @default.
- W2604451472 hasConcept C114466953 @default.
- W2604451472 hasConcept C119857082 @default.
- W2604451472 hasConcept C126255220 @default.
- W2604451472 hasConcept C134306372 @default.
- W2604451472 hasConcept C145446738 @default.
- W2604451472 hasConcept C153258448 @default.
- W2604451472 hasConcept C154945302 @default.
- W2604451472 hasConcept C177148314 @default.
- W2604451472 hasConcept C199360897 @default.
- W2604451472 hasConcept C206688291 @default.
- W2604451472 hasConcept C2524010 @default.
- W2604451472 hasConcept C28826006 @default.
- W2604451472 hasConcept C33923547 @default.
- W2604451472 hasConcept C41008148 @default.
- W2604451472 hasConcept C50644808 @default.
- W2604451472 hasConceptScore W2604451472C112680207 @default.
- W2604451472 hasConceptScore W2604451472C112972136 @default.
- W2604451472 hasConceptScore W2604451472C114466953 @default.
- W2604451472 hasConceptScore W2604451472C119857082 @default.
- W2604451472 hasConceptScore W2604451472C126255220 @default.
- W2604451472 hasConceptScore W2604451472C134306372 @default.
- W2604451472 hasConceptScore W2604451472C145446738 @default.
- W2604451472 hasConceptScore W2604451472C153258448 @default.
- W2604451472 hasConceptScore W2604451472C154945302 @default.
- W2604451472 hasConceptScore W2604451472C177148314 @default.
- W2604451472 hasConceptScore W2604451472C199360897 @default.
- W2604451472 hasConceptScore W2604451472C206688291 @default.
- W2604451472 hasConceptScore W2604451472C2524010 @default.
- W2604451472 hasConceptScore W2604451472C28826006 @default.
- W2604451472 hasConceptScore W2604451472C33923547 @default.
- W2604451472 hasConceptScore W2604451472C41008148 @default.
- W2604451472 hasConceptScore W2604451472C50644808 @default.
- W2604451472 hasLocation W26044514721 @default.
- W2604451472 hasOpenAccess W2604451472 @default.
- W2604451472 hasPrimaryLocation W26044514721 @default.
- W2604451472 hasRelatedWork W2112796928 @default.
- W2604451472 hasRelatedWork W2113651538 @default.
- W2604451472 hasRelatedWork W2131542408 @default.
- W2604451472 hasRelatedWork W2139338362 @default.
- W2604451472 hasRelatedWork W2194775991 @default.
- W2604451472 hasRelatedWork W27434444 @default.
- W2604451472 hasRelatedWork W2795605442 @default.
- W2604451472 hasRelatedWork W2950291451 @default.
- W2604451472 hasRelatedWork W2963094221 @default.
- W2604451472 hasRelatedWork W2963236897 @default.
- W2604451472 hasRelatedWork W2963248893 @default.
- W2604451472 hasRelatedWork W2963285844 @default.
- W2604451472 hasRelatedWork W2963664410 @default.
- W2604451472 hasRelatedWork W2963794891 @default.
- W2604451472 hasRelatedWork W2963959597 @default.
- W2604451472 hasRelatedWork W2964121744 @default.
- W2604451472 hasRelatedWork W2965157832 @default.
- W2604451472 hasRelatedWork W3118608800 @default.
- W2604451472 hasRelatedWork W3137695714 @default.
- W2604451472 hasRelatedWork W607505555 @default.
- W2604451472 hasVolume "80" @default.
- W2604451472 isParatext "false" @default.
- W2604451472 isRetracted "false" @default.
- W2604451472 magId "2604451472" @default.
- W2604451472 workType "article" @default.