Matches in SemOpenAlex for { <https://semopenalex.org/work/W2890773834> ?p ?o ?g. }
- W2890773834 abstract "Stochastic gradient Hamiltonian Monte Carlo (SGHMC) is a variant of stochastic gradient with momentum where a controlled and properly scaled Gaussian noise is added to the stochastic gradients to steer the iterates towards a global minimum. Many works reported its empirical success in practice for solving stochastic non-convex optimization problems, in particular it has been observed to outperform overdamped Langevin Monte Carlo-based methods such as stochastic gradient Langevin dynamics (SGLD) in many applications. Although asymptotic global convergence properties of SGHMC are well known, its finite-time performance is not well-understood. In this work, we study two variants of SGHMC based on two alternative discretizations of the underdamped Langevin diffusion. We provide finite-time performance bounds for the global convergence of both SGHMC variants for solving stochastic non-convex optimization problems with explicit constants. Our results lead to non-asymptotic guarantees for both population and empirical risk minimization problems. For a fixed target accuracy level, on a class of non-convex problems, we obtain complexity bounds for SGHMC that can be tighter than those for SGLD. These results show that acceleration with momentum is possible in the context of global non-convex optimization." @default.
- W2890773834 created "2018-09-27" @default.
- W2890773834 creator A5034370705 @default.
- W2890773834 creator A5035171822 @default.
- W2890773834 creator A5084475092 @default.
- W2890773834 date "2018-09-12" @default.
- W2890773834 modified "2023-10-14" @default.
- W2890773834 title "Global Convergence of Stochastic Gradient Hamiltonian Monte Carlo for Non-Convex Stochastic Optimization: Non-Asymptotic Performance Bounds and Momentum-Based Acceleration" @default.
- W2890773834 cites W104184427 @default.
- W2890773834 cites W123701566 @default.
- W2890773834 cites W1567414581 @default.
- W2890773834 cites W1568288633 @default.
- W2890773834 cites W1606751908 @default.
- W2890773834 cites W1652006273 @default.
- W2890773834 cites W1963921091 @default.
- W2890773834 cites W1987083649 @default.
- W2890773834 cites W1998754480 @default.
- W2890773834 cites W2007817872 @default.
- W2890773834 cites W2013321956 @default.
- W2890773834 cites W2024060531 @default.
- W2890773834 cites W2041898787 @default.
- W2890773834 cites W2045992064 @default.
- W2890773834 cites W2046392353 @default.
- W2890773834 cites W2047028564 @default.
- W2890773834 cites W2059448777 @default.
- W2890773834 cites W2065448588 @default.
- W2890773834 cites W2069627663 @default.
- W2890773834 cites W2085266415 @default.
- W2890773834 cites W2089394015 @default.
- W2890773834 cites W2090385746 @default.
- W2890773834 cites W2097854052 @default.
- W2890773834 cites W2100397110 @default.
- W2890773834 cites W2104049095 @default.
- W2890773834 cites W2110529144 @default.
- W2890773834 cites W2115380905 @default.
- W2890773834 cites W2118439011 @default.
- W2890773834 cites W2122385821 @default.
- W2890773834 cites W2134829400 @default.
- W2890773834 cites W2144193737 @default.
- W2890773834 cites W2158460069 @default.
- W2890773834 cites W2161340280 @default.
- W2890773834 cites W2162152253 @default.
- W2890773834 cites W2165652770 @default.
- W2890773834 cites W2167433878 @default.
- W2890773834 cites W2170316986 @default.
- W2890773834 cites W2184596805 @default.
- W2890773834 cites W2186210550 @default.
- W2890773834 cites W2222154095 @default.
- W2890773834 cites W2271232908 @default.
- W2890773834 cites W2323824333 @default.
- W2890773834 cites W2478027467 @default.
- W2890773834 cites W2487770199 @default.
- W2890773834 cites W2528062157 @default.
- W2890773834 cites W2546420264 @default.
- W2890773834 cites W2552959509 @default.
- W2890773834 cites W2572702041 @default.
- W2890773834 cites W2592172378 @default.
- W2890773834 cites W2738410460 @default.
- W2890773834 cites W2746461338 @default.
- W2890773834 cites W2766371994 @default.
- W2890773834 cites W2783859821 @default.
- W2890773834 cites W2787738298 @default.
- W2890773834 cites W2799226512 @default.
- W2890773834 cites W2802698595 @default.
- W2890773834 cites W2804227275 @default.
- W2890773834 cites W2883952565 @default.
- W2890773834 cites W2886739049 @default.
- W2890773834 cites W2896740728 @default.
- W2890773834 cites W2906421926 @default.
- W2890773834 cites W2914275007 @default.
- W2890773834 cites W2945658460 @default.
- W2890773834 cites W2951787821 @default.
- W2890773834 cites W2962703949 @default.
- W2890773834 cites W2962707965 @default.
- W2890773834 cites W2962732346 @default.
- W2890773834 cites W2962839956 @default.
- W2890773834 cites W2962851953 @default.
- W2890773834 cites W2962930655 @default.
- W2890773834 cites W2962947632 @default.
- W2890773834 cites W2963038177 @default.
- W2890773834 cites W2963050127 @default.
- W2890773834 cites W2963122491 @default.
- W2890773834 cites W2963145271 @default.
- W2890773834 cites W2963153890 @default.
- W2890773834 cites W2963430672 @default.
- W2890773834 cites W2963481221 @default.
- W2890773834 cites W2963499939 @default.
- W2890773834 cites W2963559717 @default.
- W2890773834 cites W2963599479 @default.
- W2890773834 cites W2963657165 @default.
- W2890773834 cites W2963744427 @default.
- W2890773834 cites W2963794891 @default.
- W2890773834 cites W2963870478 @default.
- W2890773834 cites W2963874210 @default.
- W2890773834 cites W2964027370 @default.
- W2890773834 cites W2964106499 @default.
- W2890773834 cites W2964265968 @default.
- W2890773834 cites W2964301034 @default.
- W2890773834 cites W3093329015 @default.
- W2890773834 cites W3104860245 @default.