Matches in SemOpenAlex for { <https://semopenalex.org/work/W3009716613> ?p ?o ?g. }
- W3009716613 abstract "First-order operator splitting methods are ubiquitous among many fields through science and engineering, such as inverse problems, signal/image processing, statistics, data science and machine learning, to name a few. In this paper, we study a geometric property of first-order methods when applying to solve non-smooth optimization problems. With the tool of partial smoothness, we design a framework to analyze the trajectory of the fixed-point sequence generated by first-order methods and show that locally, the fixed-point sequence settles onto a regular trajectory such as a straight line or a spiral. Based on this finding, we discuss the limitation of current widely used inertial acceleration technique, and propose a trajectory following adaptive acceleration algorithm. Global convergence is established for the proposed acceleration scheme based on the perturbation of fixed-point iteration. Locally, we first build connections between the acceleration scheme and the well-studied vector extrapolation technique in the field of numerical analysis, and then discuss local acceleration guarantees of the proposed acceleration scheme. Moreover, our result provides a geometric interpretation of these vector extrapolation techniques. Numerical experiments on various first-order methods are provided to demonstrate the advantage of the proposed adaptive acceleration scheme." @default.
- W3009716613 created "2020-03-13" @default.
- W3009716613 creator A5004350216 @default.
- W3009716613 creator A5066789410 @default.
- W3009716613 date "2020-03-08" @default.
- W3009716613 modified "2023-10-17" @default.
- W3009716613 title "Geometry of First-Order Methods and Adaptive Acceleration" @default.
- W3009716613 cites W1171682542 @default.
- W3009716613 cites W130545285 @default.
- W3009716613 cites W134988115 @default.
- W3009716613 cites W1495768073 @default.
- W3009716613 cites W1560858410 @default.
- W3009716613 cites W171925985 @default.
- W3009716613 cites W1755177043 @default.
- W3009716613 cites W1964328797 @default.
- W3009716613 cites W1967138577 @default.
- W3009716613 cites W1973665846 @default.
- W3009716613 cites W1977318272 @default.
- W3009716613 cites W1980177911 @default.
- W3009716613 cites W1988720110 @default.
- W3009716613 cites W1989464734 @default.
- W3009716613 cites W199410564 @default.
- W3009716613 cites W2000517377 @default.
- W3009716613 cites W2003372231 @default.
- W3009716613 cites W2016503956 @default.
- W3009716613 cites W2019569173 @default.
- W3009716613 cites W2020228089 @default.
- W3009716613 cites W2026198955 @default.
- W3009716613 cites W2030254567 @default.
- W3009716613 cites W2035100079 @default.
- W3009716613 cites W2038281434 @default.
- W3009716613 cites W2040544037 @default.
- W3009716613 cites W2045079045 @default.
- W3009716613 cites W2047003499 @default.
- W3009716613 cites W2048408528 @default.
- W3009716613 cites W2056578325 @default.
- W3009716613 cites W205960364 @default.
- W3009716613 cites W2063357812 @default.
- W3009716613 cites W2065196265 @default.
- W3009716613 cites W2069435104 @default.
- W3009716613 cites W2085440994 @default.
- W3009716613 cites W2092663520 @default.
- W3009716613 cites W2095980290 @default.
- W3009716613 cites W2100556411 @default.
- W3009716613 cites W2114423093 @default.
- W3009716613 cites W2124450277 @default.
- W3009716613 cites W2127447444 @default.
- W3009716613 cites W2130025383 @default.
- W3009716613 cites W2139313686 @default.
- W3009716613 cites W2145962650 @default.
- W3009716613 cites W2155727363 @default.
- W3009716613 cites W2287475882 @default.
- W3009716613 cites W2324838733 @default.
- W3009716613 cites W2331034993 @default.
- W3009716613 cites W2486484692 @default.
- W3009716613 cites W2528062157 @default.
- W3009716613 cites W2544462709 @default.
- W3009716613 cites W2562808805 @default.
- W3009716613 cites W2579401700 @default.
- W3009716613 cites W2580889931 @default.
- W3009716613 cites W2610857016 @default.
- W3009716613 cites W2643255885 @default.
- W3009716613 cites W2803984542 @default.
- W3009716613 cites W2811074406 @default.
- W3009716613 cites W2886586113 @default.
- W3009716613 cites W2886987088 @default.
- W3009716613 cites W2897413842 @default.
- W3009716613 cites W2918202932 @default.
- W3009716613 cites W2962827308 @default.
- W3009716613 cites W2963484923 @default.
- W3009716613 cites W2963899645 @default.
- W3009716613 cites W2963953907 @default.
- W3009716613 cites W2964094444 @default.
- W3009716613 cites W2964137109 @default.
- W3009716613 cites W2964224255 @default.
- W3009716613 cites W2970692013 @default.
- W3009716613 cites W2971179628 @default.
- W3009716613 cites W2990168768 @default.
- W3009716613 cites W3122823243 @default.
- W3009716613 cites W322738573 @default.
- W3009716613 doi "https://doi.org/10.48550/arxiv.2003.03910" @default.
- W3009716613 hasPublicationYear "2020" @default.
- W3009716613 type Work @default.
- W3009716613 sameAs 3009716613 @default.
- W3009716613 citedByCount "2" @default.
- W3009716613 countsByYear W30097166132021 @default.
- W3009716613 countsByYear W30097166132022 @default.
- W3009716613 crossrefType "posted-content" @default.
- W3009716613 hasAuthorship W3009716613A5004350216 @default.
- W3009716613 hasAuthorship W3009716613A5066789410 @default.
- W3009716613 hasBestOaLocation W30097166131 @default.
- W3009716613 hasConcept C102634674 @default.
- W3009716613 hasConcept C11413529 @default.
- W3009716613 hasConcept C117896860 @default.
- W3009716613 hasConcept C121332964 @default.
- W3009716613 hasConcept C126255220 @default.
- W3009716613 hasConcept C127162648 @default.
- W3009716613 hasConcept C1276947 @default.
- W3009716613 hasConcept C132459708 @default.
- W3009716613 hasConcept C13280743 @default.