Matches in SemOpenAlex for { <https://semopenalex.org/work/W3035278189> ?p ?o ?g. }
- W3035278189 abstract "This paper focuses on stochastic methods for solving smooth non-convex strongly-concave min-max problems, which have received increasing attention due to their potential applications in deep learning (e.g., deep AUC maximization). However, most of the existing algorithms are slow in practice, and their analysis revolves around the convergence to a nearly stationary point. We consider leveraging the Polyak-Łojasiewicz (PL) condition to design faster stochastic algorithms with stronger convergence guarantee. Although PL condition has been utilized for designing many stochastic minimization algorithms, their applications for non-convex min-max optimization remains rare. In this paper, we propose and analyze proximal epoch-based methods, and establish fast convergence in terms of both {bf the primal objective gap and the duality gap}. Our analysis is interesting in threefold: (i) it is based on a novel Lyapunov function that consists of the primal objective gap and the duality gap of a regularized function; (ii) it only requires a weaker PL condition for establishing the primal objective convergence than that required for the duality gap convergence; (iii) it yields the optimal dependence on the accuracy level $epsilon$, i.e., $O(1/epsilon)$. We also make explicit the dependence on the problem parameters and explore regions of weak convexity parameter that lead to improved dependence on condition numbers. Experiments on deep AUC maximization demonstrate the effectiveness of our methods. Our method (MaxAUC) achieved an AUC of 0.922 on private testing set on {bf CheXpert competition}." @default.
- W3035278189 created "2020-06-19" @default.
- W3035278189 creator A5023288846 @default.
- W3035278189 creator A5048411184 @default.
- W3035278189 creator A5054429972 @default.
- W3035278189 creator A5056106003 @default.
- W3035278189 date "2020-06-12" @default.
- W3035278189 modified "2023-09-27" @default.
- W3035278189 title "Fast Objective and Duality Gap Convergence for Non-convex Strongly-concave Min-max Problems." @default.
- W3035278189 cites W2038497950 @default.
- W3035278189 cites W2089559088 @default.
- W3035278189 cites W2146502635 @default.
- W3035278189 cites W2154682027 @default.
- W3035278189 cites W2302255633 @default.
- W3035278189 cites W2564590721 @default.
- W3035278189 cites W2619167391 @default.
- W3035278189 cites W2766383435 @default.
- W3035278189 cites W2766844050 @default.
- W3035278189 cites W2803444541 @default.
- W3035278189 cites W2886067286 @default.
- W3035278189 cites W2889576094 @default.
- W3035278189 cites W2894604724 @default.
- W3035278189 cites W2894972989 @default.
- W3035278189 cites W2895628298 @default.
- W3035278189 cites W2898280890 @default.
- W3035278189 cites W2899748887 @default.
- W3035278189 cites W2900976719 @default.
- W3035278189 cites W2905418717 @default.
- W3035278189 cites W2911319680 @default.
- W3035278189 cites W2944407464 @default.
- W3035278189 cites W2947761153 @default.
- W3035278189 cites W2947996939 @default.
- W3035278189 cites W2952574409 @default.
- W3035278189 cites W2963248893 @default.
- W3035278189 cites W2963466845 @default.
- W3035278189 cites W2963519230 @default.
- W3035278189 cites W2963545805 @default.
- W3035278189 cites W2963614065 @default.
- W3035278189 cites W2963965485 @default.
- W3035278189 cites W2964121860 @default.
- W3035278189 cites W2970072150 @default.
- W3035278189 cites W2970224333 @default.
- W3035278189 cites W2970416783 @default.
- W3035278189 cites W2986198551 @default.
- W3035278189 cites W2995509798 @default.
- W3035278189 cites W3004694802 @default.
- W3035278189 cites W3006143972 @default.
- W3035278189 cites W3007136572 @default.
- W3035278189 cites W3016604587 @default.
- W3035278189 cites W3024655380 @default.
- W3035278189 cites W3029957720 @default.
- W3035278189 cites W3035810502 @default.
- W3035278189 cites W3101511375 @default.
- W3035278189 cites W3122459568 @default.
- W3035278189 hasPublicationYear "2020" @default.
- W3035278189 type Work @default.
- W3035278189 sameAs 3035278189 @default.
- W3035278189 citedByCount "7" @default.
- W3035278189 countsByYear W30352781892020 @default.
- W3035278189 countsByYear W30352781892021 @default.
- W3035278189 crossrefType "posted-content" @default.
- W3035278189 hasAuthorship W3035278189A5023288846 @default.
- W3035278189 hasAuthorship W3035278189A5048411184 @default.
- W3035278189 hasAuthorship W3035278189A5054429972 @default.
- W3035278189 hasAuthorship W3035278189A5056106003 @default.
- W3035278189 hasConcept C106159729 @default.
- W3035278189 hasConcept C112680207 @default.
- W3035278189 hasConcept C114614502 @default.
- W3035278189 hasConcept C126255220 @default.
- W3035278189 hasConcept C127162648 @default.
- W3035278189 hasConcept C134306372 @default.
- W3035278189 hasConcept C137836250 @default.
- W3035278189 hasConcept C14036430 @default.
- W3035278189 hasConcept C145446738 @default.
- W3035278189 hasConcept C162324750 @default.
- W3035278189 hasConcept C189237950 @default.
- W3035278189 hasConcept C2524010 @default.
- W3035278189 hasConcept C2776330181 @default.
- W3035278189 hasConcept C2777303404 @default.
- W3035278189 hasConcept C2778023678 @default.
- W3035278189 hasConcept C28826006 @default.
- W3035278189 hasConcept C31258907 @default.
- W3035278189 hasConcept C33923547 @default.
- W3035278189 hasConcept C41008148 @default.
- W3035278189 hasConcept C50522688 @default.
- W3035278189 hasConcept C5274546 @default.
- W3035278189 hasConcept C57869625 @default.
- W3035278189 hasConcept C72134830 @default.
- W3035278189 hasConcept C78458016 @default.
- W3035278189 hasConcept C86803240 @default.
- W3035278189 hasConceptScore W3035278189C106159729 @default.
- W3035278189 hasConceptScore W3035278189C112680207 @default.
- W3035278189 hasConceptScore W3035278189C114614502 @default.
- W3035278189 hasConceptScore W3035278189C126255220 @default.
- W3035278189 hasConceptScore W3035278189C127162648 @default.
- W3035278189 hasConceptScore W3035278189C134306372 @default.
- W3035278189 hasConceptScore W3035278189C137836250 @default.
- W3035278189 hasConceptScore W3035278189C14036430 @default.
- W3035278189 hasConceptScore W3035278189C145446738 @default.
- W3035278189 hasConceptScore W3035278189C162324750 @default.