Matches in SemOpenAlex for { <https://semopenalex.org/work/W4302016021> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W4302016021 abstract "Statistical preconditioning enables fast methods for distributed large-scale empirical risk minimization problems. In this approach, multiple worker nodes compute gradients in parallel, which are then used by the central node to update the parameter by solving an auxiliary (preconditioned) smaller-scale optimization problem. The recently proposed Statistically Preconditioned Accelerated Gradient (SPAG) method has complexity bounds superior to other such algorithms but requires an exact solution for computationally intensive auxiliary optimization problems at every iteration. In this paper, we propose an Inexact SPAG (InSPAG) and explicitly characterize the accuracy by which the corresponding auxiliary subproblem needs to be solved to guarantee the same convergence rate as the exact method. We build our results by first developing an inexact adaptive accelerated Bregman proximal gradient method for general optimization problems under relative smoothness and strong convexity assumptions, which may be of independent interest. Moreover, we explore the properties of the auxiliary problem in the InSPAG algorithm assuming Lipschitz third-order derivatives and strong convexity. For such problem class, we develop a linearly convergent Hyperfast second-order method and estimate the total complexity of the InSPAG method with hyperfast auxiliary problem solver. Finally, we illustrate the proposed method's practical efficiency by performing large-scale numerical experiments on logistic regression models. To the best of our knowledge, these are the first empirical results on implementing high-order methods on large-scale problems, we work with data where the dimension is of the order of~$3$ million, and the number of samples is~$700$ million." @default.
- W4302016021 created "2022-10-06" @default.
- W4302016021 creator A5006239162 @default.
- W4302016021 creator A5028866398 @default.
- W4302016021 creator A5039064031 @default.
- W4302016021 creator A5047076392 @default.
- W4302016021 creator A5065807862 @default.
- W4302016021 creator A5082992656 @default.
- W4302016021 creator A5083790318 @default.
- W4302016021 date "2021-02-16" @default.
- W4302016021 modified "2023-10-14" @default.
- W4302016021 title "Hyperfast Second-Order Local Solvers for Efficient Statistically Preconditioned Distributed Optimization" @default.
- W4302016021 doi "https://doi.org/10.48550/arxiv.2102.08246" @default.
- W4302016021 hasPublicationYear "2021" @default.
- W4302016021 type Work @default.
- W4302016021 citedByCount "0" @default.
- W4302016021 crossrefType "posted-content" @default.
- W4302016021 hasAuthorship W4302016021A5006239162 @default.
- W4302016021 hasAuthorship W4302016021A5028866398 @default.
- W4302016021 hasAuthorship W4302016021A5039064031 @default.
- W4302016021 hasAuthorship W4302016021A5047076392 @default.
- W4302016021 hasAuthorship W4302016021A5065807862 @default.
- W4302016021 hasAuthorship W4302016021A5082992656 @default.
- W4302016021 hasAuthorship W4302016021A5083790318 @default.
- W4302016021 hasBestOaLocation W43020160211 @default.
- W4302016021 hasConcept C102634674 @default.
- W4302016021 hasConcept C106159729 @default.
- W4302016021 hasConcept C11413529 @default.
- W4302016021 hasConcept C121332964 @default.
- W4302016021 hasConcept C126255220 @default.
- W4302016021 hasConcept C127162648 @default.
- W4302016021 hasConcept C134306372 @default.
- W4302016021 hasConcept C137836250 @default.
- W4302016021 hasConcept C162324750 @default.
- W4302016021 hasConcept C202444582 @default.
- W4302016021 hasConcept C22324862 @default.
- W4302016021 hasConcept C2777303404 @default.
- W4302016021 hasConcept C2778755073 @default.
- W4302016021 hasConcept C2778770139 @default.
- W4302016021 hasConcept C28826006 @default.
- W4302016021 hasConcept C31258907 @default.
- W4302016021 hasConcept C33676613 @default.
- W4302016021 hasConcept C33923547 @default.
- W4302016021 hasConcept C41008148 @default.
- W4302016021 hasConcept C50522688 @default.
- W4302016021 hasConcept C57869625 @default.
- W4302016021 hasConcept C62520636 @default.
- W4302016021 hasConcept C72134830 @default.
- W4302016021 hasConceptScore W4302016021C102634674 @default.
- W4302016021 hasConceptScore W4302016021C106159729 @default.
- W4302016021 hasConceptScore W4302016021C11413529 @default.
- W4302016021 hasConceptScore W4302016021C121332964 @default.
- W4302016021 hasConceptScore W4302016021C126255220 @default.
- W4302016021 hasConceptScore W4302016021C127162648 @default.
- W4302016021 hasConceptScore W4302016021C134306372 @default.
- W4302016021 hasConceptScore W4302016021C137836250 @default.
- W4302016021 hasConceptScore W4302016021C162324750 @default.
- W4302016021 hasConceptScore W4302016021C202444582 @default.
- W4302016021 hasConceptScore W4302016021C22324862 @default.
- W4302016021 hasConceptScore W4302016021C2777303404 @default.
- W4302016021 hasConceptScore W4302016021C2778755073 @default.
- W4302016021 hasConceptScore W4302016021C2778770139 @default.
- W4302016021 hasConceptScore W4302016021C28826006 @default.
- W4302016021 hasConceptScore W4302016021C31258907 @default.
- W4302016021 hasConceptScore W4302016021C33676613 @default.
- W4302016021 hasConceptScore W4302016021C33923547 @default.
- W4302016021 hasConceptScore W4302016021C41008148 @default.
- W4302016021 hasConceptScore W4302016021C50522688 @default.
- W4302016021 hasConceptScore W4302016021C57869625 @default.
- W4302016021 hasConceptScore W4302016021C62520636 @default.
- W4302016021 hasConceptScore W4302016021C72134830 @default.
- W4302016021 hasLocation W43020160211 @default.
- W4302016021 hasOpenAccess W4302016021 @default.
- W4302016021 hasPrimaryLocation W43020160211 @default.
- W4302016021 hasRelatedWork W2070613768 @default.
- W4302016021 hasRelatedWork W2807215287 @default.
- W4302016021 hasRelatedWork W2913092934 @default.
- W4302016021 hasRelatedWork W2964237975 @default.
- W4302016021 hasRelatedWork W3197880104 @default.
- W4302016021 hasRelatedWork W3205968963 @default.
- W4302016021 hasRelatedWork W3208021060 @default.
- W4302016021 hasRelatedWork W4289782908 @default.
- W4302016021 hasRelatedWork W4312397237 @default.
- W4302016021 hasRelatedWork W86273898 @default.
- W4302016021 isParatext "false" @default.
- W4302016021 isRetracted "false" @default.
- W4302016021 workType "article" @default.