Matches in SemOpenAlex for { <https://semopenalex.org/work/W2593511347> ?p ?o ?g. }
- W2593511347 abstract "Iterative Hard Thresholding (IHT) is a class of projected gradient descent methods for optimizing sparsity-constrained minimization models, with the best known efficiency and scalability in practice. As far as we know, the existing IHT-style methods are designed for sparse minimization in primal form. It remains open to explore duality theory and algorithms in such a non-convex and NP-hard problem setting. In this paper, we bridge this gap by establishing a duality theory for sparsity-constrained minimization with $ell_2$-regularized loss function and proposing an IHT-style algorithm for dual maximization. Our sparse duality theory provides a set of sufficient and necessary conditions under which the original NP-hard/non-convex problem can be equivalently solved in a dual formulation. The proposed dual IHT algorithm is a super-gradient method for maximizing the non-smooth dual objective. An interesting finding is that the sparse recovery performance of dual IHT is invariant to the Restricted Isometry Property (RIP), which is required by virtually all the existing primal IHT algorithms without sparsity relaxation. Moreover, a stochastic variant of dual IHT is proposed for large-scale stochastic optimization. Numerical results demonstrate the superiority of dual IHT algorithms to the state-of-the-art primal IHT-style algorithms in model estimation accuracy and computational efficiency." @default.
- W2593511347 created "2017-03-16" @default.
- W2593511347 creator A5021551041 @default.
- W2593511347 creator A5054433231 @default.
- W2593511347 creator A5064437234 @default.
- W2593511347 creator A5087073100 @default.
- W2593511347 creator A5090815103 @default.
- W2593511347 date "2017-03-01" @default.
- W2593511347 modified "2023-09-27" @default.
- W2593511347 title "Dual Iterative Hard Thresholding: From Non-convex Sparse Minimization to Non-smooth Concave Maximization" @default.
- W2593511347 cites W14625021 @default.
- W2593511347 cites W1939652453 @default.
- W2593511347 cites W1948582444 @default.
- W2593511347 cites W1977520307 @default.
- W2593511347 cites W2075830955 @default.
- W2593511347 cites W2083346837 @default.
- W2593511347 cites W2092663520 @default.
- W2593511347 cites W2106967375 @default.
- W2593511347 cites W2119122547 @default.
- W2593511347 cites W2135046866 @default.
- W2593511347 cites W2165966284 @default.
- W2593511347 cites W2276322547 @default.
- W2593511347 cites W2340159948 @default.
- W2593511347 cites W2365692793 @default.
- W2593511347 cites W2549916392 @default.
- W2593511347 cites W2550629656 @default.
- W2593511347 cites W2575701667 @default.
- W2593511347 cites W2952160444 @default.
- W2593511347 cites W2962707360 @default.
- W2593511347 cites W2963347682 @default.
- W2593511347 cites W2963765119 @default.
- W2593511347 hasPublicationYear "2017" @default.
- W2593511347 type Work @default.
- W2593511347 sameAs 2593511347 @default.
- W2593511347 citedByCount "0" @default.
- W2593511347 crossrefType "posted-content" @default.
- W2593511347 hasAuthorship W2593511347A5021551041 @default.
- W2593511347 hasAuthorship W2593511347A5054433231 @default.
- W2593511347 hasAuthorship W2593511347A5064437234 @default.
- W2593511347 hasAuthorship W2593511347A5087073100 @default.
- W2593511347 hasAuthorship W2593511347A5090815103 @default.
- W2593511347 hasConcept C112680207 @default.
- W2593511347 hasConcept C11413529 @default.
- W2593511347 hasConcept C114614502 @default.
- W2593511347 hasConcept C124851039 @default.
- W2593511347 hasConcept C124952713 @default.
- W2593511347 hasConcept C126255220 @default.
- W2593511347 hasConcept C137836250 @default.
- W2593511347 hasConcept C142362112 @default.
- W2593511347 hasConcept C147764199 @default.
- W2593511347 hasConcept C15744967 @default.
- W2593511347 hasConcept C157972887 @default.
- W2593511347 hasConcept C163863214 @default.
- W2593511347 hasConcept C17902559 @default.
- W2593511347 hasConcept C2524010 @default.
- W2593511347 hasConcept C2776029896 @default.
- W2593511347 hasConcept C2776330181 @default.
- W2593511347 hasConcept C2778023678 @default.
- W2593511347 hasConcept C2780980858 @default.
- W2593511347 hasConcept C33923547 @default.
- W2593511347 hasConcept C41008148 @default.
- W2593511347 hasConcept C5274546 @default.
- W2593511347 hasConcept C77805123 @default.
- W2593511347 hasConceptScore W2593511347C112680207 @default.
- W2593511347 hasConceptScore W2593511347C11413529 @default.
- W2593511347 hasConceptScore W2593511347C114614502 @default.
- W2593511347 hasConceptScore W2593511347C124851039 @default.
- W2593511347 hasConceptScore W2593511347C124952713 @default.
- W2593511347 hasConceptScore W2593511347C126255220 @default.
- W2593511347 hasConceptScore W2593511347C137836250 @default.
- W2593511347 hasConceptScore W2593511347C142362112 @default.
- W2593511347 hasConceptScore W2593511347C147764199 @default.
- W2593511347 hasConceptScore W2593511347C15744967 @default.
- W2593511347 hasConceptScore W2593511347C157972887 @default.
- W2593511347 hasConceptScore W2593511347C163863214 @default.
- W2593511347 hasConceptScore W2593511347C17902559 @default.
- W2593511347 hasConceptScore W2593511347C2524010 @default.
- W2593511347 hasConceptScore W2593511347C2776029896 @default.
- W2593511347 hasConceptScore W2593511347C2776330181 @default.
- W2593511347 hasConceptScore W2593511347C2778023678 @default.
- W2593511347 hasConceptScore W2593511347C2780980858 @default.
- W2593511347 hasConceptScore W2593511347C33923547 @default.
- W2593511347 hasConceptScore W2593511347C41008148 @default.
- W2593511347 hasConceptScore W2593511347C5274546 @default.
- W2593511347 hasConceptScore W2593511347C77805123 @default.
- W2593511347 hasLocation W25935113471 @default.
- W2593511347 hasOpenAccess W2593511347 @default.
- W2593511347 hasPrimaryLocation W25935113471 @default.
- W2593511347 hasRelatedWork W1983956809 @default.
- W2593511347 hasRelatedWork W2030158346 @default.
- W2593511347 hasRelatedWork W2074577749 @default.
- W2593511347 hasRelatedWork W2099766834 @default.
- W2593511347 hasRelatedWork W2153103970 @default.
- W2593511347 hasRelatedWork W2171913990 @default.
- W2593511347 hasRelatedWork W2186437160 @default.
- W2593511347 hasRelatedWork W2249065054 @default.
- W2593511347 hasRelatedWork W2343193817 @default.
- W2593511347 hasRelatedWork W2394655774 @default.
- W2593511347 hasRelatedWork W2693978734 @default.
- W2593511347 hasRelatedWork W2703719507 @default.