Matches in SemOpenAlex for { <https://semopenalex.org/work/W2546388618> ?p ?o ?g. }
- W2546388618 abstract "In prior works, stochastic dual coordinate ascent (SDCA) has been parallelized in a multi-core environment where the cores communicate through shared memory, or in a multi-processor distributed memory environment where the processors communicate through message passing. In this paper, we propose a hybrid SDCA framework for multi-core clusters, the most common high performance computing environment that consists of multiple nodes each having multiple cores and its own shared memory. We distribute data across nodes where each node solves a local problem in an asynchronous parallel fashion on its cores, and then the local updates are aggregated via an asynchronous across-node update scheme. The proposed double asynchronous method converges to a global solution for $L$-Lipschitz continuous loss functions, and at a linear convergence rate if a smooth convex loss function is used. Extensive empirical comparison has shown that our algorithm scales better than the best known shared-memory methods and runs faster than previous distributed-memory methods. Big datasets, such as one of 280 GB from the LIBSVM repository, cannot be accommodated on a single node and hence cannot be solved by a parallel algorithm. For such a dataset, our hybrid algorithm takes 30 seconds to achieve a duality gap of $10^{-6}$ on 16 nodes each using 8 cores, which is significantly faster than the best known distributed algorithms, such as CoCoA+, that take more than 300 seconds on 16 nodes." @default.
- W2546388618 created "2016-11-04" @default.
- W2546388618 creator A5005345630 @default.
- W2546388618 creator A5023288846 @default.
- W2546388618 creator A5034177039 @default.
- W2546388618 creator A5051393532 @default.
- W2546388618 creator A5086885083 @default.
- W2546388618 date "2016-10-23" @default.
- W2546388618 modified "2023-09-23" @default.
- W2546388618 title "Hybrid-DCA: A Double Asynchronous Approach for Stochastic Dual Coordinate Ascent" @default.
- W2546388618 cites W130696423 @default.
- W2546388618 cites W1780115997 @default.
- W2546388618 cites W1939652453 @default.
- W2546388618 cites W2091825929 @default.
- W2546388618 cites W2108712612 @default.
- W2546388618 cites W2118545728 @default.
- W2546388618 cites W2123154536 @default.
- W2546388618 cites W2144839971 @default.
- W2546388618 cites W2156779765 @default.
- W2546388618 cites W2157462866 @default.
- W2546388618 cites W2162287622 @default.
- W2546388618 cites W2164278908 @default.
- W2546388618 cites W2165966284 @default.
- W2546388618 cites W2235185944 @default.
- W2546388618 cites W2238591594 @default.
- W2546388618 cites W2277578488 @default.
- W2546388618 cites W2616811598 @default.
- W2546388618 cites W2949085567 @default.
- W2546388618 cites W2950002113 @default.
- W2546388618 cites W2963992805 @default.
- W2546388618 cites W604355987 @default.
- W2546388618 hasPublicationYear "2016" @default.
- W2546388618 type Work @default.
- W2546388618 sameAs 2546388618 @default.
- W2546388618 citedByCount "0" @default.
- W2546388618 crossrefType "posted-content" @default.
- W2546388618 hasAuthorship W2546388618A5005345630 @default.
- W2546388618 hasAuthorship W2546388618A5023288846 @default.
- W2546388618 hasAuthorship W2546388618A5034177039 @default.
- W2546388618 hasAuthorship W2546388618A5051393532 @default.
- W2546388618 hasAuthorship W2546388618A5086885083 @default.
- W2546388618 hasConcept C120314980 @default.
- W2546388618 hasConcept C124952713 @default.
- W2546388618 hasConcept C127413603 @default.
- W2546388618 hasConcept C133875982 @default.
- W2546388618 hasConcept C14036430 @default.
- W2546388618 hasConcept C142362112 @default.
- W2546388618 hasConcept C151319957 @default.
- W2546388618 hasConcept C162324750 @default.
- W2546388618 hasConcept C173608175 @default.
- W2546388618 hasConcept C2777303404 @default.
- W2546388618 hasConcept C2780980858 @default.
- W2546388618 hasConcept C31258907 @default.
- W2546388618 hasConcept C41008148 @default.
- W2546388618 hasConcept C50522688 @default.
- W2546388618 hasConcept C62611344 @default.
- W2546388618 hasConcept C66938386 @default.
- W2546388618 hasConcept C78458016 @default.
- W2546388618 hasConcept C78766204 @default.
- W2546388618 hasConcept C86803240 @default.
- W2546388618 hasConcept C91481028 @default.
- W2546388618 hasConceptScore W2546388618C120314980 @default.
- W2546388618 hasConceptScore W2546388618C124952713 @default.
- W2546388618 hasConceptScore W2546388618C127413603 @default.
- W2546388618 hasConceptScore W2546388618C133875982 @default.
- W2546388618 hasConceptScore W2546388618C14036430 @default.
- W2546388618 hasConceptScore W2546388618C142362112 @default.
- W2546388618 hasConceptScore W2546388618C151319957 @default.
- W2546388618 hasConceptScore W2546388618C162324750 @default.
- W2546388618 hasConceptScore W2546388618C173608175 @default.
- W2546388618 hasConceptScore W2546388618C2777303404 @default.
- W2546388618 hasConceptScore W2546388618C2780980858 @default.
- W2546388618 hasConceptScore W2546388618C31258907 @default.
- W2546388618 hasConceptScore W2546388618C41008148 @default.
- W2546388618 hasConceptScore W2546388618C50522688 @default.
- W2546388618 hasConceptScore W2546388618C62611344 @default.
- W2546388618 hasConceptScore W2546388618C66938386 @default.
- W2546388618 hasConceptScore W2546388618C78458016 @default.
- W2546388618 hasConceptScore W2546388618C78766204 @default.
- W2546388618 hasConceptScore W2546388618C86803240 @default.
- W2546388618 hasConceptScore W2546388618C91481028 @default.
- W2546388618 hasLocation W25463886181 @default.
- W2546388618 hasOpenAccess W2546388618 @default.
- W2546388618 hasPrimaryLocation W25463886181 @default.
- W2546388618 hasRelatedWork W1765427387 @default.
- W2546388618 hasRelatedWork W191764195 @default.
- W2546388618 hasRelatedWork W1953514686 @default.
- W2546388618 hasRelatedWork W2082461764 @default.
- W2546388618 hasRelatedWork W2093349642 @default.
- W2546388618 hasRelatedWork W2157184701 @default.
- W2546388618 hasRelatedWork W2182389258 @default.
- W2546388618 hasRelatedWork W2258644916 @default.
- W2546388618 hasRelatedWork W2277258472 @default.
- W2546388618 hasRelatedWork W2377331855 @default.
- W2546388618 hasRelatedWork W2475836838 @default.
- W2546388618 hasRelatedWork W2494895693 @default.
- W2546388618 hasRelatedWork W2772167387 @default.
- W2546388618 hasRelatedWork W2799148788 @default.
- W2546388618 hasRelatedWork W2902116018 @default.
- W2546388618 hasRelatedWork W2953281140 @default.