Matches in SemOpenAlex for { <https://semopenalex.org/work/W1570678512> ?p ?o ?g. }
- W1570678512 abstract "Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are substantial and algorithms need to be designed suitably considering those costs. In this paper we give a novel approach to the distributed training of linear classifiers (involving smooth losses and L2 regularization) that is designed to reduce the total communication costs. At each iteration, the nodes minimize locally formed approximate objective functions; then the resulting minimizers are combined to form a descent direction to move. Our approach gives a lot of freedom in the formation of the approximate objective function as well as in the choice of methods to solve them. The method is shown to have $O(log(1/epsilon))$ time convergence. The method can be viewed as an iterative parameter mixing method. A special instantiation yields a parallel stochastic gradient descent method with strong convergence. When communication times between nodes are large, our method is much faster than the Terascale method (Agarwal et al., 2011), which is a state of the art distributed solver based on the statistical query model (Chuet al., 2006) that computes function and gradient values in a distributed fashion. We also evaluate against other recent distributed methods and demonstrate superior performance of our method." @default.
- W1570678512 created "2016-06-24" @default.
- W1570678512 creator A5003437532 @default.
- W1570678512 creator A5004541836 @default.
- W1570678512 creator A5019206666 @default.
- W1570678512 creator A5068664439 @default.
- W1570678512 creator A5090165776 @default.
- W1570678512 date "2013-10-31" @default.
- W1570678512 modified "2023-09-27" @default.
- W1570678512 title "An efficient distributed learning algorithm based on effective local functional approximations" @default.
- W1570678512 cites W114517082 @default.
- W1570678512 cites W1549918636 @default.
- W1570678512 cites W1562070494 @default.
- W1570678512 cites W1603765807 @default.
- W1570678512 cites W1606153355 @default.
- W1570678512 cites W1988849934 @default.
- W1570678512 cites W1991083751 @default.
- W1570678512 cites W2012960907 @default.
- W1570678512 cites W2051434435 @default.
- W1570678512 cites W2106955134 @default.
- W1570678512 cites W2107438106 @default.
- W1570678512 cites W2117669906 @default.
- W1570678512 cites W2120350480 @default.
- W1570678512 cites W2123154536 @default.
- W1570678512 cites W2129421243 @default.
- W1570678512 cites W2138302120 @default.
- W1570678512 cites W2144839971 @default.
- W1570678512 cites W2148844117 @default.
- W1570678512 cites W2157462866 @default.
- W1570678512 cites W2164278908 @default.
- W1570678512 cites W2165966284 @default.
- W1570678512 cites W2166706236 @default.
- W1570678512 cites W2296319761 @default.
- W1570678512 cites W2311729496 @default.
- W1570678512 cites W2951977692 @default.
- W1570678512 cites W2963861706 @default.
- W1570678512 cites W2963992805 @default.
- W1570678512 hasPublicationYear "2013" @default.
- W1570678512 type Work @default.
- W1570678512 sameAs 1570678512 @default.
- W1570678512 citedByCount "4" @default.
- W1570678512 countsByYear W15706785122016 @default.
- W1570678512 countsByYear W15706785122017 @default.
- W1570678512 crossrefType "posted-content" @default.
- W1570678512 hasAuthorship W1570678512A5003437532 @default.
- W1570678512 hasAuthorship W1570678512A5004541836 @default.
- W1570678512 hasAuthorship W1570678512A5019206666 @default.
- W1570678512 hasAuthorship W1570678512A5068664439 @default.
- W1570678512 hasAuthorship W1570678512A5090165776 @default.
- W1570678512 hasConcept C11413529 @default.
- W1570678512 hasConcept C120314980 @default.
- W1570678512 hasConcept C126255220 @default.
- W1570678512 hasConcept C127162648 @default.
- W1570678512 hasConcept C130120984 @default.
- W1570678512 hasConcept C14036430 @default.
- W1570678512 hasConcept C154945302 @default.
- W1570678512 hasConcept C15744967 @default.
- W1570678512 hasConcept C162324750 @default.
- W1570678512 hasConcept C19417346 @default.
- W1570678512 hasConcept C199360897 @default.
- W1570678512 hasConcept C206688291 @default.
- W1570678512 hasConcept C2776135515 @default.
- W1570678512 hasConcept C2777303404 @default.
- W1570678512 hasConcept C2778770139 @default.
- W1570678512 hasConcept C2779582901 @default.
- W1570678512 hasConcept C31258907 @default.
- W1570678512 hasConcept C33923547 @default.
- W1570678512 hasConcept C41008148 @default.
- W1570678512 hasConcept C48044578 @default.
- W1570678512 hasConcept C50522688 @default.
- W1570678512 hasConcept C50644808 @default.
- W1570678512 hasConcept C57869625 @default.
- W1570678512 hasConcept C77088390 @default.
- W1570678512 hasConcept C78458016 @default.
- W1570678512 hasConcept C86803240 @default.
- W1570678512 hasConceptScore W1570678512C11413529 @default.
- W1570678512 hasConceptScore W1570678512C120314980 @default.
- W1570678512 hasConceptScore W1570678512C126255220 @default.
- W1570678512 hasConceptScore W1570678512C127162648 @default.
- W1570678512 hasConceptScore W1570678512C130120984 @default.
- W1570678512 hasConceptScore W1570678512C14036430 @default.
- W1570678512 hasConceptScore W1570678512C154945302 @default.
- W1570678512 hasConceptScore W1570678512C15744967 @default.
- W1570678512 hasConceptScore W1570678512C162324750 @default.
- W1570678512 hasConceptScore W1570678512C19417346 @default.
- W1570678512 hasConceptScore W1570678512C199360897 @default.
- W1570678512 hasConceptScore W1570678512C206688291 @default.
- W1570678512 hasConceptScore W1570678512C2776135515 @default.
- W1570678512 hasConceptScore W1570678512C2777303404 @default.
- W1570678512 hasConceptScore W1570678512C2778770139 @default.
- W1570678512 hasConceptScore W1570678512C2779582901 @default.
- W1570678512 hasConceptScore W1570678512C31258907 @default.
- W1570678512 hasConceptScore W1570678512C33923547 @default.
- W1570678512 hasConceptScore W1570678512C41008148 @default.
- W1570678512 hasConceptScore W1570678512C48044578 @default.
- W1570678512 hasConceptScore W1570678512C50522688 @default.
- W1570678512 hasConceptScore W1570678512C50644808 @default.
- W1570678512 hasConceptScore W1570678512C57869625 @default.
- W1570678512 hasConceptScore W1570678512C77088390 @default.
- W1570678512 hasConceptScore W1570678512C78458016 @default.