FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3128872986> ?p ?o ?g. }

• W3128872986 abstract "Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and poor conditioning problems. Moreover, it has shown good scalability in many large-scale deep learning applications. However, there still lacks a parallel ADMM computational framework for deep neural networks because of layer dependency among variables. In this paper, we propose a novel parallel deep learning ADMM framework (pdADMM) to achieve layer parallelism: parameters in each layer of neural networks can be updated independently in parallel. The convergence of the proposed pdADMM to a critical point is theoretically proven under mild conditions. The convergence rate of the pdADMM is proven to be o(1/k) where k is the number of iterations. Extensive experiments on six benchmark datasets demonstrated that our proposed pdADMM can lead to more than 10 times speedup for training large-scale deep neural networks, and outperformed most of the comparison methods. Our code is available at: https://github.com/xianggebenben/pdADMM." @default.
• W3128872986 created "2021-02-15" @default.
• W3128872986 creator A5017614674 @default.
• W3128872986 creator A5026570493 @default.
• W3128872986 creator A5048756500 @default.
• W3128872986 creator A5079187166 @default.
• W3128872986 date "2020-11-01" @default.
• W3128872986 modified "2023-09-26" @default.
• W3128872986 title "Toward Model Parallelism for Deep Neural Network Based on Gradient-Free ADMM Framework" @default.
• W3128872986 cites W1982452826 @default.
• W3128872986 cites W2042828076 @default.
• W3128872986 cites W2046387702 @default.
• W3128872986 cites W2062022900 @default.
• W3128872986 cites W2092620240 @default.
• W3128872986 cites W2100556411 @default.
• W3128872986 cites W2112796928 @default.
• W3128872986 cites W2123705108 @default.
• W3128872986 cites W2127883485 @default.
• W3128872986 cites W2129375853 @default.
• W3128872986 cites W2155723734 @default.
• W3128872986 cites W2277973662 @default.
• W3128872986 cites W2291545909 @default.
• W3128872986 cites W2295652899 @default.
• W3128872986 cites W2588594937 @default.
• W3128872986 cites W269003556 @default.
• W3128872986 cites W2943262196 @default.
• W3128872986 cites W2964100543 @default.
• W3128872986 cites W2964120262 @default.
• W3128872986 cites W3103984481 @default.
• W3128872986 cites W3104831388 @default.
• W3128872986 cites W3105393233 @default.
• W3128872986 cites W4292363360 @default.
• W3128872986 doi "https://doi.org/10.1109/icdm50108.2020.00068" @default.
• W3128872986 hasPublicationYear "2020" @default.
• W3128872986 type Work @default.
• W3128872986 sameAs 3128872986 @default.
• W3128872986 citedByCount "5" @default.
• W3128872986 countsByYear W31288729862021 @default.
• W3128872986 countsByYear W31288729862022 @default.
• W3128872986 countsByYear W31288729862023 @default.
• W3128872986 crossrefType "proceedings-article" @default.
• W3128872986 hasAuthorship W3128872986A5017614674 @default.
• W3128872986 hasAuthorship W3128872986A5026570493 @default.
• W3128872986 hasAuthorship W3128872986A5048756500 @default.
• W3128872986 hasAuthorship W3128872986A5079187166 @default.
• W3128872986 hasBestOaLocation W31288729862 @default.
• W3128872986 hasConcept C108583219 @default.
• W3128872986 hasConcept C11413529 @default.
• W3128872986 hasConcept C121332964 @default.
• W3128872986 hasConcept C13280743 @default.
• W3128872986 hasConcept C153258448 @default.
• W3128872986 hasConcept C154945302 @default.
• W3128872986 hasConcept C162324750 @default.
• W3128872986 hasConcept C173608175 @default.
• W3128872986 hasConcept C177264268 @default.
• W3128872986 hasConcept C185798385 @default.
• W3128872986 hasConcept C199360897 @default.
• W3128872986 hasConcept C205649164 @default.
• W3128872986 hasConcept C206688291 @default.
• W3128872986 hasConcept C2776760102 @default.
• W3128872986 hasConcept C2777303404 @default.
• W3128872986 hasConcept C2778755073 @default.
• W3128872986 hasConcept C2781172179 @default.
• W3128872986 hasConcept C2984842247 @default.
• W3128872986 hasConcept C41008148 @default.
• W3128872986 hasConcept C48044578 @default.
• W3128872986 hasConcept C50522688 @default.
• W3128872986 hasConcept C50644808 @default.
• W3128872986 hasConcept C61483411 @default.
• W3128872986 hasConcept C62520636 @default.
• W3128872986 hasConcept C68339613 @default.
• W3128872986 hasConcept C77088390 @default.
• W3128872986 hasConceptScore W3128872986C108583219 @default.
• W3128872986 hasConceptScore W3128872986C11413529 @default.
• W3128872986 hasConceptScore W3128872986C121332964 @default.
• W3128872986 hasConceptScore W3128872986C13280743 @default.
• W3128872986 hasConceptScore W3128872986C153258448 @default.
• W3128872986 hasConceptScore W3128872986C154945302 @default.
• W3128872986 hasConceptScore W3128872986C162324750 @default.
• W3128872986 hasConceptScore W3128872986C173608175 @default.
• W3128872986 hasConceptScore W3128872986C177264268 @default.
• W3128872986 hasConceptScore W3128872986C185798385 @default.
• W3128872986 hasConceptScore W3128872986C199360897 @default.
• W3128872986 hasConceptScore W3128872986C205649164 @default.
• W3128872986 hasConceptScore W3128872986C206688291 @default.
• W3128872986 hasConceptScore W3128872986C2776760102 @default.
• W3128872986 hasConceptScore W3128872986C2777303404 @default.
• W3128872986 hasConceptScore W3128872986C2778755073 @default.
• W3128872986 hasConceptScore W3128872986C2781172179 @default.
• W3128872986 hasConceptScore W3128872986C2984842247 @default.
• W3128872986 hasConceptScore W3128872986C41008148 @default.
• W3128872986 hasConceptScore W3128872986C48044578 @default.
• W3128872986 hasConceptScore W3128872986C50522688 @default.
• W3128872986 hasConceptScore W3128872986C50644808 @default.
• W3128872986 hasConceptScore W3128872986C61483411 @default.
• W3128872986 hasConceptScore W3128872986C62520636 @default.
• W3128872986 hasConceptScore W3128872986C68339613 @default.
• W3128872986 hasConceptScore W3128872986C77088390 @default.
• W3128872986 hasFunder F4320306076 @default.
• W3128872986 hasFunder F4320309480 @default.

• next