FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3170408293> ?p ?o ?g. }

• W3170408293 abstract "Stochastic gradient MCMC methods, such as stochastic gradient Langevin dynamics (SGLD), employ fast but noisy gradient estimates to enable large-scale posterior sampling. Although we can easily extend SGLD to distributed settings, it suffers from two issues when applied to federated non-IID data. First, the variance of these estimates increases significantly. Second, delaying communication causes the Markov chains to diverge from the true posterior even for very simple models. To alleviate both these problems, we propose conducive gradients, a simple mechanism that combines local likelihood approximations to correct gradient updates. Notably, conducive gradients are easy to compute, and since we only calculate the approximations once, they incur negligible overhead. We apply conducive gradients to distributed stochastic gradient Langevin dynamics (DSGLD) and call the resulting method federated stochastic gradient Langevin dynamics (FSGLD). We demonstrate that our approach can handle delayed communication rounds, converging to the target posterior in cases where DSGLD fails. We also show that FSGLD outperforms DSGLD for non-IID federated data with experiments on metric learning and neural networks." @default.
• W3170408293 created "2021-06-22" @default.
• W3170408293 creator A5000113707 @default.
• W3170408293 creator A5018305257 @default.
• W3170408293 creator A5038833701 @default.
• W3170408293 creator A5091865827 @default.
• W3170408293 date "2020-04-23" @default.
• W3170408293 modified "2023-09-27" @default.
• W3170408293 title "Federated Stochastic Gradient Langevin Dynamics" @default.
• W3170408293 cites W123701566 @default.
• W3170408293 cites W1523884323 @default.
• W3170408293 cites W1545319692 @default.
• W3170408293 cites W2107438106 @default.
• W3170408293 cites W2134603645 @default.
• W3170408293 cites W2135482703 @default.
• W3170408293 cites W2144193737 @default.
• W3170408293 cites W2167433878 @default.
• W3170408293 cites W2186210550 @default.
• W3170408293 cites W2352456897 @default.
• W3170408293 cites W2478027467 @default.
• W3170408293 cites W2528137865 @default.
• W3170408293 cites W2530417694 @default.
• W3170408293 cites W2552704617 @default.
• W3170408293 cites W2615953416 @default.
• W3170408293 cites W2622995095 @default.
• W3170408293 cites W2905549570 @default.
• W3170408293 cites W2962732346 @default.
• W3170408293 cites W2962760547 @default.
• W3170408293 cites W2963372166 @default.
• W3170408293 cites W2963373052 @default.
• W3170408293 cites W2964311894 @default.
• W3170408293 cites W2964718938 @default.
• W3170408293 cites W3037668816 @default.
• W3170408293 cites W3086080324 @default.
• W3170408293 cites W3401598 @default.
• W3170408293 cites W586414279 @default.
• W3170408293 hasPublicationYear "2020" @default.
• W3170408293 type Work @default.
• W3170408293 sameAs 3170408293 @default.
• W3170408293 citedByCount "0" @default.
• W3170408293 crossrefType "posted-content" @default.
• W3170408293 hasAuthorship W3170408293A5000113707 @default.
• W3170408293 hasAuthorship W3170408293A5018305257 @default.
• W3170408293 hasAuthorship W3170408293A5038833701 @default.
• W3170408293 hasAuthorship W3170408293A5091865827 @default.
• W3170408293 hasConcept C111472728 @default.
• W3170408293 hasConcept C119857082 @default.
• W3170408293 hasConcept C121332964 @default.
• W3170408293 hasConcept C121864883 @default.
• W3170408293 hasConcept C121955636 @default.
• W3170408293 hasConcept C126255220 @default.
• W3170408293 hasConcept C138885662 @default.
• W3170408293 hasConcept C144133560 @default.
• W3170408293 hasConcept C162324750 @default.
• W3170408293 hasConcept C176217482 @default.
• W3170408293 hasConcept C196083921 @default.
• W3170408293 hasConcept C21547014 @default.
• W3170408293 hasConcept C2780004032 @default.
• W3170408293 hasConcept C2780586882 @default.
• W3170408293 hasConcept C28826006 @default.
• W3170408293 hasConcept C33923547 @default.
• W3170408293 hasConcept C41008148 @default.
• W3170408293 hasConcept C98763669 @default.
• W3170408293 hasConceptScore W3170408293C111472728 @default.
• W3170408293 hasConceptScore W3170408293C119857082 @default.
• W3170408293 hasConceptScore W3170408293C121332964 @default.
• W3170408293 hasConceptScore W3170408293C121864883 @default.
• W3170408293 hasConceptScore W3170408293C121955636 @default.
• W3170408293 hasConceptScore W3170408293C126255220 @default.
• W3170408293 hasConceptScore W3170408293C138885662 @default.
• W3170408293 hasConceptScore W3170408293C144133560 @default.
• W3170408293 hasConceptScore W3170408293C162324750 @default.
• W3170408293 hasConceptScore W3170408293C176217482 @default.
• W3170408293 hasConceptScore W3170408293C196083921 @default.
• W3170408293 hasConceptScore W3170408293C21547014 @default.
• W3170408293 hasConceptScore W3170408293C2780004032 @default.
• W3170408293 hasConceptScore W3170408293C2780586882 @default.
• W3170408293 hasConceptScore W3170408293C28826006 @default.
• W3170408293 hasConceptScore W3170408293C33923547 @default.
• W3170408293 hasConceptScore W3170408293C41008148 @default.
• W3170408293 hasConceptScore W3170408293C98763669 @default.
• W3170408293 hasLocation W31704082931 @default.
• W3170408293 hasOpenAccess W3170408293 @default.
• W3170408293 hasPrimaryLocation W31704082931 @default.
• W3170408293 hasRelatedWork W1646152356 @default.
• W3170408293 hasRelatedWork W2238987678 @default.
• W3170408293 hasRelatedWork W2765765201 @default.
• W3170408293 hasRelatedWork W2809440402 @default.
• W3170408293 hasRelatedWork W2896854698 @default.
• W3170408293 hasRelatedWork W2912350648 @default.
• W3170408293 hasRelatedWork W2950200612 @default.
• W3170408293 hasRelatedWork W2969289520 @default.
• W3170408293 hasRelatedWork W2997577243 @default.
• W3170408293 hasRelatedWork W3019065887 @default.
• W3170408293 hasRelatedWork W3039635988 @default.
• W3170408293 hasRelatedWork W3092768252 @default.
• W3170408293 hasRelatedWork W3126781576 @default.
• W3170408293 hasRelatedWork W3137067034 @default.
• W3170408293 hasRelatedWork W3181630382 @default.
• W3170408293 hasRelatedWork W3183884758 @default.

• next