Matches in SemOpenAlex for { <https://semopenalex.org/work/W2951468504> ?p ?o ?g. }
- W2951468504 abstract "Distributed learning of probabilistic models from multiple data repositories with minimum communication is increasingly important. We study a simple communication-efficient learning framework that first calculates the local maximum likelihood estimates (MLE) based on the data subsets, and then combines the local MLEs to achieve the best possible approximation to the global MLE given the whole dataset. We study this framework's statistical properties, showing that the efficiency loss compared to the global setting relates to how much the underlying distribution families deviate from full exponential families, drawing connection to the theory of information loss by Fisher, Rao and Efron. We show that the full-exponential-family-ness represents the lower bound of the error rate of arbitrary combinations of local MLEs, and is achieved by a KL-divergence-based combination method but not by a more common linear combination method. We also study the empirical properties of both methods, showing that the KL method significantly outperforms linear combination in practical settings with issues such as model misspecification, non-convexity, and heterogeneous data partitions." @default.
- W2951468504 created "2019-06-27" @default.
- W2951468504 creator A5048047705 @default.
- W2951468504 creator A5057055806 @default.
- W2951468504 date "2014-10-09" @default.
- W2951468504 modified "2023-09-27" @default.
- W2951468504 title "Distributed Estimation, Information Loss and Exponential Families" @default.
- W2951468504 cites W125706094 @default.
- W2951468504 cites W1498478255 @default.
- W2951468504 cites W1816220470 @default.
- W2951468504 cites W2053565514 @default.
- W2951468504 cites W2093054459 @default.
- W2951468504 cites W2098003004 @default.
- W2951468504 cites W2101790310 @default.
- W2951468504 cites W2107568926 @default.
- W2951468504 cites W2127180992 @default.
- W2951468504 cites W2144335278 @default.
- W2951468504 cites W2144709747 @default.
- W2951468504 cites W2145536610 @default.
- W2951468504 cites W2164278908 @default.
- W2951468504 cites W2305001871 @default.
- W2951468504 cites W2950978476 @default.
- W2951468504 cites W2952463754 @default.
- W2951468504 cites W3015736691 @default.
- W2951468504 cites W378975842 @default.
- W2951468504 cites W590667046 @default.
- W2951468504 cites W611756847 @default.
- W2951468504 hasPublicationYear "2014" @default.
- W2951468504 type Work @default.
- W2951468504 sameAs 2951468504 @default.
- W2951468504 citedByCount "6" @default.
- W2951468504 countsByYear W29514685042014 @default.
- W2951468504 countsByYear W29514685042015 @default.
- W2951468504 countsByYear W29514685042016 @default.
- W2951468504 countsByYear W29514685042017 @default.
- W2951468504 countsByYear W29514685042018 @default.
- W2951468504 crossrefType "posted-content" @default.
- W2951468504 hasAuthorship W2951468504A5048047705 @default.
- W2951468504 hasAuthorship W2951468504A5057055806 @default.
- W2951468504 hasConcept C105795698 @default.
- W2951468504 hasConcept C106159729 @default.
- W2951468504 hasConcept C111472728 @default.
- W2951468504 hasConcept C11413529 @default.
- W2951468504 hasConcept C126255220 @default.
- W2951468504 hasConcept C134306372 @default.
- W2951468504 hasConcept C138885662 @default.
- W2951468504 hasConcept C151376022 @default.
- W2951468504 hasConcept C162324750 @default.
- W2951468504 hasConcept C207390915 @default.
- W2951468504 hasConcept C2780586882 @default.
- W2951468504 hasConcept C28826006 @default.
- W2951468504 hasConcept C29406490 @default.
- W2951468504 hasConcept C33923547 @default.
- W2951468504 hasConcept C41008148 @default.
- W2951468504 hasConcept C41895202 @default.
- W2951468504 hasConcept C49937458 @default.
- W2951468504 hasConcept C55350006 @default.
- W2951468504 hasConcept C55974624 @default.
- W2951468504 hasConcept C72134830 @default.
- W2951468504 hasConcept C77553402 @default.
- W2951468504 hasConceptScore W2951468504C105795698 @default.
- W2951468504 hasConceptScore W2951468504C106159729 @default.
- W2951468504 hasConceptScore W2951468504C111472728 @default.
- W2951468504 hasConceptScore W2951468504C11413529 @default.
- W2951468504 hasConceptScore W2951468504C126255220 @default.
- W2951468504 hasConceptScore W2951468504C134306372 @default.
- W2951468504 hasConceptScore W2951468504C138885662 @default.
- W2951468504 hasConceptScore W2951468504C151376022 @default.
- W2951468504 hasConceptScore W2951468504C162324750 @default.
- W2951468504 hasConceptScore W2951468504C207390915 @default.
- W2951468504 hasConceptScore W2951468504C2780586882 @default.
- W2951468504 hasConceptScore W2951468504C28826006 @default.
- W2951468504 hasConceptScore W2951468504C29406490 @default.
- W2951468504 hasConceptScore W2951468504C33923547 @default.
- W2951468504 hasConceptScore W2951468504C41008148 @default.
- W2951468504 hasConceptScore W2951468504C41895202 @default.
- W2951468504 hasConceptScore W2951468504C49937458 @default.
- W2951468504 hasConceptScore W2951468504C55350006 @default.
- W2951468504 hasConceptScore W2951468504C55974624 @default.
- W2951468504 hasConceptScore W2951468504C72134830 @default.
- W2951468504 hasConceptScore W2951468504C77553402 @default.
- W2951468504 hasLocation W29514685041 @default.
- W2951468504 hasOpenAccess W2951468504 @default.
- W2951468504 hasPrimaryLocation W29514685041 @default.
- W2951468504 hasRelatedWork W1467346733 @default.
- W2951468504 hasRelatedWork W1579841385 @default.
- W2951468504 hasRelatedWork W1841295139 @default.
- W2951468504 hasRelatedWork W1856858227 @default.
- W2951468504 hasRelatedWork W1979547729 @default.
- W2951468504 hasRelatedWork W2049283139 @default.
- W2951468504 hasRelatedWork W2091846274 @default.
- W2951468504 hasRelatedWork W2130607673 @default.
- W2951468504 hasRelatedWork W2149695474 @default.
- W2951468504 hasRelatedWork W2162576315 @default.
- W2951468504 hasRelatedWork W2165478976 @default.
- W2951468504 hasRelatedWork W2473739150 @default.
- W2951468504 hasRelatedWork W2519513981 @default.
- W2951468504 hasRelatedWork W2754755697 @default.
- W2951468504 hasRelatedWork W2938943746 @default.
- W2951468504 hasRelatedWork W2978292356 @default.