Matches in SemOpenAlex for { <https://semopenalex.org/work/W2564393086> ?p ?o ?g. }
- W2564393086 abstract "Given a sufficient statistic for a parametric family of distributions, one can estimate the parameter without access to the data. However, the memory or code size for storing the sufficient statistic may nonetheless still be prohibitive. Indeed, for $n$ independent samples drawn from a $k$-nomial distribution with $d=k-1$ degrees of freedom, the length of the code scales as $dlog n+O(1)$. In many applications, we may not have a useful notion of sufficient statistics (e.g., when the parametric family is not an exponential family) and we also may not need to reconstruct the generating distribution exactly. By adopting a Shannon-theoretic approach in which we allow a small error in estimating the generating distribution, we construct various {em approximate sufficient statistics} and show that the code length can be reduced to $frac{d}{2}log n+O(1)$. We consider errors measured according to the relative entropy and variational distance criteria. For the code constructions, we leverage Rissanen's minimum description length principle, which yields a non-vanishing error measured according to the relative entropy. For the converse parts, we use Clarke and Barron's formula for the relative entropy of a parametrized distribution and the corresponding mixture distribution. However, this method only yields a weak converse for the variational distance. We develop new techniques to achieve vanishing errors and we also prove strong converses. The latter means that even if the code is allowed to have a non-vanishing error, its length must still be at least $frac{d}{2}log n$." @default.
- W2564393086 created "2017-01-06" @default.
- W2564393086 creator A5024634142 @default.
- W2564393086 creator A5058345431 @default.
- W2564393086 date "2016-12-08" @default.
- W2564393086 modified "2023-10-16" @default.
- W2564393086 title "Minimum Rates of Approximate Sufficient Statistics" @default.
- W2564393086 cites W1535258871 @default.
- W2564393086 cites W1549664537 @default.
- W2564393086 cites W1555033159 @default.
- W2564393086 cites W1573082642 @default.
- W2564393086 cites W1686946872 @default.
- W2564393086 cites W1948605327 @default.
- W2564393086 cites W1989065278 @default.
- W2564393086 cites W1989458118 @default.
- W2564393086 cites W1995875735 @default.
- W2564393086 cites W2010138343 @default.
- W2564393086 cites W2057393527 @default.
- W2564393086 cites W2070945723 @default.
- W2564393086 cites W2097230740 @default.
- W2564393086 cites W2102098892 @default.
- W2564393086 cites W2105957088 @default.
- W2564393086 cites W2106596127 @default.
- W2564393086 cites W2122759946 @default.
- W2564393086 cites W2131940723 @default.
- W2564393086 cites W2132119275 @default.
- W2564393086 cites W2134864073 @default.
- W2564393086 cites W2148861585 @default.
- W2564393086 cites W2160570986 @default.
- W2564393086 cites W2168365126 @default.
- W2564393086 cites W2170503197 @default.
- W2564393086 cites W3103289615 @default.
- W2564393086 doi "https://doi.org/10.48550/arxiv.1612.02542" @default.
- W2564393086 hasPublicationYear "2016" @default.
- W2564393086 type Work @default.
- W2564393086 sameAs 2564393086 @default.
- W2564393086 citedByCount "1" @default.
- W2564393086 countsByYear W25643930862017 @default.
- W2564393086 crossrefType "posted-content" @default.
- W2564393086 hasAuthorship W2564393086A5024634142 @default.
- W2564393086 hasAuthorship W2564393086A5058345431 @default.
- W2564393086 hasBestOaLocation W25643930861 @default.
- W2564393086 hasConcept C105795698 @default.
- W2564393086 hasConcept C106301342 @default.
- W2564393086 hasConcept C110121322 @default.
- W2564393086 hasConcept C11413529 @default.
- W2564393086 hasConcept C114614502 @default.
- W2564393086 hasConcept C117251300 @default.
- W2564393086 hasConcept C118615104 @default.
- W2564393086 hasConcept C121332964 @default.
- W2564393086 hasConcept C134306372 @default.
- W2564393086 hasConcept C171752962 @default.
- W2564393086 hasConcept C177264268 @default.
- W2564393086 hasConcept C178197554 @default.
- W2564393086 hasConcept C199360897 @default.
- W2564393086 hasConcept C208081375 @default.
- W2564393086 hasConcept C2524010 @default.
- W2564393086 hasConcept C2776760102 @default.
- W2564393086 hasConcept C2776809875 @default.
- W2564393086 hasConcept C28826006 @default.
- W2564393086 hasConcept C33923547 @default.
- W2564393086 hasConcept C41008148 @default.
- W2564393086 hasConcept C55974624 @default.
- W2564393086 hasConcept C62520636 @default.
- W2564393086 hasConcept C87465248 @default.
- W2564393086 hasConcept C89128539 @default.
- W2564393086 hasConceptScore W2564393086C105795698 @default.
- W2564393086 hasConceptScore W2564393086C106301342 @default.
- W2564393086 hasConceptScore W2564393086C110121322 @default.
- W2564393086 hasConceptScore W2564393086C11413529 @default.
- W2564393086 hasConceptScore W2564393086C114614502 @default.
- W2564393086 hasConceptScore W2564393086C117251300 @default.
- W2564393086 hasConceptScore W2564393086C118615104 @default.
- W2564393086 hasConceptScore W2564393086C121332964 @default.
- W2564393086 hasConceptScore W2564393086C134306372 @default.
- W2564393086 hasConceptScore W2564393086C171752962 @default.
- W2564393086 hasConceptScore W2564393086C177264268 @default.
- W2564393086 hasConceptScore W2564393086C178197554 @default.
- W2564393086 hasConceptScore W2564393086C199360897 @default.
- W2564393086 hasConceptScore W2564393086C208081375 @default.
- W2564393086 hasConceptScore W2564393086C2524010 @default.
- W2564393086 hasConceptScore W2564393086C2776760102 @default.
- W2564393086 hasConceptScore W2564393086C2776809875 @default.
- W2564393086 hasConceptScore W2564393086C28826006 @default.
- W2564393086 hasConceptScore W2564393086C33923547 @default.
- W2564393086 hasConceptScore W2564393086C41008148 @default.
- W2564393086 hasConceptScore W2564393086C55974624 @default.
- W2564393086 hasConceptScore W2564393086C62520636 @default.
- W2564393086 hasConceptScore W2564393086C87465248 @default.
- W2564393086 hasConceptScore W2564393086C89128539 @default.
- W2564393086 hasLocation W25643930861 @default.
- W2564393086 hasOpenAccess W2564393086 @default.
- W2564393086 hasPrimaryLocation W25643930861 @default.
- W2564393086 hasRelatedWork W1600784762 @default.
- W2564393086 hasRelatedWork W2012442914 @default.
- W2564393086 hasRelatedWork W2094069013 @default.
- W2564393086 hasRelatedWork W2511265471 @default.
- W2564393086 hasRelatedWork W2513728490 @default.
- W2564393086 hasRelatedWork W2564393086 @default.
- W2564393086 hasRelatedWork W2769916088 @default.