Matches in SemOpenAlex for { <https://semopenalex.org/work/W2109647515> ?p ?o ?g. }
- W2109647515 endingPage "2023" @default.
- W2109647515 startingPage "2015" @default.
- W2109647515 abstract "We consider the problem of estimating Shannon's entropy H in the under-sampled regime, where the number of possible symbols may be unknown or countably infinite. Dirichlet and Pitman-Yor processes provide tractable prior distributions over the space of countably infinite discrete distributions, and have found major applications in Bayesian non-parametric statistics and machine learning. Here we show that they provide natural priors for Bayesian entropy estimation, due to the analytic tractability of the moments of the induced posterior distribution over entropy H. We derive formulas for the posterior mean and variance of H given data. However, we show that a fixed Dirichlet or Pitman-Yor process prior implies a narrow prior on H, meaning the prior strongly determines the estimate in the under-sampled regime. We therefore define a family of continuous mixing measures such that the resulting mixture of Dirichlet or Pitman-Yor processes produces an approximately flat prior over H. We explore the theoretical properties of the resulting estimators and show that they perform well on data sampled from both exponential and power-law tailed distributions." @default.
- W2109647515 created "2016-06-24" @default.
- W2109647515 creator A5012241909 @default.
- W2109647515 creator A5026150866 @default.
- W2109647515 creator A5047908820 @default.
- W2109647515 date "2012-12-03" @default.
- W2109647515 modified "2023-10-18" @default.
- W2109647515 title "Bayesian estimation of discrete entropy with mixtures of stick-breaking priors" @default.
- W2109647515 cites W1661915592 @default.
- W2109647515 cites W1947089506 @default.
- W2109647515 cites W1992536060 @default.
- W2109647515 cites W2000650629 @default.
- W2109647515 cites W2008551287 @default.
- W2109647515 cites W2011342110 @default.
- W2109647515 cites W2072169887 @default.
- W2109647515 cites W2079656678 @default.
- W2109647515 cites W2087309226 @default.
- W2109647515 cites W2097173970 @default.
- W2109647515 cites W2097580994 @default.
- W2109647515 cites W2097636360 @default.
- W2109647515 cites W2101985079 @default.
- W2109647515 cites W2109584604 @default.
- W2109647515 cites W2114771311 @default.
- W2109647515 cites W2118036030 @default.
- W2109647515 cites W2135191607 @default.
- W2109647515 cites W2138892454 @default.
- W2109647515 cites W2150507172 @default.
- W2109647515 cites W2154099718 @default.
- W2109647515 cites W2159399018 @default.
- W2109647515 cites W2510474575 @default.
- W2109647515 cites W2903830437 @default.
- W2109647515 cites W2915635235 @default.
- W2109647515 cites W2950627632 @default.
- W2109647515 cites W2736230390 @default.
- W2109647515 hasPublicationYear "2012" @default.
- W2109647515 type Work @default.
- W2109647515 sameAs 2109647515 @default.
- W2109647515 citedByCount "6" @default.
- W2109647515 countsByYear W21096475152013 @default.
- W2109647515 countsByYear W21096475152014 @default.
- W2109647515 countsByYear W21096475152015 @default.
- W2109647515 crossrefType "proceedings-article" @default.
- W2109647515 hasAuthorship W2109647515A5012241909 @default.
- W2109647515 hasAuthorship W2109647515A5026150866 @default.
- W2109647515 hasAuthorship W2109647515A5047908820 @default.
- W2109647515 hasConcept C105795698 @default.
- W2109647515 hasConcept C106301342 @default.
- W2109647515 hasConcept C107673813 @default.
- W2109647515 hasConcept C121332964 @default.
- W2109647515 hasConcept C134306372 @default.
- W2109647515 hasConcept C169214877 @default.
- W2109647515 hasConcept C177769412 @default.
- W2109647515 hasConcept C182310444 @default.
- W2109647515 hasConcept C185429906 @default.
- W2109647515 hasConcept C2781280628 @default.
- W2109647515 hasConcept C28826006 @default.
- W2109647515 hasConcept C33923547 @default.
- W2109647515 hasConcept C55974624 @default.
- W2109647515 hasConcept C62520636 @default.
- W2109647515 hasConceptScore W2109647515C105795698 @default.
- W2109647515 hasConceptScore W2109647515C106301342 @default.
- W2109647515 hasConceptScore W2109647515C107673813 @default.
- W2109647515 hasConceptScore W2109647515C121332964 @default.
- W2109647515 hasConceptScore W2109647515C134306372 @default.
- W2109647515 hasConceptScore W2109647515C169214877 @default.
- W2109647515 hasConceptScore W2109647515C177769412 @default.
- W2109647515 hasConceptScore W2109647515C182310444 @default.
- W2109647515 hasConceptScore W2109647515C185429906 @default.
- W2109647515 hasConceptScore W2109647515C2781280628 @default.
- W2109647515 hasConceptScore W2109647515C28826006 @default.
- W2109647515 hasConceptScore W2109647515C33923547 @default.
- W2109647515 hasConceptScore W2109647515C55974624 @default.
- W2109647515 hasConceptScore W2109647515C62520636 @default.
- W2109647515 hasLocation W21096475151 @default.
- W2109647515 hasOpenAccess W2109647515 @default.
- W2109647515 hasPrimaryLocation W21096475151 @default.
- W2109647515 hasRelatedWork W1992536060 @default.
- W2109647515 hasRelatedWork W1995875735 @default.
- W2109647515 hasRelatedWork W2008551287 @default.
- W2109647515 hasRelatedWork W2061150271 @default.
- W2109647515 hasRelatedWork W2078737675 @default.
- W2109647515 hasRelatedWork W2097173970 @default.
- W2109647515 hasRelatedWork W2097580994 @default.
- W2109647515 hasRelatedWork W2097636360 @default.
- W2109647515 hasRelatedWork W2109584604 @default.
- W2109647515 hasRelatedWork W2114771311 @default.
- W2109647515 hasRelatedWork W2135191607 @default.
- W2109647515 hasRelatedWork W2151387592 @default.
- W2109647515 hasRelatedWork W2151967501 @default.
- W2109647515 hasRelatedWork W2467916758 @default.
- W2109647515 hasRelatedWork W2510474575 @default.
- W2109647515 hasRelatedWork W2752910379 @default.
- W2109647515 hasRelatedWork W2951863790 @default.
- W2109647515 hasRelatedWork W3103587541 @default.
- W2109647515 hasRelatedWork W3174357322 @default.
- W2109647515 hasRelatedWork W2736230390 @default.
- W2109647515 hasVolume "25" @default.
- W2109647515 isParatext "false" @default.