Matches in SemOpenAlex for { <https://semopenalex.org/work/W3112821474> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W3112821474 abstract "Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of statistical physics to probabilistic inference. However, a systematic approach towards its validity limits is currently missing. Here we study MAXENT in a Bayesian decision theory set-up, i.e. assuming that there exists a well-defined prior Dirichlet density for unknown probabilities, and that the average Kullback-Leibler (KL) distance can be employed for deciding on the quality and applicability of various estimators. These allow to evaluate the relevance of various MAXENT constraints, check its general applicability, and compare MAXENT with estimators having various degrees of dependence on the prior, {it viz.} the regularized maximum likelihood (ML) and the Bayesian estimators. We show that MAXENT applies in sparse data regimes, but needs specific types of prior information. In particular, MAXENT can outperform the optimally regularized ML provided that there are prior rank correlations between the estimated random quantity and its probabilities." @default.
- W3112821474 created "2020-12-21" @default.
- W3112821474 creator A5054875221 @default.
- W3112821474 date "2021-05-04" @default.
- W3112821474 modified "2023-09-23" @default.
- W3112821474 title "Maximum Entropy competes with Maximum Likelihood" @default.
- W3112821474 cites W1491841303 @default.
- W3112821474 cites W1550443206 @default.
- W3112821474 cites W1979945719 @default.
- W3112821474 cites W1984335752 @default.
- W3112821474 cites W1999094429 @default.
- W3112821474 cites W2010584937 @default.
- W3112821474 cites W2032558547 @default.
- W3112821474 cites W2036892044 @default.
- W3112821474 cites W2052958516 @default.
- W3112821474 cites W2061286780 @default.
- W3112821474 cites W2063716658 @default.
- W3112821474 cites W2074045464 @default.
- W3112821474 cites W2097998348 @default.
- W3112821474 cites W2126174118 @default.
- W3112821474 cites W2127945237 @default.
- W3112821474 cites W2130926302 @default.
- W3112821474 cites W2140404878 @default.
- W3112821474 cites W2282336968 @default.
- W3112821474 cites W2318093595 @default.
- W3112821474 cites W2587359270 @default.
- W3112821474 cites W2964123546 @default.
- W3112821474 cites W2090467479 @default.
- W3112821474 hasPublicationYear "2021" @default.
- W3112821474 type Work @default.
- W3112821474 sameAs 3112821474 @default.
- W3112821474 citedByCount "0" @default.
- W3112821474 crossrefType "journal-article" @default.
- W3112821474 hasAuthorship W3112821474A5054875221 @default.
- W3112821474 hasConcept C105795698 @default.
- W3112821474 hasConcept C106301342 @default.
- W3112821474 hasConcept C107673813 @default.
- W3112821474 hasConcept C121332964 @default.
- W3112821474 hasConcept C134306372 @default.
- W3112821474 hasConcept C169214877 @default.
- W3112821474 hasConcept C171752962 @default.
- W3112821474 hasConcept C177769412 @default.
- W3112821474 hasConcept C182310444 @default.
- W3112821474 hasConcept C185429906 @default.
- W3112821474 hasConcept C33923547 @default.
- W3112821474 hasConcept C41008148 @default.
- W3112821474 hasConcept C49781872 @default.
- W3112821474 hasConcept C62520636 @default.
- W3112821474 hasConcept C9679016 @default.
- W3112821474 hasConceptScore W3112821474C105795698 @default.
- W3112821474 hasConceptScore W3112821474C106301342 @default.
- W3112821474 hasConceptScore W3112821474C107673813 @default.
- W3112821474 hasConceptScore W3112821474C121332964 @default.
- W3112821474 hasConceptScore W3112821474C134306372 @default.
- W3112821474 hasConceptScore W3112821474C169214877 @default.
- W3112821474 hasConceptScore W3112821474C171752962 @default.
- W3112821474 hasConceptScore W3112821474C177769412 @default.
- W3112821474 hasConceptScore W3112821474C182310444 @default.
- W3112821474 hasConceptScore W3112821474C185429906 @default.
- W3112821474 hasConceptScore W3112821474C33923547 @default.
- W3112821474 hasConceptScore W3112821474C41008148 @default.
- W3112821474 hasConceptScore W3112821474C49781872 @default.
- W3112821474 hasConceptScore W3112821474C62520636 @default.
- W3112821474 hasConceptScore W3112821474C9679016 @default.
- W3112821474 hasOpenAccess W3112821474 @default.
- W3112821474 hasRelatedWork W1481336878 @default.
- W3112821474 hasRelatedWork W1521510105 @default.
- W3112821474 hasRelatedWork W1580334661 @default.
- W3112821474 hasRelatedWork W1851621373 @default.
- W3112821474 hasRelatedWork W1964080106 @default.
- W3112821474 hasRelatedWork W1993566124 @default.
- W3112821474 hasRelatedWork W2004804364 @default.
- W3112821474 hasRelatedWork W2012832451 @default.
- W3112821474 hasRelatedWork W2041832936 @default.
- W3112821474 hasRelatedWork W2183678554 @default.
- W3112821474 hasRelatedWork W2215690741 @default.
- W3112821474 hasRelatedWork W2484499731 @default.
- W3112821474 hasRelatedWork W2559562651 @default.
- W3112821474 hasRelatedWork W2883417368 @default.
- W3112821474 hasRelatedWork W2886755587 @default.
- W3112821474 hasRelatedWork W3047265784 @default.
- W3112821474 hasRelatedWork W3202099841 @default.
- W3112821474 hasRelatedWork W330672297 @default.
- W3112821474 hasRelatedWork W90580424 @default.
- W3112821474 hasRelatedWork W2186363143 @default.
- W3112821474 isParatext "false" @default.
- W3112821474 isRetracted "false" @default.
- W3112821474 magId "3112821474" @default.
- W3112821474 workType "article" @default.