Matches in SemOpenAlex for { <https://semopenalex.org/work/W2122477496> ?p ?o ?g. }
- W2122477496 endingPage "1755" @default.
- W2122477496 startingPage "1738" @default.
- W2122477496 abstract "Mutual information (MI) quantifies the statistical dependency between a pair of random variables, and plays a central role in the analysis of engineering and biological systems. Estimation of MI is difficult due to its dependence on an entire joint distribution, which is difficult to estimate from samples. Here we discuss several regularized estimators for MI that employ priors based on the Dirichlet distribution. First, we discuss three “quasi-Bayesian” estimators that result from linear combinations of Bayesian estimates for conditional and marginal entropies. We show that these estimators are not in fact Bayesian, and do not arise from a well-defined posterior distribution and may in fact be negative. Second, we show that a fully Bayesian MI estimator proposed by Hutter (2002), which relies on a fixed Dirichlet prior, exhibits strong prior dependence and has large bias for small datasets. Third, we formulate a novel Bayesian estimator using a mixture-of-Dirichlets prior, with mixing weights designed to produce an approximately flat prior over MI. We examine the performance of these estimators with a variety of simulated datasets and show that, surprisingly, quasi-Bayesian estimators generally outperform our Bayesian estimator. We discuss outstanding challenges for MI estimation and suggest promising avenues for future research." @default.
- W2122477496 created "2016-06-24" @default.
- W2122477496 creator A5026150866 @default.
- W2122477496 creator A5040510048 @default.
- W2122477496 creator A5051989657 @default.
- W2122477496 date "2013-05-10" @default.
- W2122477496 modified "2023-10-06" @default.
- W2122477496 title "Bayesian and Quasi-Bayesian Estimators for Mutual Information from Discrete Data" @default.
- W2122477496 cites W1984931175 @default.
- W2122477496 cites W1987669950 @default.
- W2122477496 cites W1992536060 @default.
- W2122477496 cites W1998596805 @default.
- W2122477496 cites W2018582985 @default.
- W2122477496 cites W2024472792 @default.
- W2122477496 cites W2087661010 @default.
- W2122477496 cites W2097580994 @default.
- W2122477496 cites W2102985846 @default.
- W2122477496 cites W2106012167 @default.
- W2122477496 cites W2109584604 @default.
- W2122477496 cites W2113051562 @default.
- W2122477496 cites W2114771311 @default.
- W2122477496 cites W2151297684 @default.
- W2122477496 cites W2151387592 @default.
- W2122477496 cites W2158219778 @default.
- W2122477496 cites W2163166770 @default.
- W2122477496 cites W2169293107 @default.
- W2122477496 doi "https://doi.org/10.3390/e15051738" @default.
- W2122477496 hasPublicationYear "2013" @default.
- W2122477496 type Work @default.
- W2122477496 sameAs 2122477496 @default.
- W2122477496 citedByCount "41" @default.
- W2122477496 countsByYear W21224774962013 @default.
- W2122477496 countsByYear W21224774962014 @default.
- W2122477496 countsByYear W21224774962016 @default.
- W2122477496 countsByYear W21224774962017 @default.
- W2122477496 countsByYear W21224774962018 @default.
- W2122477496 countsByYear W21224774962019 @default.
- W2122477496 countsByYear W21224774962020 @default.
- W2122477496 countsByYear W21224774962021 @default.
- W2122477496 countsByYear W21224774962022 @default.
- W2122477496 countsByYear W21224774962023 @default.
- W2122477496 crossrefType "journal-article" @default.
- W2122477496 hasAuthorship W2122477496A5026150866 @default.
- W2122477496 hasAuthorship W2122477496A5040510048 @default.
- W2122477496 hasAuthorship W2122477496A5051989657 @default.
- W2122477496 hasBestOaLocation W21224774961 @default.
- W2122477496 hasConcept C101112237 @default.
- W2122477496 hasConcept C105795698 @default.
- W2122477496 hasConcept C107673813 @default.
- W2122477496 hasConcept C134306372 @default.
- W2122477496 hasConcept C149569020 @default.
- W2122477496 hasConcept C160234255 @default.
- W2122477496 hasConcept C169214877 @default.
- W2122477496 hasConcept C177769412 @default.
- W2122477496 hasConcept C182310444 @default.
- W2122477496 hasConcept C185429906 @default.
- W2122477496 hasConcept C191413810 @default.
- W2122477496 hasConcept C2781280628 @default.
- W2122477496 hasConcept C33923547 @default.
- W2122477496 hasConcept C37903108 @default.
- W2122477496 hasConcept C41008148 @default.
- W2122477496 hasConcept C68022304 @default.
- W2122477496 hasConcept C95923904 @default.
- W2122477496 hasConceptScore W2122477496C101112237 @default.
- W2122477496 hasConceptScore W2122477496C105795698 @default.
- W2122477496 hasConceptScore W2122477496C107673813 @default.
- W2122477496 hasConceptScore W2122477496C134306372 @default.
- W2122477496 hasConceptScore W2122477496C149569020 @default.
- W2122477496 hasConceptScore W2122477496C160234255 @default.
- W2122477496 hasConceptScore W2122477496C169214877 @default.
- W2122477496 hasConceptScore W2122477496C177769412 @default.
- W2122477496 hasConceptScore W2122477496C182310444 @default.
- W2122477496 hasConceptScore W2122477496C185429906 @default.
- W2122477496 hasConceptScore W2122477496C191413810 @default.
- W2122477496 hasConceptScore W2122477496C2781280628 @default.
- W2122477496 hasConceptScore W2122477496C33923547 @default.
- W2122477496 hasConceptScore W2122477496C37903108 @default.
- W2122477496 hasConceptScore W2122477496C41008148 @default.
- W2122477496 hasConceptScore W2122477496C68022304 @default.
- W2122477496 hasConceptScore W2122477496C95923904 @default.
- W2122477496 hasIssue "12" @default.
- W2122477496 hasLocation W21224774961 @default.
- W2122477496 hasLocation W21224774962 @default.
- W2122477496 hasLocation W21224774963 @default.
- W2122477496 hasOpenAccess W2122477496 @default.
- W2122477496 hasPrimaryLocation W21224774961 @default.
- W2122477496 hasRelatedWork W1563730461 @default.
- W2122477496 hasRelatedWork W2347359446 @default.
- W2122477496 hasRelatedWork W2405192631 @default.
- W2122477496 hasRelatedWork W2513296691 @default.
- W2122477496 hasRelatedWork W2609999188 @default.
- W2122477496 hasRelatedWork W2613087879 @default.
- W2122477496 hasRelatedWork W3025089465 @default.
- W2122477496 hasRelatedWork W3104776319 @default.
- W2122477496 hasRelatedWork W568881065 @default.
- W2122477496 hasRelatedWork W786367546 @default.
- W2122477496 hasVolume "15" @default.
- W2122477496 isParatext "false" @default.