Matches in SemOpenAlex for { <https://semopenalex.org/work/W2891554549> ?p ?o ?g. }
- W2891554549 abstract "Information theoretic quantities play an important role in various settings in machine learning, including causality testing, structure inference in graphical models, time-series problems, feature selection as well as in providing privacy guarantees. A key quantity of interest is the mutual information and generalizations thereof, including conditional mutual information, multivariate mutual information, total correlation and directed information. While the aforementioned information quantities are well defined in arbitrary probability spaces, existing estimators add or subtract entropies (we term them $Sigma H$ methods). These methods work only in purely discrete space or purely continuous case since entropy (or differential entropy) is well defined only in that regime. In this paper, we define a general graph divergence measure ($mathbb{GDM}$), as a measure of incompatibility between the observed distribution and a given graphical model structure. This generalizes the aforementioned information measures and we construct a novel estimator via a coupling trick that directly estimates these multivariate information measures using the Radon-Nikodym derivative. These estimators are proven to be consistent in a general setting which includes several cases where the existing estimators fail, thus providing the only known estimators for the following settings: (1) the data has some discrete and some continuous-valued components (2) some (or all) of the components themselves are discrete-continuous mixtures (3) the data is real-valued but does not have a joint density on the entire space, rather is supported on a low-dimensional manifold. We show that our proposed estimators significantly outperform known estimators on synthetic and real datasets." @default.
- W2891554549 created "2018-09-27" @default.
- W2891554549 creator A5019098931 @default.
- W2891554549 creator A5053980484 @default.
- W2891554549 creator A5055459719 @default.
- W2891554549 creator A5060138971 @default.
- W2891554549 date "2018-10-26" @default.
- W2891554549 modified "2023-10-16" @default.
- W2891554549 title "Estimators for Multivariate Information Measures in General Probability Spaces" @default.
- W2891554549 cites W1429887952 @default.
- W2891554549 cites W1579548224 @default.
- W2891554549 cites W1732328119 @default.
- W2891554549 cites W1839657926 @default.
- W2891554549 cites W1974618690 @default.
- W2891554549 cites W1989151402 @default.
- W2891554549 cites W2005481656 @default.
- W2891554549 cites W2005560667 @default.
- W2891554549 cites W2007062492 @default.
- W2891554549 cites W2024472792 @default.
- W2891554549 cites W2027607571 @default.
- W2891554549 cites W2063249739 @default.
- W2891554549 cites W2066022742 @default.
- W2891554549 cites W2079145130 @default.
- W2891554549 cites W2089943482 @default.
- W2891554549 cites W2092939357 @default.
- W2891554549 cites W2095439994 @default.
- W2891554549 cites W2097173970 @default.
- W2891554549 cites W2114771311 @default.
- W2891554549 cites W2115247131 @default.
- W2891554549 cites W2119471399 @default.
- W2891554549 cites W2123649031 @default.
- W2891554549 cites W2131347386 @default.
- W2891554549 cites W2132008222 @default.
- W2891554549 cites W2139708568 @default.
- W2891554549 cites W2140911775 @default.
- W2891554549 cites W2149454242 @default.
- W2891554549 cites W2156939381 @default.
- W2891554549 cites W2165580920 @default.
- W2891554549 cites W2167826316 @default.
- W2891554549 cites W2188155116 @default.
- W2891554549 cites W2288153033 @default.
- W2891554549 cites W2336509789 @default.
- W2891554549 cites W2587908244 @default.
- W2891554549 cites W2770428807 @default.
- W2891554549 cites W2781941503 @default.
- W2891554549 cites W2789700415 @default.
- W2891554549 cites W2797998707 @default.
- W2891554549 cites W2798473808 @default.
- W2891554549 cites W2963053125 @default.
- W2891554549 cites W2963540279 @default.
- W2891554549 cites W2963608890 @default.
- W2891554549 cites W2963675110 @default.
- W2891554549 cites W2963822511 @default.
- W2891554549 cites W2963895664 @default.
- W2891554549 cites W2963993898 @default.
- W2891554549 cites W2964184826 @default.
- W2891554549 cites W2964229204 @default.
- W2891554549 cites W30853191 @default.
- W2891554549 cites W901360145 @default.
- W2891554549 hasPublicationYear "2018" @default.
- W2891554549 type Work @default.
- W2891554549 sameAs 2891554549 @default.
- W2891554549 citedByCount "2" @default.
- W2891554549 countsByYear W28915545492019 @default.
- W2891554549 countsByYear W28915545492021 @default.
- W2891554549 crossrefType "posted-content" @default.
- W2891554549 hasAuthorship W2891554549A5019098931 @default.
- W2891554549 hasAuthorship W2891554549A5053980484 @default.
- W2891554549 hasAuthorship W2891554549A5055459719 @default.
- W2891554549 hasAuthorship W2891554549A5060138971 @default.
- W2891554549 hasConcept C105795698 @default.
- W2891554549 hasConcept C106301342 @default.
- W2891554549 hasConcept C121332964 @default.
- W2891554549 hasConcept C124101348 @default.
- W2891554549 hasConcept C152139883 @default.
- W2891554549 hasConcept C154945302 @default.
- W2891554549 hasConcept C155846161 @default.
- W2891554549 hasConcept C161584116 @default.
- W2891554549 hasConcept C185429906 @default.
- W2891554549 hasConcept C2776214188 @default.
- W2891554549 hasConcept C2780009758 @default.
- W2891554549 hasConcept C33923547 @default.
- W2891554549 hasConcept C41008148 @default.
- W2891554549 hasConcept C52622258 @default.
- W2891554549 hasConcept C62520636 @default.
- W2891554549 hasConceptScore W2891554549C105795698 @default.
- W2891554549 hasConceptScore W2891554549C106301342 @default.
- W2891554549 hasConceptScore W2891554549C121332964 @default.
- W2891554549 hasConceptScore W2891554549C124101348 @default.
- W2891554549 hasConceptScore W2891554549C152139883 @default.
- W2891554549 hasConceptScore W2891554549C154945302 @default.
- W2891554549 hasConceptScore W2891554549C155846161 @default.
- W2891554549 hasConceptScore W2891554549C161584116 @default.
- W2891554549 hasConceptScore W2891554549C185429906 @default.
- W2891554549 hasConceptScore W2891554549C2776214188 @default.
- W2891554549 hasConceptScore W2891554549C2780009758 @default.
- W2891554549 hasConceptScore W2891554549C33923547 @default.
- W2891554549 hasConceptScore W2891554549C41008148 @default.
- W2891554549 hasConceptScore W2891554549C52622258 @default.
- W2891554549 hasConceptScore W2891554549C62520636 @default.