Matches in SemOpenAlex for { <https://semopenalex.org/work/W2963484654> ?p ?o ?g. }
- W2963484654 endingPage "3451" @default.
- W2963484654 startingPage "3436" @default.
- W2963484654 abstract "Given two discrete random variables X and Y, with probability distributions p = (p <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sub> , ..., p <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>n</sub> ) and q = (q <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sub> , ..., q <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>m</sub> ), respectively, let us denote by C(p, q) the set of all couplings of p and q, that is, the set of all bivariate probability distributions that have p and q as marginals. In this paper, we study the problem of finding a joint probability distribution in C(p, q) of minimum entropy (equivalently, a coupling that maximizes the mutual information between X and Y), and we discuss several situations where the need for this kind of optimization naturally arises. Since the optimization problem is known to be NP-hard, we give an efficient algorithm to find a joint probability distribution in C(p, q) with entropy exceeding the minimum possible at most by 1 bit, thus providing an approximation algorithm with an additive gap of at most 1 bit. Leveraging on this algorithm, we extend our result to the problem of finding a minimum-entropy joint distribution of arbitrary k ≥ 2 discrete random variables X <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sub> , ..., X <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>k</sub> , consistent with the known k marginal distributions of the individual random variables X <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sub> , ..., X <sub xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>k</sub> . In this case, our algorithm has an additive gap of at most log k from optimum. We also discuss several related applications of our findings and extensions of our results to entropies different from the Shannon entropy." @default.
- W2963484654 created "2019-07-30" @default.
- W2963484654 creator A5012067736 @default.
- W2963484654 creator A5022392874 @default.
- W2963484654 creator A5037548562 @default.
- W2963484654 date "2019-06-01" @default.
- W2963484654 modified "2023-09-26" @default.
- W2963484654 title "Minimum-Entropy Couplings and Their Applications" @default.
- W2963484654 cites W1589803317 @default.
- W2963484654 cites W1967370121 @default.
- W2963484654 cites W1983874169 @default.
- W2963484654 cites W1994520254 @default.
- W2963484654 cites W2004537679 @default.
- W2963484654 cites W2015344028 @default.
- W2963484654 cites W2018582985 @default.
- W2963484654 cites W2034432063 @default.
- W2963484654 cites W2034634387 @default.
- W2963484654 cites W2035632748 @default.
- W2963484654 cites W2058388580 @default.
- W2963484654 cites W2069547904 @default.
- W2963484654 cites W2079296583 @default.
- W2963484654 cites W2086324413 @default.
- W2963484654 cites W2090108863 @default.
- W2963484654 cites W2107826306 @default.
- W2963484654 cites W2111854888 @default.
- W2963484654 cites W2112883966 @default.
- W2963484654 cites W2113990831 @default.
- W2963484654 cites W2121036196 @default.
- W2963484654 cites W2123142728 @default.
- W2963484654 cites W2142155602 @default.
- W2963484654 cites W2155799962 @default.
- W2963484654 cites W2156875677 @default.
- W2963484654 cites W2161226162 @default.
- W2963484654 cites W2166857777 @default.
- W2963484654 cites W2274218479 @default.
- W2963484654 cites W2275566407 @default.
- W2963484654 cites W2304997124 @default.
- W2963484654 cites W230726820 @default.
- W2963484654 cites W2319136707 @default.
- W2963484654 cites W2390264370 @default.
- W2963484654 cites W2512147363 @default.
- W2963484654 cites W2585449849 @default.
- W2963484654 cites W2962921917 @default.
- W2963484654 cites W2963157613 @default.
- W2963484654 cites W2963705438 @default.
- W2963484654 cites W2964157181 @default.
- W2963484654 cites W3102490990 @default.
- W2963484654 cites W3103598778 @default.
- W2963484654 cites W3107978990 @default.
- W2963484654 cites W386095932 @default.
- W2963484654 cites W409136105 @default.
- W2963484654 doi "https://doi.org/10.1109/tit.2019.2894519" @default.
- W2963484654 hasPublicationYear "2019" @default.
- W2963484654 type Work @default.
- W2963484654 sameAs 2963484654 @default.
- W2963484654 citedByCount "12" @default.
- W2963484654 countsByYear W29634846542019 @default.
- W2963484654 countsByYear W29634846542020 @default.
- W2963484654 countsByYear W29634846542021 @default.
- W2963484654 countsByYear W29634846542022 @default.
- W2963484654 countsByYear W29634846542023 @default.
- W2963484654 crossrefType "journal-article" @default.
- W2963484654 hasAuthorship W2963484654A5012067736 @default.
- W2963484654 hasAuthorship W2963484654A5022392874 @default.
- W2963484654 hasAuthorship W2963484654A5037548562 @default.
- W2963484654 hasBestOaLocation W29634846542 @default.
- W2963484654 hasConcept C105795698 @default.
- W2963484654 hasConcept C106301342 @default.
- W2963484654 hasConcept C11413529 @default.
- W2963484654 hasConcept C114614502 @default.
- W2963484654 hasConcept C118615104 @default.
- W2963484654 hasConcept C121332964 @default.
- W2963484654 hasConcept C122123141 @default.
- W2963484654 hasConcept C149441793 @default.
- W2963484654 hasConcept C18653775 @default.
- W2963484654 hasConcept C33923547 @default.
- W2963484654 hasConcept C62520636 @default.
- W2963484654 hasConceptScore W2963484654C105795698 @default.
- W2963484654 hasConceptScore W2963484654C106301342 @default.
- W2963484654 hasConceptScore W2963484654C11413529 @default.
- W2963484654 hasConceptScore W2963484654C114614502 @default.
- W2963484654 hasConceptScore W2963484654C118615104 @default.
- W2963484654 hasConceptScore W2963484654C121332964 @default.
- W2963484654 hasConceptScore W2963484654C122123141 @default.
- W2963484654 hasConceptScore W2963484654C149441793 @default.
- W2963484654 hasConceptScore W2963484654C18653775 @default.
- W2963484654 hasConceptScore W2963484654C33923547 @default.
- W2963484654 hasConceptScore W2963484654C62520636 @default.
- W2963484654 hasIssue "6" @default.
- W2963484654 hasLocation W29634846541 @default.
- W2963484654 hasLocation W29634846542 @default.
- W2963484654 hasOpenAccess W2963484654 @default.
- W2963484654 hasPrimaryLocation W29634846541 @default.
- W2963484654 hasRelatedWork W1972998039 @default.
- W2963484654 hasRelatedWork W2107126366 @default.
- W2963484654 hasRelatedWork W2526245987 @default.
- W2963484654 hasRelatedWork W2742795413 @default.
- W2963484654 hasRelatedWork W3088628728 @default.