Matches in SemOpenAlex for { <https://semopenalex.org/work/W2970714164> ?p ?o ?g. }
- W2970714164 endingPage "3895" @default.
- W2970714164 startingPage "3884" @default.
- W2970714164 abstract "Compression is at the heart of effective representation learning. However, lossy compression is typically achieved through simple parametric models like Gaussian noise to preserve analytic tractability, and the limitations this imposes on learning are largely unexplored. Further, the Gaussian prior assumptions in models such as variational autoencoders (VAEs) provide only an upper bound on the compression rate in general. We introduce a new noise channel, Echo noise, that admits a simple, exact expression for mutual information for arbitrary input distributions. The noise is constructed in a data-driven fashion that does not require restrictive distributional assumptions. With its complex encoding mechanism and exact rate regularization, Echo leads to improved bounds on log-likelihood and dominates beta-VAEs across the achievable range of rate-distortion trade-offs. Further, we show that Echo noise can outperform flow-based methods without the need to train additional distributional transformations." @default.
- W2970714164 created "2019-09-05" @default.
- W2970714164 creator A5046444281 @default.
- W2970714164 creator A5064560490 @default.
- W2970714164 creator A5072158791 @default.
- W2970714164 creator A5075920466 @default.
- W2970714164 date "2019-01-01" @default.
- W2970714164 modified "2023-10-18" @default.
- W2970714164 title "Exact Rate-Distortion in Autoencoders via Echo Noise" @default.
- W2970714164 hasPublicationYear "2019" @default.
- W2970714164 type Work @default.
- W2970714164 sameAs 2970714164 @default.
- W2970714164 citedByCount "6" @default.
- W2970714164 countsByYear W29707141642019 @default.
- W2970714164 countsByYear W29707141642020 @default.
- W2970714164 countsByYear W29707141642021 @default.
- W2970714164 crossrefType "proceedings-article" @default.
- W2970714164 hasAuthorship W2970714164A5046444281 @default.
- W2970714164 hasAuthorship W2970714164A5064560490 @default.
- W2970714164 hasAuthorship W2970714164A5072158791 @default.
- W2970714164 hasAuthorship W2970714164A5075920466 @default.
- W2970714164 hasConcept C105795698 @default.
- W2970714164 hasConcept C11413529 @default.
- W2970714164 hasConcept C115961682 @default.
- W2970714164 hasConcept C117251300 @default.
- W2970714164 hasConcept C121332964 @default.
- W2970714164 hasConcept C126780896 @default.
- W2970714164 hasConcept C134306372 @default.
- W2970714164 hasConcept C13481523 @default.
- W2970714164 hasConcept C154945302 @default.
- W2970714164 hasConcept C163294075 @default.
- W2970714164 hasConcept C163716315 @default.
- W2970714164 hasConcept C165021410 @default.
- W2970714164 hasConcept C194257627 @default.
- W2970714164 hasConcept C2776135515 @default.
- W2970714164 hasConcept C2776257435 @default.
- W2970714164 hasConcept C29265498 @default.
- W2970714164 hasConcept C31258907 @default.
- W2970714164 hasConcept C33923547 @default.
- W2970714164 hasConcept C41008148 @default.
- W2970714164 hasConcept C4199805 @default.
- W2970714164 hasConcept C62520636 @default.
- W2970714164 hasConcept C77553402 @default.
- W2970714164 hasConcept C9417928 @default.
- W2970714164 hasConcept C94835093 @default.
- W2970714164 hasConcept C99498987 @default.
- W2970714164 hasConceptScore W2970714164C105795698 @default.
- W2970714164 hasConceptScore W2970714164C11413529 @default.
- W2970714164 hasConceptScore W2970714164C115961682 @default.
- W2970714164 hasConceptScore W2970714164C117251300 @default.
- W2970714164 hasConceptScore W2970714164C121332964 @default.
- W2970714164 hasConceptScore W2970714164C126780896 @default.
- W2970714164 hasConceptScore W2970714164C134306372 @default.
- W2970714164 hasConceptScore W2970714164C13481523 @default.
- W2970714164 hasConceptScore W2970714164C154945302 @default.
- W2970714164 hasConceptScore W2970714164C163294075 @default.
- W2970714164 hasConceptScore W2970714164C163716315 @default.
- W2970714164 hasConceptScore W2970714164C165021410 @default.
- W2970714164 hasConceptScore W2970714164C194257627 @default.
- W2970714164 hasConceptScore W2970714164C2776135515 @default.
- W2970714164 hasConceptScore W2970714164C2776257435 @default.
- W2970714164 hasConceptScore W2970714164C29265498 @default.
- W2970714164 hasConceptScore W2970714164C31258907 @default.
- W2970714164 hasConceptScore W2970714164C33923547 @default.
- W2970714164 hasConceptScore W2970714164C41008148 @default.
- W2970714164 hasConceptScore W2970714164C4199805 @default.
- W2970714164 hasConceptScore W2970714164C62520636 @default.
- W2970714164 hasConceptScore W2970714164C77553402 @default.
- W2970714164 hasConceptScore W2970714164C9417928 @default.
- W2970714164 hasConceptScore W2970714164C94835093 @default.
- W2970714164 hasConceptScore W2970714164C99498987 @default.
- W2970714164 hasLocation W29707141641 @default.
- W2970714164 hasOpenAccess W2970714164 @default.
- W2970714164 hasPrimaryLocation W29707141641 @default.
- W2970714164 hasRelatedWork W1766136606 @default.
- W2970714164 hasRelatedWork W1806269746 @default.
- W2970714164 hasRelatedWork W1880775172 @default.
- W2970714164 hasRelatedWork W1994756170 @default.
- W2970714164 hasRelatedWork W2091482891 @default.
- W2970714164 hasRelatedWork W2618706285 @default.
- W2970714164 hasRelatedWork W2753738274 @default.
- W2970714164 hasRelatedWork W2765989888 @default.
- W2970714164 hasRelatedWork W2891041063 @default.
- W2970714164 hasRelatedWork W2922158313 @default.
- W2970714164 hasRelatedWork W2939596270 @default.
- W2970714164 hasRelatedWork W2947159716 @default.
- W2970714164 hasRelatedWork W2951154113 @default.
- W2970714164 hasRelatedWork W2952040794 @default.
- W2970714164 hasRelatedWork W2952610888 @default.
- W2970714164 hasRelatedWork W2953167782 @default.
- W2970714164 hasRelatedWork W3016449737 @default.
- W2970714164 hasRelatedWork W3123548110 @default.
- W2970714164 hasRelatedWork W3164295722 @default.
- W2970714164 hasRelatedWork W3165583693 @default.
- W2970714164 hasVolume "32" @default.
- W2970714164 isParatext "false" @default.
- W2970714164 isRetracted "false" @default.
- W2970714164 magId "2970714164" @default.