FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3041019643> ?p ?o ?g. }

• W3041019643 abstract "Variational autoencoders optimize an objective that combines a reconstruction loss (the distortion) and a KL term (the rate). The rate is an upper bound on the mutual information, which is often interpreted as a regularizer that controls the degree of compression. We here examine whether inclusion of the rate also acts as an inductive bias that improves generalization. We perform rate-distortion analyses that control the strength of the rate term, the network capacity, and the difficulty of the generalization problem. Decreasing the strength of the rate paradoxically improves generalization in most settings, and reducing the mutual information typically leads to underfitting. Moreover, we show that generalization continues to improve even after the mutual information saturates, indicating that the gap on the bound (i.e. the KL divergence relative to the inference marginal) affects generalization. This suggests that the standard Gaussian prior is not an inductive bias that typically aids generalization, prompting work to understand what choices of priors improve generalization in VAEs." @default.
• W3041019643 created "2020-07-16" @default.
• W3041019643 creator A5031329578 @default.
• W3041019643 creator A5042038501 @default.
• W3041019643 creator A5053808736 @default.
• W3041019643 creator A5059517243 @default.
• W3041019643 creator A5073129092 @default.
• W3041019643 creator A5079980080 @default.
• W3041019643 date "2019-11-11" @default.
• W3041019643 modified "2023-09-27" @default.
• W3041019643 title "Rate-Regularization and Generalization in VAEs" @default.
• W3041019643 cites W1686946872 @default.
• W3041019643 cites W1959608418 @default.
• W3041019643 cites W2099111195 @default.
• W3041019643 cites W2112796928 @default.
• W3041019643 cites W2123469175 @default.
• W3041019643 cites W2134557905 @default.
• W3041019643 cites W2560512785 @default.
• W3041019643 cites W2572816092 @default.
• W3041019643 cites W2587284713 @default.
• W3041019643 cites W2620025707 @default.
• W3041019643 cites W2750384547 @default.
• W3041019643 cites W2753738274 @default.
• W3041019643 cites W2785961484 @default.
• W3041019643 cites W2903538854 @default.
• W3041019643 cites W2911610187 @default.
• W3041019643 cites W2952034151 @default.
• W3041019643 cites W2962897886 @default.
• W3041019643 cites W2962964508 @default.
• W3041019643 cites W2963085847 @default.
• W3041019643 cites W2963104724 @default.
• W3041019643 cites W2963134326 @default.
• W3041019643 cites W2963145887 @default.
• W3041019643 cites W2963486392 @default.
• W3041019643 cites W2963636093 @default.
• W3041019643 cites W2963801305 @default.
• W3041019643 cites W2964127395 @default.
• W3041019643 cites W2971074500 @default.
• W3041019643 cites W2972632651 @default.
• W3041019643 cites W2994610548 @default.
• W3041019643 cites W2996594819 @default.
• W3041019643 cites W2997095142 @default.
• W3041019643 cites W3004032229 @default.
• W3041019643 cites W3014079140 @default.
• W3041019643 hasPublicationYear "2019" @default.
• W3041019643 type Work @default.
• W3041019643 sameAs 3041019643 @default.
• W3041019643 citedByCount "2" @default.
• W3041019643 countsByYear W30410196432020 @default.
• W3041019643 countsByYear W30410196432021 @default.
• W3041019643 crossrefType "posted-content" @default.
• W3041019643 hasAuthorship W3041019643A5031329578 @default.
• W3041019643 hasAuthorship W3041019643A5042038501 @default.
• W3041019643 hasAuthorship W3041019643A5053808736 @default.
• W3041019643 hasAuthorship W3041019643A5059517243 @default.
• W3041019643 hasAuthorship W3041019643A5073129092 @default.
• W3041019643 hasAuthorship W3041019643A5079980080 @default.
• W3041019643 hasConcept C107673813 @default.
• W3041019643 hasConcept C11413529 @default.
• W3041019643 hasConcept C121332964 @default.
• W3041019643 hasConcept C126780896 @default.
• W3041019643 hasConcept C134306372 @default.
• W3041019643 hasConcept C152139883 @default.
• W3041019643 hasConcept C154945302 @default.
• W3041019643 hasConcept C163716315 @default.
• W3041019643 hasConcept C177148314 @default.
• W3041019643 hasConcept C177769412 @default.
• W3041019643 hasConcept C194257627 @default.
• W3041019643 hasConcept C2776135515 @default.
• W3041019643 hasConcept C2776214188 @default.
• W3041019643 hasConcept C2776257435 @default.
• W3041019643 hasConcept C28826006 @default.
• W3041019643 hasConcept C31258907 @default.
• W3041019643 hasConcept C33923547 @default.
• W3041019643 hasConcept C41008148 @default.
• W3041019643 hasConcept C62520636 @default.
• W3041019643 hasConcept C64185310 @default.
• W3041019643 hasConcept C77553402 @default.
• W3041019643 hasConcept C78548338 @default.
• W3041019643 hasConceptScore W3041019643C107673813 @default.
• W3041019643 hasConceptScore W3041019643C11413529 @default.
• W3041019643 hasConceptScore W3041019643C121332964 @default.
• W3041019643 hasConceptScore W3041019643C126780896 @default.
• W3041019643 hasConceptScore W3041019643C134306372 @default.
• W3041019643 hasConceptScore W3041019643C152139883 @default.
• W3041019643 hasConceptScore W3041019643C154945302 @default.
• W3041019643 hasConceptScore W3041019643C163716315 @default.
• W3041019643 hasConceptScore W3041019643C177148314 @default.
• W3041019643 hasConceptScore W3041019643C177769412 @default.
• W3041019643 hasConceptScore W3041019643C194257627 @default.
• W3041019643 hasConceptScore W3041019643C2776135515 @default.
• W3041019643 hasConceptScore W3041019643C2776214188 @default.
• W3041019643 hasConceptScore W3041019643C2776257435 @default.
• W3041019643 hasConceptScore W3041019643C28826006 @default.
• W3041019643 hasConceptScore W3041019643C31258907 @default.
• W3041019643 hasConceptScore W3041019643C33923547 @default.
• W3041019643 hasConceptScore W3041019643C41008148 @default.
• W3041019643 hasConceptScore W3041019643C62520636 @default.
• W3041019643 hasConceptScore W3041019643C64185310 @default.
• W3041019643 hasConceptScore W3041019643C77553402 @default.

• next