FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3091287254> ?p ?o ?g. }

• W3091287254 abstract "This paper challenges the common assumption that the weight β, in β-VAE, should be larger than 1 in order to effectively disentangle latent factors. We demonstrate that β-VAE, with β<1, can not only attain good disentanglement but also significantly improve reconstruction accuracy via dynamic control. The paper textit{removes the inherent trade-off} between reconstruction accuracy and disentanglement for β-VAE. Existing methods, such as β-VAE and FactorVAE, assign a large weight to the KL-divergence term in the objective function, leading to high reconstruction errors for the sake of better disentanglement. To mitigate this problem, a ControlVAE has recently been developed that dynamically tunes the KL-divergence weight in an attempt to textit{control the trade-off} to more a favorable point. However, ControlVAE fails to eliminate the conflict between the need for a large β (for disentanglement) and the need for a small β (for smaller reconstruction error). Instead, we propose DynamicVAE that maintains a different β at different stages of training, thereby textit{decoupling disentanglement and reconstruction accuracy}. In order to evolve the weight, β, along a trajectory that enables such decoupling, DynamicVAE leverages a modified incremental PI (proportional-integral) controller, a variant of proportional-integral-derivative controller (PID) algorithm, and employs a moving average as well as a hybrid annealing method to evolve the value of KL-divergence smoothly in a tightly controlled fashion. We theoretically prove the stability of the proposed approach. Evaluation results on three benchmark datasets demonstrate that DynamicVAE significantly improves the reconstruction accuracy while achieving disentanglement comparable to the best of existing methods. The results verify that our method can separate disentangled representation learning and reconstruction, removing the inherent tension between the two." @default.
• W3091287254 created "2020-10-08" @default.
• W3091287254 creator A5005026261 @default.
• W3091287254 creator A5025823765 @default.
• W3091287254 creator A5026062552 @default.
• W3091287254 creator A5037027582 @default.
• W3091287254 creator A5041685416 @default.
• W3091287254 creator A5062534500 @default.
• W3091287254 date "2021-05-04" @default.
• W3091287254 modified "2023-09-27" @default.
• W3091287254 title "DynamicVAE: Decoupling Reconstruction Error and Disentangled Representation Learning" @default.
• W3091287254 cites W1499788862 @default.
• W3091287254 cites W1880408395 @default.
• W3091287254 cites W1909320841 @default.
• W3091287254 cites W2010625607 @default.
• W3091287254 cites W2015244008 @default.
• W3091287254 cites W2065366926 @default.
• W3091287254 cites W2097146313 @default.
• W3091287254 cites W2099471712 @default.
• W3091287254 cites W2108501770 @default.
• W3091287254 cites W2157617585 @default.
• W3091287254 cites W2163922914 @default.
• W3091287254 cites W2188956040 @default.
• W3091287254 cites W2559823555 @default.
• W3091287254 cites W2753738274 @default.
• W3091287254 cites W2796704765 @default.
• W3091287254 cites W2902476877 @default.
• W3091287254 cites W2903538854 @default.
• W3091287254 cites W2942718970 @default.
• W3091287254 cites W2951004968 @default.
• W3091287254 cites W2962818303 @default.
• W3091287254 cites W2963045453 @default.
• W3091287254 cites W2963104724 @default.
• W3091287254 cites W2963166838 @default.
• W3091287254 cites W2963226019 @default.
• W3091287254 cites W2963264829 @default.
• W3091287254 cites W2963305465 @default.
• W3091287254 cites W2963366547 @default.
• W3091287254 cites W2963504544 @default.
• W3091287254 cites W2964127395 @default.
• W3091287254 cites W2964812973 @default.
• W3091287254 cites W2970247852 @default.
• W3091287254 cites W2971127577 @default.
• W3091287254 cites W2981628132 @default.
• W3091287254 cites W2989701728 @default.
• W3091287254 cites W2995533105 @default.
• W3091287254 cites W2996554397 @default.
• W3091287254 cites W2998387309 @default.
• W3091287254 cites W3005031238 @default.
• W3091287254 cites W3034182955 @default.
• W3091287254 cites W3035170697 @default.
• W3091287254 cites W3041244724 @default.
• W3091287254 cites W3117876796 @default.
• W3091287254 cites W612285395 @default.
• W3091287254 cites W837205638 @default.
• W3091287254 hasPublicationYear "2021" @default.
• W3091287254 type Work @default.
• W3091287254 sameAs 3091287254 @default.
• W3091287254 citedByCount "1" @default.
• W3091287254 countsByYear W30912872542021 @default.
• W3091287254 crossrefType "journal-article" @default.
• W3091287254 hasAuthorship W3091287254A5005026261 @default.
• W3091287254 hasAuthorship W3091287254A5025823765 @default.
• W3091287254 hasAuthorship W3091287254A5026062552 @default.
• W3091287254 hasAuthorship W3091287254A5037027582 @default.
• W3091287254 hasAuthorship W3091287254A5041685416 @default.
• W3091287254 hasAuthorship W3091287254A5062534500 @default.
• W3091287254 hasConcept C11413529 @default.
• W3091287254 hasConcept C121332964 @default.
• W3091287254 hasConcept C127413603 @default.
• W3091287254 hasConcept C13280743 @default.
• W3091287254 hasConcept C133731056 @default.
• W3091287254 hasConcept C138885662 @default.
• W3091287254 hasConcept C154945302 @default.
• W3091287254 hasConcept C185798385 @default.
• W3091287254 hasConcept C205606062 @default.
• W3091287254 hasConcept C205649164 @default.
• W3091287254 hasConcept C207390915 @default.
• W3091287254 hasConcept C2775924081 @default.
• W3091287254 hasConcept C41008148 @default.
• W3091287254 hasConcept C41895202 @default.
• W3091287254 hasConcept C47116090 @default.
• W3091287254 hasConcept C47446073 @default.
• W3091287254 hasConcept C536315585 @default.
• W3091287254 hasConcept C97355855 @default.
• W3091287254 hasConceptScore W3091287254C11413529 @default.
• W3091287254 hasConceptScore W3091287254C121332964 @default.
• W3091287254 hasConceptScore W3091287254C127413603 @default.
• W3091287254 hasConceptScore W3091287254C13280743 @default.
• W3091287254 hasConceptScore W3091287254C133731056 @default.
• W3091287254 hasConceptScore W3091287254C138885662 @default.
• W3091287254 hasConceptScore W3091287254C154945302 @default.
• W3091287254 hasConceptScore W3091287254C185798385 @default.
• W3091287254 hasConceptScore W3091287254C205606062 @default.
• W3091287254 hasConceptScore W3091287254C205649164 @default.
• W3091287254 hasConceptScore W3091287254C207390915 @default.
• W3091287254 hasConceptScore W3091287254C2775924081 @default.
• W3091287254 hasConceptScore W3091287254C41008148 @default.
• W3091287254 hasConceptScore W3091287254C41895202 @default.
• W3091287254 hasConceptScore W3091287254C47116090 @default.

• next