Matches in SemOpenAlex for { <https://semopenalex.org/work/W4319049326> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4319049326 abstract "Adversarial nets have proved to be powerful in various domains including generative modeling (GANs), transfer learning, and fairness. However, successfully training adversarial nets using first-order methods remains a major challenge. Typically, careful choices of the learning rates are needed to maintain the delicate balance between the competing networks. In this paper, we design a novel learning rate scheduler that dynamically adapts the learning rate of the adversary to maintain the right balance. The scheduler is driven by the fact that the loss of an ideal adversarial net is a constant known a priori. The scheduler is thus designed to keep the loss of the optimized adversarial net close to that of an ideal network. We run large-scale experiments to study the effectiveness of the scheduler on two popular applications: GANs for image generation and adversarial nets for domain adaptation. Our experiments indicate that adversarial nets trained with the scheduler are less likely to diverge and require significantly less tuning. For example, on CelebA, a GAN with the scheduler requires only one-tenth of the tuning budget needed without a scheduler. Moreover, the scheduler leads to statistically significant improvements in model quality, reaching up to $27%$ in Frechet Inception Distance for image generation and $3%$ in test accuracy for domain adaptation." @default.
- W4319049326 created "2023-02-04" @default.
- W4319049326 creator A5030782402 @default.
- W4319049326 creator A5066834365 @default.
- W4319049326 date "2023-01-31" @default.
- W4319049326 modified "2023-10-01" @default.
- W4319049326 title "Mind the (optimality) Gap: A Gap-Aware Learning Rate Scheduler for Adversarial Nets" @default.
- W4319049326 doi "https://doi.org/10.48550/arxiv.2302.00089" @default.
- W4319049326 hasPublicationYear "2023" @default.
- W4319049326 type Work @default.
- W4319049326 citedByCount "0" @default.
- W4319049326 crossrefType "posted-content" @default.
- W4319049326 hasAuthorship W4319049326A5030782402 @default.
- W4319049326 hasAuthorship W4319049326A5066834365 @default.
- W4319049326 hasBestOaLocation W43190493261 @default.
- W4319049326 hasConcept C108583219 @default.
- W4319049326 hasConcept C111472728 @default.
- W4319049326 hasConcept C119857082 @default.
- W4319049326 hasConcept C120314980 @default.
- W4319049326 hasConcept C126255220 @default.
- W4319049326 hasConcept C138885662 @default.
- W4319049326 hasConcept C154945302 @default.
- W4319049326 hasConcept C206729178 @default.
- W4319049326 hasConcept C33923547 @default.
- W4319049326 hasConcept C37736160 @default.
- W4319049326 hasConcept C38652104 @default.
- W4319049326 hasConcept C39890363 @default.
- W4319049326 hasConcept C41008148 @default.
- W4319049326 hasConcept C41065033 @default.
- W4319049326 hasConcept C75553542 @default.
- W4319049326 hasConceptScore W4319049326C108583219 @default.
- W4319049326 hasConceptScore W4319049326C111472728 @default.
- W4319049326 hasConceptScore W4319049326C119857082 @default.
- W4319049326 hasConceptScore W4319049326C120314980 @default.
- W4319049326 hasConceptScore W4319049326C126255220 @default.
- W4319049326 hasConceptScore W4319049326C138885662 @default.
- W4319049326 hasConceptScore W4319049326C154945302 @default.
- W4319049326 hasConceptScore W4319049326C206729178 @default.
- W4319049326 hasConceptScore W4319049326C33923547 @default.
- W4319049326 hasConceptScore W4319049326C37736160 @default.
- W4319049326 hasConceptScore W4319049326C38652104 @default.
- W4319049326 hasConceptScore W4319049326C39890363 @default.
- W4319049326 hasConceptScore W4319049326C41008148 @default.
- W4319049326 hasConceptScore W4319049326C41065033 @default.
- W4319049326 hasConceptScore W4319049326C75553542 @default.
- W4319049326 hasLocation W43190493261 @default.
- W4319049326 hasOpenAccess W4319049326 @default.
- W4319049326 hasPrimaryLocation W43190493261 @default.
- W4319049326 hasRelatedWork W2610321374 @default.
- W4319049326 hasRelatedWork W2753252132 @default.
- W4319049326 hasRelatedWork W2884827599 @default.
- W4319049326 hasRelatedWork W2952541330 @default.
- W4319049326 hasRelatedWork W2952919291 @default.
- W4319049326 hasRelatedWork W2963034797 @default.
- W4319049326 hasRelatedWork W2964253222 @default.
- W4319049326 hasRelatedWork W3024390022 @default.
- W4319049326 hasRelatedWork W4223943233 @default.
- W4319049326 hasRelatedWork W4312200629 @default.
- W4319049326 isParatext "false" @default.
- W4319049326 isRetracted "false" @default.
- W4319049326 workType "article" @default.