Matches in SemOpenAlex for { <https://semopenalex.org/work/W2804639765> ?p ?o ?g. }
- W2804639765 abstract "We present a theoretical analysis of the training process for a single-layer GAN fed by high-dimensional input data. The training dynamics of the proposed model at both microscopic and macroscopic scales can be exactly analyzed in the high-dimensional limit. In particular, we prove that the macroscopic quantities measuring the quality of the training process converge to a deterministic process characterized by an ordinary differential equation (ODE), whereas the microscopic states containing all the detailed weights remain stochastic, whose dynamics can be described by a stochastic differential equation (SDE). This analysis provides a new perspective different from recent analyses in the limit of small learning rate, where the microscopic state is always considered deterministic, and the contribution of noise is ignored. From our analysis, we show that the level of the background noise is essential to the convergence of the training process: setting the noise level too strong leads to failure of feature recovery, whereas setting the noise too weak causes oscillation. Although this work focuses on a simple copy model of GAN, we believe the analysis methods and insights developed here would prove useful in the theoretical understanding of other variants of GANs with more advanced training algorithms." @default.
- W2804639765 created "2018-06-01" @default.
- W2804639765 creator A5000907904 @default.
- W2804639765 creator A5038111389 @default.
- W2804639765 creator A5072240312 @default.
- W2804639765 date "2018-05-21" @default.
- W2804639765 modified "2023-09-23" @default.
- W2804639765 title "A Solvable High-Dimensional Model of GAN" @default.
- W2804639765 cites W1499021337 @default.
- W2804639765 cites W2030911724 @default.
- W2804639765 cites W2037985840 @default.
- W2804639765 cites W2042318263 @default.
- W2804639765 cites W2097714737 @default.
- W2804639765 cites W2099471712 @default.
- W2804639765 cites W2132565565 @default.
- W2804639765 cites W2405756170 @default.
- W2804639765 cites W2537458122 @default.
- W2804639765 cites W2581485081 @default.
- W2804639765 cites W2610008708 @default.
- W2804639765 cites W2617573776 @default.
- W2804639765 cites W2619503996 @default.
- W2804639765 cites W2728304432 @default.
- W2804639765 cites W2739748921 @default.
- W2804639765 cites W2766210095 @default.
- W2804639765 cites W2772785876 @default.
- W2804639765 cites W2792263949 @default.
- W2804639765 cites W2796744096 @default.
- W2804639765 cites W2907669392 @default.
- W2804639765 cites W2918794972 @default.
- W2804639765 cites W2949186514 @default.
- W2804639765 cites W2952745707 @default.
- W2804639765 cites W2963073614 @default.
- W2804639765 cites W2963141891 @default.
- W2804639765 cites W2963470893 @default.
- W2804639765 cites W2963873275 @default.
- W2804639765 cites W2963981733 @default.
- W2804639765 cites W2964038363 @default.
- W2804639765 cites W2964126461 @default.
- W2804639765 doi "https://doi.org/10.48550/arxiv.1805.08349" @default.
- W2804639765 hasPublicationYear "2018" @default.
- W2804639765 type Work @default.
- W2804639765 sameAs 2804639765 @default.
- W2804639765 citedByCount "2" @default.
- W2804639765 countsByYear W28046397652019 @default.
- W2804639765 crossrefType "posted-content" @default.
- W2804639765 hasAuthorship W2804639765A5000907904 @default.
- W2804639765 hasAuthorship W2804639765A5038111389 @default.
- W2804639765 hasAuthorship W2804639765A5072240312 @default.
- W2804639765 hasBestOaLocation W28046397651 @default.
- W2804639765 hasConcept C105795698 @default.
- W2804639765 hasConcept C111919701 @default.
- W2804639765 hasConcept C115961682 @default.
- W2804639765 hasConcept C121332964 @default.
- W2804639765 hasConcept C121864883 @default.
- W2804639765 hasConcept C134306372 @default.
- W2804639765 hasConcept C151201525 @default.
- W2804639765 hasConcept C154945302 @default.
- W2804639765 hasConcept C162324750 @default.
- W2804639765 hasConcept C2777303404 @default.
- W2804639765 hasConcept C28826006 @default.
- W2804639765 hasConcept C33923547 @default.
- W2804639765 hasConcept C34862557 @default.
- W2804639765 hasConcept C38652104 @default.
- W2804639765 hasConcept C41008148 @default.
- W2804639765 hasConcept C50522688 @default.
- W2804639765 hasConcept C51544822 @default.
- W2804639765 hasConcept C51955184 @default.
- W2804639765 hasConcept C57945734 @default.
- W2804639765 hasConcept C76178495 @default.
- W2804639765 hasConcept C78045399 @default.
- W2804639765 hasConcept C8272713 @default.
- W2804639765 hasConcept C98045186 @default.
- W2804639765 hasConcept C99498987 @default.
- W2804639765 hasConceptScore W2804639765C105795698 @default.
- W2804639765 hasConceptScore W2804639765C111919701 @default.
- W2804639765 hasConceptScore W2804639765C115961682 @default.
- W2804639765 hasConceptScore W2804639765C121332964 @default.
- W2804639765 hasConceptScore W2804639765C121864883 @default.
- W2804639765 hasConceptScore W2804639765C134306372 @default.
- W2804639765 hasConceptScore W2804639765C151201525 @default.
- W2804639765 hasConceptScore W2804639765C154945302 @default.
- W2804639765 hasConceptScore W2804639765C162324750 @default.
- W2804639765 hasConceptScore W2804639765C2777303404 @default.
- W2804639765 hasConceptScore W2804639765C28826006 @default.
- W2804639765 hasConceptScore W2804639765C33923547 @default.
- W2804639765 hasConceptScore W2804639765C34862557 @default.
- W2804639765 hasConceptScore W2804639765C38652104 @default.
- W2804639765 hasConceptScore W2804639765C41008148 @default.
- W2804639765 hasConceptScore W2804639765C50522688 @default.
- W2804639765 hasConceptScore W2804639765C51544822 @default.
- W2804639765 hasConceptScore W2804639765C51955184 @default.
- W2804639765 hasConceptScore W2804639765C57945734 @default.
- W2804639765 hasConceptScore W2804639765C76178495 @default.
- W2804639765 hasConceptScore W2804639765C78045399 @default.
- W2804639765 hasConceptScore W2804639765C8272713 @default.
- W2804639765 hasConceptScore W2804639765C98045186 @default.
- W2804639765 hasConceptScore W2804639765C99498987 @default.
- W2804639765 hasLocation W28046397651 @default.
- W2804639765 hasOpenAccess W2804639765 @default.
- W2804639765 hasPrimaryLocation W28046397651 @default.