Matches in SemOpenAlex for { <https://semopenalex.org/work/W4368304348> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4368304348 abstract "We develop information-geometric techniques to analyze the trajectories of the predictions of deep networks during training. By examining the underlying high-dimensional probabilistic models, we reveal that the training process explores an effectively low-dimensional manifold. Networks with a wide range of architectures, sizes, trained using different optimization methods, regularization techniques, data augmentation techniques, and weight initializations lie on the same manifold in the prediction space. We study the details of this manifold to find that networks with different architectures follow distinguishable trajectories but other factors have a minimal influence; larger networks train along a similar manifold as that of smaller networks, just faster; and networks initialized at very different parts of the prediction space converge to the solution along a similar manifold." @default.
- W4368304348 created "2023-05-05" @default.
- W4368304348 creator A5002001444 @default.
- W4368304348 creator A5006038667 @default.
- W4368304348 creator A5006242950 @default.
- W4368304348 creator A5030951821 @default.
- W4368304348 creator A5048733359 @default.
- W4368304348 creator A5077670292 @default.
- W4368304348 creator A5079200693 @default.
- W4368304348 creator A5084169265 @default.
- W4368304348 date "2023-05-02" @default.
- W4368304348 modified "2023-09-23" @default.
- W4368304348 title "The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold" @default.
- W4368304348 doi "https://doi.org/10.48550/arxiv.2305.01604" @default.
- W4368304348 hasPublicationYear "2023" @default.
- W4368304348 type Work @default.
- W4368304348 citedByCount "0" @default.
- W4368304348 crossrefType "posted-content" @default.
- W4368304348 hasAuthorship W4368304348A5002001444 @default.
- W4368304348 hasAuthorship W4368304348A5006038667 @default.
- W4368304348 hasAuthorship W4368304348A5006242950 @default.
- W4368304348 hasAuthorship W4368304348A5030951821 @default.
- W4368304348 hasAuthorship W4368304348A5048733359 @default.
- W4368304348 hasAuthorship W4368304348A5077670292 @default.
- W4368304348 hasAuthorship W4368304348A5079200693 @default.
- W4368304348 hasAuthorship W4368304348A5084169265 @default.
- W4368304348 hasBestOaLocation W43683043481 @default.
- W4368304348 hasConcept C108583219 @default.
- W4368304348 hasConcept C111919701 @default.
- W4368304348 hasConcept C119857082 @default.
- W4368304348 hasConcept C126255220 @default.
- W4368304348 hasConcept C127413603 @default.
- W4368304348 hasConcept C146978453 @default.
- W4368304348 hasConcept C151876577 @default.
- W4368304348 hasConcept C153120616 @default.
- W4368304348 hasConcept C154945302 @default.
- W4368304348 hasConcept C204323151 @default.
- W4368304348 hasConcept C2776135515 @default.
- W4368304348 hasConcept C2778572836 @default.
- W4368304348 hasConcept C33923547 @default.
- W4368304348 hasConcept C41008148 @default.
- W4368304348 hasConcept C49937458 @default.
- W4368304348 hasConcept C529865628 @default.
- W4368304348 hasConcept C70518039 @default.
- W4368304348 hasConcept C78519656 @default.
- W4368304348 hasConcept C98045186 @default.
- W4368304348 hasConceptScore W4368304348C108583219 @default.
- W4368304348 hasConceptScore W4368304348C111919701 @default.
- W4368304348 hasConceptScore W4368304348C119857082 @default.
- W4368304348 hasConceptScore W4368304348C126255220 @default.
- W4368304348 hasConceptScore W4368304348C127413603 @default.
- W4368304348 hasConceptScore W4368304348C146978453 @default.
- W4368304348 hasConceptScore W4368304348C151876577 @default.
- W4368304348 hasConceptScore W4368304348C153120616 @default.
- W4368304348 hasConceptScore W4368304348C154945302 @default.
- W4368304348 hasConceptScore W4368304348C204323151 @default.
- W4368304348 hasConceptScore W4368304348C2776135515 @default.
- W4368304348 hasConceptScore W4368304348C2778572836 @default.
- W4368304348 hasConceptScore W4368304348C33923547 @default.
- W4368304348 hasConceptScore W4368304348C41008148 @default.
- W4368304348 hasConceptScore W4368304348C49937458 @default.
- W4368304348 hasConceptScore W4368304348C529865628 @default.
- W4368304348 hasConceptScore W4368304348C70518039 @default.
- W4368304348 hasConceptScore W4368304348C78519656 @default.
- W4368304348 hasConceptScore W4368304348C98045186 @default.
- W4368304348 hasLocation W43683043481 @default.
- W4368304348 hasOpenAccess W4368304348 @default.
- W4368304348 hasPrimaryLocation W43683043481 @default.
- W4368304348 hasRelatedWork W1541811775 @default.
- W4368304348 hasRelatedWork W1588616767 @default.
- W4368304348 hasRelatedWork W2424268508 @default.
- W4368304348 hasRelatedWork W2900866154 @default.
- W4368304348 hasRelatedWork W2986222199 @default.
- W4368304348 hasRelatedWork W3027097012 @default.
- W4368304348 hasRelatedWork W3159953198 @default.
- W4368304348 hasRelatedWork W4288027486 @default.
- W4368304348 hasRelatedWork W4323659903 @default.
- W4368304348 hasRelatedWork W2965535361 @default.
- W4368304348 isParatext "false" @default.
- W4368304348 isRetracted "false" @default.
- W4368304348 workType "article" @default.