FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3158447071> ?p ?o ?g. }

• W3158447071 abstract "In nature, symmetry governs regularities, while symmetry breaking brings texture. Here, we reveal a novel role of symmetry breaking behind efficiency and stability in learning, a critical issue in machine learning. Recent experiments suggest that the symmetry of the loss function is closely related to the learning performance. This raises a fundamental question. Is such symmetry beneficial, harmful, or irrelevant to the success of learning? Here, we demystify this question and pose symmetry breaking as a new design principle by considering the symmetry of the learning rule in addition to the loss function. We model the discrete learning dynamics using a continuous-time Lagrangian formulation, in which the learning rule corresponds to the kinetic energy and the loss function corresponds to the potential energy. We identify kinetic asymmetry unique to learning systems, where the kinetic energy often does not have the same symmetry as the potential (loss) function reflecting the non-physical symmetries of the loss function and the non-Euclidean metric used in learning rules. We generalize Noether's theorem known in physics to explicitly take into account this kinetic asymmetry and derive the resulting motion of the Noether charge. Finally, we apply our theory to modern deep networks with normalization layers and reveal a mechanism of implicit adaptive optimization induced by the kinetic symmetry breaking." @default.
• W3158447071 created "2021-05-10" @default.
• W3158447071 creator A5022089276 @default.
• W3158447071 creator A5037955577 @default.
• W3158447071 date "2021-05-06" @default.
• W3158447071 modified "2023-09-27" @default.
• W3158447071 title "Noether's Learning Dynamics: The Role of Kinetic Symmetry Breaking in Deep Learning." @default.
• W3158447071 cites W104184427 @default.
• W3158447071 cites W2014041755 @default.
• W3158447071 cites W2170319235 @default.
• W3158447071 cites W2259558022 @default.
• W3158447071 cites W2284050935 @default.
• W3158447071 cites W2789621689 @default.
• W3158447071 cites W2807448149 @default.
• W3158447071 cites W2898564876 @default.
• W3158447071 cites W2904614653 @default.
• W3158447071 cites W2949117887 @default.
• W3158447071 cites W2949650786 @default.
• W3158447071 cites W2951248065 @default.
• W3158447071 cites W2952054889 @default.
• W3158447071 cites W2963430672 @default.
• W3158447071 cites W2970756352 @default.
• W3158447071 cites W2979240068 @default.
• W3158447071 cites W3104527631 @default.
• W3158447071 cites W3129088206 @default.
• W3158447071 cites W3157286395 @default.
• W3158447071 cites W577198184 @default.
• W3158447071 cites W3034877463 @default.
• W3158447071 cites W3111160927 @default.
• W3158447071 hasPublicationYear "2021" @default.
• W3158447071 type Work @default.
• W3158447071 sameAs 3158447071 @default.
• W3158447071 citedByCount "2" @default.
• W3158447071 countsByYear W31584470712021 @default.
• W3158447071 crossrefType "posted-content" @default.
• W3158447071 hasAuthorship W3158447071A5022089276 @default.
• W3158447071 hasAuthorship W3158447071A5037955577 @default.
• W3158447071 hasConcept C121332964 @default.
• W3158447071 hasConcept C121864883 @default.
• W3158447071 hasConcept C125881977 @default.
• W3158447071 hasConcept C135889238 @default.
• W3158447071 hasConcept C14036430 @default.
• W3158447071 hasConcept C154945302 @default.
• W3158447071 hasConcept C192423722 @default.
• W3158447071 hasConcept C204795200 @default.
• W3158447071 hasConcept C2524010 @default.
• W3158447071 hasConcept C2779886137 @default.
• W3158447071 hasConcept C33332235 @default.
• W3158447071 hasConcept C33923547 @default.
• W3158447071 hasConcept C38976095 @default.
• W3158447071 hasConcept C41008148 @default.
• W3158447071 hasConcept C53469067 @default.
• W3158447071 hasConcept C62520636 @default.
• W3158447071 hasConcept C74650414 @default.
• W3158447071 hasConcept C78458016 @default.
• W3158447071 hasConcept C80892491 @default.
• W3158447071 hasConcept C86803240 @default.
• W3158447071 hasConceptScore W3158447071C121332964 @default.
• W3158447071 hasConceptScore W3158447071C121864883 @default.
• W3158447071 hasConceptScore W3158447071C125881977 @default.
• W3158447071 hasConceptScore W3158447071C135889238 @default.
• W3158447071 hasConceptScore W3158447071C14036430 @default.
• W3158447071 hasConceptScore W3158447071C154945302 @default.
• W3158447071 hasConceptScore W3158447071C192423722 @default.
• W3158447071 hasConceptScore W3158447071C204795200 @default.
• W3158447071 hasConceptScore W3158447071C2524010 @default.
• W3158447071 hasConceptScore W3158447071C2779886137 @default.
• W3158447071 hasConceptScore W3158447071C33332235 @default.
• W3158447071 hasConceptScore W3158447071C33923547 @default.
• W3158447071 hasConceptScore W3158447071C38976095 @default.
• W3158447071 hasConceptScore W3158447071C41008148 @default.
• W3158447071 hasConceptScore W3158447071C53469067 @default.
• W3158447071 hasConceptScore W3158447071C62520636 @default.
• W3158447071 hasConceptScore W3158447071C74650414 @default.
• W3158447071 hasConceptScore W3158447071C78458016 @default.
• W3158447071 hasConceptScore W3158447071C80892491 @default.
• W3158447071 hasConceptScore W3158447071C86803240 @default.
• W3158447071 hasLocation W31584470711 @default.
• W3158447071 hasOpenAccess W3158447071 @default.
• W3158447071 hasPrimaryLocation W31584470711 @default.
• W3158447071 hasRelatedWork W1620973175 @default.
• W3158447071 hasRelatedWork W1789761972 @default.
• W3158447071 hasRelatedWork W1970546606 @default.
• W3158447071 hasRelatedWork W1980869005 @default.
• W3158447071 hasRelatedWork W2040343595 @default.
• W3158447071 hasRelatedWork W2055509736 @default.
• W3158447071 hasRelatedWork W2166817374 @default.
• W3158447071 hasRelatedWork W2309043913 @default.
• W3158447071 hasRelatedWork W23649216 @default.
• W3158447071 hasRelatedWork W2492974741 @default.
• W3158447071 hasRelatedWork W2524341501 @default.
• W3158447071 hasRelatedWork W2619864600 @default.
• W3158447071 hasRelatedWork W2898700972 @default.
• W3158447071 hasRelatedWork W2951098861 @default.
• W3158447071 hasRelatedWork W2983464841 @default.
• W3158447071 hasRelatedWork W2992985045 @default.
• W3158447071 hasRelatedWork W3098714916 @default.
• W3158447071 hasRelatedWork W3210751205 @default.
• W3158447071 hasRelatedWork W35234432 @default.
• W3158447071 hasRelatedWork W63405946 @default.

• next