Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287665726> ?p ?o ?g. }
Showing items 1 to 52 of
52
with 100 items per page.
- W4287665726 abstract "Neural networks have been achieving high generalization performance on many tasks despite being highly over-parameterized. Since classical statistical learning theory struggles to explain this behavior, much effort has recently been focused on uncovering the mechanisms behind it, in the hope of developing a more adequate theoretical framework and having a better control over the trained models. In this work, we adopt an alternate perspective, viewing the neural network as a dynamical system displacing input particles over time. We conduct a series of experiments and, by analyzing the network's behavior through its displacements, we show the presence of a low kinetic energy displacement bias in the transport map of the network, and link this bias with generalization performance. From this observation, we reformulate the learning problem as follows: finding neural networks which solve the task while transporting the data as efficiently as possible. This offers a novel formulation of the learning problem which allows us to provide regularity results for the solution network, based on Optimal Transport theory. From a practical viewpoint, this allows us to propose a new learning algorithm, which automatically adapts to the complexity of the given task, and leads to networks with a high generalization ability even in low data regimes." @default.
- W4287665726 created "2022-07-25" @default.
- W4287665726 creator A5046212252 @default.
- W4287665726 creator A5059248291 @default.
- W4287665726 creator A5063143302 @default.
- W4287665726 creator A5086752907 @default.
- W4287665726 date "2020-09-14" @default.
- W4287665726 modified "2023-10-12" @default.
- W4287665726 title "A Principle of Least Action for the Training of Neural Networks" @default.
- W4287665726 hasPublicationYear "2020" @default.
- W4287665726 type Work @default.
- W4287665726 citedByCount "0" @default.
- W4287665726 crossrefType "proceedings-article" @default.
- W4287665726 hasAuthorship W4287665726A5046212252 @default.
- W4287665726 hasAuthorship W4287665726A5059248291 @default.
- W4287665726 hasAuthorship W4287665726A5063143302 @default.
- W4287665726 hasAuthorship W4287665726A5086752907 @default.
- W4287665726 hasBestOaLocation W42876657261 @default.
- W4287665726 hasConcept C121332964 @default.
- W4287665726 hasConcept C153294291 @default.
- W4287665726 hasConcept C154945302 @default.
- W4287665726 hasConcept C2777211547 @default.
- W4287665726 hasConcept C2780791683 @default.
- W4287665726 hasConcept C41008148 @default.
- W4287665726 hasConcept C50644808 @default.
- W4287665726 hasConcept C62520636 @default.
- W4287665726 hasConceptScore W4287665726C121332964 @default.
- W4287665726 hasConceptScore W4287665726C153294291 @default.
- W4287665726 hasConceptScore W4287665726C154945302 @default.
- W4287665726 hasConceptScore W4287665726C2777211547 @default.
- W4287665726 hasConceptScore W4287665726C2780791683 @default.
- W4287665726 hasConceptScore W4287665726C41008148 @default.
- W4287665726 hasConceptScore W4287665726C50644808 @default.
- W4287665726 hasConceptScore W4287665726C62520636 @default.
- W4287665726 hasLocation W42876657261 @default.
- W4287665726 hasLocation W42876657262 @default.
- W4287665726 hasLocation W42876657263 @default.
- W4287665726 hasOpenAccess W4287665726 @default.
- W4287665726 hasPrimaryLocation W42876657261 @default.
- W4287665726 hasRelatedWork W230091440 @default.
- W4287665726 hasRelatedWork W2358668433 @default.
- W4287665726 hasRelatedWork W2376932109 @default.
- W4287665726 hasRelatedWork W2390279801 @default.
- W4287665726 hasRelatedWork W258997015 @default.
- W4287665726 hasRelatedWork W2748952813 @default.
- W4287665726 hasRelatedWork W2810751659 @default.
- W4287665726 hasRelatedWork W2899084033 @default.
- W4287665726 hasRelatedWork W2997094352 @default.
- W4287665726 hasRelatedWork W2233261550 @default.
- W4287665726 isParatext "false" @default.
- W4287665726 isRetracted "false" @default.
- W4287665726 workType "article" @default.