Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320086284> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4320086284 abstract "An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key factor to their superior empirical performance. To better understand the source and benefit of feature learning in neural networks, we consider learning problems motivated by practical data, where the labels are determined by a set of class relevant patterns and the inputs are generated from these along with some background patterns. We prove that neural networks trained by gradient descent can succeed on these problems. The success relies on the emergence and improvement of effective features, which are learned among exponentially many candidates efficiently by exploiting the data (in particular, the structure of the input distribution). In contrast, no linear models on data-independent features of polynomial sizes can learn to as good errors. Furthermore, if the specific input structure is removed, then no polynomial algorithm in the Statistical Query model can learn even weakly. These results provide theoretical evidence showing that feature learning in neural networks depends strongly on the input structure and leads to the superior performance. Our preliminary experimental results on synthetic and real data also provide positive support." @default.
- W4320086284 created "2023-02-12" @default.
- W4320086284 creator A5008658012 @default.
- W4320086284 creator A5035905957 @default.
- W4320086284 creator A5069272192 @default.
- W4320086284 date "2022-06-03" @default.
- W4320086284 modified "2023-09-29" @default.
- W4320086284 title "A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features" @default.
- W4320086284 doi "https://doi.org/10.48550/arxiv.2206.01717" @default.
- W4320086284 hasPublicationYear "2022" @default.
- W4320086284 type Work @default.
- W4320086284 citedByCount "0" @default.
- W4320086284 crossrefType "posted-content" @default.
- W4320086284 hasAuthorship W4320086284A5008658012 @default.
- W4320086284 hasAuthorship W4320086284A5035905957 @default.
- W4320086284 hasAuthorship W4320086284A5069272192 @default.
- W4320086284 hasBestOaLocation W43200862841 @default.
- W4320086284 hasConcept C119857082 @default.
- W4320086284 hasConcept C134306372 @default.
- W4320086284 hasConcept C138885662 @default.
- W4320086284 hasConcept C153258448 @default.
- W4320086284 hasConcept C154945302 @default.
- W4320086284 hasConcept C177264268 @default.
- W4320086284 hasConcept C199360897 @default.
- W4320086284 hasConcept C26517878 @default.
- W4320086284 hasConcept C2776401178 @default.
- W4320086284 hasConcept C2776502983 @default.
- W4320086284 hasConcept C33923547 @default.
- W4320086284 hasConcept C38652104 @default.
- W4320086284 hasConcept C41008148 @default.
- W4320086284 hasConcept C41895202 @default.
- W4320086284 hasConcept C50644808 @default.
- W4320086284 hasConcept C90119067 @default.
- W4320086284 hasConceptScore W4320086284C119857082 @default.
- W4320086284 hasConceptScore W4320086284C134306372 @default.
- W4320086284 hasConceptScore W4320086284C138885662 @default.
- W4320086284 hasConceptScore W4320086284C153258448 @default.
- W4320086284 hasConceptScore W4320086284C154945302 @default.
- W4320086284 hasConceptScore W4320086284C177264268 @default.
- W4320086284 hasConceptScore W4320086284C199360897 @default.
- W4320086284 hasConceptScore W4320086284C26517878 @default.
- W4320086284 hasConceptScore W4320086284C2776401178 @default.
- W4320086284 hasConceptScore W4320086284C2776502983 @default.
- W4320086284 hasConceptScore W4320086284C33923547 @default.
- W4320086284 hasConceptScore W4320086284C38652104 @default.
- W4320086284 hasConceptScore W4320086284C41008148 @default.
- W4320086284 hasConceptScore W4320086284C41895202 @default.
- W4320086284 hasConceptScore W4320086284C50644808 @default.
- W4320086284 hasConceptScore W4320086284C90119067 @default.
- W4320086284 hasLocation W43200862841 @default.
- W4320086284 hasOpenAccess W4320086284 @default.
- W4320086284 hasPrimaryLocation W43200862841 @default.
- W4320086284 hasRelatedWork W2329452785 @default.
- W4320086284 hasRelatedWork W2356380379 @default.
- W4320086284 hasRelatedWork W2961085424 @default.
- W4320086284 hasRelatedWork W3161588687 @default.
- W4320086284 hasRelatedWork W4286629047 @default.
- W4320086284 hasRelatedWork W4306321456 @default.
- W4320086284 hasRelatedWork W4306674287 @default.
- W4320086284 hasRelatedWork W4312812430 @default.
- W4320086284 hasRelatedWork W1629725936 @default.
- W4320086284 hasRelatedWork W4224009465 @default.
- W4320086284 isParatext "false" @default.
- W4320086284 isRetracted "false" @default.
- W4320086284 workType "article" @default.