Matches in SemOpenAlex for { <https://semopenalex.org/work/W3044174989> ?p ?o ?g. }
Showing items 1 to 92 of
92
with 100 items per page.
- W3044174989 endingPage "96" @default.
- W3044174989 startingPage "85" @default.
- W3044174989 abstract "We examine the closedness of sets of realized neural networks of a fixed architecture in Sobolev spaces. For an exactly m-times differentiable activation function ρ, we construct a sequence of neural networks (Φn)n∈N whose realizations converge in order-(m−1) Sobolev norm to a function that cannot be realized exactly by a neural network. Thus, sets of realized neural networks are not closed in order-(m−1) Sobolev spaces Wm−1,p for p∈[1,∞). We further show that these sets are not closed in Wm,p under slightly stronger conditions on the mth derivative of ρ. For a real analytic activation function, we show that sets of realized neural networks are not closed in Wk,p for any k∈N. The nonclosedness allows for approximation of non-network target functions with unbounded parameter growth. We partially characterize the rate of parameter growth for most activation functions by showing that a specific sequence of realized neural networks can approximate the activation function’s derivative with weights increasing inversely proportional to the Lp approximation error. Finally, we present experimental results showing that networks are capable of closely approximating non-network target functions with increasing parameters via training." @default.
- W3044174989 created "2020-07-29" @default.
- W3044174989 creator A5001220270 @default.
- W3044174989 creator A5026256475 @default.
- W3044174989 creator A5070483965 @default.
- W3044174989 date "2021-05-01" @default.
- W3044174989 modified "2023-09-27" @default.
- W3044174989 title "Nonclosedness of sets of neural networks in Sobolev spaces" @default.
- W3044174989 cites W1988115241 @default.
- W3044174989 cites W2007700211 @default.
- W3044174989 cites W2019022049 @default.
- W3044174989 cites W2027197837 @default.
- W3044174989 cites W2038716941 @default.
- W3044174989 cites W2046982699 @default.
- W3044174989 cites W2103496339 @default.
- W3044174989 cites W2137983211 @default.
- W3044174989 cites W2168420370 @default.
- W3044174989 cites W3023494653 @default.
- W3044174989 doi "https://doi.org/10.1016/j.neunet.2021.01.007" @default.
- W3044174989 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/33571864" @default.
- W3044174989 hasPublicationYear "2021" @default.
- W3044174989 type Work @default.
- W3044174989 sameAs 3044174989 @default.
- W3044174989 citedByCount "1" @default.
- W3044174989 countsByYear W30441749892021 @default.
- W3044174989 crossrefType "journal-article" @default.
- W3044174989 hasAuthorship W3044174989A5001220270 @default.
- W3044174989 hasAuthorship W3044174989A5026256475 @default.
- W3044174989 hasAuthorship W3044174989A5070483965 @default.
- W3044174989 hasBestOaLocation W30441749892 @default.
- W3044174989 hasConcept C114614502 @default.
- W3044174989 hasConcept C118615104 @default.
- W3044174989 hasConcept C14036430 @default.
- W3044174989 hasConcept C154945302 @default.
- W3044174989 hasConcept C17744445 @default.
- W3044174989 hasConcept C184720557 @default.
- W3044174989 hasConcept C191795146 @default.
- W3044174989 hasConcept C199539241 @default.
- W3044174989 hasConcept C202444582 @default.
- W3044174989 hasConcept C202615002 @default.
- W3044174989 hasConcept C2778112365 @default.
- W3044174989 hasConcept C28826006 @default.
- W3044174989 hasConcept C33923547 @default.
- W3044174989 hasConcept C38365724 @default.
- W3044174989 hasConcept C41008148 @default.
- W3044174989 hasConcept C50644808 @default.
- W3044174989 hasConcept C54355233 @default.
- W3044174989 hasConcept C78458016 @default.
- W3044174989 hasConcept C86803240 @default.
- W3044174989 hasConcept C99730327 @default.
- W3044174989 hasConceptScore W3044174989C114614502 @default.
- W3044174989 hasConceptScore W3044174989C118615104 @default.
- W3044174989 hasConceptScore W3044174989C14036430 @default.
- W3044174989 hasConceptScore W3044174989C154945302 @default.
- W3044174989 hasConceptScore W3044174989C17744445 @default.
- W3044174989 hasConceptScore W3044174989C184720557 @default.
- W3044174989 hasConceptScore W3044174989C191795146 @default.
- W3044174989 hasConceptScore W3044174989C199539241 @default.
- W3044174989 hasConceptScore W3044174989C202444582 @default.
- W3044174989 hasConceptScore W3044174989C202615002 @default.
- W3044174989 hasConceptScore W3044174989C2778112365 @default.
- W3044174989 hasConceptScore W3044174989C28826006 @default.
- W3044174989 hasConceptScore W3044174989C33923547 @default.
- W3044174989 hasConceptScore W3044174989C38365724 @default.
- W3044174989 hasConceptScore W3044174989C41008148 @default.
- W3044174989 hasConceptScore W3044174989C50644808 @default.
- W3044174989 hasConceptScore W3044174989C54355233 @default.
- W3044174989 hasConceptScore W3044174989C78458016 @default.
- W3044174989 hasConceptScore W3044174989C86803240 @default.
- W3044174989 hasConceptScore W3044174989C99730327 @default.
- W3044174989 hasFunder F4320306076 @default.
- W3044174989 hasLocation W30441749891 @default.
- W3044174989 hasLocation W30441749892 @default.
- W3044174989 hasOpenAccess W3044174989 @default.
- W3044174989 hasPrimaryLocation W30441749891 @default.
- W3044174989 hasRelatedWork W1540184672 @default.
- W3044174989 hasRelatedWork W203326517 @default.
- W3044174989 hasRelatedWork W2087968352 @default.
- W3044174989 hasRelatedWork W2296253160 @default.
- W3044174989 hasRelatedWork W2962966565 @default.
- W3044174989 hasRelatedWork W3005627584 @default.
- W3044174989 hasRelatedWork W3044174989 @default.
- W3044174989 hasRelatedWork W3137729713 @default.
- W3044174989 hasRelatedWork W4295632793 @default.
- W3044174989 hasRelatedWork W4287869072 @default.
- W3044174989 hasVolume "137" @default.
- W3044174989 isParatext "false" @default.
- W3044174989 isRetracted "false" @default.
- W3044174989 magId "3044174989" @default.
- W3044174989 workType "article" @default.