Matches in SemOpenAlex for { <https://semopenalex.org/work/W3022969236> ?p ?o ?g. }
- W3022969236 endingPage "191" @default.
- W3022969236 startingPage "159" @default.
- W3022969236 abstract "Deep neural network with rectified linear units (ReLU) is getting more and more popular recently. However, the derivatives of the function represented by a ReLU network are not continuous, which limit the usage of ReLU network to situations only when smoothness is not required. In this paper, we construct deep neural networks with rectified power units (RePU), which can give better approximations for smooth functions. Optimal algorithms are proposed to explicitly build neural networks with sparsely connected RePUs, which we call PowerNets, to represent polynomials with no approximation error. For general smooth functions, we first project the function to their polynomial approximations, then use the proposed algorithms to construct corresponding PowerNets. Thus, the error of best polynomial approximation provides an upper bound of the best RePU network approximation error. For smooth functions in higher dimensional Sobolev spaces, we use fast spectral transforms for tensor-product grid and sparse grid discretization to get polynomial approximations. Our constructive algorithms show clearly a close connection between spectral methods and deep neural networks: a PowerNet with $n$ layers can exactly represent polynomials up to degree $s^n$, where $s$ is the power of RePUs. The proposed PowerNets have potential applications in the situations where high-accuracy is desired or smoothness is required." @default.
- W3022969236 created "2020-05-13" @default.
- W3022969236 creator A5034995105 @default.
- W3022969236 creator A5039195646 @default.
- W3022969236 creator A5080825351 @default.
- W3022969236 date "2020-06-01" @default.
- W3022969236 modified "2023-09-24" @default.
- W3022969236 title "PowerNet: Efficient Representations of Polynomials and Smooth Functions by Deep Neural Networks with Rectified Power Units" @default.
- W3022969236 cites W1971735090 @default.
- W3022969236 cites W1990261069 @default.
- W3022969236 cites W2001371760 @default.
- W3022969236 cites W2006240266 @default.
- W3022969236 cites W2011138697 @default.
- W3022969236 cites W2021676252 @default.
- W3022969236 cites W2038068268 @default.
- W3022969236 cites W2051968241 @default.
- W3022969236 cites W2079224763 @default.
- W3022969236 cites W2087993295 @default.
- W3022969236 cites W2091280316 @default.
- W3022969236 cites W2094199988 @default.
- W3022969236 cites W2103496339 @default.
- W3022969236 cites W2136922672 @default.
- W3022969236 cites W2142863015 @default.
- W3022969236 cites W2165083863 @default.
- W3022969236 cites W2171629345 @default.
- W3022969236 cites W2184045248 @default.
- W3022969236 cites W2334971176 @default.
- W3022969236 cites W2528305538 @default.
- W3022969236 cites W2555745781 @default.
- W3022969236 cites W2618530766 @default.
- W3022969236 cites W2742127985 @default.
- W3022969236 cites W2760972773 @default.
- W3022969236 cites W2803629276 @default.
- W3022969236 cites W2919115771 @default.
- W3022969236 cites W2963146412 @default.
- W3022969236 cites W2963172624 @default.
- W3022969236 cites W2990653417 @default.
- W3022969236 cites W3103005288 @default.
- W3022969236 cites W3146803896 @default.
- W3022969236 cites W640428934 @default.
- W3022969236 doi "https://doi.org/10.4208/jms.v53n2.20.03" @default.
- W3022969236 hasPublicationYear "2020" @default.
- W3022969236 type Work @default.
- W3022969236 sameAs 3022969236 @default.
- W3022969236 citedByCount "4" @default.
- W3022969236 countsByYear W30229692362020 @default.
- W3022969236 countsByYear W30229692362023 @default.
- W3022969236 crossrefType "journal-article" @default.
- W3022969236 hasAuthorship W3022969236A5034995105 @default.
- W3022969236 hasAuthorship W3022969236A5039195646 @default.
- W3022969236 hasAuthorship W3022969236A5080825351 @default.
- W3022969236 hasBestOaLocation W30229692361 @default.
- W3022969236 hasConcept C102634674 @default.
- W3022969236 hasConcept C11413529 @default.
- W3022969236 hasConcept C122383733 @default.
- W3022969236 hasConcept C134306372 @default.
- W3022969236 hasConcept C14036430 @default.
- W3022969236 hasConcept C154945302 @default.
- W3022969236 hasConcept C202444582 @default.
- W3022969236 hasConcept C33923547 @default.
- W3022969236 hasConcept C41008148 @default.
- W3022969236 hasConcept C50644808 @default.
- W3022969236 hasConcept C73000952 @default.
- W3022969236 hasConcept C78458016 @default.
- W3022969236 hasConcept C86803240 @default.
- W3022969236 hasConcept C90119067 @default.
- W3022969236 hasConcept C91873725 @default.
- W3022969236 hasConcept C99730327 @default.
- W3022969236 hasConceptScore W3022969236C102634674 @default.
- W3022969236 hasConceptScore W3022969236C11413529 @default.
- W3022969236 hasConceptScore W3022969236C122383733 @default.
- W3022969236 hasConceptScore W3022969236C134306372 @default.
- W3022969236 hasConceptScore W3022969236C14036430 @default.
- W3022969236 hasConceptScore W3022969236C154945302 @default.
- W3022969236 hasConceptScore W3022969236C202444582 @default.
- W3022969236 hasConceptScore W3022969236C33923547 @default.
- W3022969236 hasConceptScore W3022969236C41008148 @default.
- W3022969236 hasConceptScore W3022969236C50644808 @default.
- W3022969236 hasConceptScore W3022969236C73000952 @default.
- W3022969236 hasConceptScore W3022969236C78458016 @default.
- W3022969236 hasConceptScore W3022969236C86803240 @default.
- W3022969236 hasConceptScore W3022969236C90119067 @default.
- W3022969236 hasConceptScore W3022969236C91873725 @default.
- W3022969236 hasConceptScore W3022969236C99730327 @default.
- W3022969236 hasIssue "2" @default.
- W3022969236 hasLocation W30229692361 @default.
- W3022969236 hasLocation W30229692362 @default.
- W3022969236 hasOpenAccess W3022969236 @default.
- W3022969236 hasPrimaryLocation W30229692361 @default.
- W3022969236 hasRelatedWork W2025296150 @default.
- W3022969236 hasRelatedWork W2050184610 @default.
- W3022969236 hasRelatedWork W2355070670 @default.
- W3022969236 hasRelatedWork W2910901527 @default.
- W3022969236 hasRelatedWork W3022969236 @default.
- W3022969236 hasRelatedWork W3152523416 @default.
- W3022969236 hasRelatedWork W3183349676 @default.
- W3022969236 hasRelatedWork W3185256248 @default.
- W3022969236 hasRelatedWork W3194468165 @default.