Matches in SemOpenAlex for { <https://semopenalex.org/work/W3135602209> ?p ?o ?g. }
Showing items 1 to 92 of
92
with 100 items per page.
- W3135602209 abstract "In this paper, we construct neural networks with ReLU, sine and $2^x$ as activation functions. For general continuous $f$ defined on $[0,1]^d$ with continuity modulus $omega_f(cdot)$, we construct ReLU-sine-$2^x$ networks that enjoy an approximation rate $mathcal{O}(omega_f(sqrt{d})cdot2^{-M}+omega_{f}left(frac{sqrt{d}}{N}right))$, where $M,Nin mathbb{N}^{+}$ denote the hyperparameters related to widths of the networks. As a consequence, we can construct ReLU-sine-$2^x$ network with the depth $5$ and width $maxleft{leftlceil2d^{3/2}left(frac{3mu}{epsilon}right)^{1/{alpha}}rightrceil,2leftlceillog_2frac{3mu d^{alpha/2}}{2epsilon}rightrceil+2right}$ that approximates $fin mathcal{H}_{mu}^{alpha}([0,1]^d)$ within a given tolerance $epsilon >0$ measured in $L^p$ norm $pin[1,infty)$, where $mathcal{H}_{mu}^{alpha}([0,1]^d)$ denotes the Holder continuous function class defined on $[0,1]^d$ with order $alpha in (0,1]$ and constant $mu > 0$. Therefore, the ReLU-sine-$2^x$ networks overcome the curse of dimensionality on $mathcal{H}_{mu}^{alpha}([0,1]^d)$. In addition to its supper expressive power, functions implemented by ReLU-sine-$2^x$ networks are (generalized) differentiable, enabling us to apply SGD to train." @default.
- W3135602209 created "2021-03-15" @default.
- W3135602209 creator A5055337142 @default.
- W3135602209 creator A5057896052 @default.
- W3135602209 creator A5079641998 @default.
- W3135602209 creator A5080185313 @default.
- W3135602209 date "2021-02-28" @default.
- W3135602209 modified "2023-09-23" @default.
- W3135602209 title "Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality on Hölder Class." @default.
- W3135602209 cites W1551360398 @default.
- W3135602209 cites W1988115241 @default.
- W3135602209 cites W2163605009 @default.
- W3135602209 cites W2163922914 @default.
- W3135602209 cites W2166116275 @default.
- W3135602209 cites W2528305538 @default.
- W3135602209 cites W2550848904 @default.
- W3135602209 cites W2886881190 @default.
- W3135602209 cites W2920266844 @default.
- W3135602209 cites W2951548721 @default.
- W3135602209 cites W2952226704 @default.
- W3135602209 cites W2956024278 @default.
- W3135602209 cites W2963097630 @default.
- W3135602209 cites W2963146412 @default.
- W3135602209 cites W2963172624 @default.
- W3135602209 cites W2963860565 @default.
- W3135602209 cites W2965449430 @default.
- W3135602209 cites W2969750612 @default.
- W3135602209 cites W2970755399 @default.
- W3135602209 cites W3000236721 @default.
- W3135602209 cites W3011972577 @default.
- W3135602209 cites W3027734040 @default.
- W3135602209 cites W3031010353 @default.
- W3135602209 cites W3102511045 @default.
- W3135602209 cites W3146803896 @default.
- W3135602209 cites W3161792008 @default.
- W3135602209 hasPublicationYear "2021" @default.
- W3135602209 type Work @default.
- W3135602209 sameAs 3135602209 @default.
- W3135602209 citedByCount "1" @default.
- W3135602209 countsByYear W31356022092021 @default.
- W3135602209 crossrefType "posted-content" @default.
- W3135602209 hasAuthorship W3135602209A5055337142 @default.
- W3135602209 hasAuthorship W3135602209A5057896052 @default.
- W3135602209 hasAuthorship W3135602209A5079641998 @default.
- W3135602209 hasAuthorship W3135602209A5080185313 @default.
- W3135602209 hasConcept C10138342 @default.
- W3135602209 hasConcept C114614502 @default.
- W3135602209 hasConcept C121332964 @default.
- W3135602209 hasConcept C134306372 @default.
- W3135602209 hasConcept C162324750 @default.
- W3135602209 hasConcept C182306322 @default.
- W3135602209 hasConcept C202615002 @default.
- W3135602209 hasConcept C2779557605 @default.
- W3135602209 hasConcept C33923547 @default.
- W3135602209 hasConcept C62520636 @default.
- W3135602209 hasConceptScore W3135602209C10138342 @default.
- W3135602209 hasConceptScore W3135602209C114614502 @default.
- W3135602209 hasConceptScore W3135602209C121332964 @default.
- W3135602209 hasConceptScore W3135602209C134306372 @default.
- W3135602209 hasConceptScore W3135602209C162324750 @default.
- W3135602209 hasConceptScore W3135602209C182306322 @default.
- W3135602209 hasConceptScore W3135602209C202615002 @default.
- W3135602209 hasConceptScore W3135602209C2779557605 @default.
- W3135602209 hasConceptScore W3135602209C33923547 @default.
- W3135602209 hasConceptScore W3135602209C62520636 @default.
- W3135602209 hasLocation W31356022091 @default.
- W3135602209 hasOpenAccess W3135602209 @default.
- W3135602209 hasPrimaryLocation W31356022091 @default.
- W3135602209 hasRelatedWork W199224989 @default.
- W3135602209 hasRelatedWork W1999902962 @default.
- W3135602209 hasRelatedWork W2042810926 @default.
- W3135602209 hasRelatedWork W2146705001 @default.
- W3135602209 hasRelatedWork W2230189894 @default.
- W3135602209 hasRelatedWork W2404834535 @default.
- W3135602209 hasRelatedWork W2571652280 @default.
- W3135602209 hasRelatedWork W2734184327 @default.
- W3135602209 hasRelatedWork W27417116 @default.
- W3135602209 hasRelatedWork W2765742625 @default.
- W3135602209 hasRelatedWork W2903915923 @default.
- W3135602209 hasRelatedWork W2950096700 @default.
- W3135602209 hasRelatedWork W2971439452 @default.
- W3135602209 hasRelatedWork W3048707547 @default.
- W3135602209 hasRelatedWork W3100328676 @default.
- W3135602209 hasRelatedWork W3101996726 @default.
- W3135602209 hasRelatedWork W3138841605 @default.
- W3135602209 hasRelatedWork W3161828098 @default.
- W3135602209 hasRelatedWork W2615514038 @default.
- W3135602209 hasRelatedWork W2666829939 @default.
- W3135602209 isParatext "false" @default.
- W3135602209 isRetracted "false" @default.
- W3135602209 magId "3135602209" @default.
- W3135602209 workType "article" @default.