Matches in SemOpenAlex for { <https://semopenalex.org/work/W4281551294> ?p ?o ?g. }
Showing items 1 to 76 of
76
with 100 items per page.
- W4281551294 abstract "We deal with two complementary questions about approximation properties of ReLU networks. First, we study how the uniform quantization of ReLU networks with real-valued weights impacts their approximation properties. We establish an upper-bound on the minimal number of bits per coordinate needed for uniformly quantized ReLU networks to keep the same polynomial asymptotic approximation speeds as unquantized ones. We also characterize the error of nearest-neighbour uniform quantization of ReLU networks. This is achieved using a new lower-bound on the Lipschitz constant of the map that associates the parameters of ReLU networks to their realization, and an upper-bound generalizing classical results. Second, we investigate when ReLU networks can be expected, or not, to have better approximation properties than other classical approximation families. Indeed, several approximation families share the following common limitation: their polynomial asymptotic approximation speed of any set is bounded from above by the encoding speed of this set. We introduce a new abstract property of approximation families, called infinite-encodability, which implies this upper-bound. Many classical approximation families, defined with dictionaries or ReLU networks, are shown to be infinite-encodable. This unifies and generalizes several situations where this upper-bound is known." @default.
- W4281551294 created "2022-05-27" @default.
- W4281551294 creator A5024033213 @default.
- W4281551294 creator A5024258728 @default.
- W4281551294 creator A5041230403 @default.
- W4281551294 creator A5058275399 @default.
- W4281551294 date "2022-05-24" @default.
- W4281551294 modified "2023-09-24" @default.
- W4281551294 title "Approximation speed of quantized vs. unquantized ReLU neural networks and beyond" @default.
- W4281551294 doi "https://doi.org/10.48550/arxiv.2205.11874" @default.
- W4281551294 hasPublicationYear "2022" @default.
- W4281551294 type Work @default.
- W4281551294 citedByCount "0" @default.
- W4281551294 crossrefType "posted-content" @default.
- W4281551294 hasAuthorship W4281551294A5024033213 @default.
- W4281551294 hasAuthorship W4281551294A5024258728 @default.
- W4281551294 hasAuthorship W4281551294A5041230403 @default.
- W4281551294 hasAuthorship W4281551294A5058275399 @default.
- W4281551294 hasBestOaLocation W42815512941 @default.
- W4281551294 hasConcept C111919701 @default.
- W4281551294 hasConcept C11413529 @default.
- W4281551294 hasConcept C114614502 @default.
- W4281551294 hasConcept C117148685 @default.
- W4281551294 hasConcept C118615104 @default.
- W4281551294 hasConcept C122383733 @default.
- W4281551294 hasConcept C134306372 @default.
- W4281551294 hasConcept C145242015 @default.
- W4281551294 hasConcept C148764684 @default.
- W4281551294 hasConcept C154945302 @default.
- W4281551294 hasConcept C202444582 @default.
- W4281551294 hasConcept C22324862 @default.
- W4281551294 hasConcept C2777894999 @default.
- W4281551294 hasConcept C28826006 @default.
- W4281551294 hasConcept C28855332 @default.
- W4281551294 hasConcept C33923547 @default.
- W4281551294 hasConcept C34388435 @default.
- W4281551294 hasConcept C41008148 @default.
- W4281551294 hasConcept C50644808 @default.
- W4281551294 hasConcept C77553402 @default.
- W4281551294 hasConceptScore W4281551294C111919701 @default.
- W4281551294 hasConceptScore W4281551294C11413529 @default.
- W4281551294 hasConceptScore W4281551294C114614502 @default.
- W4281551294 hasConceptScore W4281551294C117148685 @default.
- W4281551294 hasConceptScore W4281551294C118615104 @default.
- W4281551294 hasConceptScore W4281551294C122383733 @default.
- W4281551294 hasConceptScore W4281551294C134306372 @default.
- W4281551294 hasConceptScore W4281551294C145242015 @default.
- W4281551294 hasConceptScore W4281551294C148764684 @default.
- W4281551294 hasConceptScore W4281551294C154945302 @default.
- W4281551294 hasConceptScore W4281551294C202444582 @default.
- W4281551294 hasConceptScore W4281551294C22324862 @default.
- W4281551294 hasConceptScore W4281551294C2777894999 @default.
- W4281551294 hasConceptScore W4281551294C28826006 @default.
- W4281551294 hasConceptScore W4281551294C28855332 @default.
- W4281551294 hasConceptScore W4281551294C33923547 @default.
- W4281551294 hasConceptScore W4281551294C34388435 @default.
- W4281551294 hasConceptScore W4281551294C41008148 @default.
- W4281551294 hasConceptScore W4281551294C50644808 @default.
- W4281551294 hasConceptScore W4281551294C77553402 @default.
- W4281551294 hasLocation W42815512941 @default.
- W4281551294 hasLocation W42815512942 @default.
- W4281551294 hasOpenAccess W4281551294 @default.
- W4281551294 hasPrimaryLocation W42815512941 @default.
- W4281551294 hasRelatedWork W158010619 @default.
- W4281551294 hasRelatedWork W189995875 @default.
- W4281551294 hasRelatedWork W2047048571 @default.
- W4281551294 hasRelatedWork W2462799664 @default.
- W4281551294 hasRelatedWork W2595727203 @default.
- W4281551294 hasRelatedWork W2737349826 @default.
- W4281551294 hasRelatedWork W4281393111 @default.
- W4281551294 hasRelatedWork W4281551294 @default.
- W4281551294 hasRelatedWork W4308701628 @default.
- W4281551294 hasRelatedWork W2596940265 @default.
- W4281551294 isParatext "false" @default.
- W4281551294 isRetracted "false" @default.
- W4281551294 workType "article" @default.