Matches in SemOpenAlex for { <https://semopenalex.org/work/W2789121304> ?p ?o ?g. }
- W2789121304 abstract "We consider the problem of representing Boolean functions exactly by linear combinations (over $mathbb{R}$) of functions from some simple class ${cal C}$. In particular, given ${cal C}$ we are interested in finding low-complexity functions lacking sparse representations. When ${cal C}$ is the set of PARITY functions or the set of conjunctions, this sort of problem has a well-understood answer, the problem becomes interesting when ${cal C}$ is overcomplete and the set of functions is not linearly independent. We focus on the cases where ${cal C}$ is the set of linear threshold functions, the set of rectified linear units (ReLUs), and the set of low-degree polynomials over a finite field, all of which are well-studied in different contexts. We provide generic tools for proving lower bounds on representations of this kind. Applying these, we give several new lower bounds for semi-explicit Boolean functions. For example, we show there are functions in nondeterministic quasi-polynomial time that require super-polynomial size: $bullet$ Depth-two neural networks with sign activation function, a special case of depth-two threshold circuit lower bounds. $bullet$ Depth-two neural networks with ReLU activation function. $bullet$ $mathbb{R}$-linear combinations of $O(1)$-degree $mathbb{F}_p$-polynomials, for every prime $p$ (related to problems regarding Higher-Order Uncertainty Principles). We also obtain a function in $E^{NP}$ requiring $2^{Omega(n)}$ linear combinations. $bullet$ $mathbb{R}$-linear combinations of $ACC circ THR$ circuits of polynomial size (further generalizing the recent lower bounds of Murray and the author). (The above is a shortened abstract. For the full abstract, see the paper.)" @default.
- W2789121304 created "2018-03-06" @default.
- W2789121304 creator A5063871533 @default.
- W2789121304 date "2018-02-26" @default.
- W2789121304 modified "2023-09-25" @default.
- W2789121304 title "Limits on representing Boolean functions by linear combinations of simple functions: thresholds, ReLUs, and low-degree polynomials" @default.
- W2789121304 cites W1500453128 @default.
- W2789121304 cites W1570657399 @default.
- W2789121304 cites W184142732 @default.
- W2789121304 cites W1982026196 @default.
- W2789121304 cites W1989076199 @default.
- W2789121304 cites W1996834809 @default.
- W2789121304 cites W2004130530 @default.
- W2789121304 cites W2031437056 @default.
- W2789121304 cites W2045492613 @default.
- W2789121304 cites W2059892717 @default.
- W2789121304 cites W2061055380 @default.
- W2789121304 cites W2066915075 @default.
- W2789121304 cites W2083820240 @default.
- W2789121304 cites W2091641588 @default.
- W2789121304 cites W2107998050 @default.
- W2789121304 cites W2137407595 @default.
- W2789121304 cites W2146466938 @default.
- W2789121304 cites W2175125908 @default.
- W2789121304 cites W2263246245 @default.
- W2789121304 cites W2295866677 @default.
- W2789121304 cites W2555745781 @default.
- W2789121304 cites W2574342001 @default.
- W2789121304 cites W2595713799 @default.
- W2789121304 cites W2782707694 @default.
- W2789121304 cites W2912133662 @default.
- W2789121304 cites W2949604493 @default.
- W2789121304 cites W2952600837 @default.
- W2789121304 cites W2962696346 @default.
- W2789121304 cites W2962742960 @default.
- W2789121304 cites W2964142086 @default.
- W2789121304 cites W3037975911 @default.
- W2789121304 cites W86440672 @default.
- W2789121304 cites W215161086 @default.
- W2789121304 hasPublicationYear "2018" @default.
- W2789121304 type Work @default.
- W2789121304 sameAs 2789121304 @default.
- W2789121304 citedByCount "2" @default.
- W2789121304 countsByYear W27891213042018 @default.
- W2789121304 countsByYear W27891213042021 @default.
- W2789121304 crossrefType "posted-content" @default.
- W2789121304 hasAuthorship W2789121304A5063871533 @default.
- W2789121304 hasConcept C111472728 @default.
- W2789121304 hasConcept C114614502 @default.
- W2789121304 hasConcept C118615104 @default.
- W2789121304 hasConcept C121332964 @default.
- W2789121304 hasConcept C134306372 @default.
- W2789121304 hasConcept C138885662 @default.
- W2789121304 hasConcept C14036430 @default.
- W2789121304 hasConcept C176181172 @default.
- W2789121304 hasConcept C187455244 @default.
- W2789121304 hasConcept C24890656 @default.
- W2789121304 hasConcept C2775997480 @default.
- W2789121304 hasConcept C2780586882 @default.
- W2789121304 hasConcept C33923547 @default.
- W2789121304 hasConcept C78458016 @default.
- W2789121304 hasConcept C86803240 @default.
- W2789121304 hasConcept C90119067 @default.
- W2789121304 hasConceptScore W2789121304C111472728 @default.
- W2789121304 hasConceptScore W2789121304C114614502 @default.
- W2789121304 hasConceptScore W2789121304C118615104 @default.
- W2789121304 hasConceptScore W2789121304C121332964 @default.
- W2789121304 hasConceptScore W2789121304C134306372 @default.
- W2789121304 hasConceptScore W2789121304C138885662 @default.
- W2789121304 hasConceptScore W2789121304C14036430 @default.
- W2789121304 hasConceptScore W2789121304C176181172 @default.
- W2789121304 hasConceptScore W2789121304C187455244 @default.
- W2789121304 hasConceptScore W2789121304C24890656 @default.
- W2789121304 hasConceptScore W2789121304C2775997480 @default.
- W2789121304 hasConceptScore W2789121304C2780586882 @default.
- W2789121304 hasConceptScore W2789121304C33923547 @default.
- W2789121304 hasConceptScore W2789121304C78458016 @default.
- W2789121304 hasConceptScore W2789121304C86803240 @default.
- W2789121304 hasConceptScore W2789121304C90119067 @default.
- W2789121304 hasLocation W27891213041 @default.
- W2789121304 hasOpenAccess W2789121304 @default.
- W2789121304 hasPrimaryLocation W27891213041 @default.
- W2789121304 hasRelatedWork W1518031539 @default.
- W2789121304 hasRelatedWork W1583772930 @default.
- W2789121304 hasRelatedWork W1604438253 @default.
- W2789121304 hasRelatedWork W1975071935 @default.
- W2789121304 hasRelatedWork W1985076392 @default.
- W2789121304 hasRelatedWork W2023834316 @default.
- W2789121304 hasRelatedWork W2053927789 @default.
- W2789121304 hasRelatedWork W2121570310 @default.
- W2789121304 hasRelatedWork W2151608543 @default.
- W2789121304 hasRelatedWork W2216908642 @default.
- W2789121304 hasRelatedWork W2605157281 @default.
- W2789121304 hasRelatedWork W2792174692 @default.
- W2789121304 hasRelatedWork W2888000245 @default.
- W2789121304 hasRelatedWork W2951238417 @default.
- W2789121304 hasRelatedWork W2978625405 @default.
- W2789121304 hasRelatedWork W3029213479 @default.
- W2789121304 hasRelatedWork W3053418944 @default.
- W2789121304 hasRelatedWork W3184867574 @default.