Matches in SemOpenAlex for { <https://semopenalex.org/work/W2963325933> ?p ?o ?g. }
- W2963325933 endingPage "1163" @default.
- W2963325933 startingPage "1135" @default.
- W2963325933 abstract "Although neural networks are routinely and successfully trained in practice using simple gradient-based methods, most existing theoretical results are negative, showing that learning such networks is difficult, in a worst-case sense over all data distributions. In this paper, we take a more nuanced view, and consider whether specific assumptions on the niceness of the input distribution, or niceness of the target function (e.g. in terms of smoothness, non-degeneracy, incoherence, random choice of parameters etc.), are sufficient to guarantee learnability using gradient-based methods. We provide evidence that neither class of assumptions alone is sufficient: On the one hand, for any member of a class of nice target functions, there are difficult input distributions. On the other hand, we identify a family of simple target functions, which are di_cult to learn even if the input distribution is nice. To prove our results, we develop some tools which may be of independent interest, such as extending Fourier-based hardness techniques developed in the context of statistical queries (Blum et al., 1994), from the Boolean cube to Euclidean space and to more general classes of functions." @default.
- W2963325933 created "2019-07-30" @default.
- W2963325933 creator A5017753135 @default.
- W2963325933 date "2018-01-01" @default.
- W2963325933 modified "2023-09-27" @default.
- W2963325933 title "Distribution-specific hardness of learning neural networks" @default.
- W2963325933 cites W1528905581 @default.
- W2963325933 cites W1836465849 @default.
- W2963325933 cites W1839868949 @default.
- W2963325933 cites W1899249567 @default.
- W2963325933 cites W1995897489 @default.
- W2963325933 cites W2058802470 @default.
- W2963325933 cites W2064680241 @default.
- W2963325933 cites W2113517874 @default.
- W2963325933 cites W2119877753 @default.
- W2963325933 cites W2143859313 @default.
- W2963325933 cites W2143915663 @default.
- W2963325933 cites W2146502635 @default.
- W2963325933 cites W2168002876 @default.
- W2963325933 cites W2276387674 @default.
- W2963325933 cites W2296319761 @default.
- W2963325933 cites W2963326517 @default.
- W2963325933 cites W2963535657 @default.
- W2963325933 cites W3109393067 @default.
- W2963325933 cites W836608889 @default.
- W2963325933 hasPublicationYear "2018" @default.
- W2963325933 type Work @default.
- W2963325933 sameAs 2963325933 @default.
- W2963325933 citedByCount "34" @default.
- W2963325933 countsByYear W29633259332017 @default.
- W2963325933 countsByYear W29633259332018 @default.
- W2963325933 countsByYear W29633259332019 @default.
- W2963325933 countsByYear W29633259332020 @default.
- W2963325933 countsByYear W29633259332021 @default.
- W2963325933 crossrefType "journal-article" @default.
- W2963325933 hasAuthorship W2963325933A5017753135 @default.
- W2963325933 hasConcept C102634674 @default.
- W2963325933 hasConcept C110121322 @default.
- W2963325933 hasConcept C111472728 @default.
- W2963325933 hasConcept C114614502 @default.
- W2963325933 hasConcept C119857082 @default.
- W2963325933 hasConcept C129782007 @default.
- W2963325933 hasConcept C134306372 @default.
- W2963325933 hasConcept C138885662 @default.
- W2963325933 hasConcept C14036430 @default.
- W2963325933 hasConcept C151730666 @default.
- W2963325933 hasConcept C154945302 @default.
- W2963325933 hasConcept C186450821 @default.
- W2963325933 hasConcept C2524010 @default.
- W2963325933 hasConcept C2777212361 @default.
- W2963325933 hasConcept C2777723229 @default.
- W2963325933 hasConcept C2777727622 @default.
- W2963325933 hasConcept C2779343474 @default.
- W2963325933 hasConcept C2780586882 @default.
- W2963325933 hasConcept C33923547 @default.
- W2963325933 hasConcept C41008148 @default.
- W2963325933 hasConcept C50644808 @default.
- W2963325933 hasConcept C60644358 @default.
- W2963325933 hasConcept C78458016 @default.
- W2963325933 hasConcept C80444323 @default.
- W2963325933 hasConcept C86803240 @default.
- W2963325933 hasConceptScore W2963325933C102634674 @default.
- W2963325933 hasConceptScore W2963325933C110121322 @default.
- W2963325933 hasConceptScore W2963325933C111472728 @default.
- W2963325933 hasConceptScore W2963325933C114614502 @default.
- W2963325933 hasConceptScore W2963325933C119857082 @default.
- W2963325933 hasConceptScore W2963325933C129782007 @default.
- W2963325933 hasConceptScore W2963325933C134306372 @default.
- W2963325933 hasConceptScore W2963325933C138885662 @default.
- W2963325933 hasConceptScore W2963325933C14036430 @default.
- W2963325933 hasConceptScore W2963325933C151730666 @default.
- W2963325933 hasConceptScore W2963325933C154945302 @default.
- W2963325933 hasConceptScore W2963325933C186450821 @default.
- W2963325933 hasConceptScore W2963325933C2524010 @default.
- W2963325933 hasConceptScore W2963325933C2777212361 @default.
- W2963325933 hasConceptScore W2963325933C2777723229 @default.
- W2963325933 hasConceptScore W2963325933C2777727622 @default.
- W2963325933 hasConceptScore W2963325933C2779343474 @default.
- W2963325933 hasConceptScore W2963325933C2780586882 @default.
- W2963325933 hasConceptScore W2963325933C33923547 @default.
- W2963325933 hasConceptScore W2963325933C41008148 @default.
- W2963325933 hasConceptScore W2963325933C50644808 @default.
- W2963325933 hasConceptScore W2963325933C60644358 @default.
- W2963325933 hasConceptScore W2963325933C78458016 @default.
- W2963325933 hasConceptScore W2963325933C80444323 @default.
- W2963325933 hasConceptScore W2963325933C86803240 @default.
- W2963325933 hasIssue "1" @default.
- W2963325933 hasLocation W29633259331 @default.
- W2963325933 hasOpenAccess W2963325933 @default.
- W2963325933 hasPrimaryLocation W29633259331 @default.
- W2963325933 hasRelatedWork W1995897489 @default.
- W2963325933 hasRelatedWork W2064680241 @default.
- W2963325933 hasRelatedWork W2163605009 @default.
- W2963325933 hasRelatedWork W2166116275 @default.
- W2963325933 hasRelatedWork W2509435534 @default.
- W2963325933 hasRelatedWork W2558384550 @default.
- W2963325933 hasRelatedWork W2591714514 @default.
- W2963325933 hasRelatedWork W2809090039 @default.