Matches in SemOpenAlex for { <https://semopenalex.org/work/W3126988966> ?p ?o ?g. }
- W3126988966 abstract "Several recent works have shown separation results between deep neural networks, and hypothesis classes with inferior approximation capacity such as shallow networks or kernel classes. On the other hand, the fact that deep networks can efficiently express a target function does not mean that this target function can be learned efficiently by deep neural networks. In this work we study the intricate connection between learnability and approximation capacity. We show that learnability with deep networks of a target function depends on the ability of simpler classes to approximate the target. Specifically, we show that a necessary condition for a function to be learnable by gradient descent on deep neural networks is to be able to approximate the function, at least in a weak sense, with shallow neural networks. We also show that a class of functions can be learned by an efficient statistical query algorithm if and only if it can be approximated in a weak sense by some kernel class. We give several examples of functions which demonstrate depth separation, and conclude that they cannot be efficiently learned, even by a hypothesis class that can efficiently approximate them." @default.
- W3126988966 created "2021-02-15" @default.
- W3126988966 creator A5017753135 @default.
- W3126988966 creator A5069983576 @default.
- W3126988966 creator A5070705848 @default.
- W3126988966 creator A5078263052 @default.
- W3126988966 date "2021-01-31" @default.
- W3126988966 modified "2023-10-17" @default.
- W3126988966 title "The Connection Between Approximation, Depth Separation and Learnability in Neural Networks" @default.
- W3126988966 cites W1533861849 @default.
- W3126988966 cites W1583948032 @default.
- W3126988966 cites W1995897489 @default.
- W3126988966 cites W2064680241 @default.
- W3126988966 cites W2103496339 @default.
- W3126988966 cites W2130608487 @default.
- W3126988966 cites W2187362426 @default.
- W3126988966 cites W2281746805 @default.
- W3126988966 cites W2532798880 @default.
- W3126988966 cites W2546502841 @default.
- W3126988966 cites W2593965610 @default.
- W3126988966 cites W2595713799 @default.
- W3126988966 cites W2937006657 @default.
- W3126988966 cites W2962742960 @default.
- W3126988966 cites W2963086136 @default.
- W3126988966 cites W2963325933 @default.
- W3126988966 cites W2963847403 @default.
- W3126988966 cites W2968880761 @default.
- W3126988966 cites W2970882350 @default.
- W3126988966 cites W2971169274 @default.
- W3126988966 cites W2982282910 @default.
- W3126988966 cites W2995975522 @default.
- W3126988966 cites W2998734833 @default.
- W3126988966 cites W3000189159 @default.
- W3126988966 cites W3006410630 @default.
- W3126988966 cites W3009328655 @default.
- W3126988966 cites W3030399983 @default.
- W3126988966 cites W3034933105 @default.
- W3126988966 cites W3035519553 @default.
- W3126988966 cites W3125537303 @default.
- W3126988966 cites W3174935984 @default.
- W3126988966 cites W3031369584 @default.
- W3126988966 hasPublicationYear "2021" @default.
- W3126988966 type Work @default.
- W3126988966 sameAs 3126988966 @default.
- W3126988966 citedByCount "4" @default.
- W3126988966 countsByYear W31269889662021 @default.
- W3126988966 crossrefType "posted-content" @default.
- W3126988966 hasAuthorship W3126988966A5017753135 @default.
- W3126988966 hasAuthorship W3126988966A5069983576 @default.
- W3126988966 hasAuthorship W3126988966A5070705848 @default.
- W3126988966 hasAuthorship W3126988966A5078263052 @default.
- W3126988966 hasConcept C108583219 @default.
- W3126988966 hasConcept C11413529 @default.
- W3126988966 hasConcept C118615104 @default.
- W3126988966 hasConcept C119857082 @default.
- W3126988966 hasConcept C13355873 @default.
- W3126988966 hasConcept C14036430 @default.
- W3126988966 hasConcept C154945302 @default.
- W3126988966 hasConcept C2524010 @default.
- W3126988966 hasConcept C2776061190 @default.
- W3126988966 hasConcept C2777212361 @default.
- W3126988966 hasConcept C2777723229 @default.
- W3126988966 hasConcept C33923547 @default.
- W3126988966 hasConcept C41008148 @default.
- W3126988966 hasConcept C50644808 @default.
- W3126988966 hasConcept C74193536 @default.
- W3126988966 hasConcept C78458016 @default.
- W3126988966 hasConcept C86803240 @default.
- W3126988966 hasConcept C91873725 @default.
- W3126988966 hasConceptScore W3126988966C108583219 @default.
- W3126988966 hasConceptScore W3126988966C11413529 @default.
- W3126988966 hasConceptScore W3126988966C118615104 @default.
- W3126988966 hasConceptScore W3126988966C119857082 @default.
- W3126988966 hasConceptScore W3126988966C13355873 @default.
- W3126988966 hasConceptScore W3126988966C14036430 @default.
- W3126988966 hasConceptScore W3126988966C154945302 @default.
- W3126988966 hasConceptScore W3126988966C2524010 @default.
- W3126988966 hasConceptScore W3126988966C2776061190 @default.
- W3126988966 hasConceptScore W3126988966C2777212361 @default.
- W3126988966 hasConceptScore W3126988966C2777723229 @default.
- W3126988966 hasConceptScore W3126988966C33923547 @default.
- W3126988966 hasConceptScore W3126988966C41008148 @default.
- W3126988966 hasConceptScore W3126988966C50644808 @default.
- W3126988966 hasConceptScore W3126988966C74193536 @default.
- W3126988966 hasConceptScore W3126988966C78458016 @default.
- W3126988966 hasConceptScore W3126988966C86803240 @default.
- W3126988966 hasConceptScore W3126988966C91873725 @default.
- W3126988966 hasLocation W31269889661 @default.
- W3126988966 hasOpenAccess W3126988966 @default.
- W3126988966 hasPrimaryLocation W31269889661 @default.
- W3126988966 hasRelatedWork W1680674731 @default.
- W3126988966 hasRelatedWork W2310813700 @default.
- W3126988966 hasRelatedWork W2614119628 @default.
- W3126988966 hasRelatedWork W2894812324 @default.
- W3126988966 hasRelatedWork W2897097528 @default.
- W3126988966 hasRelatedWork W2963560640 @default.
- W3126988966 hasRelatedWork W2964098911 @default.
- W3126988966 hasRelatedWork W2966695781 @default.
- W3126988966 hasRelatedWork W2970330753 @default.
- W3126988966 hasRelatedWork W3005679856 @default.