FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3196095315> ?p ?o ?g. }

• W3196095315 abstract "This paper identifies a structural property of data distributions that enables deep neural networks to learn hierarchically. We define the property for functions over the Boolean hypercube, which posits that high-order Fourier coefficients are reachable from lower-order Fourier coefficients along increasing chains. We prove that functions satisfying this property can be learned in polynomial time using layerwise stochastic coordinate descent on regular neural networks -- a class of network architectures and initializations that have homogeneity properties. Our analysis shows that for such staircase functions and neural networks, the gradient-based algorithm learns high-level features by greedily combining lower-level features along the depth of the network. We further back our theoretical results with experiments showing that staircase functions are also learnable by more standard ResNet architectures with stochastic gradient descent. Both the theoretical and experimental results support the fact that staircase properties have a role to play in understanding the capabilities of gradient-based learning on regular networks, in contrast to general polynomial-size networks that can emulate any SQ or PAC algorithms as recently shown." @default.
• W3196095315 created "2021-08-30" @default.
• W3196095315 creator A5022211634 @default.
• W3196095315 creator A5055776312 @default.
• W3196095315 creator A5060812074 @default.
• W3196095315 creator A5063107043 @default.
• W3196095315 creator A5091031925 @default.
• W3196095315 date "2021-08-24" @default.
• W3196095315 modified "2023-10-01" @default.
• W3196095315 title "The staircase property: How hierarchical structure can guide deep learning" @default.
• W3196095315 cites W1732796048 @default.
• W3196095315 cites W1817561967 @default.
• W3196095315 cites W1845051632 @default.
• W3196095315 cites W1849277567 @default.
• W3196095315 cites W1995897489 @default.
• W3196095315 cites W2064680241 @default.
• W3196095315 cites W2072072671 @default.
• W3196095315 cites W2108581418 @default.
• W3196095315 cites W2113517874 @default.
• W3196095315 cites W2125930537 @default.
• W3196095315 cites W2194775991 @default.
• W3196095315 cites W2317107098 @default.
• W3196095315 cites W2335959470 @default.
• W3196095315 cites W2410678056 @default.
• W3196095315 cites W2562573853 @default.
• W3196095315 cites W2777802649 @default.
• W3196095315 cites W2795291708 @default.
• W3196095315 cites W2911586496 @default.
• W3196095315 cites W2922371350 @default.
• W3196095315 cites W2945404573 @default.
• W3196095315 cites W2947859416 @default.
• W3196095315 cites W2962742960 @default.
• W3196095315 cites W2962990163 @default.
• W3196095315 cites W2963047948 @default.
• W3196095315 cites W2963092340 @default.
• W3196095315 cites W2963847403 @default.
• W3196095315 cites W2970166047 @default.
• W3196095315 cites W2970618525 @default.
• W3196095315 cites W2971127900 @default.
• W3196095315 cites W2976713865 @default.
• W3196095315 cites W3000127803 @default.
• W3196095315 cites W3010694149 @default.
• W3196095315 cites W3035172409 @default.
• W3196095315 cites W3046565576 @default.
• W3196095315 cites W3046669596 @default.
• W3196095315 cites W3089458484 @default.
• W3196095315 cites W3098527778 @default.
• W3196095315 cites W3098931864 @default.
• W3196095315 cites W3101640453 @default.
• W3196095315 cites W3103424281 @default.
• W3196095315 cites W3104345111 @default.
• W3196095315 cites W3135746662 @default.
• W3196095315 cites W3211742412 @default.
• W3196095315 hasPublicationYear "2021" @default.
• W3196095315 type Work @default.
• W3196095315 sameAs 3196095315 @default.
• W3196095315 citedByCount "0" @default.
• W3196095315 crossrefType "posted-content" @default.
• W3196095315 hasAuthorship W3196095315A5022211634 @default.
• W3196095315 hasAuthorship W3196095315A5055776312 @default.
• W3196095315 hasAuthorship W3196095315A5060812074 @default.
• W3196095315 hasAuthorship W3196095315A5063107043 @default.
• W3196095315 hasAuthorship W3196095315A5091031925 @default.
• W3196095315 hasConcept C108583219 @default.
• W3196095315 hasConcept C111472728 @default.
• W3196095315 hasConcept C11413529 @default.
• W3196095315 hasConcept C134306372 @default.
• W3196095315 hasConcept C138885662 @default.
• W3196095315 hasConcept C153258448 @default.
• W3196095315 hasConcept C154945302 @default.
• W3196095315 hasConcept C173608175 @default.
• W3196095315 hasConcept C187455244 @default.
• W3196095315 hasConcept C189950617 @default.
• W3196095315 hasConcept C206688291 @default.
• W3196095315 hasConcept C33923547 @default.
• W3196095315 hasConcept C41008148 @default.
• W3196095315 hasConcept C50644808 @default.
• W3196095315 hasConcept C50820777 @default.
• W3196095315 hasConcept C90119067 @default.
• W3196095315 hasConceptScore W3196095315C108583219 @default.
• W3196095315 hasConceptScore W3196095315C111472728 @default.
• W3196095315 hasConceptScore W3196095315C11413529 @default.
• W3196095315 hasConceptScore W3196095315C134306372 @default.
• W3196095315 hasConceptScore W3196095315C138885662 @default.
• W3196095315 hasConceptScore W3196095315C153258448 @default.
• W3196095315 hasConceptScore W3196095315C154945302 @default.
• W3196095315 hasConceptScore W3196095315C173608175 @default.
• W3196095315 hasConceptScore W3196095315C187455244 @default.
• W3196095315 hasConceptScore W3196095315C189950617 @default.
• W3196095315 hasConceptScore W3196095315C206688291 @default.
• W3196095315 hasConceptScore W3196095315C33923547 @default.
• W3196095315 hasConceptScore W3196095315C41008148 @default.
• W3196095315 hasConceptScore W3196095315C50644808 @default.
• W3196095315 hasConceptScore W3196095315C50820777 @default.
• W3196095315 hasConceptScore W3196095315C90119067 @default.
• W3196095315 hasLocation W31960953151 @default.
• W3196095315 hasOpenAccess W3196095315 @default.
• W3196095315 hasPrimaryLocation W31960953151 @default.
• W3196095315 hasRelatedWork W2039656002 @default.
• W3196095315 hasRelatedWork W2546515640 @default.

• next