Matches in SemOpenAlex for { <https://semopenalex.org/work/W3205380061> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W3205380061 abstract "Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of scientific and technical applications by explicitly encoding group symmetries, such as rotations and permutations, in their architectures. Although the success of G-CNNs is driven by the explicit symmetry bias of their convolutional architecture, a recent line of work has proposed that the implicit bias of training algorithms on a particular parameterization (or architecture) is key to understanding generalization for overparameterized neural nets. In this context, we show that $L$-layer full-width linear G-CNNs trained via gradient descent in a binary classification task converge to solutions with low-rank Fourier matrix coefficients, regularized by the $2/L$-Schatten matrix norm. Our work strictly generalizes previous analysis on the implicit bias of linear CNNs to linear G-CNNs over all finite groups, including the challenging setting of non-commutative symmetry groups (such as permutations). We validate our theorems via experiments on a variety of groups and empirically explore more realistic nonlinear networks, which locally capture similar regularization patterns. Finally, we provide intuitive interpretations of our Fourier space implicit regularization results in real space via uncertainty principles." @default.
- W3205380061 created "2021-10-25" @default.
- W3205380061 creator A5014346709 @default.
- W3205380061 creator A5053803103 @default.
- W3205380061 creator A5058281884 @default.
- W3205380061 creator A5079855181 @default.
- W3205380061 date "2021-10-12" @default.
- W3205380061 modified "2023-09-26" @default.
- W3205380061 title "Implicit Bias of Linear Equivariant Networks." @default.
- W3205380061 cites W1513167324 @default.
- W3205380061 cites W1596578766 @default.
- W3205380061 cites W1635256758 @default.
- W3205380061 cites W2000985550 @default.
- W3205380061 cites W2029213856 @default.
- W3205380061 cites W2071042641 @default.
- W3205380061 cites W2124005487 @default.
- W3205380061 cites W2125455772 @default.
- W3205380061 cites W2136026194 @default.
- W3205380061 cites W2279221249 @default.
- W3205380061 cites W2766678531 @default.
- W3205380061 cites W2785397276 @default.
- W3205380061 cites W2796422723 @default.
- W3205380061 cites W2952433032 @default.
- W3205380061 cites W2962843949 @default.
- W3205380061 cites W2963737468 @default.
- W3205380061 cites W2963798163 @default.
- W3205380061 cites W2963826371 @default.
- W3205380061 cites W2970663744 @default.
- W3205380061 cites W2970754912 @default.
- W3205380061 cites W2970756352 @default.
- W3205380061 cites W3020859587 @default.
- W3205380061 cites W3106042364 @default.
- W3205380061 cites W3120617215 @default.
- W3205380061 cites W3123819420 @default.
- W3205380061 cites W3129276786 @default.
- W3205380061 cites W3130340534 @default.
- W3205380061 cites W3137695714 @default.
- W3205380061 cites W3149692010 @default.
- W3205380061 cites W3157282745 @default.
- W3205380061 cites W3159956551 @default.
- W3205380061 cites W3170752534 @default.
- W3205380061 cites W3185572534 @default.
- W3205380061 hasPublicationYear "2021" @default.
- W3205380061 type Work @default.
- W3205380061 sameAs 3205380061 @default.
- W3205380061 citedByCount "0" @default.
- W3205380061 crossrefType "posted-content" @default.
- W3205380061 hasAuthorship W3205380061A5014346709 @default.
- W3205380061 hasAuthorship W3205380061A5053803103 @default.
- W3205380061 hasAuthorship W3205380061A5058281884 @default.
- W3205380061 hasAuthorship W3205380061A5079855181 @default.
- W3205380061 hasConcept C11413529 @default.
- W3205380061 hasConcept C134306372 @default.
- W3205380061 hasConcept C154945302 @default.
- W3205380061 hasConcept C171036898 @default.
- W3205380061 hasConcept C177148314 @default.
- W3205380061 hasConcept C202444582 @default.
- W3205380061 hasConcept C2776135515 @default.
- W3205380061 hasConcept C28826006 @default.
- W3205380061 hasConcept C33923547 @default.
- W3205380061 hasConcept C41008148 @default.
- W3205380061 hasConcept C81363708 @default.
- W3205380061 hasConceptScore W3205380061C11413529 @default.
- W3205380061 hasConceptScore W3205380061C134306372 @default.
- W3205380061 hasConceptScore W3205380061C154945302 @default.
- W3205380061 hasConceptScore W3205380061C171036898 @default.
- W3205380061 hasConceptScore W3205380061C177148314 @default.
- W3205380061 hasConceptScore W3205380061C202444582 @default.
- W3205380061 hasConceptScore W3205380061C2776135515 @default.
- W3205380061 hasConceptScore W3205380061C28826006 @default.
- W3205380061 hasConceptScore W3205380061C33923547 @default.
- W3205380061 hasConceptScore W3205380061C41008148 @default.
- W3205380061 hasConceptScore W3205380061C81363708 @default.
- W3205380061 hasLocation W32053800611 @default.
- W3205380061 hasOpenAccess W3205380061 @default.
- W3205380061 hasPrimaryLocation W32053800611 @default.
- W3205380061 hasRelatedWork W2128660912 @default.
- W3205380061 hasRelatedWork W2584280040 @default.
- W3205380061 hasRelatedWork W2787442904 @default.
- W3205380061 hasRelatedWork W2898529868 @default.
- W3205380061 hasRelatedWork W2909878113 @default.
- W3205380061 hasRelatedWork W2936232398 @default.
- W3205380061 hasRelatedWork W2936957173 @default.
- W3205380061 hasRelatedWork W2946510242 @default.
- W3205380061 hasRelatedWork W2949913952 @default.
- W3205380061 hasRelatedWork W2979038370 @default.
- W3205380061 hasRelatedWork W2982320693 @default.
- W3205380061 hasRelatedWork W3001808426 @default.
- W3205380061 hasRelatedWork W3014013215 @default.
- W3205380061 hasRelatedWork W3046476838 @default.
- W3205380061 hasRelatedWork W3092412346 @default.
- W3205380061 hasRelatedWork W3101895620 @default.
- W3205380061 hasRelatedWork W3126655516 @default.
- W3205380061 hasRelatedWork W3131815757 @default.
- W3205380061 hasRelatedWork W3155066824 @default.
- W3205380061 hasRelatedWork W3173306803 @default.
- W3205380061 isParatext "false" @default.
- W3205380061 isRetracted "false" @default.
- W3205380061 magId "3205380061" @default.
- W3205380061 workType "article" @default.