Matches in SemOpenAlex for { <https://semopenalex.org/work/W2148571195> ?p ?o ?g. }
- W2148571195 abstract "Recent works have highlighted scale invariance or symmetry that is present in the weight space of a typical deep network and the adverse effect that it has on the Euclidean gradient based stochastic gradient descent optimization. In this work, we show that these and other commonly used deep networks, such as those which use a max-pooling and sub-sampling layer, possess more complex forms of symmetry arising from scaling based reparameterization of the network weights. We then propose two symmetry-invariant gradient based weight updates for stochastic gradient descent based learning. Our empirical evidence based on the MNIST dataset shows that these updates improve the test performance without sacrificing the computational efficiency of the weight updates. We also show the results of training with one of the proposed weight updates on an image segmentation problem." @default.
- W2148571195 created "2016-06-24" @default.
- W2148571195 creator A5018207993 @default.
- W2148571195 creator A5023551959 @default.
- W2148571195 creator A5049143130 @default.
- W2148571195 date "2015-11-05" @default.
- W2148571195 modified "2023-09-27" @default.
- W2148571195 title "Symmetry-invariant optimization in deep networks." @default.
- W2148571195 cites W114517082 @default.
- W2148571195 cites W1498436455 @default.
- W2148571195 cites W1804110266 @default.
- W2148571195 cites W1836465849 @default.
- W2148571195 cites W1844261860 @default.
- W2148571195 cites W1915968771 @default.
- W2148571195 cites W1970789124 @default.
- W2148571195 cites W1996294669 @default.
- W2148571195 cites W2045512849 @default.
- W2148571195 cites W2117198760 @default.
- W2148571195 cites W2126407450 @default.
- W2148571195 cites W2134797427 @default.
- W2148571195 cites W2147631863 @default.
- W2148571195 cites W2156529323 @default.
- W2148571195 cites W2167623372 @default.
- W2148571195 cites W2171943915 @default.
- W2148571195 cites W2228459002 @default.
- W2148571195 cites W2919115771 @default.
- W2148571195 cites W2962913334 @default.
- W2148571195 cites W3037096902 @default.
- W2148571195 cites W3102317997 @default.
- W2148571195 cites W360623563 @default.
- W2148571195 cites W577198184 @default.
- W2148571195 hasPublicationYear "2015" @default.
- W2148571195 type Work @default.
- W2148571195 sameAs 2148571195 @default.
- W2148571195 citedByCount "7" @default.
- W2148571195 countsByYear W21485711952016 @default.
- W2148571195 countsByYear W21485711952017 @default.
- W2148571195 countsByYear W21485711952018 @default.
- W2148571195 countsByYear W21485711952020 @default.
- W2148571195 countsByYear W21485711952021 @default.
- W2148571195 crossrefType "posted-content" @default.
- W2148571195 hasAuthorship W2148571195A5018207993 @default.
- W2148571195 hasAuthorship W2148571195A5023551959 @default.
- W2148571195 hasAuthorship W2148571195A5049143130 @default.
- W2148571195 hasConcept C105795698 @default.
- W2148571195 hasConcept C108583219 @default.
- W2148571195 hasConcept C126255220 @default.
- W2148571195 hasConcept C134306372 @default.
- W2148571195 hasConcept C135593079 @default.
- W2148571195 hasConcept C153258448 @default.
- W2148571195 hasConcept C154945302 @default.
- W2148571195 hasConcept C186450821 @default.
- W2148571195 hasConcept C190470478 @default.
- W2148571195 hasConcept C190502265 @default.
- W2148571195 hasConcept C206688291 @default.
- W2148571195 hasConcept C2524010 @default.
- W2148571195 hasConcept C2779886137 @default.
- W2148571195 hasConcept C28826006 @default.
- W2148571195 hasConcept C33923547 @default.
- W2148571195 hasConcept C37914503 @default.
- W2148571195 hasConcept C41008148 @default.
- W2148571195 hasConcept C50644808 @default.
- W2148571195 hasConcept C70437156 @default.
- W2148571195 hasConcept C99844830 @default.
- W2148571195 hasConceptScore W2148571195C105795698 @default.
- W2148571195 hasConceptScore W2148571195C108583219 @default.
- W2148571195 hasConceptScore W2148571195C126255220 @default.
- W2148571195 hasConceptScore W2148571195C134306372 @default.
- W2148571195 hasConceptScore W2148571195C135593079 @default.
- W2148571195 hasConceptScore W2148571195C153258448 @default.
- W2148571195 hasConceptScore W2148571195C154945302 @default.
- W2148571195 hasConceptScore W2148571195C186450821 @default.
- W2148571195 hasConceptScore W2148571195C190470478 @default.
- W2148571195 hasConceptScore W2148571195C190502265 @default.
- W2148571195 hasConceptScore W2148571195C206688291 @default.
- W2148571195 hasConceptScore W2148571195C2524010 @default.
- W2148571195 hasConceptScore W2148571195C2779886137 @default.
- W2148571195 hasConceptScore W2148571195C28826006 @default.
- W2148571195 hasConceptScore W2148571195C33923547 @default.
- W2148571195 hasConceptScore W2148571195C37914503 @default.
- W2148571195 hasConceptScore W2148571195C41008148 @default.
- W2148571195 hasConceptScore W2148571195C50644808 @default.
- W2148571195 hasConceptScore W2148571195C70437156 @default.
- W2148571195 hasConceptScore W2148571195C99844830 @default.
- W2148571195 hasLocation W21485711951 @default.
- W2148571195 hasOpenAccess W2148571195 @default.
- W2148571195 hasPrimaryLocation W21485711951 @default.
- W2148571195 hasRelatedWork W2186878252 @default.
- W2148571195 hasRelatedWork W2228459002 @default.
- W2148571195 hasRelatedWork W2513463608 @default.
- W2148571195 hasRelatedWork W2540616960 @default.
- W2148571195 hasRelatedWork W2769561741 @default.
- W2148571195 hasRelatedWork W2771655537 @default.
- W2148571195 hasRelatedWork W2786619528 @default.
- W2148571195 hasRelatedWork W2996176259 @default.
- W2148571195 hasRelatedWork W3016875959 @default.
- W2148571195 hasRelatedWork W3017466908 @default.
- W2148571195 hasRelatedWork W3037767126 @default.
- W2148571195 hasRelatedWork W3115341478 @default.
- W2148571195 hasRelatedWork W3131178597 @default.