Matches in SemOpenAlex for { <https://semopenalex.org/work/W2560628199> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W2560628199 abstract "We analyze dropout in deep networks with rectified linear units and the quadratic loss. Our results expose surprising differences between the behavior of dropout and more traditional regularizers like weight decay. For example, on some simple data sets dropout training produces negative weights even though the output is the sum of the inputs. This provides a counterpoint to the suggestion that dropout discourages co-adaptation of weights. We also show that the dropout penalty can grow exponentially in the depth of the network while the weight-decay penalty remains essentially linear, and that dropout is insensitive to various re-scalings of the input features, outputs, and network weights. This last insensitivity implies that there are no isolated local minima of the dropout training criterion. Our work uncovers new properties of dropout, extends our understanding of why dropout succeeds, and lays the foundation for further progress." @default.
- W2560628199 created "2016-12-16" @default.
- W2560628199 creator A5014740431 @default.
- W2560628199 creator A5084487318 @default.
- W2560628199 date "2016-02-14" @default.
- W2560628199 modified "2023-09-27" @default.
- W2560628199 title "Surprising properties of dropout in deep networks" @default.
- W2560628199 cites W1677182931 @default.
- W2560628199 cites W1904365287 @default.
- W2560628199 cites W1984541135 @default.
- W2560628199 cites W2023163512 @default.
- W2560628199 cites W2076063813 @default.
- W2560628199 cites W2095705004 @default.
- W2560628199 cites W2097117768 @default.
- W2560628199 cites W2129068307 @default.
- W2560628199 cites W2144459111 @default.
- W2560628199 cites W2152722485 @default.
- W2560628199 cites W2164370980 @default.
- W2560628199 cites W2250861254 @default.
- W2560628199 cites W2294567968 @default.
- W2560628199 cites W2949300694 @default.
- W2560628199 cites W2962857907 @default.
- W2560628199 cites W2963724148 @default.
- W2560628199 cites W3037950864 @default.
- W2560628199 cites W4919037 @default.
- W2560628199 cites W582134693 @default.
- W2560628199 hasPublicationYear "2016" @default.
- W2560628199 type Work @default.
- W2560628199 sameAs 2560628199 @default.
- W2560628199 citedByCount "2" @default.
- W2560628199 countsByYear W25606281992016 @default.
- W2560628199 countsByYear W25606281992019 @default.
- W2560628199 crossrefType "posted-content" @default.
- W2560628199 hasAuthorship W2560628199A5014740431 @default.
- W2560628199 hasAuthorship W2560628199A5084487318 @default.
- W2560628199 hasConcept C111472728 @default.
- W2560628199 hasConcept C119857082 @default.
- W2560628199 hasConcept C126255220 @default.
- W2560628199 hasConcept C129844170 @default.
- W2560628199 hasConcept C134306372 @default.
- W2560628199 hasConcept C138885662 @default.
- W2560628199 hasConcept C186633575 @default.
- W2560628199 hasConcept C2524010 @default.
- W2560628199 hasConcept C2776145597 @default.
- W2560628199 hasConcept C2780586882 @default.
- W2560628199 hasConcept C28826006 @default.
- W2560628199 hasConcept C33923547 @default.
- W2560628199 hasConcept C41008148 @default.
- W2560628199 hasConceptScore W2560628199C111472728 @default.
- W2560628199 hasConceptScore W2560628199C119857082 @default.
- W2560628199 hasConceptScore W2560628199C126255220 @default.
- W2560628199 hasConceptScore W2560628199C129844170 @default.
- W2560628199 hasConceptScore W2560628199C134306372 @default.
- W2560628199 hasConceptScore W2560628199C138885662 @default.
- W2560628199 hasConceptScore W2560628199C186633575 @default.
- W2560628199 hasConceptScore W2560628199C2524010 @default.
- W2560628199 hasConceptScore W2560628199C2776145597 @default.
- W2560628199 hasConceptScore W2560628199C2780586882 @default.
- W2560628199 hasConceptScore W2560628199C28826006 @default.
- W2560628199 hasConceptScore W2560628199C33923547 @default.
- W2560628199 hasConceptScore W2560628199C41008148 @default.
- W2560628199 hasLocation W25606281991 @default.
- W2560628199 hasOpenAccess W2560628199 @default.
- W2560628199 hasPrimaryLocation W25606281991 @default.
- W2560628199 hasRelatedWork W2338182290 @default.
- W2560628199 hasRelatedWork W2808205079 @default.
- W2560628199 isParatext "false" @default.
- W2560628199 isRetracted "false" @default.
- W2560628199 magId "2560628199" @default.
- W2560628199 workType "article" @default.