Matches in SemOpenAlex for { <https://semopenalex.org/work/W3034384909> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W3034384909 abstract "Dropout and its extensions (e.g. DropBlock and DropConnect) are popular heuristics for training neural networks, which have been shown to improve generalization performance in practice. However, a theoretical understanding of their optimization and regularization properties remains elusive. Recent work shows that in the case of single hidden-layer linear networks, Dropout is a stochastic gradient descent method for minimizing a regularized loss, and that the regularizer induces solutions that are low-rank and balanced. In this work we show that for single hidden-layer linear networks, DropBlock induces spectral k-support norm regularization, and promotes solutions that are low-rank and have factors with equal norm. We also show that the global minimizer for DropBlock can be computed in closed form, and that DropConnect is equivalent to Dropout. We then show that some of these results can be extended to a general class of Dropout-strategies, and, with some assumptions, to deep non-linear networks when Dropout is applied to the last layer. We verify our theoretical claims and assumptions experimentally with commonly used network architectures." @default.
- W3034384909 created "2020-06-19" @default.
- W3034384909 creator A5011256828 @default.
- W3034384909 creator A5026449354 @default.
- W3034384909 creator A5067124640 @default.
- W3034384909 creator A5075966843 @default.
- W3034384909 date "2020-06-01" @default.
- W3034384909 modified "2023-10-09" @default.
- W3034384909 title "On the Regularization Properties of Structured Dropout" @default.
- W3034384909 cites W1979482308 @default.
- W3034384909 cites W2963074844 @default.
- W3034384909 cites W4231090517 @default.
- W3034384909 doi "https://doi.org/10.1109/cvpr42600.2020.00769" @default.
- W3034384909 hasPublicationYear "2020" @default.
- W3034384909 type Work @default.
- W3034384909 sameAs 3034384909 @default.
- W3034384909 citedByCount "4" @default.
- W3034384909 countsByYear W30343849092018 @default.
- W3034384909 countsByYear W30343849092020 @default.
- W3034384909 countsByYear W30343849092021 @default.
- W3034384909 countsByYear W30343849092023 @default.
- W3034384909 crossrefType "proceedings-article" @default.
- W3034384909 hasAuthorship W3034384909A5011256828 @default.
- W3034384909 hasAuthorship W3034384909A5026449354 @default.
- W3034384909 hasAuthorship W3034384909A5067124640 @default.
- W3034384909 hasAuthorship W3034384909A5075966843 @default.
- W3034384909 hasBestOaLocation W30343849092 @default.
- W3034384909 hasConcept C11413529 @default.
- W3034384909 hasConcept C114614502 @default.
- W3034384909 hasConcept C119857082 @default.
- W3034384909 hasConcept C126255220 @default.
- W3034384909 hasConcept C127705205 @default.
- W3034384909 hasConcept C153258448 @default.
- W3034384909 hasConcept C154945302 @default.
- W3034384909 hasConcept C164226766 @default.
- W3034384909 hasConcept C17744445 @default.
- W3034384909 hasConcept C191795146 @default.
- W3034384909 hasConcept C199539241 @default.
- W3034384909 hasConcept C206688291 @default.
- W3034384909 hasConcept C2776135515 @default.
- W3034384909 hasConcept C2776145597 @default.
- W3034384909 hasConcept C28826006 @default.
- W3034384909 hasConcept C33923547 @default.
- W3034384909 hasConcept C41008148 @default.
- W3034384909 hasConcept C50644808 @default.
- W3034384909 hasConceptScore W3034384909C11413529 @default.
- W3034384909 hasConceptScore W3034384909C114614502 @default.
- W3034384909 hasConceptScore W3034384909C119857082 @default.
- W3034384909 hasConceptScore W3034384909C126255220 @default.
- W3034384909 hasConceptScore W3034384909C127705205 @default.
- W3034384909 hasConceptScore W3034384909C153258448 @default.
- W3034384909 hasConceptScore W3034384909C154945302 @default.
- W3034384909 hasConceptScore W3034384909C164226766 @default.
- W3034384909 hasConceptScore W3034384909C17744445 @default.
- W3034384909 hasConceptScore W3034384909C191795146 @default.
- W3034384909 hasConceptScore W3034384909C199539241 @default.
- W3034384909 hasConceptScore W3034384909C206688291 @default.
- W3034384909 hasConceptScore W3034384909C2776135515 @default.
- W3034384909 hasConceptScore W3034384909C2776145597 @default.
- W3034384909 hasConceptScore W3034384909C28826006 @default.
- W3034384909 hasConceptScore W3034384909C33923547 @default.
- W3034384909 hasConceptScore W3034384909C41008148 @default.
- W3034384909 hasConceptScore W3034384909C50644808 @default.
- W3034384909 hasLocation W30343849091 @default.
- W3034384909 hasLocation W30343849092 @default.
- W3034384909 hasOpenAccess W3034384909 @default.
- W3034384909 hasPrimaryLocation W30343849091 @default.
- W3034384909 hasRelatedWork W11141431 @default.
- W3034384909 hasRelatedWork W11910490 @default.
- W3034384909 hasRelatedWork W12549385 @default.
- W3034384909 hasRelatedWork W1365889 @default.
- W3034384909 hasRelatedWork W3765441 @default.
- W3034384909 hasRelatedWork W4919037 @default.
- W3034384909 hasRelatedWork W8049136 @default.
- W3034384909 hasRelatedWork W8259573 @default.
- W3034384909 hasRelatedWork W9443576 @default.
- W3034384909 hasRelatedWork W12792411 @default.
- W3034384909 isParatext "false" @default.
- W3034384909 isRetracted "false" @default.
- W3034384909 magId "3034384909" @default.
- W3034384909 workType "article" @default.