Matches in SemOpenAlex for { <https://semopenalex.org/work/W3106394209> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W3106394209 endingPage "511" @default.
- W3106394209 startingPage "511" @default.
- W3106394209 abstract "The aim of this paper is to provide new theoretical and computational understanding on two loss regularizations employed in deep learning, known as local entropy and heat regularization. For both regularized losses we introduce variational characterizations that naturally suggest a two-step scheme for their optimization, based on the iterative shift of a probability density and the calculation of a best Gaussian approximation in Kullback-Leibler divergence. Under this unified light, the optimization schemes for local entropy and heat regularized loss differ only over which argument of the Kullback-Leibler divergence is used to find the best Gaussian approximation. Local entropy corresponds to minimizing over the second argument, and the solution is given by moment matching. This allows to replace traditional back-propagation calculation of gradients by sampling algorithms, opening an avenue for gradient-free, parallelizable training of neural networks." @default.
- W3106394209 created "2020-11-23" @default.
- W3106394209 creator A5058626346 @default.
- W3106394209 creator A5076597158 @default.
- W3106394209 creator A5089991960 @default.
- W3106394209 date "2019-05-20" @default.
- W3106394209 modified "2023-10-03" @default.
- W3106394209 title "Variational Characterizations of Local Entropy and Heat Regularization in Deep Learning" @default.
- W3106394209 cites W2211979669 @default.
- W3106394209 cites W2575742565 @default.
- W3106394209 cites W260216039 @default.
- W3106394209 cites W2912811302 @default.
- W3106394209 cites W2919115771 @default.
- W3106394209 cites W2962984936 @default.
- W3106394209 cites W2963371806 @default.
- W3106394209 cites W2963480765 @default.
- W3106394209 cites W3101357194 @default.
- W3106394209 cites W4293052541 @default.
- W3106394209 doi "https://doi.org/10.3390/e21050511" @default.
- W3106394209 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/33267225" @default.
- W3106394209 hasPublicationYear "2019" @default.
- W3106394209 type Work @default.
- W3106394209 sameAs 3106394209 @default.
- W3106394209 citedByCount "1" @default.
- W3106394209 countsByYear W31063942092021 @default.
- W3106394209 crossrefType "journal-article" @default.
- W3106394209 hasAuthorship W3106394209A5058626346 @default.
- W3106394209 hasAuthorship W3106394209A5076597158 @default.
- W3106394209 hasAuthorship W3106394209A5089991960 @default.
- W3106394209 hasBestOaLocation W31063942091 @default.
- W3106394209 hasConcept C105795698 @default.
- W3106394209 hasConcept C106301342 @default.
- W3106394209 hasConcept C121332964 @default.
- W3106394209 hasConcept C121864883 @default.
- W3106394209 hasConcept C126255220 @default.
- W3106394209 hasConcept C154945302 @default.
- W3106394209 hasConcept C163716315 @default.
- W3106394209 hasConcept C167981619 @default.
- W3106394209 hasConcept C171752962 @default.
- W3106394209 hasConcept C2776135515 @default.
- W3106394209 hasConcept C28826006 @default.
- W3106394209 hasConcept C33923547 @default.
- W3106394209 hasConcept C41008148 @default.
- W3106394209 hasConcept C62520636 @default.
- W3106394209 hasConcept C9679016 @default.
- W3106394209 hasConceptScore W3106394209C105795698 @default.
- W3106394209 hasConceptScore W3106394209C106301342 @default.
- W3106394209 hasConceptScore W3106394209C121332964 @default.
- W3106394209 hasConceptScore W3106394209C121864883 @default.
- W3106394209 hasConceptScore W3106394209C126255220 @default.
- W3106394209 hasConceptScore W3106394209C154945302 @default.
- W3106394209 hasConceptScore W3106394209C163716315 @default.
- W3106394209 hasConceptScore W3106394209C167981619 @default.
- W3106394209 hasConceptScore W3106394209C171752962 @default.
- W3106394209 hasConceptScore W3106394209C2776135515 @default.
- W3106394209 hasConceptScore W3106394209C28826006 @default.
- W3106394209 hasConceptScore W3106394209C33923547 @default.
- W3106394209 hasConceptScore W3106394209C41008148 @default.
- W3106394209 hasConceptScore W3106394209C62520636 @default.
- W3106394209 hasConceptScore W3106394209C9679016 @default.
- W3106394209 hasIssue "5" @default.
- W3106394209 hasLocation W31063942091 @default.
- W3106394209 hasLocation W31063942092 @default.
- W3106394209 hasLocation W31063942093 @default.
- W3106394209 hasLocation W31063942094 @default.
- W3106394209 hasLocation W31063942095 @default.
- W3106394209 hasOpenAccess W3106394209 @default.
- W3106394209 hasPrimaryLocation W31063942091 @default.
- W3106394209 hasRelatedWork W1577453590 @default.
- W3106394209 hasRelatedWork W2043702349 @default.
- W3106394209 hasRelatedWork W2060174126 @default.
- W3106394209 hasRelatedWork W2068375500 @default.
- W3106394209 hasRelatedWork W2788133688 @default.
- W3106394209 hasRelatedWork W2921407448 @default.
- W3106394209 hasRelatedWork W35419712 @default.
- W3106394209 hasRelatedWork W4292189767 @default.
- W3106394209 hasRelatedWork W4293875084 @default.
- W3106394209 hasRelatedWork W4375959289 @default.
- W3106394209 hasVolume "21" @default.
- W3106394209 isParatext "false" @default.
- W3106394209 isRetracted "false" @default.
- W3106394209 magId "3106394209" @default.
- W3106394209 workType "article" @default.