FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3208537105> ?p ?o ?g. }

• W3208537105 abstract "We study an approach to learning pruning masks by optimizing the expected loss of stochastic pruning masks, i.e., masks which zero out each weight independently with some weight-specific probability. We analyze the training dynamics of the induced stochastic predictor in the setting of linear regression, and observe a data-adaptive L1 regularization term, in contrast to the dataadaptive L2 regularization term known to underlie dropout in linear regression. We also observe a preference to prune weights that are less well-aligned with the data labels. We evaluate probabilistic fine-tuning for optimizing stochastic pruning masks for neural networks, starting from masks produced by several baselines. In each case, we see improvements in test error over baselines, even after we threshold fine-tuned stochastic pruning masks. Finally, since a stochastic pruning mask induces a stochastic neural network, we consider training the weights and/or pruning probabilities simultaneously to minimize a PAC-Bayes bound on generalization error. Using data-dependent priors, we obtain a selfbounded learning algorithm with strong performance and numerically tight bounds. In the linear model, we show that a PAC-Bayes generalization error bound is controlled by the magnitude of the change in feature alignment between the 'prior' and 'posterior' data." @default.
• W3208537105 created "2021-11-08" @default.
• W3208537105 creator A5021062973 @default.
• W3208537105 creator A5031304561 @default.
• W3208537105 creator A5089509060 @default.
• W3208537105 date "2021-10-22" @default.
• W3208537105 modified "2023-09-26" @default.
• W3208537105 title "Probabilistic fine-tuning of pruning masks and PAC-Bayes self-bounded learning." @default.
• W3208537105 cites W1845051632 @default.
• W3208537105 cites W1859987214 @default.
• W3208537105 cites W2014384147 @default.
• W3208537105 cites W2088101562 @default.
• W3208537105 cites W2095705004 @default.
• W3208537105 cites W2108810117 @default.
• W3208537105 cites W2112065930 @default.
• W3208537105 cites W2112796928 @default.
• W3208537105 cites W2114766824 @default.
• W3208537105 cites W2134273960 @default.
• W3208537105 cites W2152722485 @default.
• W3208537105 cites W2156150815 @default.
• W3208537105 cites W2466856990 @default.
• W3208537105 cites W2547875792 @default.
• W3208537105 cites W2548228487 @default.
• W3208537105 cites W2582745083 @default.
• W3208537105 cites W2587006126 @default.
• W3208537105 cites W2750384547 @default.
• W3208537105 cites W2764043458 @default.
• W3208537105 cites W2809090039 @default.
• W3208537105 cites W2915589364 @default.
• W3208537105 cites W2963247446 @default.
• W3208537105 cites W2963375484 @default.
• W3208537105 cites W2963433148 @default.
• W3208537105 cites W2963509076 @default.
• W3208537105 cites W2963813662 @default.
• W3208537105 cites W2963828549 @default.
• W3208537105 cites W2963862827 @default.
• W3208537105 cites W2964015990 @default.
• W3208537105 cites W2970638103 @default.
• W3208537105 cites W2995492258 @default.
• W3208537105 cites W2995816250 @default.
• W3208537105 cites W3015812362 @default.
• W3208537105 cites W3035081900 @default.
• W3208537105 cites W3036393886 @default.
• W3208537105 cites W3042900599 @default.
• W3208537105 cites W3099022131 @default.
• W3208537105 cites W3104951933 @default.
• W3208537105 cites W3105249545 @default.
• W3208537105 cites W3118608800 @default.
• W3208537105 cites W3120244898 @default.
• W3208537105 cites W3128136716 @default.
• W3208537105 cites W35527955 @default.
• W3208537105 cites W3034877463 @default.
• W3208537105 hasPublicationYear "2021" @default.
• W3208537105 type Work @default.
• W3208537105 sameAs 3208537105 @default.
• W3208537105 citedByCount "0" @default.
• W3208537105 crossrefType "posted-content" @default.
• W3208537105 hasAuthorship W3208537105A5021062973 @default.
• W3208537105 hasAuthorship W3208537105A5031304561 @default.
• W3208537105 hasAuthorship W3208537105A5089509060 @default.
• W3208537105 hasConcept C107673813 @default.
• W3208537105 hasConcept C108010975 @default.
• W3208537105 hasConcept C11413529 @default.
• W3208537105 hasConcept C119857082 @default.
• W3208537105 hasConcept C134306372 @default.
• W3208537105 hasConcept C138885662 @default.
• W3208537105 hasConcept C154945302 @default.
• W3208537105 hasConcept C177148314 @default.
• W3208537105 hasConcept C177769412 @default.
• W3208537105 hasConcept C207201462 @default.
• W3208537105 hasConcept C2776135515 @default.
• W3208537105 hasConcept C2776401178 @default.
• W3208537105 hasConcept C33923547 @default.
• W3208537105 hasConcept C41008148 @default.
• W3208537105 hasConcept C41895202 @default.
• W3208537105 hasConcept C49937458 @default.
• W3208537105 hasConcept C50644808 @default.
• W3208537105 hasConcept C6557445 @default.
• W3208537105 hasConcept C86803240 @default.
• W3208537105 hasConceptScore W3208537105C107673813 @default.
• W3208537105 hasConceptScore W3208537105C108010975 @default.
• W3208537105 hasConceptScore W3208537105C11413529 @default.
• W3208537105 hasConceptScore W3208537105C119857082 @default.
• W3208537105 hasConceptScore W3208537105C134306372 @default.
• W3208537105 hasConceptScore W3208537105C138885662 @default.
• W3208537105 hasConceptScore W3208537105C154945302 @default.
• W3208537105 hasConceptScore W3208537105C177148314 @default.
• W3208537105 hasConceptScore W3208537105C177769412 @default.
• W3208537105 hasConceptScore W3208537105C207201462 @default.
• W3208537105 hasConceptScore W3208537105C2776135515 @default.
• W3208537105 hasConceptScore W3208537105C2776401178 @default.
• W3208537105 hasConceptScore W3208537105C33923547 @default.
• W3208537105 hasConceptScore W3208537105C41008148 @default.
• W3208537105 hasConceptScore W3208537105C41895202 @default.
• W3208537105 hasConceptScore W3208537105C49937458 @default.
• W3208537105 hasConceptScore W3208537105C50644808 @default.
• W3208537105 hasConceptScore W3208537105C6557445 @default.
• W3208537105 hasConceptScore W3208537105C86803240 @default.
• W3208537105 hasLocation W32085371051 @default.
• W3208537105 hasOpenAccess W3208537105 @default.

• next