FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3172581125> ?p ?o ?g. }

• W3172581125 abstract "Thanks to the combination of state-of-the-art accelerators and highly optimized open software frameworks, there has been tremendous progress in the performance of deep neural networks. While these developments have been responsible for many breakthroughs, progress towards solving large-scale problems, such as video encoding and semantic segmentation in 3D, is hampered because access to on-premise memory is often limited. Instead of relying on (optimal) checkpointing or invertibility of the network layers -- to recover the activations during backpropagation -- we propose to approximate the gradient of convolutional layers in neural networks with a multi-channel randomized trace estimation technique. Compared to other methods, this approach is simple, amenable to analyses, and leads to a greatly reduced memory footprint. Even though the randomized trace estimation introduces stochasticity during training, we argue that this is of little consequence as long as the induced errors are of the same order as errors in the gradient due to the use of stochastic gradient descent. We discuss the performance of networks trained with stochastic backpropagation and how the error can be controlled while maximizing memory usage and minimizing computational overhead." @default.
• W3172581125 created "2021-06-22" @default.
• W3172581125 creator A5010780250 @default.
• W3172581125 creator A5044553315 @default.
• W3172581125 creator A5046677578 @default.
• W3172581125 creator A5065362776 @default.
• W3172581125 date "2021-06-13" @default.
• W3172581125 modified "2023-09-27" @default.
• W3172581125 title "Low-memory stochastic backpropagation with multi-channel randomized trace estimation." @default.
• W3172581125 cites W1530262073 @default.
• W3172581125 cites W1667652561 @default.
• W3172581125 cites W1967134278 @default.
• W3172581125 cites W1968097571 @default.
• W3172581125 cites W1990457366 @default.
• W3172581125 cites W2057450058 @default.
• W3172581125 cites W2103869034 @default.
• W3172581125 cites W2120575449 @default.
• W3172581125 cites W2165991720 @default.
• W3172581125 cites W2194775991 @default.
• W3172581125 cites W2263490141 @default.
• W3172581125 cites W2279098554 @default.
• W3172581125 cites W2595142274 @default.
• W3172581125 cites W2762578791 @default.
• W3172581125 cites W2787248994 @default.
• W3172581125 cites W2801128564 @default.
• W3172581125 cites W2908666743 @default.
• W3172581125 cites W2911586496 @default.
• W3172581125 cites W2962949867 @default.
• W3172581125 cites W2963374099 @default.
• W3172581125 cites W2964115671 @default.
• W3172581125 cites W2964121744 @default.
• W3172581125 cites W2964361301 @default.
• W3172581125 cites W2967176361 @default.
• W3172581125 cites W2970028551 @default.
• W3172581125 cites W2970971581 @default.
• W3172581125 cites W2982185430 @default.
• W3172581125 cites W2990896553 @default.
• W3172581125 cites W3011442353 @default.
• W3172581125 cites W3027452332 @default.
• W3172581125 cites W3098011980 @default.
• W3172581125 cites W3108353645 @default.
• W3172581125 cites W3121174466 @default.
• W3172581125 cites W3125905771 @default.
• W3172581125 cites W3141126219 @default.
• W3172581125 cites W3178106795 @default.
• W3172581125 hasPublicationYear "2021" @default.
• W3172581125 type Work @default.
• W3172581125 sameAs 3172581125 @default.
• W3172581125 citedByCount "0" @default.
• W3172581125 crossrefType "posted-content" @default.
• W3172581125 hasAuthorship W3172581125A5010780250 @default.
• W3172581125 hasAuthorship W3172581125A5044553315 @default.
• W3172581125 hasAuthorship W3172581125A5046677578 @default.
• W3172581125 hasAuthorship W3172581125A5065362776 @default.
• W3172581125 hasConcept C111919701 @default.
• W3172581125 hasConcept C119857082 @default.
• W3172581125 hasConcept C138885662 @default.
• W3172581125 hasConcept C154945302 @default.
• W3172581125 hasConcept C155032097 @default.
• W3172581125 hasConcept C206688291 @default.
• W3172581125 hasConcept C2779960059 @default.
• W3172581125 hasConcept C41008148 @default.
• W3172581125 hasConcept C41895202 @default.
• W3172581125 hasConcept C50644808 @default.
• W3172581125 hasConcept C74912251 @default.
• W3172581125 hasConcept C75291252 @default.
• W3172581125 hasConcept C81363708 @default.
• W3172581125 hasConceptScore W3172581125C111919701 @default.
• W3172581125 hasConceptScore W3172581125C119857082 @default.
• W3172581125 hasConceptScore W3172581125C138885662 @default.
• W3172581125 hasConceptScore W3172581125C154945302 @default.
• W3172581125 hasConceptScore W3172581125C155032097 @default.
• W3172581125 hasConceptScore W3172581125C206688291 @default.
• W3172581125 hasConceptScore W3172581125C2779960059 @default.
• W3172581125 hasConceptScore W3172581125C41008148 @default.
• W3172581125 hasConceptScore W3172581125C41895202 @default.
• W3172581125 hasConceptScore W3172581125C50644808 @default.
• W3172581125 hasConceptScore W3172581125C74912251 @default.
• W3172581125 hasConceptScore W3172581125C75291252 @default.
• W3172581125 hasConceptScore W3172581125C81363708 @default.
• W3172581125 hasLocation W31725811251 @default.
• W3172581125 hasOpenAccess W3172581125 @default.
• W3172581125 hasPrimaryLocation W31725811251 @default.
• W3172581125 hasRelatedWork W2616086569 @default.
• W3172581125 hasRelatedWork W2617019596 @default.
• W3172581125 hasRelatedWork W2795127895 @default.
• W3172581125 hasRelatedWork W2798849118 @default.
• W3172581125 hasRelatedWork W2903679594 @default.
• W3172581125 hasRelatedWork W2912440723 @default.
• W3172581125 hasRelatedWork W2913618604 @default.
• W3172581125 hasRelatedWork W2917767146 @default.
• W3172581125 hasRelatedWork W2919853922 @default.
• W3172581125 hasRelatedWork W2962710991 @default.
• W3172581125 hasRelatedWork W2963374099 @default.
• W3172581125 hasRelatedWork W2970294425 @default.
• W3172581125 hasRelatedWork W2971653326 @default.
• W3172581125 hasRelatedWork W2990315703 @default.
• W3172581125 hasRelatedWork W2998981231 @default.
• W3172581125 hasRelatedWork W3058788517 @default.
• W3172581125 hasRelatedWork W3115260384 @default.

• next