Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100889249> ?p ?o ?g. }
- W3100889249 abstract "Gradient descent and backpropagation have enabled neural networks to achieve remarkable results in many real-world applications. Despite ongoing success, training a neural network with gradient descent can be a slow and strenuous affair. We present a simple yet faster training algorithm called Zeroth-Order Relaxed Backpropagation (ZORB). Instead of calculating gradients, ZORB uses the pseudoinverse of targets to backpropagate information. ZORB is designed to reduce the time required to train deep neural networks without penalizing performance. To illustrate the speed up, we trained a feed-forward neural network with 11 layers on MNIST and observed that ZORB converged 300 times faster than Adam while achieving a comparable error rate, without any hyperparameter tuning. We also broaden the scope of ZORB to convolutional neural networks, and apply it to subsamples of the CIFAR-10 dataset. Experiments on standard classification and regression benchmarks demonstrate ZORB's advantage over traditional backpropagation with Gradient Descent." @default.
- W3100889249 created "2020-11-23" @default.
- W3100889249 creator A5019039177 @default.
- W3100889249 creator A5042618723 @default.
- W3100889249 date "2020-11-17" @default.
- W3100889249 modified "2023-09-27" @default.
- W3100889249 title "ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks." @default.
- W3100889249 cites W1498436455 @default.
- W3100889249 cites W1522301498 @default.
- W3100889249 cites W1564268856 @default.
- W3100889249 cites W1780149461 @default.
- W3100889249 cites W1980287119 @default.
- W3100889249 cites W1997419185 @default.
- W3100889249 cites W2001619934 @default.
- W3100889249 cites W2007339694 @default.
- W3100889249 cites W2028759731 @default.
- W3100889249 cites W2034365297 @default.
- W3100889249 cites W2036256495 @default.
- W3100889249 cites W2096450582 @default.
- W3100889249 cites W2097998348 @default.
- W3100889249 cites W2121971770 @default.
- W3100889249 cites W2138061685 @default.
- W3100889249 cites W2146292423 @default.
- W3100889249 cites W2158533106 @default.
- W3100889249 cites W2159579247 @default.
- W3100889249 cites W2170166494 @default.
- W3100889249 cites W2472390602 @default.
- W3100889249 cites W2523246573 @default.
- W3100889249 cites W2598842133 @default.
- W3100889249 cites W2695777493 @default.
- W3100889249 cites W2786746258 @default.
- W3100889249 cites W2902230480 @default.
- W3100889249 cites W2949966795 @default.
- W3100889249 cites W2963403868 @default.
- W3100889249 cites W2979800795 @default.
- W3100889249 cites W2980692935 @default.
- W3100889249 cites W3048000637 @default.
- W3100889249 cites W3118608800 @default.
- W3100889249 hasPublicationYear "2020" @default.
- W3100889249 type Work @default.
- W3100889249 sameAs 3100889249 @default.
- W3100889249 citedByCount "0" @default.
- W3100889249 crossrefType "posted-content" @default.
- W3100889249 hasAuthorship W3100889249A5019039177 @default.
- W3100889249 hasAuthorship W3100889249A5042618723 @default.
- W3100889249 hasConcept C108583219 @default.
- W3100889249 hasConcept C11413529 @default.
- W3100889249 hasConcept C153258448 @default.
- W3100889249 hasConcept C154945302 @default.
- W3100889249 hasConcept C155032097 @default.
- W3100889249 hasConcept C175202392 @default.
- W3100889249 hasConcept C177973122 @default.
- W3100889249 hasConcept C190502265 @default.
- W3100889249 hasConcept C207467116 @default.
- W3100889249 hasConcept C21556879 @default.
- W3100889249 hasConcept C2524010 @default.
- W3100889249 hasConcept C33923547 @default.
- W3100889249 hasConcept C41008148 @default.
- W3100889249 hasConcept C47702885 @default.
- W3100889249 hasConcept C50644808 @default.
- W3100889249 hasConcept C81363708 @default.
- W3100889249 hasConcept C8642999 @default.
- W3100889249 hasConcept C98359873 @default.
- W3100889249 hasConceptScore W3100889249C108583219 @default.
- W3100889249 hasConceptScore W3100889249C11413529 @default.
- W3100889249 hasConceptScore W3100889249C153258448 @default.
- W3100889249 hasConceptScore W3100889249C154945302 @default.
- W3100889249 hasConceptScore W3100889249C155032097 @default.
- W3100889249 hasConceptScore W3100889249C175202392 @default.
- W3100889249 hasConceptScore W3100889249C177973122 @default.
- W3100889249 hasConceptScore W3100889249C190502265 @default.
- W3100889249 hasConceptScore W3100889249C207467116 @default.
- W3100889249 hasConceptScore W3100889249C21556879 @default.
- W3100889249 hasConceptScore W3100889249C2524010 @default.
- W3100889249 hasConceptScore W3100889249C33923547 @default.
- W3100889249 hasConceptScore W3100889249C41008148 @default.
- W3100889249 hasConceptScore W3100889249C47702885 @default.
- W3100889249 hasConceptScore W3100889249C50644808 @default.
- W3100889249 hasConceptScore W3100889249C81363708 @default.
- W3100889249 hasConceptScore W3100889249C8642999 @default.
- W3100889249 hasConceptScore W3100889249C98359873 @default.
- W3100889249 hasLocation W31008892491 @default.
- W3100889249 hasOpenAccess W3100889249 @default.
- W3100889249 hasPrimaryLocation W31008892491 @default.
- W3100889249 hasRelatedWork W1522075255 @default.
- W3100889249 hasRelatedWork W1550843670 @default.
- W3100889249 hasRelatedWork W1592104656 @default.
- W3100889249 hasRelatedWork W1863807633 @default.
- W3100889249 hasRelatedWork W1973966843 @default.
- W3100889249 hasRelatedWork W2088845016 @default.
- W3100889249 hasRelatedWork W2112594540 @default.
- W3100889249 hasRelatedWork W2114370465 @default.
- W3100889249 hasRelatedWork W2128712546 @default.
- W3100889249 hasRelatedWork W2149532957 @default.
- W3100889249 hasRelatedWork W2169923338 @default.
- W3100889249 hasRelatedWork W2501046637 @default.
- W3100889249 hasRelatedWork W2599464331 @default.
- W3100889249 hasRelatedWork W2886907189 @default.
- W3100889249 hasRelatedWork W2896628485 @default.
- W3100889249 hasRelatedWork W2900628392 @default.