Matches in SemOpenAlex for { <https://semopenalex.org/work/W3092083334> ?p ?o ?g. }
- W3092083334 abstract "Computing derivatives of tensor expressions, also known as tensor calculus, is a fundamental task in machine learning. key concern is the efficiency of evaluating the expressions and their derivatives that hinges on the representation of these expressions. Recently, an algorithm for computing higher order derivatives of tensor expressions like Jacobians or Hessians has been introduced that is a few orders of magnitude faster than previous state-of-the-art approaches. Unfortunately, the approach is based on Ricci notation and hence cannot be incorporated into automatic differentiation frameworks from deep learning like TensorFlow, PyTorch, autograd, or JAX that use the simpler Einstein notation. This leaves two options, to either change the underlying tensor representation in these frameworks or to develop a new, provably correct algorithm based on Einstein notation. Obviously, the first option is impractical. Hence, we pursue the second option. Here, we show that using Ricci notation is not necessary for an efficient tensor calculus and develop an equally efficient method for the simpler Einstein notation. It turns out that turning to Einstein notation enables further improvements that lead to even better efficiency. The methods that are described in this paper have been implemented in the online tool this http URL for computing derivatives of matrix and tensor expressions. An extended abstract of this paper appeared as A Simple and Efficient Tensor Calculus, AAAI 2020." @default.
- W3092083334 created "2020-10-15" @default.
- W3092083334 creator A5027313464 @default.
- W3092083334 creator A5043832270 @default.
- W3092083334 creator A5091320755 @default.
- W3092083334 date "2020-10-07" @default.
- W3092083334 modified "2023-09-27" @default.
- W3092083334 title "A Simple and Efficient Tensor Calculus for Machine Learning" @default.
- W3092083334 cites W1448623749 @default.
- W3092083334 cites W1498436455 @default.
- W3092083334 cites W1569098853 @default.
- W3092083334 cites W1585773866 @default.
- W3092083334 cites W1612003148 @default.
- W3092083334 cites W1746819321 @default.
- W3092083334 cites W1880262756 @default.
- W3092083334 cites W188376461 @default.
- W3092083334 cites W1950330800 @default.
- W3092083334 cites W1983864872 @default.
- W3092083334 cites W2006903949 @default.
- W3092083334 cites W2031070741 @default.
- W3092083334 cites W2045126306 @default.
- W3092083334 cites W2054141820 @default.
- W3092083334 cites W2087169336 @default.
- W3092083334 cites W2119821739 @default.
- W3092083334 cites W2119946195 @default.
- W3092083334 cites W2133400152 @default.
- W3092083334 cites W2135046866 @default.
- W3092083334 cites W2136922672 @default.
- W3092083334 cites W2144902422 @default.
- W3092083334 cites W2464234964 @default.
- W3092083334 cites W2589859332 @default.
- W3092083334 cites W2786320458 @default.
- W3092083334 cites W2797638056 @default.
- W3092083334 cites W2890411254 @default.
- W3092083334 cites W2890506771 @default.
- W3092083334 cites W2891673498 @default.
- W3092083334 cites W2891885685 @default.
- W3092083334 cites W2899771611 @default.
- W3092083334 cites W2899971035 @default.
- W3092083334 cites W2903224116 @default.
- W3092083334 cites W2903950532 @default.
- W3092083334 cites W2912713668 @default.
- W3092083334 cites W2929122190 @default.
- W3092083334 cites W2953384591 @default.
- W3092083334 cites W2962695963 @default.
- W3092083334 cites W2962727772 @default.
- W3092083334 cites W2964346549 @default.
- W3092083334 cites W2996865504 @default.
- W3092083334 cites W3029427430 @default.
- W3092083334 cites W3035490956 @default.
- W3092083334 cites W3037501888 @default.
- W3092083334 cites W83961856 @default.
- W3092083334 cites W94523489 @default.
- W3092083334 hasPublicationYear "2020" @default.
- W3092083334 type Work @default.
- W3092083334 sameAs 3092083334 @default.
- W3092083334 citedByCount "0" @default.
- W3092083334 crossrefType "posted-content" @default.
- W3092083334 hasAuthorship W3092083334A5027313464 @default.
- W3092083334 hasAuthorship W3092083334A5043832270 @default.
- W3092083334 hasAuthorship W3092083334A5091320755 @default.
- W3092083334 hasConcept C100376341 @default.
- W3092083334 hasConcept C111472728 @default.
- W3092083334 hasConcept C124007464 @default.
- W3092083334 hasConcept C136119220 @default.
- W3092083334 hasConcept C138885662 @default.
- W3092083334 hasConcept C14440778 @default.
- W3092083334 hasConcept C146846114 @default.
- W3092083334 hasConcept C154945302 @default.
- W3092083334 hasConcept C155281189 @default.
- W3092083334 hasConcept C1680195 @default.
- W3092083334 hasConcept C17744445 @default.
- W3092083334 hasConcept C183517385 @default.
- W3092083334 hasConcept C195065555 @default.
- W3092083334 hasConcept C199539241 @default.
- W3092083334 hasConcept C202444582 @default.
- W3092083334 hasConcept C2524010 @default.
- W3092083334 hasConcept C2776359362 @default.
- W3092083334 hasConcept C2780586882 @default.
- W3092083334 hasConcept C33923547 @default.
- W3092083334 hasConcept C37914503 @default.
- W3092083334 hasConcept C41008148 @default.
- W3092083334 hasConcept C45357846 @default.
- W3092083334 hasConcept C51255310 @default.
- W3092083334 hasConcept C80444323 @default.
- W3092083334 hasConcept C81999800 @default.
- W3092083334 hasConcept C94375191 @default.
- W3092083334 hasConcept C94625758 @default.
- W3092083334 hasConceptScore W3092083334C100376341 @default.
- W3092083334 hasConceptScore W3092083334C111472728 @default.
- W3092083334 hasConceptScore W3092083334C124007464 @default.
- W3092083334 hasConceptScore W3092083334C136119220 @default.
- W3092083334 hasConceptScore W3092083334C138885662 @default.
- W3092083334 hasConceptScore W3092083334C14440778 @default.
- W3092083334 hasConceptScore W3092083334C146846114 @default.
- W3092083334 hasConceptScore W3092083334C154945302 @default.
- W3092083334 hasConceptScore W3092083334C155281189 @default.
- W3092083334 hasConceptScore W3092083334C1680195 @default.
- W3092083334 hasConceptScore W3092083334C17744445 @default.
- W3092083334 hasConceptScore W3092083334C183517385 @default.