Matches in SemOpenAlex for { <https://semopenalex.org/work/W3168156488> ?p ?o ?g. }
- W3168156488 endingPage "5487" @default.
- W3168156488 startingPage "5472" @default.
- W3168156488 abstract "Eigendecomposition of symmetric matrices is at the heart of many computer vision algorithms. However, the derivatives of the eigenvectors tend to be numerically unstable, whether using the SVD to compute them analytically or using the Power Iteration (PI) method to approximate them. This instability arises in the presence of eigenvalues that are close to each other. This makes integrating eigendecomposition into deep networks difficult and often results in poor convergence, particularly when dealing with large matrices. While this can be mitigated by partitioning the data into small arbitrary groups, doing so has no theoretical basis and makes it impossible to exploit the full power of eigendecomposition. In previous work, we mitigated this using SVD during the forward pass and PI to compute the gradients during the backward pass. However, the iterative deflation procedure required to compute multiple eigenvectors using PI tends to accumulate errors and yield inaccurate gradients. Here, we show that the Taylor expansion of the SVD gradient is theoretically equivalent to the gradient obtained using PI without relying in practice on an iterative process and thus yields more accurate gradients. We demonstrate the benefits of this increased accuracy for image classification and style transfer." @default.
- W3168156488 created "2021-06-22" @default.
- W3168156488 creator A5005859555 @default.
- W3168156488 creator A5038674741 @default.
- W3168156488 creator A5046597133 @default.
- W3168156488 creator A5049300388 @default.
- W3168156488 creator A5072751878 @default.
- W3168156488 date "2022-09-01" @default.
- W3168156488 modified "2023-10-01" @default.
- W3168156488 title "Robust Differentiable SVD" @default.
- W3168156488 cites W1600402929 @default.
- W3168156488 cites W1975461372 @default.
- W3168156488 cites W1991544872 @default.
- W3168156488 cites W2059076129 @default.
- W3168156488 cites W2068300001 @default.
- W3168156488 cites W2068704041 @default.
- W3168156488 cites W2104657103 @default.
- W3168156488 cites W2117539524 @default.
- W3168156488 cites W2136505671 @default.
- W3168156488 cites W2137234026 @default.
- W3168156488 cites W2183341477 @default.
- W3168156488 cites W2188333210 @default.
- W3168156488 cites W2194775991 @default.
- W3168156488 cites W2204257188 @default.
- W3168156488 cites W2475287302 @default.
- W3168156488 cites W2592533706 @default.
- W3168156488 cites W2593414223 @default.
- W3168156488 cites W2601789736 @default.
- W3168156488 cites W2603777577 @default.
- W3168156488 cites W2604737827 @default.
- W3168156488 cites W2752965000 @default.
- W3168156488 cites W2799132636 @default.
- W3168156488 cites W2909593838 @default.
- W3168156488 cites W2962692288 @default.
- W3168156488 cites W2962761264 @default.
- W3168156488 cites W2962793481 @default.
- W3168156488 cites W2963072534 @default.
- W3168156488 cites W2963674285 @default.
- W3168156488 cites W2963743626 @default.
- W3168156488 cites W2963890275 @default.
- W3168156488 cites W2964350570 @default.
- W3168156488 cites W2979475574 @default.
- W3168156488 cites W2979800489 @default.
- W3168156488 cites W2981488580 @default.
- W3168156488 cites W2982975881 @default.
- W3168156488 cites W2996781180 @default.
- W3168156488 cites W3034692948 @default.
- W3168156488 cites W3159890710 @default.
- W3168156488 cites W4245755434 @default.
- W3168156488 cites W78159342 @default.
- W3168156488 doi "https://doi.org/10.1109/tpami.2021.3072422" @default.
- W3168156488 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/33844626" @default.
- W3168156488 hasPublicationYear "2022" @default.
- W3168156488 type Work @default.
- W3168156488 sameAs 3168156488 @default.
- W3168156488 citedByCount "10" @default.
- W3168156488 countsByYear W31681564882021 @default.
- W3168156488 countsByYear W31681564882022 @default.
- W3168156488 countsByYear W31681564882023 @default.
- W3168156488 crossrefType "journal-article" @default.
- W3168156488 hasAuthorship W3168156488A5005859555 @default.
- W3168156488 hasAuthorship W3168156488A5038674741 @default.
- W3168156488 hasAuthorship W3168156488A5046597133 @default.
- W3168156488 hasAuthorship W3168156488A5049300388 @default.
- W3168156488 hasAuthorship W3168156488A5072751878 @default.
- W3168156488 hasBestOaLocation W31681564882 @default.
- W3168156488 hasConcept C11413529 @default.
- W3168156488 hasConcept C121332964 @default.
- W3168156488 hasConcept C134306372 @default.
- W3168156488 hasConcept C158693339 @default.
- W3168156488 hasConcept C159694833 @default.
- W3168156488 hasConcept C162324750 @default.
- W3168156488 hasConcept C162443888 @default.
- W3168156488 hasConcept C169756996 @default.
- W3168156488 hasConcept C202615002 @default.
- W3168156488 hasConcept C22789450 @default.
- W3168156488 hasConcept C2777303404 @default.
- W3168156488 hasConcept C28826006 @default.
- W3168156488 hasConcept C33923547 @default.
- W3168156488 hasConcept C41008148 @default.
- W3168156488 hasConcept C50522688 @default.
- W3168156488 hasConcept C62520636 @default.
- W3168156488 hasConceptScore W3168156488C11413529 @default.
- W3168156488 hasConceptScore W3168156488C121332964 @default.
- W3168156488 hasConceptScore W3168156488C134306372 @default.
- W3168156488 hasConceptScore W3168156488C158693339 @default.
- W3168156488 hasConceptScore W3168156488C159694833 @default.
- W3168156488 hasConceptScore W3168156488C162324750 @default.
- W3168156488 hasConceptScore W3168156488C162443888 @default.
- W3168156488 hasConceptScore W3168156488C169756996 @default.
- W3168156488 hasConceptScore W3168156488C202615002 @default.
- W3168156488 hasConceptScore W3168156488C22789450 @default.
- W3168156488 hasConceptScore W3168156488C2777303404 @default.
- W3168156488 hasConceptScore W3168156488C28826006 @default.
- W3168156488 hasConceptScore W3168156488C33923547 @default.
- W3168156488 hasConceptScore W3168156488C41008148 @default.
- W3168156488 hasConceptScore W3168156488C50522688 @default.
- W3168156488 hasConceptScore W3168156488C62520636 @default.