FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2995427991> ?p ?o ?g. }

• W2995427991 abstract "We present Rotated Adaptive Tetra-iterated Quantizer (RATQ), a fixed-length quantizer for gradients in first order stochastic optimization. RATQ is easy to implement and involves only a Hadamard transform computation and adaptive uniform quantization with appropriately chosen dynamic ranges. For noisy gradients with almost surely bounded Euclidean norms, we establish an information theoretic lower bound for optimization accuracy using finite precision gradients and show that RATQ almost attains this lower bound. For mean square bounded noisy gradients, we use a gain-shape quantizer which separately quantizes the Euclidean norm and uses RATQ to quantize the normalized unit norm vector. We establish lower bounds for performance of any optimization procedure and shape quantizer, when used with a uniform gain quantizer. Finally, we propose an adaptive quantizer for gain which when used with RATQ for shape quantizer outperforms uniform gain quantization and is, in fact, close to optimal. As a by-product, we show that our fixed-length quantizer RATQ has almost the same performance as the optimal variable-length quantizers for distributed mean estimation. Also, we obtain an efficient quantizer for Gaussian vectors which attains a rate very close to the Gaussian rate-distortion function and is, in fact, universal for subgaussian input vectors." @default.
• W2995427991 created "2019-12-26" @default.
• W2995427991 creator A5005804593 @default.
• W2995427991 creator A5077741905 @default.
• W2995427991 date "2019-08-22" @default.
• W2995427991 modified "2023-09-25" @default.
• W2995427991 title "RATQ: A Universal Fixed-Length Quantizer for Stochastic Optimization" @default.
• W2995427991 cites W1505731132 @default.
• W2995427991 cites W1626317705 @default.
• W2995427991 cites W1634005169 @default.
• W2995427991 cites W1982924149 @default.
• W2995427991 cites W1987728542 @default.
• W2995427991 cites W1994616650 @default.
• W2995427991 cites W2023530046 @default.
• W2995427991 cites W2096840748 @default.
• W2995427991 cites W2098936473 @default.
• W2995427991 cites W2108226783 @default.
• W2995427991 cites W2116595504 @default.
• W2995427991 cites W2122678453 @default.
• W2995427991 cites W2126606574 @default.
• W2995427991 cites W2130422479 @default.
• W2995427991 cites W2134887275 @default.
• W2995427991 cites W2138577627 @default.
• W2995427991 cites W2140752095 @default.
• W2995427991 cites W2142901448 @default.
• W2995427991 cites W2152402969 @default.
• W2995427991 cites W2156254348 @default.
• W2995427991 cites W2162576315 @default.
• W2995427991 cites W2164184339 @default.
• W2995427991 cites W2165750745 @default.
• W2995427991 cites W2172272342 @default.
• W2995427991 cites W2516186024 @default.
• W2995427991 cites W2535838896 @default.
• W2995427991 cites W2547352193 @default.
• W2995427991 cites W2769644379 @default.
• W2995427991 cites W2886974017 @default.
• W2995427991 cites W2890924858 @default.
• W2995427991 cites W2907436114 @default.
• W2995427991 cites W2923133561 @default.
• W2995427991 cites W2946277198 @default.
• W2995427991 cites W2948092338 @default.
• W2995427991 cites W2950826569 @default.
• W2995427991 cites W2951232050 @default.
• W2995427991 cites W2953732516 @default.
• W2995427991 cites W2963189173 @default.
• W2995427991 cites W2963326510 @default.
• W2995427991 cites W2963374099 @default.
• W2995427991 cites W2963422939 @default.
• W2995427991 cites W2963473808 @default.
• W2995427991 cites W2964004663 @default.
• W2995427991 cites W2964181194 @default.
• W2995427991 cites W2964267428 @default.
• W2995427991 cites W2968267155 @default.
• W2995427991 cites W2989787172 @default.
• W2995427991 cites W3020944613 @default.
• W2995427991 cites W3141595720 @default.
• W2995427991 cites W3215641518 @default.
• W2995427991 cites W401986301 @default.
• W2995427991 cites W568673721 @default.
• W2995427991 cites W87339831 @default.
• W2995427991 cites W2963587506 @default.
• W2995427991 hasPublicationYear "2019" @default.
• W2995427991 type Work @default.
• W2995427991 sameAs 2995427991 @default.
• W2995427991 citedByCount "2" @default.
• W2995427991 countsByYear W29954279912019 @default.
• W2995427991 countsByYear W29954279912020 @default.
• W2995427991 crossrefType "posted-content" @default.
• W2995427991 hasAuthorship W2995427991A5005804593 @default.
• W2995427991 hasAuthorship W2995427991A5077741905 @default.
• W2995427991 hasConcept C11413529 @default.
• W2995427991 hasConcept C120174047 @default.
• W2995427991 hasConcept C121332964 @default.
• W2995427991 hasConcept C126255220 @default.
• W2995427991 hasConcept C134306372 @default.
• W2995427991 hasConcept C140479938 @default.
• W2995427991 hasConcept C163716315 @default.
• W2995427991 hasConcept C17744445 @default.
• W2995427991 hasConcept C191795146 @default.
• W2995427991 hasConcept C199539241 @default.
• W2995427991 hasConcept C2524010 @default.
• W2995427991 hasConcept C28826006 @default.
• W2995427991 hasConcept C28855332 @default.
• W2995427991 hasConcept C33923547 @default.
• W2995427991 hasConcept C34388435 @default.
• W2995427991 hasConcept C62520636 @default.
• W2995427991 hasConcept C64185310 @default.
• W2995427991 hasConcept C77553402 @default.
• W2995427991 hasConcept C78548338 @default.
• W2995427991 hasConceptScore W2995427991C11413529 @default.
• W2995427991 hasConceptScore W2995427991C120174047 @default.
• W2995427991 hasConceptScore W2995427991C121332964 @default.
• W2995427991 hasConceptScore W2995427991C126255220 @default.
• W2995427991 hasConceptScore W2995427991C134306372 @default.
• W2995427991 hasConceptScore W2995427991C140479938 @default.
• W2995427991 hasConceptScore W2995427991C163716315 @default.
• W2995427991 hasConceptScore W2995427991C17744445 @default.
• W2995427991 hasConceptScore W2995427991C191795146 @default.
• W2995427991 hasConceptScore W2995427991C199539241 @default.
• W2995427991 hasConceptScore W2995427991C2524010 @default.

• next