Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287067343> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4287067343 abstract "Privacy concerns in client-server machine learning have given rise to private inference (PI), where neural inference occurs directly on encrypted inputs. PI protects clients' personal data and the server's intellectual property. A common practice in PI is to use garbled circuits to compute nonlinear functions privately, namely ReLUs. However, garbled circuits suffer from high storage, bandwidth, and latency costs. To mitigate these issues, PI-friendly polynomial activation functions have been employed to replace ReLU. In this work, we ask: Is it feasible to substitute all ReLUs with low-degree polynomial activation functions for building deep, privacy-friendly neural networks? We explore this question by analyzing the challenges of substituting ReLUs with polynomials, starting with simple drop-and-replace solutions to novel, more involved replace-and-retrain strategies. We examine the limitations of each method and provide commentary on the use of polynomial activation functions for PI. We find all evaluated solutions suffer from the escaping activation problem: forward activation values inevitably begin to expand at an exponential rate away from stable regions of the polynomials, which leads to exploding values (NaNs) or poor approximations." @default.
- W4287067343 created "2022-07-25" @default.
- W4287067343 creator A5032975353 @default.
- W4287067343 creator A5087218901 @default.
- W4287067343 creator A5089173037 @default.
- W4287067343 date "2021-07-26" @default.
- W4287067343 modified "2023-09-26" @default.
- W4287067343 title "Sisyphus: A Cautionary Tale of Using Low-Degree Polynomial Activations in Privacy-Preserving Deep Learning" @default.
- W4287067343 doi "https://doi.org/10.48550/arxiv.2107.12342" @default.
- W4287067343 hasPublicationYear "2021" @default.
- W4287067343 type Work @default.
- W4287067343 citedByCount "0" @default.
- W4287067343 crossrefType "posted-content" @default.
- W4287067343 hasAuthorship W4287067343A5032975353 @default.
- W4287067343 hasAuthorship W4287067343A5087218901 @default.
- W4287067343 hasAuthorship W4287067343A5089173037 @default.
- W4287067343 hasBestOaLocation W42870673431 @default.
- W4287067343 hasConcept C118615104 @default.
- W4287067343 hasConcept C134306372 @default.
- W4287067343 hasConcept C148730421 @default.
- W4287067343 hasConcept C151376022 @default.
- W4287067343 hasConcept C154945302 @default.
- W4287067343 hasConcept C158338273 @default.
- W4287067343 hasConcept C2776214188 @default.
- W4287067343 hasConcept C2984842247 @default.
- W4287067343 hasConcept C33923547 @default.
- W4287067343 hasConcept C38652104 @default.
- W4287067343 hasConcept C41008148 @default.
- W4287067343 hasConcept C50644808 @default.
- W4287067343 hasConcept C76155785 @default.
- W4287067343 hasConcept C80444323 @default.
- W4287067343 hasConcept C82876162 @default.
- W4287067343 hasConcept C90119067 @default.
- W4287067343 hasConceptScore W4287067343C118615104 @default.
- W4287067343 hasConceptScore W4287067343C134306372 @default.
- W4287067343 hasConceptScore W4287067343C148730421 @default.
- W4287067343 hasConceptScore W4287067343C151376022 @default.
- W4287067343 hasConceptScore W4287067343C154945302 @default.
- W4287067343 hasConceptScore W4287067343C158338273 @default.
- W4287067343 hasConceptScore W4287067343C2776214188 @default.
- W4287067343 hasConceptScore W4287067343C2984842247 @default.
- W4287067343 hasConceptScore W4287067343C33923547 @default.
- W4287067343 hasConceptScore W4287067343C38652104 @default.
- W4287067343 hasConceptScore W4287067343C41008148 @default.
- W4287067343 hasConceptScore W4287067343C50644808 @default.
- W4287067343 hasConceptScore W4287067343C76155785 @default.
- W4287067343 hasConceptScore W4287067343C80444323 @default.
- W4287067343 hasConceptScore W4287067343C82876162 @default.
- W4287067343 hasConceptScore W4287067343C90119067 @default.
- W4287067343 hasLocation W42870673431 @default.
- W4287067343 hasOpenAccess W4287067343 @default.
- W4287067343 hasPrimaryLocation W42870673431 @default.
- W4287067343 hasRelatedWork W2340393497 @default.
- W4287067343 hasRelatedWork W2471310969 @default.
- W4287067343 hasRelatedWork W2906483705 @default.
- W4287067343 hasRelatedWork W2952826183 @default.
- W4287067343 hasRelatedWork W2963369796 @default.
- W4287067343 hasRelatedWork W2966649771 @default.
- W4287067343 hasRelatedWork W3008625068 @default.
- W4287067343 hasRelatedWork W3042419602 @default.
- W4287067343 hasRelatedWork W4308654840 @default.
- W4287067343 hasRelatedWork W4312617295 @default.
- W4287067343 isParatext "false" @default.
- W4287067343 isRetracted "false" @default.
- W4287067343 workType "article" @default.