Matches in SemOpenAlex for { <https://semopenalex.org/work/W4310283072> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W4310283072 abstract "Secure multi-party computation (MPC) enables computation directly on encrypted data and protects both data and model privacy in deep learning inference. However, existing neural network architectures, including Vision Transformers (ViTs), are not designed or optimized for MPC and incur significant latency overhead. We observe Softmax accounts for the major latency bottleneck due to a high communication complexity, but can be selectively replaced or linearized without compromising the model accuracy. Hence, in this paper, we propose an MPC-friendly ViT, dubbed MPCViT, to enable accurate yet efficient ViT inference in MPC. Based on a systematic latency and accuracy evaluation of the Softmax attention and other attention variants, we propose a heterogeneous attention optimization space. We also develop a simple yet effective MPC-aware neural architecture search algorithm for fast Pareto optimization. To further boost the inference efficiency, we propose MPCViT+, to jointly optimize the Softmax attention and other network components, including GeLU, matrix multiplication, etc. With extensive experiments, we demonstrate that MPCViT achieves 1.9%, 1.3% and 3.6% higher accuracy with 6.2x, 2.9x and 1.9x latency reduction compared with baseline ViT, MPCFormer and THE-X on the Tiny-ImageNet dataset, respectively. MPCViT+ further achieves a better Pareto front compared with MPCViT. The code and models for evaluation are available at https://github.com/PKU-SEC-Lab/mpcvit." @default.
- W4310283072 created "2022-11-30" @default.
- W4310283072 creator A5002760019 @default.
- W4310283072 creator A5025944547 @default.
- W4310283072 creator A5035740553 @default.
- W4310283072 creator A5062886480 @default.
- W4310283072 creator A5084058792 @default.
- W4310283072 creator A5084065765 @default.
- W4310283072 creator A5087592842 @default.
- W4310283072 date "2022-11-25" @default.
- W4310283072 modified "2023-09-30" @default.
- W4310283072 title "MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention" @default.
- W4310283072 doi "https://doi.org/10.48550/arxiv.2211.13955" @default.
- W4310283072 hasPublicationYear "2022" @default.
- W4310283072 type Work @default.
- W4310283072 citedByCount "0" @default.
- W4310283072 crossrefType "posted-content" @default.
- W4310283072 hasAuthorship W4310283072A5002760019 @default.
- W4310283072 hasAuthorship W4310283072A5025944547 @default.
- W4310283072 hasAuthorship W4310283072A5035740553 @default.
- W4310283072 hasAuthorship W4310283072A5062886480 @default.
- W4310283072 hasAuthorship W4310283072A5084058792 @default.
- W4310283072 hasAuthorship W4310283072A5084065765 @default.
- W4310283072 hasAuthorship W4310283072A5087592842 @default.
- W4310283072 hasBestOaLocation W43102830721 @default.
- W4310283072 hasConcept C113775141 @default.
- W4310283072 hasConcept C11413529 @default.
- W4310283072 hasConcept C119599485 @default.
- W4310283072 hasConcept C119857082 @default.
- W4310283072 hasConcept C127413603 @default.
- W4310283072 hasConcept C149635348 @default.
- W4310283072 hasConcept C154945302 @default.
- W4310283072 hasConcept C165801399 @default.
- W4310283072 hasConcept C188441871 @default.
- W4310283072 hasConcept C2776214188 @default.
- W4310283072 hasConcept C2780513914 @default.
- W4310283072 hasConcept C41008148 @default.
- W4310283072 hasConcept C45374587 @default.
- W4310283072 hasConcept C50644808 @default.
- W4310283072 hasConcept C66322947 @default.
- W4310283072 hasConcept C76155785 @default.
- W4310283072 hasConcept C82876162 @default.
- W4310283072 hasConceptScore W4310283072C113775141 @default.
- W4310283072 hasConceptScore W4310283072C11413529 @default.
- W4310283072 hasConceptScore W4310283072C119599485 @default.
- W4310283072 hasConceptScore W4310283072C119857082 @default.
- W4310283072 hasConceptScore W4310283072C127413603 @default.
- W4310283072 hasConceptScore W4310283072C149635348 @default.
- W4310283072 hasConceptScore W4310283072C154945302 @default.
- W4310283072 hasConceptScore W4310283072C165801399 @default.
- W4310283072 hasConceptScore W4310283072C188441871 @default.
- W4310283072 hasConceptScore W4310283072C2776214188 @default.
- W4310283072 hasConceptScore W4310283072C2780513914 @default.
- W4310283072 hasConceptScore W4310283072C41008148 @default.
- W4310283072 hasConceptScore W4310283072C45374587 @default.
- W4310283072 hasConceptScore W4310283072C50644808 @default.
- W4310283072 hasConceptScore W4310283072C66322947 @default.
- W4310283072 hasConceptScore W4310283072C76155785 @default.
- W4310283072 hasConceptScore W4310283072C82876162 @default.
- W4310283072 hasLocation W43102830721 @default.
- W4310283072 hasOpenAccess W4310283072 @default.
- W4310283072 hasPrimaryLocation W43102830721 @default.
- W4310283072 hasRelatedWork W3146091044 @default.
- W4310283072 hasRelatedWork W3203166921 @default.
- W4310283072 hasRelatedWork W4211165872 @default.
- W4310283072 hasRelatedWork W4214588794 @default.
- W4310283072 hasRelatedWork W4283714288 @default.
- W4310283072 hasRelatedWork W4285327616 @default.
- W4310283072 hasRelatedWork W4287241953 @default.
- W4310283072 hasRelatedWork W4287748555 @default.
- W4310283072 hasRelatedWork W4295681619 @default.
- W4310283072 hasRelatedWork W4385574170 @default.
- W4310283072 isParatext "false" @default.
- W4310283072 isRetracted "false" @default.
- W4310283072 workType "article" @default.