Matches in SemOpenAlex for { <https://semopenalex.org/work/W3153834700> ?p ?o ?g. }
- W3153834700 abstract "When trying to apply the recent advance of Natural Language Understanding (NLU) technologies to real-world applications, privacy preservation imposes a crucial challenge, which, unfortunately, has not been well resolved. To address this issue, we study how to improve the effectiveness of NLU models under a Local Privacy setting, using BERT, a widely-used pretrained Language Model (LM), as an example. We systematically study the strengths and weaknesses of imposing dx-privacy, a relaxed variant of Local Differential Privacy, at different stages of language modeling: input text, token embeddings, and sequence representations. We then focus on the former two with privacy-constrained fine-tuning experiments to reveal the utility of BERT under local privacy constraints. More importantly, to the best of our knowledge, we are the first to propose privacy-adaptive LM pretraining methods and demonstrate that they can significantly improve model performance on privatized text input. We also interpret the level of privacy preservation and provide our guidance on privacy parameter selections." @default.
- W3153834700 created "2021-04-26" @default.
- W3153834700 creator A5002453567 @default.
- W3153834700 creator A5021205962 @default.
- W3153834700 creator A5032248436 @default.
- W3153834700 creator A5037200145 @default.
- W3153834700 creator A5071466474 @default.
- W3153834700 creator A5071923786 @default.
- W3153834700 date "2021-04-15" @default.
- W3153834700 modified "2023-09-23" @default.
- W3153834700 title "Privacy-Adaptive BERT for Natural Language Understanding" @default.
- W3153834700 cites W1658920975 @default.
- W3153834700 cites W1873763122 @default.
- W3153834700 cites W2053637704 @default.
- W3153834700 cites W2124090777 @default.
- W3153834700 cites W2170240176 @default.
- W3153834700 cites W2251939518 @default.
- W3153834700 cites W2525778437 @default.
- W3153834700 cites W2578241483 @default.
- W3153834700 cites W2742225091 @default.
- W3153834700 cites W2784621220 @default.
- W3153834700 cites W2798768357 @default.
- W3153834700 cites W2799054028 @default.
- W3153834700 cites W2889507104 @default.
- W3153834700 cites W2897754576 @default.
- W3153834700 cites W2901147448 @default.
- W3153834700 cites W2902114605 @default.
- W3153834700 cites W2949758198 @default.
- W3153834700 cites W2950813464 @default.
- W3153834700 cites W2950935670 @default.
- W3153834700 cites W2953890885 @default.
- W3153834700 cites W2963341956 @default.
- W3153834700 cites W2963952467 @default.
- W3153834700 cites W2963999993 @default.
- W3153834700 cites W2965373594 @default.
- W3153834700 cites W3010262580 @default.
- W3153834700 cites W3013184331 @default.
- W3153834700 cites W3014514837 @default.
- W3153834700 cites W3027472889 @default.
- W3153834700 cites W3030163527 @default.
- W3153834700 cites W3045013345 @default.
- W3153834700 cites W3090414294 @default.
- W3153834700 cites W3104674875 @default.
- W3153834700 hasPublicationYear "2021" @default.
- W3153834700 type Work @default.
- W3153834700 sameAs 3153834700 @default.
- W3153834700 citedByCount "5" @default.
- W3153834700 countsByYear W31538347002021 @default.
- W3153834700 crossrefType "posted-content" @default.
- W3153834700 hasAuthorship W3153834700A5002453567 @default.
- W3153834700 hasAuthorship W3153834700A5021205962 @default.
- W3153834700 hasAuthorship W3153834700A5032248436 @default.
- W3153834700 hasAuthorship W3153834700A5037200145 @default.
- W3153834700 hasAuthorship W3153834700A5071466474 @default.
- W3153834700 hasAuthorship W3153834700A5071923786 @default.
- W3153834700 hasConcept C120665830 @default.
- W3153834700 hasConcept C121332964 @default.
- W3153834700 hasConcept C124101348 @default.
- W3153834700 hasConcept C137293760 @default.
- W3153834700 hasConcept C154945302 @default.
- W3153834700 hasConcept C15744967 @default.
- W3153834700 hasConcept C166957645 @default.
- W3153834700 hasConcept C192209626 @default.
- W3153834700 hasConcept C195324797 @default.
- W3153834700 hasConcept C23130292 @default.
- W3153834700 hasConcept C2776608160 @default.
- W3153834700 hasConcept C2779439875 @default.
- W3153834700 hasConcept C38652104 @default.
- W3153834700 hasConcept C41008148 @default.
- W3153834700 hasConcept C48145219 @default.
- W3153834700 hasConcept C63882131 @default.
- W3153834700 hasConcept C77805123 @default.
- W3153834700 hasConcept C95457728 @default.
- W3153834700 hasConceptScore W3153834700C120665830 @default.
- W3153834700 hasConceptScore W3153834700C121332964 @default.
- W3153834700 hasConceptScore W3153834700C124101348 @default.
- W3153834700 hasConceptScore W3153834700C137293760 @default.
- W3153834700 hasConceptScore W3153834700C154945302 @default.
- W3153834700 hasConceptScore W3153834700C15744967 @default.
- W3153834700 hasConceptScore W3153834700C166957645 @default.
- W3153834700 hasConceptScore W3153834700C192209626 @default.
- W3153834700 hasConceptScore W3153834700C195324797 @default.
- W3153834700 hasConceptScore W3153834700C23130292 @default.
- W3153834700 hasConceptScore W3153834700C2776608160 @default.
- W3153834700 hasConceptScore W3153834700C2779439875 @default.
- W3153834700 hasConceptScore W3153834700C38652104 @default.
- W3153834700 hasConceptScore W3153834700C41008148 @default.
- W3153834700 hasConceptScore W3153834700C48145219 @default.
- W3153834700 hasConceptScore W3153834700C63882131 @default.
- W3153834700 hasConceptScore W3153834700C77805123 @default.
- W3153834700 hasConceptScore W3153834700C95457728 @default.
- W3153834700 hasLocation W31538347001 @default.
- W3153834700 hasOpenAccess W3153834700 @default.
- W3153834700 hasPrimaryLocation W31538347001 @default.
- W3153834700 hasRelatedWork W2102527503 @default.
- W3153834700 hasRelatedWork W2163058276 @default.
- W3153834700 hasRelatedWork W2560610000 @default.
- W3153834700 hasRelatedWork W2771411698 @default.
- W3153834700 hasRelatedWork W2793382159 @default.
- W3153834700 hasRelatedWork W2916674192 @default.