Matches in SemOpenAlex for { <https://semopenalex.org/work/W3092367439> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W3092367439 endingPage "6025" @default.
- W3092367439 startingPage "6011" @default.
- W3092367439 abstract "There is a recent surge of interest in the design of the first-order and the second-order distributed machine learning algorithms. However, distributed algorithms are sensitive to Byzantine attackers who can send falsified information to prevent the convergence of algorithms or lead the algorithms to converge to value of the attackers' choice. Some recent works have proposed algorithms that can defend against Byzantine attackers for the first-order methods. In this paper, we design two algorithms that can deal with Byzantine attackers for the second-order methods. The main idea of the first algorithm, named median-based approximate Newton's method (MNM), is to ask the parameter server to aggregate gradient information and approximate Newton's direction from all workers by geometric median. We show that MNM can converge when up to half of the workers are Byzantine attackers. To deal with the case with an arbitrary number of attackers, we then propose a comparison-based approximate Newton's method (CNM). The main idea of CNM is to ask the server to randomly select a small clean dataset and compute noisy gradient and Newton's direction using this small dataset. These noisy information will then be used as an approximation of the ground truth to filter out bad information from Byzantine attackers. We show that CNM can converge to the neighborhood of the population minimizer even when more than half of the workers are Byzantine workers. We further provide numerical examples to illustrate the performance of the proposed algorithms." @default.
- W3092367439 created "2020-10-15" @default.
- W3092367439 creator A5075064996 @default.
- W3092367439 creator A5081715462 @default.
- W3092367439 date "2020-01-01" @default.
- W3092367439 modified "2023-10-15" @default.
- W3092367439 title "Distributed Approximate Newton's Method Robust to Byzantine Attackers" @default.
- W3092367439 cites W1597838394 @default.
- W3092367439 cites W1753414968 @default.
- W3092367439 cites W1794006809 @default.
- W3092367439 cites W1851342690 @default.
- W3092367439 cites W1993137686 @default.
- W3092367439 cites W2032395696 @default.
- W3092367439 cites W2069713732 @default.
- W3092367439 cites W2075406189 @default.
- W3092367439 cites W2165966284 @default.
- W3092367439 cites W2409973437 @default.
- W3092367439 cites W2485473371 @default.
- W3092367439 cites W2544902556 @default.
- W3092367439 cites W2614254310 @default.
- W3092367439 cites W2797573937 @default.
- W3092367439 cites W2940527161 @default.
- W3092367439 cites W2947064482 @default.
- W3092367439 cites W2958735581 @default.
- W3092367439 cites W2963334472 @default.
- W3092367439 cites W2963408258 @default.
- W3092367439 cites W2963879045 @default.
- W3092367439 cites W2972939971 @default.
- W3092367439 cites W2979956265 @default.
- W3092367439 cites W2986088584 @default.
- W3092367439 cites W3101159567 @default.
- W3092367439 cites W4206039841 @default.
- W3092367439 cites W4292363360 @default.
- W3092367439 doi "https://doi.org/10.1109/tsp.2020.3029461" @default.
- W3092367439 hasPublicationYear "2020" @default.
- W3092367439 type Work @default.
- W3092367439 sameAs 3092367439 @default.
- W3092367439 citedByCount "9" @default.
- W3092367439 countsByYear W30923674392020 @default.
- W3092367439 countsByYear W30923674392022 @default.
- W3092367439 countsByYear W30923674392023 @default.
- W3092367439 crossrefType "journal-article" @default.
- W3092367439 hasAuthorship W3092367439A5075064996 @default.
- W3092367439 hasAuthorship W3092367439A5081715462 @default.
- W3092367439 hasBestOaLocation W30923674391 @default.
- W3092367439 hasConcept C104562893 @default.
- W3092367439 hasConcept C11413529 @default.
- W3092367439 hasConcept C120314980 @default.
- W3092367439 hasConcept C130120984 @default.
- W3092367439 hasConcept C146849305 @default.
- W3092367439 hasConcept C154945302 @default.
- W3092367439 hasConcept C162324750 @default.
- W3092367439 hasConcept C168021876 @default.
- W3092367439 hasConcept C17532199 @default.
- W3092367439 hasConcept C195244886 @default.
- W3092367439 hasConcept C2777303404 @default.
- W3092367439 hasConcept C31258907 @default.
- W3092367439 hasConcept C41008148 @default.
- W3092367439 hasConcept C50522688 @default.
- W3092367439 hasConcept C63540848 @default.
- W3092367439 hasConcept C93996380 @default.
- W3092367439 hasConcept C95457728 @default.
- W3092367439 hasConceptScore W3092367439C104562893 @default.
- W3092367439 hasConceptScore W3092367439C11413529 @default.
- W3092367439 hasConceptScore W3092367439C120314980 @default.
- W3092367439 hasConceptScore W3092367439C130120984 @default.
- W3092367439 hasConceptScore W3092367439C146849305 @default.
- W3092367439 hasConceptScore W3092367439C154945302 @default.
- W3092367439 hasConceptScore W3092367439C162324750 @default.
- W3092367439 hasConceptScore W3092367439C168021876 @default.
- W3092367439 hasConceptScore W3092367439C17532199 @default.
- W3092367439 hasConceptScore W3092367439C195244886 @default.
- W3092367439 hasConceptScore W3092367439C2777303404 @default.
- W3092367439 hasConceptScore W3092367439C31258907 @default.
- W3092367439 hasConceptScore W3092367439C41008148 @default.
- W3092367439 hasConceptScore W3092367439C50522688 @default.
- W3092367439 hasConceptScore W3092367439C63540848 @default.
- W3092367439 hasConceptScore W3092367439C93996380 @default.
- W3092367439 hasConceptScore W3092367439C95457728 @default.
- W3092367439 hasFunder F4320335353 @default.
- W3092367439 hasLocation W30923674391 @default.
- W3092367439 hasOpenAccess W3092367439 @default.
- W3092367439 hasPrimaryLocation W30923674391 @default.
- W3092367439 hasRelatedWork W1897922812 @default.
- W3092367439 hasRelatedWork W2047416510 @default.
- W3092367439 hasRelatedWork W2362644888 @default.
- W3092367439 hasRelatedWork W2775054947 @default.
- W3092367439 hasRelatedWork W2788308444 @default.
- W3092367439 hasRelatedWork W2944482745 @default.
- W3092367439 hasRelatedWork W3186834465 @default.
- W3092367439 hasRelatedWork W4285206854 @default.
- W3092367439 hasRelatedWork W4287642586 @default.
- W3092367439 hasRelatedWork W4288359398 @default.
- W3092367439 hasVolume "68" @default.
- W3092367439 isParatext "false" @default.
- W3092367439 isRetracted "false" @default.
- W3092367439 magId "3092367439" @default.
- W3092367439 workType "article" @default.