Matches in SemOpenAlex for { <https://semopenalex.org/work/W4319165890> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W4319165890 abstract "Recent research on online Gradient Balancing (GraB) has revealed that there exist permutation-based example orderings that are guaranteed to outperform random reshuffling (RR). Whereas RR arbitrarily permutes training examples, GraB leverages stale gradients from prior epochs to order examples -- achieving a provably faster convergence rate than RR. However, GraB is limited by design: While it demonstrates an impressive ability to scale-up training on centralized data, it does not naturally extend to modern distributed ML workloads. We therefore propose Coordinated Distributed GraB (CD-GraB), which uses insights from prior work on kernel thinning to translate the benefits of provably faster permutation-based example ordering to distributed settings. With negligible overhead, CD-GraB exhibits a linear speedup in convergence rate over centralized GraB and outperforms baselines empirically, including distributed RR, on a variety of benchmark tasks." @default.
- W4319165890 created "2023-02-04" @default.
- W4319165890 creator A5002356656 @default.
- W4319165890 creator A5039366956 @default.
- W4319165890 creator A5041869459 @default.
- W4319165890 creator A5059172361 @default.
- W4319165890 creator A5066555129 @default.
- W4319165890 creator A5070405874 @default.
- W4319165890 date "2023-02-01" @default.
- W4319165890 modified "2023-09-28" @default.
- W4319165890 title "CD-GraB: Coordinating Distributed Example Orders for Provably Accelerated Training" @default.
- W4319165890 doi "https://doi.org/10.48550/arxiv.2302.00845" @default.
- W4319165890 hasPublicationYear "2023" @default.
- W4319165890 type Work @default.
- W4319165890 citedByCount "0" @default.
- W4319165890 crossrefType "posted-content" @default.
- W4319165890 hasAuthorship W4319165890A5002356656 @default.
- W4319165890 hasAuthorship W4319165890A5039366956 @default.
- W4319165890 hasAuthorship W4319165890A5041869459 @default.
- W4319165890 hasAuthorship W4319165890A5059172361 @default.
- W4319165890 hasAuthorship W4319165890A5066555129 @default.
- W4319165890 hasAuthorship W4319165890A5070405874 @default.
- W4319165890 hasBestOaLocation W43191658901 @default.
- W4319165890 hasConcept C111919701 @default.
- W4319165890 hasConcept C114614502 @default.
- W4319165890 hasConcept C119857082 @default.
- W4319165890 hasConcept C120314980 @default.
- W4319165890 hasConcept C121332964 @default.
- W4319165890 hasConcept C127162648 @default.
- W4319165890 hasConcept C13280743 @default.
- W4319165890 hasConcept C162324750 @default.
- W4319165890 hasConcept C173608175 @default.
- W4319165890 hasConcept C185798385 @default.
- W4319165890 hasConcept C205649164 @default.
- W4319165890 hasConcept C21308566 @default.
- W4319165890 hasConcept C24890656 @default.
- W4319165890 hasConcept C2777303404 @default.
- W4319165890 hasConcept C2779960059 @default.
- W4319165890 hasConcept C31258907 @default.
- W4319165890 hasConcept C33923547 @default.
- W4319165890 hasConcept C41008148 @default.
- W4319165890 hasConcept C50522688 @default.
- W4319165890 hasConcept C57869625 @default.
- W4319165890 hasConcept C68339613 @default.
- W4319165890 hasConcept C74193536 @default.
- W4319165890 hasConcept C80444323 @default.
- W4319165890 hasConceptScore W4319165890C111919701 @default.
- W4319165890 hasConceptScore W4319165890C114614502 @default.
- W4319165890 hasConceptScore W4319165890C119857082 @default.
- W4319165890 hasConceptScore W4319165890C120314980 @default.
- W4319165890 hasConceptScore W4319165890C121332964 @default.
- W4319165890 hasConceptScore W4319165890C127162648 @default.
- W4319165890 hasConceptScore W4319165890C13280743 @default.
- W4319165890 hasConceptScore W4319165890C162324750 @default.
- W4319165890 hasConceptScore W4319165890C173608175 @default.
- W4319165890 hasConceptScore W4319165890C185798385 @default.
- W4319165890 hasConceptScore W4319165890C205649164 @default.
- W4319165890 hasConceptScore W4319165890C21308566 @default.
- W4319165890 hasConceptScore W4319165890C24890656 @default.
- W4319165890 hasConceptScore W4319165890C2777303404 @default.
- W4319165890 hasConceptScore W4319165890C2779960059 @default.
- W4319165890 hasConceptScore W4319165890C31258907 @default.
- W4319165890 hasConceptScore W4319165890C33923547 @default.
- W4319165890 hasConceptScore W4319165890C41008148 @default.
- W4319165890 hasConceptScore W4319165890C50522688 @default.
- W4319165890 hasConceptScore W4319165890C57869625 @default.
- W4319165890 hasConceptScore W4319165890C68339613 @default.
- W4319165890 hasConceptScore W4319165890C74193536 @default.
- W4319165890 hasConceptScore W4319165890C80444323 @default.
- W4319165890 hasLocation W43191658901 @default.
- W4319165890 hasOpenAccess W4319165890 @default.
- W4319165890 hasPrimaryLocation W43191658901 @default.
- W4319165890 hasRelatedWork W1784146144 @default.
- W4319165890 hasRelatedWork W1822667161 @default.
- W4319165890 hasRelatedWork W2053732522 @default.
- W4319165890 hasRelatedWork W2092071486 @default.
- W4319165890 hasRelatedWork W2156409740 @default.
- W4319165890 hasRelatedWork W2348739446 @default.
- W4319165890 hasRelatedWork W2391167130 @default.
- W4319165890 hasRelatedWork W2765352472 @default.
- W4319165890 hasRelatedWork W4283067488 @default.
- W4319165890 hasRelatedWork W4308536657 @default.
- W4319165890 isParatext "false" @default.
- W4319165890 isRetracted "false" @default.
- W4319165890 workType "article" @default.