Matches in SemOpenAlex for { <https://semopenalex.org/work/W3095476920> ?p ?o ?g. }
- W3095476920 abstract "Large-scale interactive web services and advanced AI applications make sophisticated decisions in real-time, based on executing a massive amount of computation tasks on thousands of servers. Task schedulers, which often operate in heterogeneous and volatile environments, require high throughput, i.e., scheduling millions of tasks per second, and low latency, i.e., incurring minimal scheduling delays for millisecond-level tasks. Scheduling is further complicated by other users’ workloads in a shared system, other background activities, and the diverse hardware configurations inside datacenters.We present Rosella, a new self-driving, distributed approach for task scheduling in heterogeneous clusters. Rosella automatically learns the compute environment and adjusts its scheduling policy in real-time. The solution provides high throughput and low latency simultaneously because it runs in parallel on multiple machines with minimum coordination and only performs simple operations for each scheduling decision. Our learning module monitors total system load and uses the information to dynamically determine optimal estimation strategy for the backends’ compute-power. Rosella generalizes power-of-two-choice algorithms to handle heterogeneous workers, reducing the max queue length of O(logn) obtained by prior algorithms to O(logn). We evaluate Rosella with a variety of workloads on a 32-node AWS cluster. Experimental results show that Rosella significantly reduces task response time, and adapts to environment changes quickly." @default.
- W3095476920 created "2020-11-09" @default.
- W3095476920 creator A5013876473 @default.
- W3095476920 creator A5014988656 @default.
- W3095476920 creator A5049692186 @default.
- W3095476920 date "2021-12-01" @default.
- W3095476920 modified "2023-09-24" @default.
- W3095476920 title "Rosella: A Self-Driving Distributed Scheduler for Heterogeneous Clusters" @default.
- W3095476920 cites W1464363888 @default.
- W3095476920 cites W1508832460 @default.
- W3095476920 cites W1534130940 @default.
- W3095476920 cites W1546020435 @default.
- W3095476920 cites W1595409123 @default.
- W3095476920 cites W1623461676 @default.
- W3095476920 cites W1678178911 @default.
- W3095476920 cites W1890643295 @default.
- W3095476920 cites W1971700347 @default.
- W3095476920 cites W1982063824 @default.
- W3095476920 cites W2022678927 @default.
- W3095476920 cites W2023246505 @default.
- W3095476920 cites W2048898205 @default.
- W3095476920 cites W2049934117 @default.
- W3095476920 cites W2061857234 @default.
- W3095476920 cites W2070666741 @default.
- W3095476920 cites W2102849319 @default.
- W3095476920 cites W2106352837 @default.
- W3095476920 cites W2120422789 @default.
- W3095476920 cites W2131975293 @default.
- W3095476920 cites W2155047033 @default.
- W3095476920 cites W2159279524 @default.
- W3095476920 cites W2159279836 @default.
- W3095476920 cites W2163599171 @default.
- W3095476920 cites W2163961697 @default.
- W3095476920 cites W2172051303 @default.
- W3095476920 cites W2239450181 @default.
- W3095476920 cites W2257979135 @default.
- W3095476920 cites W2271840356 @default.
- W3095476920 cites W2312281960 @default.
- W3095476920 cites W2322524800 @default.
- W3095476920 cites W2339203807 @default.
- W3095476920 cites W2571578228 @default.
- W3095476920 cites W2589907274 @default.
- W3095476920 cites W2895519740 @default.
- W3095476920 cites W2904948956 @default.
- W3095476920 cites W2922116887 @default.
- W3095476920 cites W2963390429 @default.
- W3095476920 cites W2964910657 @default.
- W3095476920 cites W2973182536 @default.
- W3095476920 cites W2984139344 @default.
- W3095476920 cites W2988514844 @default.
- W3095476920 cites W3010779417 @default.
- W3095476920 cites W3047494720 @default.
- W3095476920 cites W3095068464 @default.
- W3095476920 cites W3096582536 @default.
- W3095476920 cites W3097984729 @default.
- W3095476920 cites W3166418133 @default.
- W3095476920 cites W3200421407 @default.
- W3095476920 cites W51438938 @default.
- W3095476920 cites W7417966 @default.
- W3095476920 doi "https://doi.org/10.1109/msn53354.2021.00073" @default.
- W3095476920 hasPublicationYear "2021" @default.
- W3095476920 type Work @default.
- W3095476920 sameAs 3095476920 @default.
- W3095476920 citedByCount "2" @default.
- W3095476920 countsByYear W30954769202021 @default.
- W3095476920 countsByYear W30954769202022 @default.
- W3095476920 crossrefType "proceedings-article" @default.
- W3095476920 hasAuthorship W3095476920A5013876473 @default.
- W3095476920 hasAuthorship W3095476920A5014988656 @default.
- W3095476920 hasAuthorship W3095476920A5049692186 @default.
- W3095476920 hasBestOaLocation W30954769202 @default.
- W3095476920 hasConcept C107568181 @default.
- W3095476920 hasConcept C111919701 @default.
- W3095476920 hasConcept C11413529 @default.
- W3095476920 hasConcept C120314980 @default.
- W3095476920 hasConcept C127456818 @default.
- W3095476920 hasConcept C138959212 @default.
- W3095476920 hasConcept C160403385 @default.
- W3095476920 hasConcept C162324750 @default.
- W3095476920 hasConcept C173608175 @default.
- W3095476920 hasConcept C187691185 @default.
- W3095476920 hasConcept C19012869 @default.
- W3095476920 hasConcept C206729178 @default.
- W3095476920 hasConcept C21547014 @default.
- W3095476920 hasConcept C2524010 @default.
- W3095476920 hasConcept C31258907 @default.
- W3095476920 hasConcept C32310161 @default.
- W3095476920 hasConcept C33923547 @default.
- W3095476920 hasConcept C41008148 @default.
- W3095476920 hasConcept C45374587 @default.
- W3095476920 hasConcept C5119721 @default.
- W3095476920 hasConcept C76155785 @default.
- W3095476920 hasConcept C79403827 @default.
- W3095476920 hasConcept C82876162 @default.
- W3095476920 hasConcept C93996380 @default.
- W3095476920 hasConceptScore W3095476920C107568181 @default.
- W3095476920 hasConceptScore W3095476920C111919701 @default.
- W3095476920 hasConceptScore W3095476920C11413529 @default.
- W3095476920 hasConceptScore W3095476920C120314980 @default.
- W3095476920 hasConceptScore W3095476920C127456818 @default.