Matches in SemOpenAlex for { <https://semopenalex.org/work/W2791456077> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W2791456077 endingPage "500" @default.
- W2791456077 startingPage "488" @default.
- W2791456077 abstract "It has become routine for large volumes of data to be generated, stored, and processed across geographically distributed datacenters. To run a single data analytic job on such geo-distributed data, recent research proposed to distribute its tasks across datacenters, considering both data locality and network bandwidth across datacenters. Yet, it remains an open problem in the more general case, where multiple analytic jobs need to fairly share the resources at these geo-distributed datacenters. In this paper, we focus on the problem of assigning tasks belonging to multiple jobs across datacenters, with the specific objective of achieving max-min fairness across jobs sharing these datacenters, in terms of their job completion times. We formulate this problem as a lexicographical minimization problem, which is challenging to solve in practice due to its inherent multi-objective and discrete nature. To address these challenges, we iteratively solve its single-objective subproblems, which can be transformed to equivalent linear programming (LP) problems to be efficiently solved, thanks to their favorable properties. As a highlight of this paper, we have designed and implemented our proposed solution as a fair job scheduler based on Apache Spark, a modern data processing framework. With extensive evaluations of our real-world implementation on Amazon EC2 and large-scale simulations, we have shown convincing evidence that max-min fairness has been achieved and the worst job completion time has been significantly improved using our new job scheduler." @default.
- W2791456077 created "2018-03-29" @default.
- W2791456077 creator A5034995105 @default.
- W2791456077 creator A5037989560 @default.
- W2791456077 creator A5078722234 @default.
- W2791456077 creator A5083596391 @default.
- W2791456077 date "2019-07-01" @default.
- W2791456077 modified "2023-10-16" @default.
- W2791456077 title "Scheduling Jobs across Geo-Distributed Datacenters with Max-Min Fairness" @default.
- W2791456077 cites W1596877211 @default.
- W2791456077 cites W1969299781 @default.
- W2791456077 cites W1998509479 @default.
- W2791456077 cites W2004255221 @default.
- W2791456077 cites W2007126746 @default.
- W2791456077 cites W2035309843 @default.
- W2791456077 cites W2040466547 @default.
- W2791456077 cites W2096125134 @default.
- W2791456077 cites W2173213060 @default.
- W2791456077 cites W2267569004 @default.
- W2791456077 cites W2496080211 @default.
- W2791456077 cites W2757024591 @default.
- W2791456077 cites W2764122222 @default.
- W2791456077 doi "https://doi.org/10.1109/tnse.2018.2795580" @default.
- W2791456077 hasPublicationYear "2019" @default.
- W2791456077 type Work @default.
- W2791456077 sameAs 2791456077 @default.
- W2791456077 citedByCount "29" @default.
- W2791456077 countsByYear W27914560772018 @default.
- W2791456077 countsByYear W27914560772019 @default.
- W2791456077 countsByYear W27914560772020 @default.
- W2791456077 countsByYear W27914560772021 @default.
- W2791456077 countsByYear W27914560772022 @default.
- W2791456077 countsByYear W27914560772023 @default.
- W2791456077 crossrefType "journal-article" @default.
- W2791456077 hasAuthorship W2791456077A5034995105 @default.
- W2791456077 hasAuthorship W2791456077A5037989560 @default.
- W2791456077 hasAuthorship W2791456077A5078722234 @default.
- W2791456077 hasAuthorship W2791456077A5083596391 @default.
- W2791456077 hasConcept C111873713 @default.
- W2791456077 hasConcept C111919701 @default.
- W2791456077 hasConcept C120314980 @default.
- W2791456077 hasConcept C126255220 @default.
- W2791456077 hasConcept C138885662 @default.
- W2791456077 hasConcept C206729178 @default.
- W2791456077 hasConcept C2779808786 @default.
- W2791456077 hasConcept C33923547 @default.
- W2791456077 hasConcept C41008148 @default.
- W2791456077 hasConcept C41895202 @default.
- W2791456077 hasConcept C79974875 @default.
- W2791456077 hasConceptScore W2791456077C111873713 @default.
- W2791456077 hasConceptScore W2791456077C111919701 @default.
- W2791456077 hasConceptScore W2791456077C120314980 @default.
- W2791456077 hasConceptScore W2791456077C126255220 @default.
- W2791456077 hasConceptScore W2791456077C138885662 @default.
- W2791456077 hasConceptScore W2791456077C206729178 @default.
- W2791456077 hasConceptScore W2791456077C2779808786 @default.
- W2791456077 hasConceptScore W2791456077C33923547 @default.
- W2791456077 hasConceptScore W2791456077C41008148 @default.
- W2791456077 hasConceptScore W2791456077C41895202 @default.
- W2791456077 hasConceptScore W2791456077C79974875 @default.
- W2791456077 hasIssue "3" @default.
- W2791456077 hasLocation W27914560771 @default.
- W2791456077 hasOpenAccess W2791456077 @default.
- W2791456077 hasPrimaryLocation W27914560771 @default.
- W2791456077 hasRelatedWork W1559381305 @default.
- W2791456077 hasRelatedWork W1582214068 @default.
- W2791456077 hasRelatedWork W1970208768 @default.
- W2791456077 hasRelatedWork W2014963843 @default.
- W2791456077 hasRelatedWork W2121959948 @default.
- W2791456077 hasRelatedWork W2172100609 @default.
- W2791456077 hasRelatedWork W2393232088 @default.
- W2791456077 hasRelatedWork W2980381382 @default.
- W2791456077 hasRelatedWork W3174084021 @default.
- W2791456077 hasRelatedWork W44553394 @default.
- W2791456077 hasVolume "6" @default.
- W2791456077 isParatext "false" @default.
- W2791456077 isRetracted "false" @default.
- W2791456077 magId "2791456077" @default.
- W2791456077 workType "article" @default.