Matches in SemOpenAlex for { <https://semopenalex.org/work/W2587519888> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W2587519888 abstract "Spark has become the first choice of distributed computing framework for big data processing. The biggest highlight is the use of in-memory computations on large clusters, which is suitable for iterative computing and interactive computing. However, the straggler machines can seriously affect their performance. The current approach of Spark is speculative execution which selects the slow tasks and resubmit them, but there are two deficiencies: Firstly, it directly uses the median time to judge whether the task is abnormal, this may be misleading in reality; Secondly, the backup tasks are directly added to the task queue without taking into account the presence of straggler machines. These deficiencies will further extend the execution time of a job. Therefore, we design a improved speculative strategy, Multiple Phases Time Estimation (MPTE), which greatly reduces the impact of straggler machines. In MPTE, we use the remaining time estimated based on multiple phases to select slow tasks, and we improve the task scheduler for backup tasks scheduling. Experiment results show that MPTE can improve the accuracy of determining if should run a speculative copy for a task by about 20% compared to Spark native scheduler." @default.
- W2587519888 created "2017-02-17" @default.
- W2587519888 creator A5002967258 @default.
- W2587519888 creator A5024663581 @default.
- W2587519888 creator A5026647049 @default.
- W2587519888 creator A5030224312 @default.
- W2587519888 creator A5059167482 @default.
- W2587519888 creator A5077348149 @default.
- W2587519888 date "2016-07-01" @default.
- W2587519888 modified "2023-10-14" @default.
- W2587519888 title "Improving Spark performance with MPTE in heterogeneous environments" @default.
- W2587519888 cites W1113701143 @default.
- W2587519888 cites W1987671078 @default.
- W2587519888 cites W2023718005 @default.
- W2587519888 cites W2040722314 @default.
- W2587519888 cites W2096125134 @default.
- W2587519888 cites W2100830825 @default.
- W2587519888 cites W2140486418 @default.
- W2587519888 cites W2157490430 @default.
- W2587519888 cites W4253537957 @default.
- W2587519888 doi "https://doi.org/10.1109/icalip.2016.7846627" @default.
- W2587519888 hasPublicationYear "2016" @default.
- W2587519888 type Work @default.
- W2587519888 sameAs 2587519888 @default.
- W2587519888 citedByCount "11" @default.
- W2587519888 countsByYear W25875198882018 @default.
- W2587519888 countsByYear W25875198882019 @default.
- W2587519888 countsByYear W25875198882020 @default.
- W2587519888 countsByYear W25875198882021 @default.
- W2587519888 crossrefType "proceedings-article" @default.
- W2587519888 hasAuthorship W2587519888A5002967258 @default.
- W2587519888 hasAuthorship W2587519888A5024663581 @default.
- W2587519888 hasAuthorship W2587519888A5026647049 @default.
- W2587519888 hasAuthorship W2587519888A5030224312 @default.
- W2587519888 hasAuthorship W2587519888A5059167482 @default.
- W2587519888 hasAuthorship W2587519888A5077348149 @default.
- W2587519888 hasConcept C111919701 @default.
- W2587519888 hasConcept C120314980 @default.
- W2587519888 hasConcept C141331961 @default.
- W2587519888 hasConcept C160403385 @default.
- W2587519888 hasConcept C162324750 @default.
- W2587519888 hasConcept C173608175 @default.
- W2587519888 hasConcept C187736073 @default.
- W2587519888 hasConcept C199360897 @default.
- W2587519888 hasConcept C206729178 @default.
- W2587519888 hasConcept C21547014 @default.
- W2587519888 hasConcept C2780451532 @default.
- W2587519888 hasConcept C2780945871 @default.
- W2587519888 hasConcept C2781215313 @default.
- W2587519888 hasConcept C2989134064 @default.
- W2587519888 hasConcept C31258907 @default.
- W2587519888 hasConcept C41008148 @default.
- W2587519888 hasConcept C75684735 @default.
- W2587519888 hasConceptScore W2587519888C111919701 @default.
- W2587519888 hasConceptScore W2587519888C120314980 @default.
- W2587519888 hasConceptScore W2587519888C141331961 @default.
- W2587519888 hasConceptScore W2587519888C160403385 @default.
- W2587519888 hasConceptScore W2587519888C162324750 @default.
- W2587519888 hasConceptScore W2587519888C173608175 @default.
- W2587519888 hasConceptScore W2587519888C187736073 @default.
- W2587519888 hasConceptScore W2587519888C199360897 @default.
- W2587519888 hasConceptScore W2587519888C206729178 @default.
- W2587519888 hasConceptScore W2587519888C21547014 @default.
- W2587519888 hasConceptScore W2587519888C2780451532 @default.
- W2587519888 hasConceptScore W2587519888C2780945871 @default.
- W2587519888 hasConceptScore W2587519888C2781215313 @default.
- W2587519888 hasConceptScore W2587519888C2989134064 @default.
- W2587519888 hasConceptScore W2587519888C31258907 @default.
- W2587519888 hasConceptScore W2587519888C41008148 @default.
- W2587519888 hasConceptScore W2587519888C75684735 @default.
- W2587519888 hasLocation W25875198881 @default.
- W2587519888 hasOpenAccess W2587519888 @default.
- W2587519888 hasPrimaryLocation W25875198881 @default.
- W2587519888 hasRelatedWork W1882733036 @default.
- W2587519888 hasRelatedWork W1992741870 @default.
- W2587519888 hasRelatedWork W2160425906 @default.
- W2587519888 hasRelatedWork W2542083118 @default.
- W2587519888 hasRelatedWork W2546696010 @default.
- W2587519888 hasRelatedWork W2587519888 @default.
- W2587519888 hasRelatedWork W2913814439 @default.
- W2587519888 hasRelatedWork W2980830217 @default.
- W2587519888 hasRelatedWork W3208869747 @default.
- W2587519888 hasRelatedWork W4318832445 @default.
- W2587519888 isParatext "false" @default.
- W2587519888 isRetracted "false" @default.
- W2587519888 magId "2587519888" @default.
- W2587519888 workType "article" @default.