Matches in SemOpenAlex for { <https://semopenalex.org/work/W3081652511> ?p ?o ?g. }
- W3081652511 abstract "Apache introduced YARN as the next generation of the Hadoop framework, providing resource management and a central platform to deliver consistent data governance tools across Hadoop clusters. Hadoop YARN supports multiple frameworks like MapReduce to process different types of data and works with different scheduling policies such as FIFO, Capacity, and Fair schedulers. DRF is the best option that uses short-term, without considering history information, convergence to fairness for multi-type resource allocation. However, DRF performance is still not satisfying due to trade-offs between fairness and performance regarding resource utilization. To address this problem, we propose Simulated Annealing Fair scheduling, SAF, a long-term fair scheme in resource allocation to have fairness and excellent performance in terms of resource utilization and MakeSpan. We introduce a new parameter as entropy, which is an approach to indicates the disorder in the fairness of allocated resources of the whole cluster. We implemented SAF as a pluggable scheduler in Hadoop Yarn Cluster and evaluated it with standard MapReduce benchmarks in Yarn Scheduler Load Simulator (SLS) and CloudSim Plus simulation framework. Finally, the results of both simulation tools are evidence to prove our claim. Compared to DRF, SAF increases resource utilization of YARN clusters significantly and decreases MakeSpan to an appropriate level." @default.
- W3081652511 created "2020-09-08" @default.
- W3081652511 creator A5063778898 @default.
- W3081652511 creator A5071752241 @default.
- W3081652511 creator A5086631530 @default.
- W3081652511 date "2020-08-28" @default.
- W3081652511 modified "2023-09-27" @default.
- W3081652511 title "SAF: Simulated Annealing Fair Scheduling for Hadoop Yarn Clusters." @default.
- W3081652511 cites W146027647 @default.
- W3081652511 cites W1518982541 @default.
- W3081652511 cites W1556451512 @default.
- W3081652511 cites W1598064945 @default.
- W3081652511 cites W16138695 @default.
- W3081652511 cites W1817903323 @default.
- W3081652511 cites W1890643295 @default.
- W3081652511 cites W1986342384 @default.
- W3081652511 cites W1995875735 @default.
- W3081652511 cites W1999617930 @default.
- W3081652511 cites W2001466659 @default.
- W3081652511 cites W2008585803 @default.
- W3081652511 cites W2020999234 @default.
- W3081652511 cites W2024060531 @default.
- W3081652511 cites W2045287414 @default.
- W3081652511 cites W2048898205 @default.
- W3081652511 cites W2068792866 @default.
- W3081652511 cites W2070225064 @default.
- W3081652511 cites W2085043026 @default.
- W3081652511 cites W2105947650 @default.
- W3081652511 cites W2110560130 @default.
- W3081652511 cites W2119738171 @default.
- W3081652511 cites W2122882636 @default.
- W3081652511 cites W2133569115 @default.
- W3081652511 cites W2163144548 @default.
- W3081652511 cites W2170704906 @default.
- W3081652511 cites W2173213060 @default.
- W3081652511 cites W2332225927 @default.
- W3081652511 cites W2521597241 @default.
- W3081652511 cites W2601826852 @default.
- W3081652511 cites W2736768677 @default.
- W3081652511 cites W2737838663 @default.
- W3081652511 cites W2793887942 @default.
- W3081652511 cites W2890134559 @default.
- W3081652511 cites W2911441061 @default.
- W3081652511 cites W2914275007 @default.
- W3081652511 cites W379212275 @default.
- W3081652511 hasPublicationYear "2020" @default.
- W3081652511 type Work @default.
- W3081652511 sameAs 3081652511 @default.
- W3081652511 citedByCount "0" @default.
- W3081652511 crossrefType "posted-content" @default.
- W3081652511 hasAuthorship W3081652511A5063778898 @default.
- W3081652511 hasAuthorship W3081652511A5071752241 @default.
- W3081652511 hasAuthorship W3081652511A5086631530 @default.
- W3081652511 hasConcept C111919701 @default.
- W3081652511 hasConcept C11413529 @default.
- W3081652511 hasConcept C120314980 @default.
- W3081652511 hasConcept C126255220 @default.
- W3081652511 hasConcept C126980161 @default.
- W3081652511 hasConcept C127413603 @default.
- W3081652511 hasConcept C206729178 @default.
- W3081652511 hasConcept C2778787235 @default.
- W3081652511 hasConcept C2779907789 @default.
- W3081652511 hasConcept C33923547 @default.
- W3081652511 hasConcept C41008148 @default.
- W3081652511 hasConcept C55416958 @default.
- W3081652511 hasConcept C68387754 @default.
- W3081652511 hasConcept C77088390 @default.
- W3081652511 hasConcept C78519656 @default.
- W3081652511 hasConcept C79974875 @default.
- W3081652511 hasConceptScore W3081652511C111919701 @default.
- W3081652511 hasConceptScore W3081652511C11413529 @default.
- W3081652511 hasConceptScore W3081652511C120314980 @default.
- W3081652511 hasConceptScore W3081652511C126255220 @default.
- W3081652511 hasConceptScore W3081652511C126980161 @default.
- W3081652511 hasConceptScore W3081652511C127413603 @default.
- W3081652511 hasConceptScore W3081652511C206729178 @default.
- W3081652511 hasConceptScore W3081652511C2778787235 @default.
- W3081652511 hasConceptScore W3081652511C2779907789 @default.
- W3081652511 hasConceptScore W3081652511C33923547 @default.
- W3081652511 hasConceptScore W3081652511C41008148 @default.
- W3081652511 hasConceptScore W3081652511C55416958 @default.
- W3081652511 hasConceptScore W3081652511C68387754 @default.
- W3081652511 hasConceptScore W3081652511C77088390 @default.
- W3081652511 hasConceptScore W3081652511C78519656 @default.
- W3081652511 hasConceptScore W3081652511C79974875 @default.
- W3081652511 hasLocation W30816525111 @default.
- W3081652511 hasOpenAccess W3081652511 @default.
- W3081652511 hasPrimaryLocation W30816525111 @default.
- W3081652511 hasRelatedWork W1921815664 @default.
- W3081652511 hasRelatedWork W1986419873 @default.
- W3081652511 hasRelatedWork W1987516674 @default.
- W3081652511 hasRelatedWork W1992928432 @default.
- W3081652511 hasRelatedWork W2014963843 @default.
- W3081652511 hasRelatedWork W208034268 @default.
- W3081652511 hasRelatedWork W2158876212 @default.
- W3081652511 hasRelatedWork W2370730194 @default.
- W3081652511 hasRelatedWork W2529578040 @default.
- W3081652511 hasRelatedWork W2559241810 @default.
- W3081652511 hasRelatedWork W2598021343 @default.
- W3081652511 hasRelatedWork W2601826852 @default.