Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313120384> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W4313120384 endingPage "681" @default.
- W4313120384 startingPage "669" @default.
- W4313120384 abstract "Apache Hadoop is one of the most popular distributed computing systems, used largely for big data analysis and processing. The Hadoop cluster hosts multiple parallel workloads requiring various resource usage (CPU, RAM, etc.). In practice, in heterogeneous Hadoop environments, resource-intensive tasks may be allocated to the lower performing nodes, causing load imbalance between and within clusters and high data transfer cost. These weaknesses lead to performance deterioration of the Hadoop system and delays the completion of all submitted jobs. To overcome these challenges, this paper proposes an efficient and dynamic load balancing policy in a heterogeneous Hadoop YARN cluster. This novel load balancing model is based on clustering nodes into subgroups of nodes similar in performance, and then allocating different jobs in these subgroups using a multi-criteria ranking. This policy ensures the most accurate match between resource demands and available resources in real time, which decreases the data transfer in the cluster. The experimental results show that the introduced approach allows reducing noticeably the completion time s by 42% and 11% compared with the H-fair and a load balancing approach respectively. Thus, Hadoop can rapidly release the resources for the next job which enhance the overall performance of the distributed computing systems. The obtained finding also reveal that our approach optimizes the use of the available resources and avoids cluster over-load in real time." @default.
- W4313120384 created "2023-01-06" @default.
- W4313120384 creator A5006970633 @default.
- W4313120384 creator A5016650119 @default.
- W4313120384 creator A5034231423 @default.
- W4313120384 creator A5074125761 @default.
- W4313120384 date "2022-01-01" @default.
- W4313120384 modified "2023-09-25" @default.
- W4313120384 title "Effective Resource Utilization in Heterogeneous Hadoop Environment Through a Dynamic Inter-cluster and Intra-cluster Load Balancing" @default.
- W4313120384 cites W2622747630 @default.
- W4313120384 cites W2724721453 @default.
- W4313120384 cites W2802772536 @default.
- W4313120384 cites W2806355570 @default.
- W4313120384 cites W2812640133 @default.
- W4313120384 cites W2886384632 @default.
- W4313120384 cites W2890134559 @default.
- W4313120384 cites W2893768869 @default.
- W4313120384 cites W2970548363 @default.
- W4313120384 cites W3100408509 @default.
- W4313120384 cites W3112842035 @default.
- W4313120384 doi "https://doi.org/10.1007/978-3-031-21967-2_54" @default.
- W4313120384 hasPublicationYear "2022" @default.
- W4313120384 type Work @default.
- W4313120384 citedByCount "0" @default.
- W4313120384 crossrefType "book-chapter" @default.
- W4313120384 hasAuthorship W4313120384A5006970633 @default.
- W4313120384 hasAuthorship W4313120384A5016650119 @default.
- W4313120384 hasAuthorship W4313120384A5034231423 @default.
- W4313120384 hasAuthorship W4313120384A5074125761 @default.
- W4313120384 hasConcept C111919701 @default.
- W4313120384 hasConcept C120314980 @default.
- W4313120384 hasConcept C138959212 @default.
- W4313120384 hasConcept C154945302 @default.
- W4313120384 hasConcept C159985019 @default.
- W4313120384 hasConcept C164866538 @default.
- W4313120384 hasConcept C187691185 @default.
- W4313120384 hasConcept C189430467 @default.
- W4313120384 hasConcept C19012869 @default.
- W4313120384 hasConcept C192562407 @default.
- W4313120384 hasConcept C206345919 @default.
- W4313120384 hasConcept C2524010 @default.
- W4313120384 hasConcept C2776175482 @default.
- W4313120384 hasConcept C2778787235 @default.
- W4313120384 hasConcept C29140674 @default.
- W4313120384 hasConcept C31258907 @default.
- W4313120384 hasConcept C33923547 @default.
- W4313120384 hasConcept C41008148 @default.
- W4313120384 hasConcept C73555534 @default.
- W4313120384 hasConcept C75684735 @default.
- W4313120384 hasConcept C77088390 @default.
- W4313120384 hasConceptScore W4313120384C111919701 @default.
- W4313120384 hasConceptScore W4313120384C120314980 @default.
- W4313120384 hasConceptScore W4313120384C138959212 @default.
- W4313120384 hasConceptScore W4313120384C154945302 @default.
- W4313120384 hasConceptScore W4313120384C159985019 @default.
- W4313120384 hasConceptScore W4313120384C164866538 @default.
- W4313120384 hasConceptScore W4313120384C187691185 @default.
- W4313120384 hasConceptScore W4313120384C189430467 @default.
- W4313120384 hasConceptScore W4313120384C19012869 @default.
- W4313120384 hasConceptScore W4313120384C192562407 @default.
- W4313120384 hasConceptScore W4313120384C206345919 @default.
- W4313120384 hasConceptScore W4313120384C2524010 @default.
- W4313120384 hasConceptScore W4313120384C2776175482 @default.
- W4313120384 hasConceptScore W4313120384C2778787235 @default.
- W4313120384 hasConceptScore W4313120384C29140674 @default.
- W4313120384 hasConceptScore W4313120384C31258907 @default.
- W4313120384 hasConceptScore W4313120384C33923547 @default.
- W4313120384 hasConceptScore W4313120384C41008148 @default.
- W4313120384 hasConceptScore W4313120384C73555534 @default.
- W4313120384 hasConceptScore W4313120384C75684735 @default.
- W4313120384 hasConceptScore W4313120384C77088390 @default.
- W4313120384 hasLocation W43131203841 @default.
- W4313120384 hasOpenAccess W4313120384 @default.
- W4313120384 hasPrimaryLocation W43131203841 @default.
- W4313120384 hasRelatedWork W1596201972 @default.
- W4313120384 hasRelatedWork W163783926 @default.
- W4313120384 hasRelatedWork W2150101281 @default.
- W4313120384 hasRelatedWork W2161624780 @default.
- W4313120384 hasRelatedWork W2316565485 @default.
- W4313120384 hasRelatedWork W2359390461 @default.
- W4313120384 hasRelatedWork W2367967182 @default.
- W4313120384 hasRelatedWork W2376924539 @default.
- W4313120384 hasRelatedWork W2380023786 @default.
- W4313120384 hasRelatedWork W2385899138 @default.
- W4313120384 isParatext "false" @default.
- W4313120384 isRetracted "false" @default.
- W4313120384 workType "book-chapter" @default.