Matches in SemOpenAlex for { <https://semopenalex.org/work/W1551149630> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W1551149630 abstract "Hadoop MapReduce is one of the largely used platforms for large scale data processing. Hadoop cluster has machines with different resources, including memory size, CPU capability and disk space. This introduces challenging research issue of improving Hadoop's performance through proper resource provisioning. The work presented in this paper focuses on optimizing job scheduling in Hadoop. Workload Characteristic and Resource Aware (WCRA) Hadoop scheduler is proposed, that classifies the jobs into CPU bound and Disk I/O bound. Based on the performance, nodes in the cluster are classified as CPU busy and Disk I/O busy. The amount of primary memory available in the node is ensured to be more than 25% before scheduling the job. Performance parameters of Map tasks such as the time required for parsing the data, map, sort and merge the result, and of Reduce task, such as the time to merge, parse and reduce is considered to categorize the job as CPU bound or Disk I/O bound. Tasks are assigned the priority based on their minimum Estimated Completion Time. The jobs are scheduled on a compute node in such a way that jobs already running on it will not be affected. Experimental results has given 30 % improvement in performance compared to Hadoop's FIFO, Fair and Capacity scheduler." @default.
- W1551149630 created "2016-06-24" @default.
- W1551149630 creator A5008134411 @default.
- W1551149630 creator A5021922196 @default.
- W1551149630 date "2015-07-01" @default.
- W1551149630 modified "2023-09-27" @default.
- W1551149630 title "Workload characteristics and resource aware Hadoop scheduler" @default.
- W1551149630 cites W161201110 @default.
- W1551149630 cites W185167974 @default.
- W1551149630 cites W1968230071 @default.
- W1551149630 cites W2001041091 @default.
- W1551149630 cites W2055533652 @default.
- W1551149630 cites W2058047606 @default.
- W1551149630 cites W2067005380 @default.
- W1551149630 cites W2074501444 @default.
- W1551149630 cites W2096125134 @default.
- W1551149630 cites W2105054767 @default.
- W1551149630 cites W2157099238 @default.
- W1551149630 cites W2169413177 @default.
- W1551149630 cites W2170704906 @default.
- W1551149630 cites W2173213060 @default.
- W1551149630 cites W2339804275 @default.
- W1551149630 cites W413391506 @default.
- W1551149630 doi "https://doi.org/10.1109/retis.2015.7232871" @default.
- W1551149630 hasPublicationYear "2015" @default.
- W1551149630 type Work @default.
- W1551149630 sameAs 1551149630 @default.
- W1551149630 citedByCount "5" @default.
- W1551149630 countsByYear W15511496302017 @default.
- W1551149630 countsByYear W15511496302018 @default.
- W1551149630 countsByYear W15511496302019 @default.
- W1551149630 countsByYear W15511496302021 @default.
- W1551149630 crossrefType "proceedings-article" @default.
- W1551149630 hasAuthorship W1551149630A5008134411 @default.
- W1551149630 hasAuthorship W1551149630A5021922196 @default.
- W1551149630 hasConcept C111873713 @default.
- W1551149630 hasConcept C111919701 @default.
- W1551149630 hasConcept C120314980 @default.
- W1551149630 hasConcept C162324750 @default.
- W1551149630 hasConcept C173608175 @default.
- W1551149630 hasConcept C197129107 @default.
- W1551149630 hasConcept C206729178 @default.
- W1551149630 hasConcept C21547014 @default.
- W1551149630 hasConcept C2777145635 @default.
- W1551149630 hasConcept C2778476105 @default.
- W1551149630 hasConcept C41008148 @default.
- W1551149630 hasConcept C48721391 @default.
- W1551149630 hasConcept C77088390 @default.
- W1551149630 hasConcept C79974875 @default.
- W1551149630 hasConceptScore W1551149630C111873713 @default.
- W1551149630 hasConceptScore W1551149630C111919701 @default.
- W1551149630 hasConceptScore W1551149630C120314980 @default.
- W1551149630 hasConceptScore W1551149630C162324750 @default.
- W1551149630 hasConceptScore W1551149630C173608175 @default.
- W1551149630 hasConceptScore W1551149630C197129107 @default.
- W1551149630 hasConceptScore W1551149630C206729178 @default.
- W1551149630 hasConceptScore W1551149630C21547014 @default.
- W1551149630 hasConceptScore W1551149630C2777145635 @default.
- W1551149630 hasConceptScore W1551149630C2778476105 @default.
- W1551149630 hasConceptScore W1551149630C41008148 @default.
- W1551149630 hasConceptScore W1551149630C48721391 @default.
- W1551149630 hasConceptScore W1551149630C77088390 @default.
- W1551149630 hasConceptScore W1551149630C79974875 @default.
- W1551149630 hasLocation W15511496301 @default.
- W1551149630 hasOpenAccess W1551149630 @default.
- W1551149630 hasPrimaryLocation W15511496301 @default.
- W1551149630 hasRelatedWork W1521911429 @default.
- W1551149630 hasRelatedWork W1545686965 @default.
- W1551149630 hasRelatedWork W1554459923 @default.
- W1551149630 hasRelatedWork W1987516674 @default.
- W1551149630 hasRelatedWork W1992928432 @default.
- W1551149630 hasRelatedWork W2003642209 @default.
- W1551149630 hasRelatedWork W2010695522 @default.
- W1551149630 hasRelatedWork W2048038783 @default.
- W1551149630 hasRelatedWork W2105054767 @default.
- W1551149630 hasRelatedWork W2163626053 @default.
- W1551149630 hasRelatedWork W2287293435 @default.
- W1551149630 hasRelatedWork W2294489640 @default.
- W1551149630 hasRelatedWork W2783721313 @default.
- W1551149630 hasRelatedWork W2792986258 @default.
- W1551149630 hasRelatedWork W2810781488 @default.
- W1551149630 hasRelatedWork W2919057462 @default.
- W1551149630 hasRelatedWork W3034553598 @default.
- W1551149630 hasRelatedWork W3042877361 @default.
- W1551149630 hasRelatedWork W3048510945 @default.
- W1551149630 hasRelatedWork W413391506 @default.
- W1551149630 isParatext "false" @default.
- W1551149630 isRetracted "false" @default.
- W1551149630 magId "1551149630" @default.
- W1551149630 workType "article" @default.