Matches in SemOpenAlex for { <https://semopenalex.org/work/W2157099238> ?p ?o ?g. }
Showing items 1 to 98 of
98
with 100 items per page.
- W2157099238 abstract "MapReduce is a programming model that supports distributed and parallel processing for large-scale data-intensive applications such as machine learning, data mining, and scientific simulation. Hadoop is an open-source implementation of the MapReduce programming model. Hadoop is used by many companies including Yahoo!, Amazon, and Facebook to perform various data mining on large-scale data sets such as user search logs and visit logs. In these cases, it is very common to share the same computing resources by multiple users due to practical considerations about cost, system utilization, and manageability. However, Hadoop assumes that all cluster nodes are dedicated to a single user, failing to guarantee high performance in the shared MapReduce computation environment. In this paper, we propose two optimization schemes, prefetching and pre-shuffling, which improve the overall performance under the shared environment while retaining compatibility with the native Hadoop. The proposed schemes are implemented in the native Hadoop-0.18.3 as a plug-in component called HPMR (High Performance MapReduce Engine). Our evaluation on the Yahoo!Grid platform with three different workloads and seven types of test sets from Yahoo! shows that HPMR reduces the execution time by up to 73%." @default.
- W2157099238 created "2016-06-24" @default.
- W2157099238 creator A5039343718 @default.
- W2157099238 creator A5045922502 @default.
- W2157099238 creator A5050941325 @default.
- W2157099238 creator A5061058177 @default.
- W2157099238 creator A5076261696 @default.
- W2157099238 creator A5083141649 @default.
- W2157099238 date "2009-01-01" @default.
- W2157099238 modified "2023-10-16" @default.
- W2157099238 title "HPMR: Prefetching and pre-shuffling in shared MapReduce computation environment" @default.
- W2157099238 cites W1967838552 @default.
- W2157099238 cites W2030599258 @default.
- W2157099238 cites W2044534358 @default.
- W2157099238 cites W2047418149 @default.
- W2157099238 cites W2049482525 @default.
- W2157099238 cites W2098935637 @default.
- W2157099238 cites W2100830825 @default.
- W2157099238 cites W2154894831 @default.
- W2157099238 cites W2436525433 @default.
- W2157099238 cites W4239670432 @default.
- W2157099238 cites W4248953486 @default.
- W2157099238 doi "https://doi.org/10.1109/clustr.2009.5289171" @default.
- W2157099238 hasPublicationYear "2009" @default.
- W2157099238 type Work @default.
- W2157099238 sameAs 2157099238 @default.
- W2157099238 citedByCount "108" @default.
- W2157099238 countsByYear W21570992382012 @default.
- W2157099238 countsByYear W21570992382013 @default.
- W2157099238 countsByYear W21570992382014 @default.
- W2157099238 countsByYear W21570992382015 @default.
- W2157099238 countsByYear W21570992382016 @default.
- W2157099238 countsByYear W21570992382017 @default.
- W2157099238 countsByYear W21570992382018 @default.
- W2157099238 countsByYear W21570992382019 @default.
- W2157099238 countsByYear W21570992382021 @default.
- W2157099238 crossrefType "proceedings-article" @default.
- W2157099238 hasAuthorship W2157099238A5039343718 @default.
- W2157099238 hasAuthorship W2157099238A5045922502 @default.
- W2157099238 hasAuthorship W2157099238A5050941325 @default.
- W2157099238 hasAuthorship W2157099238A5061058177 @default.
- W2157099238 hasAuthorship W2157099238A5076261696 @default.
- W2157099238 hasAuthorship W2157099238A5083141649 @default.
- W2157099238 hasConcept C111919701 @default.
- W2157099238 hasConcept C11413529 @default.
- W2157099238 hasConcept C120314980 @default.
- W2157099238 hasConcept C121332964 @default.
- W2157099238 hasConcept C167927819 @default.
- W2157099238 hasConcept C168167062 @default.
- W2157099238 hasConcept C173608175 @default.
- W2157099238 hasConcept C187691185 @default.
- W2157099238 hasConcept C199360897 @default.
- W2157099238 hasConcept C2524010 @default.
- W2157099238 hasConcept C33923547 @default.
- W2157099238 hasConcept C34165917 @default.
- W2157099238 hasConcept C41008148 @default.
- W2157099238 hasConcept C45374587 @default.
- W2157099238 hasConcept C70429105 @default.
- W2157099238 hasConcept C75684735 @default.
- W2157099238 hasConcept C76831024 @default.
- W2157099238 hasConcept C79974875 @default.
- W2157099238 hasConcept C97355855 @default.
- W2157099238 hasConceptScore W2157099238C111919701 @default.
- W2157099238 hasConceptScore W2157099238C11413529 @default.
- W2157099238 hasConceptScore W2157099238C120314980 @default.
- W2157099238 hasConceptScore W2157099238C121332964 @default.
- W2157099238 hasConceptScore W2157099238C167927819 @default.
- W2157099238 hasConceptScore W2157099238C168167062 @default.
- W2157099238 hasConceptScore W2157099238C173608175 @default.
- W2157099238 hasConceptScore W2157099238C187691185 @default.
- W2157099238 hasConceptScore W2157099238C199360897 @default.
- W2157099238 hasConceptScore W2157099238C2524010 @default.
- W2157099238 hasConceptScore W2157099238C33923547 @default.
- W2157099238 hasConceptScore W2157099238C34165917 @default.
- W2157099238 hasConceptScore W2157099238C41008148 @default.
- W2157099238 hasConceptScore W2157099238C45374587 @default.
- W2157099238 hasConceptScore W2157099238C70429105 @default.
- W2157099238 hasConceptScore W2157099238C75684735 @default.
- W2157099238 hasConceptScore W2157099238C76831024 @default.
- W2157099238 hasConceptScore W2157099238C79974875 @default.
- W2157099238 hasConceptScore W2157099238C97355855 @default.
- W2157099238 hasLocation W21570992381 @default.
- W2157099238 hasOpenAccess W2157099238 @default.
- W2157099238 hasPrimaryLocation W21570992381 @default.
- W2157099238 hasRelatedWork W1585052355 @default.
- W2157099238 hasRelatedWork W1865085340 @default.
- W2157099238 hasRelatedWork W2143819726 @default.
- W2157099238 hasRelatedWork W2158030964 @default.
- W2157099238 hasRelatedWork W2188069249 @default.
- W2157099238 hasRelatedWork W2353464440 @default.
- W2157099238 hasRelatedWork W2522947711 @default.
- W2157099238 hasRelatedWork W2911620088 @default.
- W2157099238 hasRelatedWork W3004288367 @default.
- W2157099238 hasRelatedWork W4297792185 @default.
- W2157099238 isParatext "false" @default.
- W2157099238 isRetracted "false" @default.
- W2157099238 magId "2157099238" @default.
- W2157099238 workType "article" @default.