Matches in SemOpenAlex for { <https://semopenalex.org/work/W224788867> ?p ?o ?g. }
- W224788867 abstract "Nowadays, more and more scientific fields rely on data mining to produce new results. These raw data are produced at an increasing rate by several tools like DNA sequencers in biology, the Large Hadron Collider (LHC) in physics that produced 25 petabytes per year as of 2012, or the Large Synoptic Survey Telescope (LSST) that should produce 30 petabyte of data per night. High-resolution scanners in medical imaging and social networks also produce huge amounts of data. This data deluge raise several challenges in terms of storage and computer processing. The Google company proposed in 2004 to use the MapReduce model in order to distribute the computation across several computers.This thesis focus mainly on improving the performance of a MapReduce environment. In order to easily replace the software parts needed to improve the performance, designing a modular and adaptable MapReduce environment is necessary. This is why a component based approach is studied in order to design such a programming environment. In order to study the performance of a MapReduce application, modeling the platform, the application and their performance is mandatory. These models should be both precise enough for the algorithms using them to produce meaningful results, but also simple enough to be analyzed. A state of the art of the existing models is done and a new model adapted to the needs is defined. On order to optimise a MapReduce environment, the first studied approach is a global optimization which result in a computation time reduced by up to 47 %. The second approach focus on the shuffle phase of MapReduce when all the nodes may send some data to every other node. Several algorithms are defined and studied when the network is the bottleneck of the data transfers. These algorithms are tested on the Grid'5000 experiment platform and usually show a behavior close to the lower bound while the trivial approach is far from it." @default.
- W224788867 created "2016-06-24" @default.
- W224788867 creator A5091473199 @default.
- W224788867 date "2015-03-23" @default.
- W224788867 modified "2023-09-23" @default.
- W224788867 title "Improving MapReduce Performance on Clusters" @default.
- W224788867 cites W110612056 @default.
- W224788867 cites W1491464987 @default.
- W224788867 cites W1513913200 @default.
- W224788867 cites W1575350781 @default.
- W224788867 cites W16311991 @default.
- W224788867 cites W1651242740 @default.
- W224788867 cites W1794174336 @default.
- W224788867 cites W1834532152 @default.
- W224788867 cites W1847647515 @default.
- W224788867 cites W1861377444 @default.
- W224788867 cites W1889862212 @default.
- W224788867 cites W1952896064 @default.
- W224788867 cites W1968075755 @default.
- W224788867 cites W1968781019 @default.
- W224788867 cites W1976860187 @default.
- W224788867 cites W1979808859 @default.
- W224788867 cites W1981266946 @default.
- W224788867 cites W1981493461 @default.
- W224788867 cites W1985790218 @default.
- W224788867 cites W1988425770 @default.
- W224788867 cites W2002472616 @default.
- W224788867 cites W2013344760 @default.
- W224788867 cites W2018485251 @default.
- W224788867 cites W2022678927 @default.
- W224788867 cites W2030165200 @default.
- W224788867 cites W2039536220 @default.
- W224788867 cites W2042876290 @default.
- W224788867 cites W2047135526 @default.
- W224788867 cites W2055084240 @default.
- W224788867 cites W2055186388 @default.
- W224788867 cites W2055281385 @default.
- W224788867 cites W2057420573 @default.
- W224788867 cites W2058414872 @default.
- W224788867 cites W2060204338 @default.
- W224788867 cites W2067051372 @default.
- W224788867 cites W2070275167 @default.
- W224788867 cites W2072637364 @default.
- W224788867 cites W2087085699 @default.
- W224788867 cites W2089098642 @default.
- W224788867 cites W2096125134 @default.
- W224788867 cites W2096893233 @default.
- W224788867 cites W2098935637 @default.
- W224788867 cites W2100773341 @default.
- W224788867 cites W2104237323 @default.
- W224788867 cites W2104644701 @default.
- W224788867 cites W2109720909 @default.
- W224788867 cites W2110086534 @default.
- W224788867 cites W2112486185 @default.
- W224788867 cites W2117489143 @default.
- W224788867 cites W2118676041 @default.
- W224788867 cites W2119738171 @default.
- W224788867 cites W2120458882 @default.
- W224788867 cites W2120755171 @default.
- W224788867 cites W2124101779 @default.
- W224788867 cites W2126160525 @default.
- W224788867 cites W2130531694 @default.
- W224788867 cites W2133754329 @default.
- W224788867 cites W2138440835 @default.
- W224788867 cites W2139605600 @default.
- W224788867 cites W2140509629 @default.
- W224788867 cites W2141740699 @default.
- W224788867 cites W2142863519 @default.
- W224788867 cites W2143462372 @default.
- W224788867 cites W2154442293 @default.
- W224788867 cites W2154446133 @default.
- W224788867 cites W2154655801 @default.
- W224788867 cites W2157099238 @default.
- W224788867 cites W2157614013 @default.
- W224788867 cites W2162155824 @default.
- W224788867 cites W2167500728 @default.
- W224788867 cites W2173213060 @default.
- W224788867 cites W2275530856 @default.
- W224788867 cites W2285891976 @default.
- W224788867 cites W2294316975 @default.
- W224788867 cites W2296381359 @default.
- W224788867 cites W2613419005 @default.
- W224788867 cites W2616747538 @default.
- W224788867 cites W2752885492 @default.
- W224788867 cites W2912802084 @default.
- W224788867 cites W3145042860 @default.
- W224788867 cites W593241111 @default.
- W224788867 cites W63594926 @default.
- W224788867 hasPublicationYear "2015" @default.
- W224788867 type Work @default.
- W224788867 sameAs 224788867 @default.
- W224788867 citedByCount "0" @default.
- W224788867 crossrefType "dissertation" @default.
- W224788867 hasAuthorship W224788867A5091473199 @default.
- W224788867 hasConcept C10138342 @default.
- W224788867 hasConcept C101468663 @default.
- W224788867 hasConcept C111919701 @default.
- W224788867 hasConcept C11413529 @default.
- W224788867 hasConcept C120314980 @default.
- W224788867 hasConcept C120665830 @default.