Matches in SemOpenAlex for { <https://semopenalex.org/work/W2885175122> ?p ?o ?g. }
- W2885175122 abstract "Most distributed file systems assign new files to storage servers randomly. While working well in some situations, this does not help to optimize the input performance for most MapReduce computations' data access patterns. In this work, we consider an access pattern where input files are partitioned into groups of heterogeneous size. Each group is accessed by exactly one process. We design and implement a data placement strategy that places these file groups together on the same storage server. This colocation approach is combined with near-optimal storage load balancing. To do so, we use a classical scheduling approximation algorithm to solve the NP hard group assignment problem. We argue that local processing is not only beneficial because of reduced network traffic, but especially because it imposes an even resource schedule. Our experiments, based on the parallel processing of remote sensing images, reveal an enormous reduction of network traffic and up to 39 % faster input read times. Further, simulations show that our approximate assignments limit storage server imbalances to less than 5 % above the theoretical minimum, in contrast to more than 85 % with random assignment." @default.
- W2885175122 created "2018-08-22" @default.
- W2885175122 creator A5007738316 @default.
- W2885175122 creator A5033149837 @default.
- W2885175122 creator A5060801460 @default.
- W2885175122 date "2018-05-01" @default.
- W2885175122 modified "2023-09-25" @default.
- W2885175122 title "Improving I/O Performance Through Colocating Interrelated Input Data and Near-Optimal Load Balancing" @default.
- W2885175122 cites W1968563567 @default.
- W2885175122 cites W1970979311 @default.
- W2885175122 cites W1978732961 @default.
- W2885175122 cites W1984292487 @default.
- W2885175122 cites W1986282189 @default.
- W2885175122 cites W1996438407 @default.
- W2885175122 cites W1999984505 @default.
- W2885175122 cites W2000664510 @default.
- W2885175122 cites W2004958263 @default.
- W2885175122 cites W2038303146 @default.
- W2885175122 cites W2058917948 @default.
- W2885175122 cites W2062657914 @default.
- W2885175122 cites W2074988668 @default.
- W2885175122 cites W2079055947 @default.
- W2885175122 cites W2079251873 @default.
- W2885175122 cites W2089269509 @default.
- W2885175122 cites W2089288909 @default.
- W2885175122 cites W2102294813 @default.
- W2885175122 cites W2109706326 @default.
- W2885175122 cites W2121810937 @default.
- W2885175122 cites W2122465391 @default.
- W2885175122 cites W2131975293 @default.
- W2885175122 cites W2163726882 @default.
- W2885175122 cites W2181088386 @default.
- W2885175122 cites W2284140255 @default.
- W2885175122 cites W2594712981 @default.
- W2885175122 cites W2725897987 @default.
- W2885175122 doi "https://doi.org/10.1109/ipdpsw.2018.00081" @default.
- W2885175122 hasPublicationYear "2018" @default.
- W2885175122 type Work @default.
- W2885175122 sameAs 2885175122 @default.
- W2885175122 citedByCount "0" @default.
- W2885175122 crossrefType "proceedings-article" @default.
- W2885175122 hasAuthorship W2885175122A5007738316 @default.
- W2885175122 hasAuthorship W2885175122A5033149837 @default.
- W2885175122 hasAuthorship W2885175122A5060801460 @default.
- W2885175122 hasConcept C101722063 @default.
- W2885175122 hasConcept C111919701 @default.
- W2885175122 hasConcept C11413529 @default.
- W2885175122 hasConcept C120314980 @default.
- W2885175122 hasConcept C126255220 @default.
- W2885175122 hasConcept C138959212 @default.
- W2885175122 hasConcept C148764684 @default.
- W2885175122 hasConcept C173608175 @default.
- W2885175122 hasConcept C187691185 @default.
- W2885175122 hasConcept C206729178 @default.
- W2885175122 hasConcept C2524010 @default.
- W2885175122 hasConcept C31258907 @default.
- W2885175122 hasConcept C33923547 @default.
- W2885175122 hasConcept C41008148 @default.
- W2885175122 hasConcept C4373008 @default.
- W2885175122 hasConcept C45374587 @default.
- W2885175122 hasConcept C68387754 @default.
- W2885175122 hasConcept C93996380 @default.
- W2885175122 hasConcept C98045186 @default.
- W2885175122 hasConceptScore W2885175122C101722063 @default.
- W2885175122 hasConceptScore W2885175122C111919701 @default.
- W2885175122 hasConceptScore W2885175122C11413529 @default.
- W2885175122 hasConceptScore W2885175122C120314980 @default.
- W2885175122 hasConceptScore W2885175122C126255220 @default.
- W2885175122 hasConceptScore W2885175122C138959212 @default.
- W2885175122 hasConceptScore W2885175122C148764684 @default.
- W2885175122 hasConceptScore W2885175122C173608175 @default.
- W2885175122 hasConceptScore W2885175122C187691185 @default.
- W2885175122 hasConceptScore W2885175122C206729178 @default.
- W2885175122 hasConceptScore W2885175122C2524010 @default.
- W2885175122 hasConceptScore W2885175122C31258907 @default.
- W2885175122 hasConceptScore W2885175122C33923547 @default.
- W2885175122 hasConceptScore W2885175122C41008148 @default.
- W2885175122 hasConceptScore W2885175122C4373008 @default.
- W2885175122 hasConceptScore W2885175122C45374587 @default.
- W2885175122 hasConceptScore W2885175122C68387754 @default.
- W2885175122 hasConceptScore W2885175122C93996380 @default.
- W2885175122 hasConceptScore W2885175122C98045186 @default.
- W2885175122 hasLocation W28851751221 @default.
- W2885175122 hasOpenAccess W2885175122 @default.
- W2885175122 hasPrimaryLocation W28851751221 @default.
- W2885175122 hasRelatedWork W1486923923 @default.
- W2885175122 hasRelatedWork W1535499771 @default.
- W2885175122 hasRelatedWork W1751470173 @default.
- W2885175122 hasRelatedWork W1996359191 @default.
- W2885175122 hasRelatedWork W2047691106 @default.
- W2885175122 hasRelatedWork W2116494850 @default.
- W2885175122 hasRelatedWork W2283764194 @default.
- W2885175122 hasRelatedWork W2315612884 @default.
- W2885175122 hasRelatedWork W2424868040 @default.
- W2885175122 hasRelatedWork W2534999042 @default.
- W2885175122 hasRelatedWork W2795400936 @default.
- W2885175122 hasRelatedWork W2884387459 @default.
- W2885175122 hasRelatedWork W2902547952 @default.
- W2885175122 hasRelatedWork W2906545490 @default.
- W2885175122 hasRelatedWork W2987263449 @default.