Matches in SemOpenAlex for { <https://semopenalex.org/work/W3043755557> ?p ?o ?g. }
- W3043755557 abstract "Parallel computing is the fundamental base for MapReduce framework in Hadoop. Each data chunk is replicated over 3 servers for increasing availability of data and decreasing probability of data loss. Hence, the 3 servers that have Map task stored on their disk are fastest servers to process them, which are called local servers. All servers in the same rack as local servers are called rack-local servers that are slower than local servers since data chunk associated with Map task should be fetched through top of the rack switch. All other servers are called remote servers that are slowest servers since they need to fetch data from a local server in another rack, so data should be transmitted through at least 2 top of rack switches and a core switch. Note that number of switches in path of data transfer depends on internal network structure of data centers. The First-In-First-Out (FIFO) and Hadoop Fair Scheduler (HFS) algorithms do not take rack structure of data centers into account, so they are known to not be heavy-traffic delay optimal or even throughput optimal. The recent advances on scheduling for data centers considering rack structure of them and heterogeneity of servers resulted in state-of-the-art Balanced-PANDAS algorithm that outperforms classic MaxWeight algorithm. In both Balanced-PANDAS and MaxWeight algorithms, processing rate of local, rack-local, and remote servers are assumed to be known. However, with the change of traffic over time in addition to estimation errors of processing rates, it is not realistic to consider processing rates to be known. In this work, we study robustness of Balanced-PANDAS and MaxWeight algorithms in terms of inaccurate estimations of processing rates. We observe that Balanced-PANDAS is not as sensitive as MaxWeight on the accuracy of processing rates, making it more appealing to use in data centers." @default.
- W3043755557 created "2020-07-23" @default.
- W3043755557 creator A5002795248 @default.
- W3043755557 creator A5056146157 @default.
- W3043755557 date "2020-04-14" @default.
- W3043755557 modified "2023-09-27" @default.
- W3043755557 title "Comparisons of Algorithms in Big Data Processing" @default.
- W3043755557 cites W1540956271 @default.
- W3043755557 cites W1569258476 @default.
- W3043755557 cites W1591180426 @default.
- W3043755557 cites W1598064945 @default.
- W3043755557 cites W1600799074 @default.
- W3043755557 cites W1678178911 @default.
- W3043755557 cites W177118472 @default.
- W3043755557 cites W185167974 @default.
- W3043755557 cites W1861377444 @default.
- W3043755557 cites W1974518363 @default.
- W3043755557 cites W1985330892 @default.
- W3043755557 cites W1998936794 @default.
- W3043755557 cites W1999102639 @default.
- W3043755557 cites W2015517796 @default.
- W3043755557 cites W2022678927 @default.
- W3043755557 cites W2026824323 @default.
- W3043755557 cites W2028076825 @default.
- W3043755557 cites W2029709107 @default.
- W3043755557 cites W2041927050 @default.
- W3043755557 cites W2045717006 @default.
- W3043755557 cites W2056347483 @default.
- W3043755557 cites W2076406848 @default.
- W3043755557 cites W2082183995 @default.
- W3043755557 cites W2096125134 @default.
- W3043755557 cites W2100830825 @default.
- W3043755557 cites W2104093457 @default.
- W3043755557 cites W2105802076 @default.
- W3043755557 cites W2115297415 @default.
- W3043755557 cites W2115594466 @default.
- W3043755557 cites W2117702591 @default.
- W3043755557 cites W2154442293 @default.
- W3043755557 cites W2155770202 @default.
- W3043755557 cites W2156037541 @default.
- W3043755557 cites W2159617688 @default.
- W3043755557 cites W2160222332 @default.
- W3043755557 cites W2162775152 @default.
- W3043755557 cites W2163108953 @default.
- W3043755557 cites W2164174434 @default.
- W3043755557 cites W2164774161 @default.
- W3043755557 cites W2173213060 @default.
- W3043755557 cites W2321096069 @default.
- W3043755557 cites W2333709796 @default.
- W3043755557 cites W2343335135 @default.
- W3043755557 cites W2497236108 @default.
- W3043755557 cites W2526146261 @default.
- W3043755557 cites W2594568420 @default.
- W3043755557 cites W2604490148 @default.
- W3043755557 cites W2612153958 @default.
- W3043755557 cites W2738818740 @default.
- W3043755557 cites W2744132602 @default.
- W3043755557 cites W2768603575 @default.
- W3043755557 cites W2806241433 @default.
- W3043755557 cites W2811298321 @default.
- W3043755557 cites W283401411 @default.
- W3043755557 cites W2908148244 @default.
- W3043755557 cites W2914940357 @default.
- W3043755557 cites W2935055857 @default.
- W3043755557 cites W3007234945 @default.
- W3043755557 cites W3007304072 @default.
- W3043755557 cites W3011294066 @default.
- W3043755557 cites W3012446265 @default.
- W3043755557 cites W3123517799 @default.
- W3043755557 cites W3126508259 @default.
- W3043755557 cites W2416457698 @default.
- W3043755557 hasPublicationYear "2020" @default.
- W3043755557 type Work @default.
- W3043755557 sameAs 3043755557 @default.
- W3043755557 citedByCount "0" @default.
- W3043755557 crossrefType "posted-content" @default.
- W3043755557 hasAuthorship W3043755557A5002795248 @default.
- W3043755557 hasAuthorship W3043755557A5056146157 @default.
- W3043755557 hasConcept C11413529 @default.
- W3043755557 hasConcept C120314980 @default.
- W3043755557 hasConcept C126255220 @default.
- W3043755557 hasConcept C127413603 @default.
- W3043755557 hasConcept C206729178 @default.
- W3043755557 hasConcept C2776843527 @default.
- W3043755557 hasConcept C31258907 @default.
- W3043755557 hasConcept C33923547 @default.
- W3043755557 hasConcept C41008148 @default.
- W3043755557 hasConcept C78519656 @default.
- W3043755557 hasConcept C93996380 @default.
- W3043755557 hasConceptScore W3043755557C11413529 @default.
- W3043755557 hasConceptScore W3043755557C120314980 @default.
- W3043755557 hasConceptScore W3043755557C126255220 @default.
- W3043755557 hasConceptScore W3043755557C127413603 @default.
- W3043755557 hasConceptScore W3043755557C206729178 @default.
- W3043755557 hasConceptScore W3043755557C2776843527 @default.
- W3043755557 hasConceptScore W3043755557C31258907 @default.
- W3043755557 hasConceptScore W3043755557C33923547 @default.
- W3043755557 hasConceptScore W3043755557C41008148 @default.
- W3043755557 hasConceptScore W3043755557C78519656 @default.
- W3043755557 hasConceptScore W3043755557C93996380 @default.