Matches in SemOpenAlex for { <https://semopenalex.org/work/W1536639265> ?p ?o ?g. }
- W1536639265 endingPage "3" @default.
- W1536639265 startingPage "3" @default.
- W1536639265 abstract "Large companies like Facebook, Google, and Microsoft as well as a number of small and medium enterprises daily process massive amounts of data in batch jobs and in real time applications. This generates high network traffic, which is hard to support using traditional, oversubscribed, network infrastructures. To address this issue, several novel network topologies have been proposed, aiming at increasing the bandwidth available in enterprise clusters.We observe that in many of the commonly used workloads, data is aggregated during the process and the output size is a fraction of the input size. This motivated us to explore a different point in the design space. Instead of increasing the bandwidth, we focus on decreasing the traffic by pushing aggregation from the edge into the network.We built Camdoop, a MapReduce-like system running on CamCube, a cluster design that uses a direct-connect network topology with servers directly linked to other servers. Camdoop exploits the property that CamCube servers forward traffic to perform in-network aggregation of data during the shuffle phase. Camdoop supports the same functions used in MapReduce and is compatible with existing MapReduce applications. We demonstrate that, in common cases, Camdoop significantly reduces the network traffic and provides high performance increase over a version of Camdoop running over a switch and against two production systems, Hadoop and Dryad/DryadLINQ." @default.
- W1536639265 created "2016-06-24" @default.
- W1536639265 creator A5018671035 @default.
- W1536639265 creator A5019519706 @default.
- W1536639265 creator A5033317994 @default.
- W1536639265 creator A5087216360 @default.
- W1536639265 date "2012-04-25" @default.
- W1536639265 modified "2023-10-05" @default.
- W1536639265 title "Camdoop: exploiting in-network aggregation for big data applications" @default.
- W1536639265 cites W1487337216 @default.
- W1536639265 cites W1493893823 @default.
- W1536639265 cites W1537714433 @default.
- W1536639265 cites W1587951920 @default.
- W1536639265 cites W1698388015 @default.
- W1536639265 cites W174578849 @default.
- W1536639265 cites W1857009450 @default.
- W1536639265 cites W1985419898 @default.
- W1536639265 cites W1995597621 @default.
- W1536639265 cites W1997369208 @default.
- W1536639265 cites W2010929544 @default.
- W1536639265 cites W2056394733 @default.
- W1536639265 cites W2060204338 @default.
- W1536639265 cites W2099283075 @default.
- W1536639265 cites W2099952176 @default.
- W1536639265 cites W2100830825 @default.
- W1536639265 cites W2114103324 @default.
- W1536639265 cites W2115503987 @default.
- W1536639265 cites W2119528150 @default.
- W1536639265 cites W2119565742 @default.
- W1536639265 cites W2120417050 @default.
- W1536639265 cites W2126210439 @default.
- W1536639265 cites W2128958340 @default.
- W1536639265 cites W2130182604 @default.
- W1536639265 cites W2130531694 @default.
- W1536639265 cites W2133581580 @default.
- W1536639265 cites W2144499729 @default.
- W1536639265 cites W2151062909 @default.
- W1536639265 cites W2157355837 @default.
- W1536639265 cites W2157614013 @default.
- W1536639265 cites W2163059190 @default.
- W1536639265 cites W2163291889 @default.
- W1536639265 cites W2163769126 @default.
- W1536639265 cites W2164740236 @default.
- W1536639265 cites W2167396179 @default.
- W1536639265 cites W2168595508 @default.
- W1536639265 cites W2171575705 @default.
- W1536639265 cites W2173213060 @default.
- W1536639265 cites W2912802084 @default.
- W1536639265 cites W79504326 @default.
- W1536639265 cites W2283242794 @default.
- W1536639265 cites W2609208611 @default.
- W1536639265 hasPublicationYear "2012" @default.
- W1536639265 type Work @default.
- W1536639265 sameAs 1536639265 @default.
- W1536639265 citedByCount "59" @default.
- W1536639265 countsByYear W15366392652012 @default.
- W1536639265 countsByYear W15366392652013 @default.
- W1536639265 countsByYear W15366392652014 @default.
- W1536639265 countsByYear W15366392652015 @default.
- W1536639265 countsByYear W15366392652016 @default.
- W1536639265 countsByYear W15366392652017 @default.
- W1536639265 countsByYear W15366392652018 @default.
- W1536639265 countsByYear W15366392652019 @default.
- W1536639265 countsByYear W15366392652020 @default.
- W1536639265 countsByYear W15366392652021 @default.
- W1536639265 crossrefType "proceedings-article" @default.
- W1536639265 hasAuthorship W1536639265A5018671035 @default.
- W1536639265 hasAuthorship W1536639265A5019519706 @default.
- W1536639265 hasAuthorship W1536639265A5033317994 @default.
- W1536639265 hasAuthorship W1536639265A5087216360 @default.
- W1536639265 hasConcept C120314980 @default.
- W1536639265 hasConcept C165696696 @default.
- W1536639265 hasConcept C199845137 @default.
- W1536639265 hasConcept C2776257435 @default.
- W1536639265 hasConcept C31258907 @default.
- W1536639265 hasConcept C38652104 @default.
- W1536639265 hasConcept C41008148 @default.
- W1536639265 hasConcept C93996380 @default.
- W1536639265 hasConceptScore W1536639265C120314980 @default.
- W1536639265 hasConceptScore W1536639265C165696696 @default.
- W1536639265 hasConceptScore W1536639265C199845137 @default.
- W1536639265 hasConceptScore W1536639265C2776257435 @default.
- W1536639265 hasConceptScore W1536639265C31258907 @default.
- W1536639265 hasConceptScore W1536639265C38652104 @default.
- W1536639265 hasConceptScore W1536639265C41008148 @default.
- W1536639265 hasConceptScore W1536639265C93996380 @default.
- W1536639265 hasLocation W15366392651 @default.
- W1536639265 hasOpenAccess W1536639265 @default.
- W1536639265 hasPrimaryLocation W15366392651 @default.
- W1536639265 hasRelatedWork W1493893823 @default.
- W1536639265 hasRelatedWork W1698388015 @default.
- W1536639265 hasRelatedWork W1861377444 @default.
- W1536639265 hasRelatedWork W2022678927 @default.
- W1536639265 hasRelatedWork W2096125134 @default.
- W1536639265 hasRelatedWork W2100830825 @default.
- W1536639265 hasRelatedWork W2110104287 @default.
- W1536639265 hasRelatedWork W2110514750 @default.
- W1536639265 hasRelatedWork W2114103324 @default.