Matches in SemOpenAlex for { <https://semopenalex.org/work/W1756536912> ?p ?o ?g. }
- W1756536912 endingPage "22" @default.
- W1756536912 startingPage "22" @default.
- W1756536912 abstract "Map/Reduce style data-parallel computation is characterized by the extensive use of user-defined functions for data processing and relies on data-shuffling stages to prepare data partitions for parallel computation. Instead of treating user-defined functions as black boxes, we propose to analyze those functions to turn them into gray boxes that expose opportunities to optimize data shuffling. We identify useful functional properties for user-defined functions, and propose SUDO, an optimization framework that reasons about data-partition properties, functional properties, and data shuffling. We have assessed this optimization opportunity on over 10,000 data-parallel programs used in production SCOPE clusters, and designed a framework that is incorporated it into the production system. Experiments with real SCOPE programs on real production data have shown that this optimization can save up to 47% in terms of disk and network I/O for shuffling, and up to 48% in terms of cross-pod network traffic." @default.
- W1756536912 created "2016-06-24" @default.
- W1756536912 creator A5013547786 @default.
- W1756536912 creator A5014463358 @default.
- W1756536912 creator A5017996548 @default.
- W1756536912 creator A5025481175 @default.
- W1756536912 creator A5032588207 @default.
- W1756536912 creator A5037359171 @default.
- W1756536912 creator A5057864403 @default.
- W1756536912 creator A5064254080 @default.
- W1756536912 creator A5074075949 @default.
- W1756536912 creator A5086880570 @default.
- W1756536912 date "2012-04-25" @default.
- W1756536912 modified "2023-10-03" @default.
- W1756536912 title "Optimizing data shuffling in data-parallel computation by understanding user-defined functions" @default.
- W1756536912 cites W1487337216 @default.
- W1756536912 cites W1491178396 @default.
- W1756536912 cites W1493893823 @default.
- W1756536912 cites W1494930385 @default.
- W1756536912 cites W1531082802 @default.
- W1756536912 cites W1535431348 @default.
- W1756536912 cites W1547205936 @default.
- W1756536912 cites W1585877844 @default.
- W1756536912 cites W1597532222 @default.
- W1756536912 cites W1980590442 @default.
- W1756536912 cites W1983342812 @default.
- W1756536912 cites W1983587324 @default.
- W1756536912 cites W1993433750 @default.
- W1756536912 cites W2025549137 @default.
- W1756536912 cites W2037168816 @default.
- W1756536912 cites W2090777502 @default.
- W1756536912 cites W2094469165 @default.
- W1756536912 cites W2096092966 @default.
- W1756536912 cites W2098935637 @default.
- W1756536912 cites W2100830825 @default.
- W1756536912 cites W2104327580 @default.
- W1756536912 cites W2110086534 @default.
- W1756536912 cites W2110104287 @default.
- W1756536912 cites W2114067856 @default.
- W1756536912 cites W2114103324 @default.
- W1756536912 cites W2114303224 @default.
- W1756536912 cites W2119400430 @default.
- W1756536912 cites W2119714163 @default.
- W1756536912 cites W2122465391 @default.
- W1756536912 cites W2126594616 @default.
- W1756536912 cites W2145335345 @default.
- W1756536912 cites W2147722789 @default.
- W1756536912 cites W2153329411 @default.
- W1756536912 cites W2153889808 @default.
- W1756536912 cites W2154894831 @default.
- W1756536912 cites W2157182386 @default.
- W1756536912 cites W2158050820 @default.
- W1756536912 cites W2295114861 @default.
- W1756536912 cites W2295244175 @default.
- W1756536912 cites W2296349066 @default.
- W1756536912 cites W2912802084 @default.
- W1756536912 cites W2913256667 @default.
- W1756536912 cites W37827439 @default.
- W1756536912 hasPublicationYear "2012" @default.
- W1756536912 type Work @default.
- W1756536912 sameAs 1756536912 @default.
- W1756536912 citedByCount "26" @default.
- W1756536912 countsByYear W17565369122012 @default.
- W1756536912 countsByYear W17565369122013 @default.
- W1756536912 countsByYear W17565369122014 @default.
- W1756536912 countsByYear W17565369122015 @default.
- W1756536912 countsByYear W17565369122016 @default.
- W1756536912 countsByYear W17565369122017 @default.
- W1756536912 countsByYear W17565369122019 @default.
- W1756536912 countsByYear W17565369122020 @default.
- W1756536912 countsByYear W17565369122021 @default.
- W1756536912 countsByYear W17565369122022 @default.
- W1756536912 crossrefType "proceedings-article" @default.
- W1756536912 hasAuthorship W1756536912A5013547786 @default.
- W1756536912 hasAuthorship W1756536912A5014463358 @default.
- W1756536912 hasAuthorship W1756536912A5017996548 @default.
- W1756536912 hasAuthorship W1756536912A5025481175 @default.
- W1756536912 hasAuthorship W1756536912A5032588207 @default.
- W1756536912 hasAuthorship W1756536912A5037359171 @default.
- W1756536912 hasAuthorship W1756536912A5057864403 @default.
- W1756536912 hasAuthorship W1756536912A5064254080 @default.
- W1756536912 hasAuthorship W1756536912A5074075949 @default.
- W1756536912 hasAuthorship W1756536912A5086880570 @default.
- W1756536912 hasConcept C11413529 @default.
- W1756536912 hasConcept C114614502 @default.
- W1756536912 hasConcept C167927819 @default.
- W1756536912 hasConcept C199360897 @default.
- W1756536912 hasConcept C2778012447 @default.
- W1756536912 hasConcept C33923547 @default.
- W1756536912 hasConcept C41008148 @default.
- W1756536912 hasConcept C42812 @default.
- W1756536912 hasConcept C45374587 @default.
- W1756536912 hasConcept C80444323 @default.
- W1756536912 hasConceptScore W1756536912C11413529 @default.
- W1756536912 hasConceptScore W1756536912C114614502 @default.
- W1756536912 hasConceptScore W1756536912C167927819 @default.
- W1756536912 hasConceptScore W1756536912C199360897 @default.
- W1756536912 hasConceptScore W1756536912C2778012447 @default.