Matches in SemOpenAlex for { <https://semopenalex.org/work/W4297129129> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W4297129129 abstract "Parallel dataflow systems are a central part of most analytic pipelines for big data. The iterative nature of many analysis and machine learning algorithms, however, is still a challenge for current systems. While certain types of bulk iterative algorithms are supported by novel dataflow frameworks, these systems cannot exploit computational dependencies present in many algorithms, such as graph algorithms. As a result, these algorithms are inefficiently executed and have led to specialized systems based on other paradigms, such as message passing or shared memory. We propose a method to integrate incremental iterations, a form of workset iterations, with parallel dataflows. After showing how to integrate bulk iterations into a dataflow system and its optimizer, we present an extension to the programming model for incremental iterations. The extension alleviates for the lack of mutable state in dataflows and allows for exploiting the sparse computational dependencies inherent in many iterative algorithms. The evaluation of a prototypical implementation shows that those aspects lead to up to two orders of magnitude speedup in algorithm runtime, when exploited. In our experiments, the improved dataflow system is highly competitive with specialized systems while maintaining a transparent and unified dataflow abstraction." @default.
- W4297129129 created "2022-09-27" @default.
- W4297129129 creator A5002413906 @default.
- W4297129129 creator A5022844658 @default.
- W4297129129 creator A5027972403 @default.
- W4297129129 creator A5036482272 @default.
- W4297129129 date "2012-07-31" @default.
- W4297129129 modified "2023-09-23" @default.
- W4297129129 title "Spinning Fast Iterative Data Flows" @default.
- W4297129129 doi "https://doi.org/10.48550/arxiv.1208.0088" @default.
- W4297129129 hasPublicationYear "2012" @default.
- W4297129129 type Work @default.
- W4297129129 citedByCount "0" @default.
- W4297129129 crossrefType "posted-content" @default.
- W4297129129 hasAuthorship W4297129129A5002413906 @default.
- W4297129129 hasAuthorship W4297129129A5022844658 @default.
- W4297129129 hasAuthorship W4297129129A5027972403 @default.
- W4297129129 hasAuthorship W4297129129A5036482272 @default.
- W4297129129 hasBestOaLocation W42971291291 @default.
- W4297129129 hasConcept C111472728 @default.
- W4297129129 hasConcept C11413529 @default.
- W4297129129 hasConcept C124304363 @default.
- W4297129129 hasConcept C132525143 @default.
- W4297129129 hasConcept C138885662 @default.
- W4297129129 hasConcept C159694833 @default.
- W4297129129 hasConcept C162319229 @default.
- W4297129129 hasConcept C165696696 @default.
- W4297129129 hasConcept C173608175 @default.
- W4297129129 hasConcept C176727019 @default.
- W4297129129 hasConcept C199360897 @default.
- W4297129129 hasConcept C38652104 @default.
- W4297129129 hasConcept C41008148 @default.
- W4297129129 hasConcept C43521106 @default.
- W4297129129 hasConcept C68339613 @default.
- W4297129129 hasConcept C80444323 @default.
- W4297129129 hasConcept C96324660 @default.
- W4297129129 hasConceptScore W4297129129C111472728 @default.
- W4297129129 hasConceptScore W4297129129C11413529 @default.
- W4297129129 hasConceptScore W4297129129C124304363 @default.
- W4297129129 hasConceptScore W4297129129C132525143 @default.
- W4297129129 hasConceptScore W4297129129C138885662 @default.
- W4297129129 hasConceptScore W4297129129C159694833 @default.
- W4297129129 hasConceptScore W4297129129C162319229 @default.
- W4297129129 hasConceptScore W4297129129C165696696 @default.
- W4297129129 hasConceptScore W4297129129C173608175 @default.
- W4297129129 hasConceptScore W4297129129C176727019 @default.
- W4297129129 hasConceptScore W4297129129C199360897 @default.
- W4297129129 hasConceptScore W4297129129C38652104 @default.
- W4297129129 hasConceptScore W4297129129C41008148 @default.
- W4297129129 hasConceptScore W4297129129C43521106 @default.
- W4297129129 hasConceptScore W4297129129C68339613 @default.
- W4297129129 hasConceptScore W4297129129C80444323 @default.
- W4297129129 hasConceptScore W4297129129C96324660 @default.
- W4297129129 hasLocation W42971291291 @default.
- W4297129129 hasLocation W42971291292 @default.
- W4297129129 hasOpenAccess W4297129129 @default.
- W4297129129 hasPrimaryLocation W42971291291 @default.
- W4297129129 hasRelatedWork W1572523360 @default.
- W4297129129 hasRelatedWork W1586644070 @default.
- W4297129129 hasRelatedWork W1998949396 @default.
- W4297129129 hasRelatedWork W2068264970 @default.
- W4297129129 hasRelatedWork W2073056184 @default.
- W4297129129 hasRelatedWork W2100229967 @default.
- W4297129129 hasRelatedWork W2126606633 @default.
- W4297129129 hasRelatedWork W2133923912 @default.
- W4297129129 hasRelatedWork W2968111836 @default.
- W4297129129 hasRelatedWork W3092708771 @default.
- W4297129129 isParatext "false" @default.
- W4297129129 isRetracted "false" @default.
- W4297129129 workType "article" @default.