Matches in SemOpenAlex for { <https://semopenalex.org/work/W2954005332> ?p ?o ?g. }
- W2954005332 abstract "Parallel dataflow systems are a central part of most analytic pipelines for big data. The iterative nature of many analysis and machine learning algorithms, however, is still a challenge for current systems. While certain types of bulk iterative algorithms are supported by novel dataflow frameworks, these systems cannot exploit computational dependencies present in many algorithms, such as graph algorithms. As a result, these algorithms are inefficiently executed and have led to specialized systems based on other paradigms, such as message passing or shared memory. We propose a method to integrate incremental iterations, a form of workset iterations, with parallel dataflows. After showing how to integrate bulk iterations into a dataflow system and its optimizer, we present an extension to the programming model for incremental iterations. The extension alleviates for the lack of mutable state in dataflows and allows for exploiting the sparse computational dependencies inherent in many iterative algorithms. The evaluation of a prototypical implementation shows that those aspects lead to up to two orders of magnitude speedup in algorithm runtime, when exploited. In our experiments, the improved dataflow system is highly competitive with specialized systems while maintaining a transparent and unified dataflow abstraction." @default.
- W2954005332 created "2019-07-12" @default.
- W2954005332 creator A5002413906 @default.
- W2954005332 creator A5022844658 @default.
- W2954005332 creator A5027972403 @default.
- W2954005332 creator A5036482272 @default.
- W2954005332 date "2012-08-01" @default.
- W2954005332 modified "2023-10-01" @default.
- W2954005332 title "Spinning Fast Iterative Data Flows" @default.
- W2954005332 cites W1487337216 @default.
- W2954005332 cites W1560473542 @default.
- W2954005332 cites W1791611415 @default.
- W2954005332 cites W1854214752 @default.
- W2954005332 cites W1976860187 @default.
- W2954005332 cites W1994727615 @default.
- W2954005332 cites W2033258621 @default.
- W2954005332 cites W2060280513 @default.
- W2954005332 cites W2070553391 @default.
- W2954005332 cites W2078528123 @default.
- W2954005332 cites W2100830825 @default.
- W2954005332 cites W2108272874 @default.
- W2954005332 cites W2119400430 @default.
- W2954005332 cites W2120060475 @default.
- W2954005332 cites W2153329411 @default.
- W2954005332 cites W2166706236 @default.
- W2954005332 cites W2167927436 @default.
- W2954005332 cites W2169724035 @default.
- W2954005332 cites W2170616854 @default.
- W2954005332 cites W2189465200 @default.
- W2954005332 cites W2400702091 @default.
- W2954005332 cites W2951113132 @default.
- W2954005332 hasPublicationYear "2012" @default.
- W2954005332 type Work @default.
- W2954005332 sameAs 2954005332 @default.
- W2954005332 citedByCount "2" @default.
- W2954005332 countsByYear W29540053322015 @default.
- W2954005332 countsByYear W29540053322017 @default.
- W2954005332 crossrefType "posted-content" @default.
- W2954005332 hasAuthorship W2954005332A5002413906 @default.
- W2954005332 hasAuthorship W2954005332A5022844658 @default.
- W2954005332 hasAuthorship W2954005332A5027972403 @default.
- W2954005332 hasAuthorship W2954005332A5036482272 @default.
- W2954005332 hasConcept C111472728 @default.
- W2954005332 hasConcept C11413529 @default.
- W2954005332 hasConcept C124304363 @default.
- W2954005332 hasConcept C132525143 @default.
- W2954005332 hasConcept C138885662 @default.
- W2954005332 hasConcept C162319229 @default.
- W2954005332 hasConcept C165696696 @default.
- W2954005332 hasConcept C173608175 @default.
- W2954005332 hasConcept C176727019 @default.
- W2954005332 hasConcept C199360897 @default.
- W2954005332 hasConcept C38652104 @default.
- W2954005332 hasConcept C41008148 @default.
- W2954005332 hasConcept C43521106 @default.
- W2954005332 hasConcept C489000 @default.
- W2954005332 hasConcept C68339613 @default.
- W2954005332 hasConcept C77088390 @default.
- W2954005332 hasConcept C80444323 @default.
- W2954005332 hasConcept C96324660 @default.
- W2954005332 hasConceptScore W2954005332C111472728 @default.
- W2954005332 hasConceptScore W2954005332C11413529 @default.
- W2954005332 hasConceptScore W2954005332C124304363 @default.
- W2954005332 hasConceptScore W2954005332C132525143 @default.
- W2954005332 hasConceptScore W2954005332C138885662 @default.
- W2954005332 hasConceptScore W2954005332C162319229 @default.
- W2954005332 hasConceptScore W2954005332C165696696 @default.
- W2954005332 hasConceptScore W2954005332C173608175 @default.
- W2954005332 hasConceptScore W2954005332C176727019 @default.
- W2954005332 hasConceptScore W2954005332C199360897 @default.
- W2954005332 hasConceptScore W2954005332C38652104 @default.
- W2954005332 hasConceptScore W2954005332C41008148 @default.
- W2954005332 hasConceptScore W2954005332C43521106 @default.
- W2954005332 hasConceptScore W2954005332C489000 @default.
- W2954005332 hasConceptScore W2954005332C68339613 @default.
- W2954005332 hasConceptScore W2954005332C77088390 @default.
- W2954005332 hasConceptScore W2954005332C80444323 @default.
- W2954005332 hasConceptScore W2954005332C96324660 @default.
- W2954005332 hasLocation W29540053321 @default.
- W2954005332 hasOpenAccess W2954005332 @default.
- W2954005332 hasPrimaryLocation W29540053321 @default.
- W2954005332 hasRelatedWork W1510285529 @default.
- W2954005332 hasRelatedWork W1558815430 @default.
- W2954005332 hasRelatedWork W162694113 @default.
- W2954005332 hasRelatedWork W1970759612 @default.
- W2954005332 hasRelatedWork W1973262089 @default.
- W2954005332 hasRelatedWork W207818447 @default.
- W2954005332 hasRelatedWork W2110189501 @default.
- W2954005332 hasRelatedWork W2146620757 @default.
- W2954005332 hasRelatedWork W2466364321 @default.
- W2954005332 hasRelatedWork W2611487775 @default.
- W2954005332 hasRelatedWork W2736644822 @default.
- W2954005332 hasRelatedWork W2790352117 @default.
- W2954005332 hasRelatedWork W2796719380 @default.
- W2954005332 hasRelatedWork W2884886796 @default.
- W2954005332 hasRelatedWork W2914774799 @default.
- W2954005332 hasRelatedWork W2985253298 @default.
- W2954005332 hasRelatedWork W3165904637 @default.
- W2954005332 hasRelatedWork W3184391514 @default.
- W2954005332 hasRelatedWork W118146258 @default.