Matches in SemOpenAlex for { <https://semopenalex.org/work/W2746552017> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W2746552017 abstract "Abstract The most successful systems for “big data” processing have all adopted functional APIs. We present a new programming model, we call function passing , designed to provide a more principled substrate, or middleware, upon which to build data-centric distributed systems like Spark. A key idea is to build up a persistent functional data structure representing transformations on distributed immutable data by passing well-typed serializable functions over the wire and applying them to this distributed data. Thus, the function passing model can be thought of as a persistent functional data structure that is distributed , where transformations performed on distributed data are stored in its nodes rather than the distributed data itself. One advantage of this model is that failure recovery is simplified by design – data can be recovered by replaying function applications atop immutable data loaded from stable storage. Deferred evaluation is also central to our model; by incorporating deferred evaluation into our design only at the point of initiating network communication, the function passing model remains easy to reason about while remaining efficient in time and memory. Moreover, we provide a complete formalization of the programming model in order to study the foundations of lineage-based distributed computation. In particular, we develop a theory of safe, mobile lineages based on a subject reduction theorem for a typed core language. Furthermore, we formalize a progress theorem that guarantees the finite materialization of remote, lineage-based data. Thus, the formal model may serve as a basis for further developments of the theory of data-centric distributed programming, including aspects such as fault tolerance. We provide an open-source implementation of our model in and for the Scala programming language, along with a case study of several example frameworks and end-user programs written atop this model." @default.
- W2746552017 created "2017-08-31" @default.
- W2746552017 creator A5021433095 @default.
- W2746552017 creator A5024815945 @default.
- W2746552017 creator A5044900918 @default.
- W2746552017 date "2018-01-01" @default.
- W2746552017 modified "2023-10-16" @default.
- W2746552017 title "A programming model and foundation for lineage-based distributed computation" @default.
- W2746552017 cites W1795023635 @default.
- W2746552017 cites W1978924650 @default.
- W2746552017 cites W1984988351 @default.
- W2746552017 cites W1987073254 @default.
- W2746552017 cites W2021978684 @default.
- W2746552017 cites W2070310827 @default.
- W2746552017 cites W2098830227 @default.
- W2746552017 cites W2100830825 @default.
- W2746552017 cites W2119629818 @default.
- W2746552017 cites W2124753887 @default.
- W2746552017 cites W2128932399 @default.
- W2746552017 cites W2137472273 @default.
- W2746552017 cites W2143847610 @default.
- W2746552017 cites W2164387399 @default.
- W2746552017 cites W2173213060 @default.
- W2746552017 cites W2296715995 @default.
- W2746552017 cites W4234270404 @default.
- W2746552017 cites W4256363426 @default.
- W2746552017 doi "https://doi.org/10.1017/s0956796818000035" @default.
- W2746552017 hasPublicationYear "2018" @default.
- W2746552017 type Work @default.
- W2746552017 sameAs 2746552017 @default.
- W2746552017 citedByCount "2" @default.
- W2746552017 countsByYear W27465520172019 @default.
- W2746552017 countsByYear W27465520172022 @default.
- W2746552017 crossrefType "journal-article" @default.
- W2746552017 hasAuthorship W2746552017A5021433095 @default.
- W2746552017 hasAuthorship W2746552017A5024815945 @default.
- W2746552017 hasAuthorship W2746552017A5044900918 @default.
- W2746552017 hasBestOaLocation W27465520172 @default.
- W2746552017 hasConcept C100463513 @default.
- W2746552017 hasConcept C120314980 @default.
- W2746552017 hasConcept C133875982 @default.
- W2746552017 hasConcept C14036430 @default.
- W2746552017 hasConcept C154945302 @default.
- W2746552017 hasConcept C172086080 @default.
- W2746552017 hasConcept C173608175 @default.
- W2746552017 hasConcept C199360897 @default.
- W2746552017 hasConcept C24885549 @default.
- W2746552017 hasConcept C34165917 @default.
- W2746552017 hasConcept C41008148 @default.
- W2746552017 hasConcept C42383842 @default.
- W2746552017 hasConcept C78458016 @default.
- W2746552017 hasConcept C80444323 @default.
- W2746552017 hasConcept C86803240 @default.
- W2746552017 hasConcept C91481028 @default.
- W2746552017 hasConceptScore W2746552017C100463513 @default.
- W2746552017 hasConceptScore W2746552017C120314980 @default.
- W2746552017 hasConceptScore W2746552017C133875982 @default.
- W2746552017 hasConceptScore W2746552017C14036430 @default.
- W2746552017 hasConceptScore W2746552017C154945302 @default.
- W2746552017 hasConceptScore W2746552017C172086080 @default.
- W2746552017 hasConceptScore W2746552017C173608175 @default.
- W2746552017 hasConceptScore W2746552017C199360897 @default.
- W2746552017 hasConceptScore W2746552017C24885549 @default.
- W2746552017 hasConceptScore W2746552017C34165917 @default.
- W2746552017 hasConceptScore W2746552017C41008148 @default.
- W2746552017 hasConceptScore W2746552017C42383842 @default.
- W2746552017 hasConceptScore W2746552017C78458016 @default.
- W2746552017 hasConceptScore W2746552017C80444323 @default.
- W2746552017 hasConceptScore W2746552017C86803240 @default.
- W2746552017 hasConceptScore W2746552017C91481028 @default.
- W2746552017 hasLocation W27465520171 @default.
- W2746552017 hasLocation W27465520172 @default.
- W2746552017 hasOpenAccess W2746552017 @default.
- W2746552017 hasPrimaryLocation W27465520171 @default.
- W2746552017 hasRelatedWork W120656789 @default.
- W2746552017 hasRelatedWork W120931515 @default.
- W2746552017 hasRelatedWork W1570923846 @default.
- W2746552017 hasRelatedWork W1966767581 @default.
- W2746552017 hasRelatedWork W2023056990 @default.
- W2746552017 hasRelatedWork W2068737373 @default.
- W2746552017 hasRelatedWork W2348049281 @default.
- W2746552017 hasRelatedWork W2746552017 @default.
- W2746552017 hasRelatedWork W3136833600 @default.
- W2746552017 hasRelatedWork W4243252198 @default.
- W2746552017 hasVolume "28" @default.
- W2746552017 isParatext "false" @default.
- W2746552017 isRetracted "false" @default.
- W2746552017 magId "2746552017" @default.
- W2746552017 workType "article" @default.