Matches in SemOpenAlex for { <https://semopenalex.org/work/W2949530071> ?p ?o ?g. }
- W2949530071 abstract "Many systems for big data analytics employ a data flow abstraction to define parallel data processing tasks. In this setting, custom operations expressed as user-defined functions are very common. We address the problem of performing data flow optimization at this level of abstraction, where the semantics of operators are not known. Traditionally, query optimization is applied to queries with known algebraic semantics. In this work, we find that a handful of properties, rather than a full algebraic specification, suffice to establish reordering conditions for data processing operators. We show that these properties can be accurately estimated for black box operators by statically analyzing the general-purpose code of their user-defined functions. We design and implement an optimizer for parallel data flows that does not assume knowledge of semantics or algebraic properties of operators. Our evaluation confirms that the optimizer can apply common rewritings such as selection reordering, bushy join-order enumeration, and limited forms of aggregation push-down, hence yielding similar rewriting power as modern relational DBMS optimizers. Moreover, it can optimize the operator order of non-relational data flows, a unique feature among today's systems." @default.
- W2949530071 created "2019-06-27" @default.
- W2949530071 creator A5007738316 @default.
- W2949530071 creator A5021751187 @default.
- W2949530071 creator A5022844658 @default.
- W2949530071 creator A5027843498 @default.
- W2949530071 creator A5059803641 @default.
- W2949530071 creator A5066448126 @default.
- W2949530071 creator A5082039142 @default.
- W2949530071 date "2012-08-01" @default.
- W2949530071 modified "2023-10-15" @default.
- W2949530071 title "Opening the Black Boxes in Data Flow Optimization" @default.
- W2949530071 cites W135863099 @default.
- W2949530071 cites W1493893823 @default.
- W2949530071 cites W1538786304 @default.
- W2949530071 cites W1575324001 @default.
- W2949530071 cites W2060280513 @default.
- W2949530071 cites W2060883486 @default.
- W2949530071 cites W2098935637 @default.
- W2949530071 cites W2100830825 @default.
- W2949530071 cites W2105821863 @default.
- W2949530071 cites W2110086534 @default.
- W2949530071 cites W2112485457 @default.
- W2949530071 cites W2112866468 @default.
- W2949530071 cites W2119400430 @default.
- W2949530071 cites W2153180521 @default.
- W2949530071 cites W2153329411 @default.
- W2949530071 cites W2153889808 @default.
- W2949530071 cites W2169724035 @default.
- W2949530071 cites W2294316975 @default.
- W2949530071 cites W2296349066 @default.
- W2949530071 cites W253264081 @default.
- W2949530071 hasPublicationYear "2012" @default.
- W2949530071 type Work @default.
- W2949530071 sameAs 2949530071 @default.
- W2949530071 citedByCount "0" @default.
- W2949530071 crossrefType "posted-content" @default.
- W2949530071 hasAuthorship W2949530071A5007738316 @default.
- W2949530071 hasAuthorship W2949530071A5021751187 @default.
- W2949530071 hasAuthorship W2949530071A5022844658 @default.
- W2949530071 hasAuthorship W2949530071A5027843498 @default.
- W2949530071 hasAuthorship W2949530071A5059803641 @default.
- W2949530071 hasAuthorship W2949530071A5066448126 @default.
- W2949530071 hasAuthorship W2949530071A5082039142 @default.
- W2949530071 hasConcept C104317684 @default.
- W2949530071 hasConcept C111472728 @default.
- W2949530071 hasConcept C124101348 @default.
- W2949530071 hasConcept C124304363 @default.
- W2949530071 hasConcept C138885662 @default.
- W2949530071 hasConcept C154690210 @default.
- W2949530071 hasConcept C157692150 @default.
- W2949530071 hasConcept C158448853 @default.
- W2949530071 hasConcept C17020691 @default.
- W2949530071 hasConcept C184337299 @default.
- W2949530071 hasConcept C185592680 @default.
- W2949530071 hasConcept C199360897 @default.
- W2949530071 hasConcept C2779729104 @default.
- W2949530071 hasConcept C41008148 @default.
- W2949530071 hasConcept C489000 @default.
- W2949530071 hasConcept C55493867 @default.
- W2949530071 hasConcept C75684735 @default.
- W2949530071 hasConcept C77088390 @default.
- W2949530071 hasConcept C80444323 @default.
- W2949530071 hasConcept C86339819 @default.
- W2949530071 hasConceptScore W2949530071C104317684 @default.
- W2949530071 hasConceptScore W2949530071C111472728 @default.
- W2949530071 hasConceptScore W2949530071C124101348 @default.
- W2949530071 hasConceptScore W2949530071C124304363 @default.
- W2949530071 hasConceptScore W2949530071C138885662 @default.
- W2949530071 hasConceptScore W2949530071C154690210 @default.
- W2949530071 hasConceptScore W2949530071C157692150 @default.
- W2949530071 hasConceptScore W2949530071C158448853 @default.
- W2949530071 hasConceptScore W2949530071C17020691 @default.
- W2949530071 hasConceptScore W2949530071C184337299 @default.
- W2949530071 hasConceptScore W2949530071C185592680 @default.
- W2949530071 hasConceptScore W2949530071C199360897 @default.
- W2949530071 hasConceptScore W2949530071C2779729104 @default.
- W2949530071 hasConceptScore W2949530071C41008148 @default.
- W2949530071 hasConceptScore W2949530071C489000 @default.
- W2949530071 hasConceptScore W2949530071C55493867 @default.
- W2949530071 hasConceptScore W2949530071C75684735 @default.
- W2949530071 hasConceptScore W2949530071C77088390 @default.
- W2949530071 hasConceptScore W2949530071C80444323 @default.
- W2949530071 hasConceptScore W2949530071C86339819 @default.
- W2949530071 hasLocation W29495300711 @default.
- W2949530071 hasOpenAccess W2949530071 @default.
- W2949530071 hasPrimaryLocation W29495300711 @default.
- W2949530071 hasRelatedWork W1430647328 @default.
- W2949530071 hasRelatedWork W1748452786 @default.
- W2949530071 hasRelatedWork W1973678011 @default.
- W2949530071 hasRelatedWork W2007829077 @default.
- W2949530071 hasRelatedWork W2048422440 @default.
- W2949530071 hasRelatedWork W2075832021 @default.
- W2949530071 hasRelatedWork W2121108801 @default.
- W2949530071 hasRelatedWork W2124563731 @default.
- W2949530071 hasRelatedWork W2170466119 @default.
- W2949530071 hasRelatedWork W2174129300 @default.
- W2949530071 hasRelatedWork W2184175540 @default.
- W2949530071 hasRelatedWork W2185765091 @default.
- W2949530071 hasRelatedWork W2223906130 @default.