Matches in SemOpenAlex for { <https://semopenalex.org/work/W1496006980> ?p ?o ?g. }
- W1496006980 abstract "To remain competitive, enterprises are evolving in order to quickly respond to changing market conditions and customer needs. In this new environment, a single centralized data warehouse is no longer sufficient. Next generation business intelligence involves data flows that span multiple, diverse processing engines, that contain complex functionality like data/text analytics, machine learning operations, and that need to be optimized against various objectives. A common example is the use of Hadoop to analyze unstructured text and merging these results with relational database queries over the data warehouse. We refer to these multi-engine analytic data flows as hybrid flows. Currently, it is a cumbersome task to create and run hybrid flows. Custom scripts must be written to dispatch tasks to the individual processing engines and to exchange intermediate results. So, designing correct hybrid flows is a challenging task. Optimizing such flows is even harder. Additionally, when the underlying computing infrastructure changes, existing flows likely need modification and reoptimization. The current, ad-hoc design approach cannot scale as hybrid flows become more commonplace. To address this challenge, we are building a platform to design and manage hybrid flows. It supports the logical design of hybrid flows in which implementation details are not exposed. It generates code for the underlying processing engines and orchestrates their execution. But the key enabling technology in the platform is an optimizer that converts the logical flow to an executable form that is optimized for the underlying infrastructure according to user-specified objectives. In this paper, we describe challenges in designing the optimizer and our solutions. We illustrate the optimizer through a real-world use case. We present a logical design and optimized designs for the use case. We show how the performance of the use case varies depending on the system configuration and how the optimizer is able to generate different optimized flows for different configurations." @default.
- W1496006980 created "2016-06-24" @default.
- W1496006980 creator A5045738980 @default.
- W1496006980 creator A5072082268 @default.
- W1496006980 creator A5086875579 @default.
- W1496006980 date "2013-01-01" @default.
- W1496006980 modified "2023-09-27" @default.
- W1496006980 title "Hybrid Analytic Flows - the Case for Optimization" @default.
- W1496006980 cites W1487337216 @default.
- W1496006980 cites W1507469828 @default.
- W1496006980 cites W1565651085 @default.
- W1496006980 cites W1575324001 @default.
- W1496006980 cites W167093911 @default.
- W1496006980 cites W1911170630 @default.
- W1496006980 cites W1920644729 @default.
- W1496006980 cites W1967093902 @default.
- W1496006980 cites W1983833794 @default.
- W1496006980 cites W1993892970 @default.
- W1496006980 cites W2002472616 @default.
- W1496006980 cites W2010279913 @default.
- W1496006980 cites W2019448824 @default.
- W1496006980 cites W201997434 @default.
- W1496006980 cites W2035543557 @default.
- W1496006980 cites W2037895088 @default.
- W1496006980 cites W2058978608 @default.
- W1496006980 cites W2060280513 @default.
- W1496006980 cites W2086851811 @default.
- W1496006980 cites W2098935637 @default.
- W1496006980 cites W2100830825 @default.
- W1496006980 cites W2119558533 @default.
- W1496006980 cites W2122519137 @default.
- W1496006980 cites W2125775320 @default.
- W1496006980 cites W2149229014 @default.
- W1496006980 cites W2149877754 @default.
- W1496006980 cites W2150304332 @default.
- W1496006980 cites W2158643472 @default.
- W1496006980 cites W2164645353 @default.
- W1496006980 cites W47420562 @default.
- W1496006980 cites W648574622 @default.
- W1496006980 cites W2026766678 @default.
- W1496006980 cites W2583716686 @default.
- W1496006980 doi "https://doi.org/10.3233/fi-2013-948" @default.
- W1496006980 hasPublicationYear "2013" @default.
- W1496006980 type Work @default.
- W1496006980 sameAs 1496006980 @default.
- W1496006980 citedByCount "2" @default.
- W1496006980 countsByYear W14960069802014 @default.
- W1496006980 crossrefType "journal-article" @default.
- W1496006980 hasAuthorship W1496006980A5045738980 @default.
- W1496006980 hasAuthorship W1496006980A5072082268 @default.
- W1496006980 hasAuthorship W1496006980A5086875579 @default.
- W1496006980 hasConcept C111919701 @default.
- W1496006980 hasConcept C115903868 @default.
- W1496006980 hasConcept C120314980 @default.
- W1496006980 hasConcept C127413603 @default.
- W1496006980 hasConcept C135572916 @default.
- W1496006980 hasConcept C160145156 @default.
- W1496006980 hasConcept C199360897 @default.
- W1496006980 hasConcept C201995342 @default.
- W1496006980 hasConcept C26517878 @default.
- W1496006980 hasConcept C2767350 @default.
- W1496006980 hasConcept C2780451532 @default.
- W1496006980 hasConcept C41008148 @default.
- W1496006980 hasConcept C48044578 @default.
- W1496006980 hasConcept C61423126 @default.
- W1496006980 hasConcept C77088390 @default.
- W1496006980 hasConcept C79158427 @default.
- W1496006980 hasConceptScore W1496006980C111919701 @default.
- W1496006980 hasConceptScore W1496006980C115903868 @default.
- W1496006980 hasConceptScore W1496006980C120314980 @default.
- W1496006980 hasConceptScore W1496006980C127413603 @default.
- W1496006980 hasConceptScore W1496006980C135572916 @default.
- W1496006980 hasConceptScore W1496006980C160145156 @default.
- W1496006980 hasConceptScore W1496006980C199360897 @default.
- W1496006980 hasConceptScore W1496006980C201995342 @default.
- W1496006980 hasConceptScore W1496006980C26517878 @default.
- W1496006980 hasConceptScore W1496006980C2767350 @default.
- W1496006980 hasConceptScore W1496006980C2780451532 @default.
- W1496006980 hasConceptScore W1496006980C41008148 @default.
- W1496006980 hasConceptScore W1496006980C48044578 @default.
- W1496006980 hasConceptScore W1496006980C61423126 @default.
- W1496006980 hasConceptScore W1496006980C77088390 @default.
- W1496006980 hasConceptScore W1496006980C79158427 @default.
- W1496006980 hasLocation W14960069801 @default.
- W1496006980 hasOpenAccess W1496006980 @default.
- W1496006980 hasPrimaryLocation W14960069801 @default.
- W1496006980 hasRelatedWork W1966579513 @default.
- W1496006980 hasRelatedWork W2011830405 @default.
- W1496006980 hasRelatedWork W2066526623 @default.
- W1496006980 hasRelatedWork W2089794289 @default.
- W1496006980 hasRelatedWork W2108782615 @default.
- W1496006980 hasRelatedWork W2160592069 @default.
- W1496006980 hasRelatedWork W2182291107 @default.
- W1496006980 hasRelatedWork W2205705386 @default.
- W1496006980 hasRelatedWork W2223315718 @default.
- W1496006980 hasRelatedWork W2451114 @default.
- W1496006980 hasRelatedWork W2497767505 @default.
- W1496006980 hasRelatedWork W2622654092 @default.
- W1496006980 hasRelatedWork W2626822961 @default.
- W1496006980 hasRelatedWork W2783144021 @default.