Matches in SemOpenAlex for { <https://semopenalex.org/work/W2548933032> ?p ?o ?g. }
- W2548933032 endingPage "38" @default.
- W2548933032 startingPage "1" @default.
- W2548933032 abstract "The Hadoop Distributed File System (HDFS) has become an important data repository in the enterprise as the center for all business analytics, from SQL queries and machine learning to reporting. At the same time, enterprise data warehouses (EDWs) continue to support critical business analytics. This has created the need for a new generation of a special federation between Hadoop-like big data platforms and EDWs, which we call the hybrid warehouse . There are many applications that require correlating data stored in HDFS with EDW data, such as the analysis that associates click logs stored in HDFS with the sales data stored in the database. All existing solutions reach out to HDFS and read the data into the EDW to perform the joins, assuming that the Hadoop side does not have efficient SQL support. In this article, we show that it is actually better to do most data processing on the HDFS side, provided that we can leverage a sophisticated execution engine for joins on the Hadoop side. We identify the best hybrid warehouse architecture by studying various algorithms to join database and HDFS tables. We utilize Bloom filters to minimize the data movement and exploit the massive parallelism in both systems to the fullest extent possible. We describe a new zigzag join algorithm and show that it is a robust join algorithm for hybrid warehouses that performs well in almost all cases. We further develop a sophisticated cost model for the various join algorithms and show that it can facilitate query optimization in the hybrid warehouse to correctly choose the right algorithm under different predicate and join selectivities." @default.
- W2548933032 created "2016-11-11" @default.
- W2548933032 creator A5017841792 @default.
- W2548933032 creator A5070638387 @default.
- W2548933032 creator A5083725187 @default.
- W2548933032 creator A5090507213 @default.
- W2548933032 creator A5090562336 @default.
- W2548933032 date "2016-11-02" @default.
- W2548933032 modified "2023-10-09" @default.
- W2548933032 title "Building a Hybrid Warehouse" @default.
- W2548933032 cites W1993226606 @default.
- W2548933032 cites W1999883293 @default.
- W2548933032 cites W2001040824 @default.
- W2548933032 cites W2008750849 @default.
- W2548933032 cites W2016758618 @default.
- W2548933032 cites W2016829627 @default.
- W2548933032 cites W2021724486 @default.
- W2548933032 cites W2029036662 @default.
- W2548933032 cites W2037027334 @default.
- W2548933032 cites W2038412523 @default.
- W2548933032 cites W2043099794 @default.
- W2548933032 cites W2043934800 @default.
- W2548933032 cites W2051756193 @default.
- W2548933032 cites W2072001200 @default.
- W2548933032 cites W2104615308 @default.
- W2548933032 cites W2110086534 @default.
- W2548933032 cites W2112101330 @default.
- W2548933032 cites W2112668678 @default.
- W2548933032 cites W2119400430 @default.
- W2548933032 cites W2121810937 @default.
- W2548933032 cites W2122949840 @default.
- W2548933032 cites W2123845384 @default.
- W2548933032 cites W2128350269 @default.
- W2548933032 cites W2136625956 @default.
- W2548933032 cites W2139429256 @default.
- W2548933032 cites W2139445852 @default.
- W2548933032 cites W2145812340 @default.
- W2548933032 cites W2146183750 @default.
- W2548933032 cites W2173213060 @default.
- W2548933032 cites W2265297126 @default.
- W2548933032 doi "https://doi.org/10.1145/2972950" @default.
- W2548933032 hasPublicationYear "2016" @default.
- W2548933032 type Work @default.
- W2548933032 sameAs 2548933032 @default.
- W2548933032 citedByCount "14" @default.
- W2548933032 countsByYear W25489330322017 @default.
- W2548933032 countsByYear W25489330322018 @default.
- W2548933032 countsByYear W25489330322019 @default.
- W2548933032 countsByYear W25489330322020 @default.
- W2548933032 countsByYear W25489330322022 @default.
- W2548933032 crossrefType "journal-article" @default.
- W2548933032 hasAuthorship W2548933032A5017841792 @default.
- W2548933032 hasAuthorship W2548933032A5070638387 @default.
- W2548933032 hasAuthorship W2548933032A5083725187 @default.
- W2548933032 hasAuthorship W2548933032A5090507213 @default.
- W2548933032 hasAuthorship W2548933032A5090562336 @default.
- W2548933032 hasConcept C111919701 @default.
- W2548933032 hasConcept C119857082 @default.
- W2548933032 hasConcept C135572916 @default.
- W2548933032 hasConcept C153083717 @default.
- W2548933032 hasConcept C165696696 @default.
- W2548933032 hasConcept C199360897 @default.
- W2548933032 hasConcept C2778692605 @default.
- W2548933032 hasConcept C2779599972 @default.
- W2548933032 hasConcept C38652104 @default.
- W2548933032 hasConcept C41008148 @default.
- W2548933032 hasConcept C48044578 @default.
- W2548933032 hasConcept C510870499 @default.
- W2548933032 hasConcept C77088390 @default.
- W2548933032 hasConcept C79158427 @default.
- W2548933032 hasConceptScore W2548933032C111919701 @default.
- W2548933032 hasConceptScore W2548933032C119857082 @default.
- W2548933032 hasConceptScore W2548933032C135572916 @default.
- W2548933032 hasConceptScore W2548933032C153083717 @default.
- W2548933032 hasConceptScore W2548933032C165696696 @default.
- W2548933032 hasConceptScore W2548933032C199360897 @default.
- W2548933032 hasConceptScore W2548933032C2778692605 @default.
- W2548933032 hasConceptScore W2548933032C2779599972 @default.
- W2548933032 hasConceptScore W2548933032C38652104 @default.
- W2548933032 hasConceptScore W2548933032C41008148 @default.
- W2548933032 hasConceptScore W2548933032C48044578 @default.
- W2548933032 hasConceptScore W2548933032C510870499 @default.
- W2548933032 hasConceptScore W2548933032C77088390 @default.
- W2548933032 hasConceptScore W2548933032C79158427 @default.
- W2548933032 hasIssue "4" @default.
- W2548933032 hasLocation W25489330321 @default.
- W2548933032 hasOpenAccess W2548933032 @default.
- W2548933032 hasPrimaryLocation W25489330321 @default.
- W2548933032 hasRelatedWork W1490390966 @default.
- W2548933032 hasRelatedWork W158505489 @default.
- W2548933032 hasRelatedWork W2048395535 @default.
- W2548933032 hasRelatedWork W2072956666 @default.
- W2548933032 hasRelatedWork W2078451216 @default.
- W2548933032 hasRelatedWork W2335228830 @default.
- W2548933032 hasRelatedWork W2810193297 @default.
- W2548933032 hasRelatedWork W3043154962 @default.
- W2548933032 hasRelatedWork W4285587305 @default.
- W2548933032 hasRelatedWork W4312581606 @default.