Matches in SemOpenAlex for { <https://semopenalex.org/work/W3042656784> ?p ?o ?g. }
- W3042656784 abstract "The amazing advances being made in the fields of machine and deep learning are a highlight of the Big Data era for both enterprise and research communities. Modern applications require resources beyond a single node's ability to provide. However this is just a small part of the issues facing the overall data processing environment, which must also support a raft of data engineering for pre- and post-data processing, communication, and system integration. An important requirement of data analytics tools is to be able to easily integrate with existing frameworks in a multitude of languages, thereby increasing user productivity and efficiency. All this demands an efficient and highly distributed integrated approach for data processing, yet many of today's popular data analytics tools are unable to satisfy all these requirements at the same time. In this paper we present Cylon, an open-source high performance distributed data processing library that can be seamlessly integrated with existing Big Data and AI/ML frameworks. It is developed with a flexible C++ core on top of a compact data structure and exposes language bindings to C++, Java, and Python. We discuss Cylon's architecture in detail, and reveal how it can be imported as a library to existing applications or operate as a standalone framework. Initial experiments show that Cylon enhances popular tools such as Apache Spark and Dask with major performance improvements for key operations and better component linkages. Finally, we show how its design enables Cylon to be used cross-platform with minimum overhead, which includes popular AI tools such as PyTorch, Tensorflow, and Jupyter notebooks." @default.
- W3042656784 created "2020-07-23" @default.
- W3042656784 creator A5012533273 @default.
- W3042656784 creator A5022147541 @default.
- W3042656784 creator A5046534488 @default.
- W3042656784 creator A5054344158 @default.
- W3042656784 creator A5059116835 @default.
- W3042656784 creator A5060958524 @default.
- W3042656784 creator A5067538337 @default.
- W3042656784 creator A5075312279 @default.
- W3042656784 creator A5078240493 @default.
- W3042656784 creator A5084157484 @default.
- W3042656784 date "2020-07-19" @default.
- W3042656784 modified "2023-09-27" @default.
- W3042656784 title "High Performance Data Engineering Everywhere" @default.
- W3042656784 cites W1573548168 @default.
- W3042656784 cites W1962931680 @default.
- W3042656784 cites W1968411163 @default.
- W3042656784 cites W2131975293 @default.
- W3042656784 cites W2173213060 @default.
- W3042656784 cites W2181616869 @default.
- W3042656784 cites W2186615578 @default.
- W3042656784 cites W2189162242 @default.
- W3042656784 cites W2189465200 @default.
- W3042656784 cites W2535374105 @default.
- W3042656784 cites W2542459869 @default.
- W3042656784 cites W2566979091 @default.
- W3042656784 cites W2771222977 @default.
- W3042656784 cites W2787998955 @default.
- W3042656784 cites W2949178128 @default.
- W3042656784 cites W2963390429 @default.
- W3042656784 cites W2970971581 @default.
- W3042656784 hasPublicationYear "2020" @default.
- W3042656784 type Work @default.
- W3042656784 sameAs 3042656784 @default.
- W3042656784 citedByCount "0" @default.
- W3042656784 crossrefType "posted-content" @default.
- W3042656784 hasAuthorship W3042656784A5012533273 @default.
- W3042656784 hasAuthorship W3042656784A5022147541 @default.
- W3042656784 hasAuthorship W3042656784A5046534488 @default.
- W3042656784 hasAuthorship W3042656784A5054344158 @default.
- W3042656784 hasAuthorship W3042656784A5059116835 @default.
- W3042656784 hasAuthorship W3042656784A5060958524 @default.
- W3042656784 hasAuthorship W3042656784A5067538337 @default.
- W3042656784 hasAuthorship W3042656784A5075312279 @default.
- W3042656784 hasAuthorship W3042656784A5078240493 @default.
- W3042656784 hasAuthorship W3042656784A5084157484 @default.
- W3042656784 hasConcept C109701466 @default.
- W3042656784 hasConcept C111919701 @default.
- W3042656784 hasConcept C115903868 @default.
- W3042656784 hasConcept C120314980 @default.
- W3042656784 hasConcept C199360897 @default.
- W3042656784 hasConcept C2522767166 @default.
- W3042656784 hasConcept C2779960059 @default.
- W3042656784 hasConcept C2781215313 @default.
- W3042656784 hasConcept C41008148 @default.
- W3042656784 hasConcept C519991488 @default.
- W3042656784 hasConcept C548217200 @default.
- W3042656784 hasConcept C75684735 @default.
- W3042656784 hasConcept C77088390 @default.
- W3042656784 hasConcept C79158427 @default.
- W3042656784 hasConceptScore W3042656784C109701466 @default.
- W3042656784 hasConceptScore W3042656784C111919701 @default.
- W3042656784 hasConceptScore W3042656784C115903868 @default.
- W3042656784 hasConceptScore W3042656784C120314980 @default.
- W3042656784 hasConceptScore W3042656784C199360897 @default.
- W3042656784 hasConceptScore W3042656784C2522767166 @default.
- W3042656784 hasConceptScore W3042656784C2779960059 @default.
- W3042656784 hasConceptScore W3042656784C2781215313 @default.
- W3042656784 hasConceptScore W3042656784C41008148 @default.
- W3042656784 hasConceptScore W3042656784C519991488 @default.
- W3042656784 hasConceptScore W3042656784C548217200 @default.
- W3042656784 hasConceptScore W3042656784C75684735 @default.
- W3042656784 hasConceptScore W3042656784C77088390 @default.
- W3042656784 hasConceptScore W3042656784C79158427 @default.
- W3042656784 hasLocation W30426567841 @default.
- W3042656784 hasOpenAccess W3042656784 @default.
- W3042656784 hasPrimaryLocation W30426567841 @default.
- W3042656784 hasRelatedWork W1635892993 @default.
- W3042656784 hasRelatedWork W2012407659 @default.
- W3042656784 hasRelatedWork W2122713649 @default.
- W3042656784 hasRelatedWork W2150978015 @default.
- W3042656784 hasRelatedWork W2261258473 @default.
- W3042656784 hasRelatedWork W2293946261 @default.
- W3042656784 hasRelatedWork W2593026014 @default.
- W3042656784 hasRelatedWork W2740304484 @default.
- W3042656784 hasRelatedWork W2746629849 @default.
- W3042656784 hasRelatedWork W2911702447 @default.
- W3042656784 hasRelatedWork W2950223910 @default.
- W3042656784 hasRelatedWork W2990755887 @default.
- W3042656784 hasRelatedWork W3117319848 @default.
- W3042656784 hasRelatedWork W3118950091 @default.
- W3042656784 hasRelatedWork W3136844352 @default.
- W3042656784 hasRelatedWork W3137502679 @default.
- W3042656784 hasRelatedWork W3197295094 @default.
- W3042656784 hasRelatedWork W595494729 @default.
- W3042656784 hasRelatedWork W79014748 @default.
- W3042656784 hasRelatedWork W2577115914 @default.
- W3042656784 isParatext "false" @default.
- W3042656784 isRetracted "false" @default.