Matches in SemOpenAlex for { <https://semopenalex.org/work/W3092946168> ?p ?o ?g. }
- W3092946168 abstract "Data engineering is becoming an increasingly important part of scientific discoveries with the adoption of deep learning and machine learning. Data engineering deals with a variety of data formats, storage, data extraction, transformation, and data movements. One goal of data engineering is to transform data from original data to vector/matrix/tensor formats accepted by deep learning and machine learning applications. There are many structures such as tables, graphs, and trees to represent data in these data engineering phases. Among them, tables are a versatile and commonly used format to load and process data. In this paper, we present a distributed Python API based on table abstraction for representing and processing data. Unlike existing state-of-the-art data engineering tools written purely in Python, our solution adopts high performance compute kernels in C++, with an in-memory table representation with Cython-based Python bindings. In the core system, we use MPI for distributed memory computations with a data-parallel approach for processing large datasets in HPC clusters." @default.
- W3092946168 created "2020-10-22" @default.
- W3092946168 creator A5022147541 @default.
- W3092946168 creator A5046534488 @default.
- W3092946168 creator A5054344158 @default.
- W3092946168 creator A5059116835 @default.
- W3092946168 creator A5060958524 @default.
- W3092946168 creator A5067538337 @default.
- W3092946168 creator A5075312279 @default.
- W3092946168 creator A5078240493 @default.
- W3092946168 creator A5084157484 @default.
- W3092946168 date "2020-10-13" @default.
- W3092946168 modified "2023-09-27" @default.
- W3092946168 title "Data Engineering for HPC with Python." @default.
- W3092946168 cites W1168671556 @default.
- W3092946168 cites W1493349649 @default.
- W3092946168 cites W1633637678 @default.
- W3092946168 cites W182691100 @default.
- W3092946168 cites W1962931680 @default.
- W3092946168 cites W1968411163 @default.
- W3092946168 cites W2006552857 @default.
- W3092946168 cites W2037759417 @default.
- W3092946168 cites W2061939373 @default.
- W3092946168 cites W2101234009 @default.
- W3092946168 cites W2104266030 @default.
- W3092946168 cites W2133695315 @default.
- W3092946168 cites W2146099733 @default.
- W3092946168 cites W2149381887 @default.
- W3092946168 cites W2181616869 @default.
- W3092946168 cites W2186615578 @default.
- W3092946168 cites W2245493112 @default.
- W3092946168 cites W2247317079 @default.
- W3092946168 cites W2266751702 @default.
- W3092946168 cites W2290761674 @default.
- W3092946168 cites W2472803348 @default.
- W3092946168 cites W2527672088 @default.
- W3092946168 cites W2542459869 @default.
- W3092946168 cites W2769856846 @default.
- W3092946168 cites W2771222977 @default.
- W3092946168 cites W2947737663 @default.
- W3092946168 cites W2949178128 @default.
- W3092946168 cites W2963341956 @default.
- W3092946168 cites W2963390429 @default.
- W3092946168 cites W2970971581 @default.
- W3092946168 cites W2998286700 @default.
- W3092946168 cites W3010913348 @default.
- W3092946168 cites W3117319848 @default.
- W3092946168 hasPublicationYear "2020" @default.
- W3092946168 type Work @default.
- W3092946168 sameAs 3092946168 @default.
- W3092946168 citedByCount "1" @default.
- W3092946168 countsByYear W30929461682020 @default.
- W3092946168 crossrefType "posted-content" @default.
- W3092946168 hasAuthorship W3092946168A5022147541 @default.
- W3092946168 hasAuthorship W3092946168A5046534488 @default.
- W3092946168 hasAuthorship W3092946168A5054344158 @default.
- W3092946168 hasAuthorship W3092946168A5059116835 @default.
- W3092946168 hasAuthorship W3092946168A5060958524 @default.
- W3092946168 hasAuthorship W3092946168A5067538337 @default.
- W3092946168 hasAuthorship W3092946168A5075312279 @default.
- W3092946168 hasAuthorship W3092946168A5078240493 @default.
- W3092946168 hasAuthorship W3092946168A5084157484 @default.
- W3092946168 hasConcept C116409475 @default.
- W3092946168 hasConcept C154945302 @default.
- W3092946168 hasConcept C162319229 @default.
- W3092946168 hasConcept C199360897 @default.
- W3092946168 hasConcept C41008148 @default.
- W3092946168 hasConcept C519991488 @default.
- W3092946168 hasConcept C80444323 @default.
- W3092946168 hasConceptScore W3092946168C116409475 @default.
- W3092946168 hasConceptScore W3092946168C154945302 @default.
- W3092946168 hasConceptScore W3092946168C162319229 @default.
- W3092946168 hasConceptScore W3092946168C199360897 @default.
- W3092946168 hasConceptScore W3092946168C41008148 @default.
- W3092946168 hasConceptScore W3092946168C519991488 @default.
- W3092946168 hasConceptScore W3092946168C80444323 @default.
- W3092946168 hasLocation W30929461681 @default.
- W3092946168 hasOpenAccess W3092946168 @default.
- W3092946168 hasPrimaryLocation W30929461681 @default.
- W3092946168 hasRelatedWork W1570371166 @default.
- W3092946168 hasRelatedWork W1993320880 @default.
- W3092946168 hasRelatedWork W2029455112 @default.
- W3092946168 hasRelatedWork W2038726616 @default.
- W3092946168 hasRelatedWork W2085400819 @default.
- W3092946168 hasRelatedWork W2090215046 @default.
- W3092946168 hasRelatedWork W2115128623 @default.
- W3092946168 hasRelatedWork W2259760037 @default.
- W3092946168 hasRelatedWork W2544822491 @default.
- W3092946168 hasRelatedWork W2725246756 @default.
- W3092946168 hasRelatedWork W2950085081 @default.
- W3092946168 hasRelatedWork W3014448556 @default.
- W3092946168 hasRelatedWork W3028559235 @default.
- W3092946168 hasRelatedWork W3029497569 @default.
- W3092946168 hasRelatedWork W3103222352 @default.
- W3092946168 hasRelatedWork W3103319457 @default.
- W3092946168 hasRelatedWork W3104388511 @default.
- W3092946168 hasRelatedWork W3116903755 @default.
- W3092946168 hasRelatedWork W3145543835 @default.
- W3092946168 hasRelatedWork W3211823527 @default.
- W3092946168 isParatext "false" @default.