Matches in SemOpenAlex for { <https://semopenalex.org/work/W3117019536> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W3117019536 abstract "Data engineering is becoming an increasingly important part of scientific discoveries with the adoption of deep learning and machine learning. Data engineering deals with a variety of data formats, storage, data extraction, transformation, and data movements. One goal of data engineering is to transform data from original data to vector/matrix/tensor formats accepted by deep learning and machine learning applications. There are many structures such as tables, graphs, and trees to represent data in these data engineering phases. Among them, tables are a versatile and commonly used format to load and process data. In this paper, we present a distributed Python API based on table abstraction for representing and processing data. Unlike existing state-of-the-art data engineering tools written purely in Python, our solution adopts high performance compute kernels in C++, with an in-memory table representation with Cython-based Python bindings. In the core system, we use MPI for distributed memory computations with a data-parallel approach for processing large datasets in HPC clusters." @default.
- W3117019536 created "2021-01-05" @default.
- W3117019536 creator A5022147541 @default.
- W3117019536 creator A5046534488 @default.
- W3117019536 creator A5054344158 @default.
- W3117019536 creator A5059116835 @default.
- W3117019536 creator A5060958524 @default.
- W3117019536 creator A5067538337 @default.
- W3117019536 creator A5075312279 @default.
- W3117019536 creator A5078240493 @default.
- W3117019536 creator A5084157484 @default.
- W3117019536 date "2020-11-01" @default.
- W3117019536 modified "2023-09-27" @default.
- W3117019536 title "Data Engineering for HPC with Python" @default.
- W3117019536 cites W1168671556 @default.
- W3117019536 cites W1633637678 @default.
- W3117019536 cites W1962931680 @default.
- W3117019536 cites W1968411163 @default.
- W3117019536 cites W2006552857 @default.
- W3117019536 cites W2037759417 @default.
- W3117019536 cites W2061939373 @default.
- W3117019536 cites W2104266030 @default.
- W3117019536 cites W2133695315 @default.
- W3117019536 cites W2146099733 @default.
- W3117019536 cites W2149381887 @default.
- W3117019536 cites W2245493112 @default.
- W3117019536 cites W2247317079 @default.
- W3117019536 cites W2527672088 @default.
- W3117019536 cites W2542459869 @default.
- W3117019536 cites W2771222977 @default.
- W3117019536 cites W2949178128 @default.
- W3117019536 cites W3010913348 @default.
- W3117019536 cites W3082494217 @default.
- W3117019536 cites W3117319848 @default.
- W3117019536 doi "https://doi.org/10.1109/pyhpc51966.2020.00007" @default.
- W3117019536 hasPublicationYear "2020" @default.
- W3117019536 type Work @default.
- W3117019536 sameAs 3117019536 @default.
- W3117019536 citedByCount "7" @default.
- W3117019536 countsByYear W31170195362020 @default.
- W3117019536 countsByYear W31170195362021 @default.
- W3117019536 countsByYear W31170195362022 @default.
- W3117019536 countsByYear W31170195362023 @default.
- W3117019536 crossrefType "proceedings-article" @default.
- W3117019536 hasAuthorship W3117019536A5022147541 @default.
- W3117019536 hasAuthorship W3117019536A5046534488 @default.
- W3117019536 hasAuthorship W3117019536A5054344158 @default.
- W3117019536 hasAuthorship W3117019536A5059116835 @default.
- W3117019536 hasAuthorship W3117019536A5060958524 @default.
- W3117019536 hasAuthorship W3117019536A5067538337 @default.
- W3117019536 hasAuthorship W3117019536A5075312279 @default.
- W3117019536 hasAuthorship W3117019536A5078240493 @default.
- W3117019536 hasAuthorship W3117019536A5084157484 @default.
- W3117019536 hasBestOaLocation W31170195362 @default.
- W3117019536 hasConcept C111919701 @default.
- W3117019536 hasConcept C115903868 @default.
- W3117019536 hasConcept C173608175 @default.
- W3117019536 hasConcept C199360897 @default.
- W3117019536 hasConcept C41008148 @default.
- W3117019536 hasConcept C519991488 @default.
- W3117019536 hasConceptScore W3117019536C111919701 @default.
- W3117019536 hasConceptScore W3117019536C115903868 @default.
- W3117019536 hasConceptScore W3117019536C173608175 @default.
- W3117019536 hasConceptScore W3117019536C199360897 @default.
- W3117019536 hasConceptScore W3117019536C41008148 @default.
- W3117019536 hasConceptScore W3117019536C519991488 @default.
- W3117019536 hasLocation W31170195361 @default.
- W3117019536 hasLocation W31170195362 @default.
- W3117019536 hasOpenAccess W3117019536 @default.
- W3117019536 hasPrimaryLocation W31170195361 @default.
- W3117019536 hasRelatedWork W1906486629 @default.
- W3117019536 hasRelatedWork W2135396778 @default.
- W3117019536 hasRelatedWork W2327204559 @default.
- W3117019536 hasRelatedWork W2529681551 @default.
- W3117019536 hasRelatedWork W3017187763 @default.
- W3117019536 hasRelatedWork W3021560500 @default.
- W3117019536 hasRelatedWork W4232504361 @default.
- W3117019536 hasRelatedWork W656686947 @default.
- W3117019536 hasRelatedWork W858026363 @default.
- W3117019536 hasRelatedWork W88042385 @default.
- W3117019536 isParatext "false" @default.
- W3117019536 isRetracted "false" @default.
- W3117019536 magId "3117019536" @default.
- W3117019536 workType "article" @default.