Matches in SemOpenAlex for { <https://semopenalex.org/work/W2792297482> ?p ?o ?g. }
- W2792297482 endingPage "166" @default.
- W2792297482 startingPage "154" @default.
- W2792297482 abstract "The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple-dimensional, array-based datasets in various geoscience domains." @default.
- W2792297482 created "2018-03-29" @default.
- W2792297482 creator A5017769945 @default.
- W2792297482 creator A5019995639 @default.
- W2792297482 creator A5024737035 @default.
- W2792297482 creator A5028328772 @default.
- W2792297482 creator A5047812888 @default.
- W2792297482 creator A5048422487 @default.
- W2792297482 creator A5066382672 @default.
- W2792297482 creator A5068236378 @default.
- W2792297482 date "2018-06-01" @default.
- W2792297482 modified "2023-09-25" @default.
- W2792297482 title "ClimateSpark: An in-memory distributed computing framework for big climate data analytics" @default.
- W2792297482 cites W1982497210 @default.
- W2792297482 cites W1983967597 @default.
- W2792297482 cites W1985479415 @default.
- W2792297482 cites W1986214504 @default.
- W2792297482 cites W1987822482 @default.
- W2792297482 cites W2012275375 @default.
- W2792297482 cites W2017369298 @default.
- W2792297482 cites W2024968285 @default.
- W2792297482 cites W2059087733 @default.
- W2792297482 cites W2107264672 @default.
- W2792297482 cites W2122847664 @default.
- W2792297482 cites W2345500432 @default.
- W2792297482 cites W2527514331 @default.
- W2792297482 cites W2547221248 @default.
- W2792297482 cites W2548753368 @default.
- W2792297482 cites W3142730227 @default.
- W2792297482 doi "https://doi.org/10.1016/j.cageo.2018.03.011" @default.
- W2792297482 hasPublicationYear "2018" @default.
- W2792297482 type Work @default.
- W2792297482 sameAs 2792297482 @default.
- W2792297482 citedByCount "32" @default.
- W2792297482 countsByYear W27922974822018 @default.
- W2792297482 countsByYear W27922974822019 @default.
- W2792297482 countsByYear W27922974822020 @default.
- W2792297482 countsByYear W27922974822021 @default.
- W2792297482 countsByYear W27922974822022 @default.
- W2792297482 countsByYear W27922974822023 @default.
- W2792297482 crossrefType "journal-article" @default.
- W2792297482 hasAuthorship W2792297482A5017769945 @default.
- W2792297482 hasAuthorship W2792297482A5019995639 @default.
- W2792297482 hasAuthorship W2792297482A5024737035 @default.
- W2792297482 hasAuthorship W2792297482A5028328772 @default.
- W2792297482 hasAuthorship W2792297482A5047812888 @default.
- W2792297482 hasAuthorship W2792297482A5048422487 @default.
- W2792297482 hasAuthorship W2792297482A5066382672 @default.
- W2792297482 hasAuthorship W2792297482A5068236378 @default.
- W2792297482 hasConcept C111919701 @default.
- W2792297482 hasConcept C120314980 @default.
- W2792297482 hasConcept C123593499 @default.
- W2792297482 hasConcept C124101348 @default.
- W2792297482 hasConcept C136764020 @default.
- W2792297482 hasConcept C164120249 @default.
- W2792297482 hasConcept C175801342 @default.
- W2792297482 hasConcept C177212765 @default.
- W2792297482 hasConcept C194222762 @default.
- W2792297482 hasConcept C199360897 @default.
- W2792297482 hasConcept C2522767166 @default.
- W2792297482 hasConcept C2781215313 @default.
- W2792297482 hasConcept C41008148 @default.
- W2792297482 hasConcept C510870499 @default.
- W2792297482 hasConcept C519991488 @default.
- W2792297482 hasConcept C75684735 @default.
- W2792297482 hasConcept C77088390 @default.
- W2792297482 hasConcept C79158427 @default.
- W2792297482 hasConcept C97854310 @default.
- W2792297482 hasConceptScore W2792297482C111919701 @default.
- W2792297482 hasConceptScore W2792297482C120314980 @default.
- W2792297482 hasConceptScore W2792297482C123593499 @default.
- W2792297482 hasConceptScore W2792297482C124101348 @default.
- W2792297482 hasConceptScore W2792297482C136764020 @default.
- W2792297482 hasConceptScore W2792297482C164120249 @default.
- W2792297482 hasConceptScore W2792297482C175801342 @default.
- W2792297482 hasConceptScore W2792297482C177212765 @default.
- W2792297482 hasConceptScore W2792297482C194222762 @default.
- W2792297482 hasConceptScore W2792297482C199360897 @default.
- W2792297482 hasConceptScore W2792297482C2522767166 @default.
- W2792297482 hasConceptScore W2792297482C2781215313 @default.
- W2792297482 hasConceptScore W2792297482C41008148 @default.
- W2792297482 hasConceptScore W2792297482C510870499 @default.
- W2792297482 hasConceptScore W2792297482C519991488 @default.
- W2792297482 hasConceptScore W2792297482C75684735 @default.
- W2792297482 hasConceptScore W2792297482C77088390 @default.
- W2792297482 hasConceptScore W2792297482C79158427 @default.
- W2792297482 hasConceptScore W2792297482C97854310 @default.
- W2792297482 hasLocation W27922974821 @default.
- W2792297482 hasOpenAccess W2792297482 @default.
- W2792297482 hasPrimaryLocation W27922974821 @default.
- W2792297482 hasRelatedWork W20993042 @default.
- W2792297482 hasRelatedWork W2470196046 @default.
- W2792297482 hasRelatedWork W2767450342 @default.
- W2792297482 hasRelatedWork W2769430831 @default.
- W2792297482 hasRelatedWork W2777139086 @default.
- W2792297482 hasRelatedWork W3142038251 @default.
- W2792297482 hasRelatedWork W3177086633 @default.
- W2792297482 hasRelatedWork W4206451144 @default.