Matches in SemOpenAlex for { <https://semopenalex.org/work/W4322006640> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W4322006640 abstract "Typical end-to-end Earth System Modelling (ESM) workflows rely on different steps including data pre-processing, numerical simulation, output post-processing, as well as data analytics and visualization. The approaches currently available for implementing scientific workflows in the climate context do not properly integrate the entire set of components into a single workflow and in a transparent manner. The increasing usage of High Performance Data Analytics (HPDA) and Machine Learning (ML) in climate applications further exacerbate the issues. A more integrated approach would allow to support next-generation ESM and improve the workflow in terms of execution and energy consumption.Moreover, a seamless integration of components for HPDA and ML into the ESM workflow will open the floor to novel applications and support larger scale pre- and post-processing. However, these components typically have different deployment requirements spanning from HPC (for ESM simulation) to Cloud computing (for HPDA and ML). It is paramount to provide scientists with solutions capable of hiding the technical details of the underlying infrastructure and improving workflow portability.In the context of the eFlows4HPC project, we are exploring the use of innovative workflow solutions integrating approaches from HPC, HPDA and ML for supporting end-to-end ESM simulations and post-processing, with a focus on extreme events analysis (e.g., heat waves and tropical cyclones). In particular, the envisioned solution exploits PyCOMPSs for the management of parallel pipelines, task orchestration and synchronization, as well as PyOphidia for climate data analytics and ML frameworks (i.e., TensorFlow) for data-driven event detection models. This contribution presents the approaches being explored in the frame of the project to address the convergence of HPC, Big Data and ML into a single end-to-end ESM workflows." @default.
- W4322006640 created "2023-02-26" @default.
- W4322006640 creator A5015588225 @default.
- W4322006640 creator A5017628619 @default.
- W4322006640 creator A5031765937 @default.
- W4322006640 creator A5032433954 @default.
- W4322006640 creator A5038281463 @default.
- W4322006640 creator A5041348739 @default.
- W4322006640 creator A5057585451 @default.
- W4322006640 creator A5065153145 @default.
- W4322006640 creator A5068232148 @default.
- W4322006640 creator A5069521976 @default.
- W4322006640 date "2023-05-15" @default.
- W4322006640 modified "2023-09-26" @default.
- W4322006640 title "Convergence of HPC, Big Data and Machine Learning for Earth System workflows" @default.
- W4322006640 doi "https://doi.org/10.5194/egusphere-egu23-6857" @default.
- W4322006640 hasPublicationYear "2023" @default.
- W4322006640 type Work @default.
- W4322006640 citedByCount "0" @default.
- W4322006640 crossrefType "posted-content" @default.
- W4322006640 hasAuthorship W4322006640A5015588225 @default.
- W4322006640 hasAuthorship W4322006640A5017628619 @default.
- W4322006640 hasAuthorship W4322006640A5031765937 @default.
- W4322006640 hasAuthorship W4322006640A5032433954 @default.
- W4322006640 hasAuthorship W4322006640A5038281463 @default.
- W4322006640 hasAuthorship W4322006640A5041348739 @default.
- W4322006640 hasAuthorship W4322006640A5057585451 @default.
- W4322006640 hasAuthorship W4322006640A5065153145 @default.
- W4322006640 hasAuthorship W4322006640A5068232148 @default.
- W4322006640 hasAuthorship W4322006640A5069521976 @default.
- W4322006640 hasConcept C111919701 @default.
- W4322006640 hasConcept C120314980 @default.
- W4322006640 hasConcept C124101348 @default.
- W4322006640 hasConcept C140824633 @default.
- W4322006640 hasConcept C142362112 @default.
- W4322006640 hasConcept C151730666 @default.
- W4322006640 hasConcept C153349607 @default.
- W4322006640 hasConcept C177212765 @default.
- W4322006640 hasConcept C199168358 @default.
- W4322006640 hasConcept C2522767166 @default.
- W4322006640 hasConcept C2779343474 @default.
- W4322006640 hasConcept C41008148 @default.
- W4322006640 hasConcept C558565934 @default.
- W4322006640 hasConcept C63000827 @default.
- W4322006640 hasConcept C75684735 @default.
- W4322006640 hasConcept C77088390 @default.
- W4322006640 hasConcept C79158427 @default.
- W4322006640 hasConcept C79974875 @default.
- W4322006640 hasConcept C86803240 @default.
- W4322006640 hasConceptScore W4322006640C111919701 @default.
- W4322006640 hasConceptScore W4322006640C120314980 @default.
- W4322006640 hasConceptScore W4322006640C124101348 @default.
- W4322006640 hasConceptScore W4322006640C140824633 @default.
- W4322006640 hasConceptScore W4322006640C142362112 @default.
- W4322006640 hasConceptScore W4322006640C151730666 @default.
- W4322006640 hasConceptScore W4322006640C153349607 @default.
- W4322006640 hasConceptScore W4322006640C177212765 @default.
- W4322006640 hasConceptScore W4322006640C199168358 @default.
- W4322006640 hasConceptScore W4322006640C2522767166 @default.
- W4322006640 hasConceptScore W4322006640C2779343474 @default.
- W4322006640 hasConceptScore W4322006640C41008148 @default.
- W4322006640 hasConceptScore W4322006640C558565934 @default.
- W4322006640 hasConceptScore W4322006640C63000827 @default.
- W4322006640 hasConceptScore W4322006640C75684735 @default.
- W4322006640 hasConceptScore W4322006640C77088390 @default.
- W4322006640 hasConceptScore W4322006640C79158427 @default.
- W4322006640 hasConceptScore W4322006640C79974875 @default.
- W4322006640 hasConceptScore W4322006640C86803240 @default.
- W4322006640 hasLocation W43220066401 @default.
- W4322006640 hasOpenAccess W4322006640 @default.
- W4322006640 hasPrimaryLocation W43220066401 @default.
- W4322006640 hasRelatedWork W2080529815 @default.
- W4322006640 hasRelatedWork W2081035100 @default.
- W4322006640 hasRelatedWork W3097243301 @default.
- W4322006640 hasRelatedWork W3114771222 @default.
- W4322006640 hasRelatedWork W3171568351 @default.
- W4322006640 hasRelatedWork W3180337491 @default.
- W4322006640 hasRelatedWork W4200184607 @default.
- W4322006640 hasRelatedWork W4214869855 @default.
- W4322006640 hasRelatedWork W4287605407 @default.
- W4322006640 hasRelatedWork W4295151157 @default.
- W4322006640 isParatext "false" @default.
- W4322006640 isRetracted "false" @default.
- W4322006640 workType "article" @default.