Matches in SemOpenAlex for { <https://semopenalex.org/work/W55910774> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W55910774 abstract "Large scale climate data analysis could not be constrained to a single data archive. Rather, linking many differentdata archives delivers new insights into the fundamental processes in climate science. Thus infrastructuresemerged supporting the development of distributed climate data analysis workflows by providing integrated dataand workflow management middleware. Two examples of this development are the ESGF infrastructure and theC3Grid.The ESGF data federation is based on an international effort to establish a distributed archive serving climatemodel data from large climate modeling intercomparison projects like CMIP5. C3Grid was developed as a nationalinitiative for a climate data processing and data access infrastructure in Germany, integrating national climate datacenters with compute providers.While no support for processing workflows is currently integrated into the ESGF infrastructure (some developmentefforts are on the way), the C3Grid offers several processing features with different diagnostic workflows. Theexperiences in this context show the complexity and fragility of efforts to provide operational workflows relyingon a distributed e-science infrastructure composed of middleware services interacting with distributed computeand storage resources.Based on this experience we present a generic workflow integration process. The basic idea is to modularizethe necessary integration steps of workflows into the C3Grid e-science infrastructure. The presented workflowsalso use data sources integrated in the worldwide ESGF data federation.In a nutshell the process is structured as follows:1) local development and test of a data analysis components / workflows with example data2) Exposition of the workflows as a processing web service based on the WPS OGC standard using locally hosteddata3) Generalizing the workflows by explicit inclusion of data staging tasks (thus extension to externally hosted data)alongside with persistent data identification (e.g. for provenance tracking of generated data products)4) Development of a workflow parametrization GUI5) Integration of workflows and GUI into the C3Grid infrastructureThe key advantages of this process are:- early access and testing of newly developed functionality- ease of access and reuse of analysis components (with a restricted set data sources) independent of the C3Gridmiddleware e.g. for testing and research- additional effort for integration into the C3Grid infrastructure is only done for well tested workflows which havereached production status- clear interaction points between domain scientists (workflow developers) and e-science experts (infrastructuredevelopers)The approach is illustrated by workflows developed by the climate service center (CSC)." @default.
- W55910774 created "2016-06-24" @default.
- W55910774 creator A5021872913 @default.
- W55910774 creator A5024851960 @default.
- W55910774 creator A5027670679 @default.
- W55910774 creator A5050109541 @default.
- W55910774 creator A5054886567 @default.
- W55910774 creator A5087343198 @default.
- W55910774 date "2013-04-09" @default.
- W55910774 modified "2023-09-23" @default.
- W55910774 title "A stepwise approach to integrate climate data analysis workflows into e-science infrastructures" @default.
- W55910774 hasPublicationYear "2013" @default.
- W55910774 type Work @default.
- W55910774 sameAs 55910774 @default.
- W55910774 citedByCount "0" @default.
- W55910774 crossrefType "journal-article" @default.
- W55910774 hasAuthorship W55910774A5021872913 @default.
- W55910774 hasAuthorship W55910774A5024851960 @default.
- W55910774 hasAuthorship W55910774A5027670679 @default.
- W55910774 hasAuthorship W55910774A5050109541 @default.
- W55910774 hasAuthorship W55910774A5054886567 @default.
- W55910774 hasAuthorship W55910774A5087343198 @default.
- W55910774 hasConcept C111919701 @default.
- W55910774 hasConcept C115903868 @default.
- W55910774 hasConcept C151730666 @default.
- W55910774 hasConcept C169468491 @default.
- W55910774 hasConcept C177212765 @default.
- W55910774 hasConcept C187691185 @default.
- W55910774 hasConcept C2522767166 @default.
- W55910774 hasConcept C2524010 @default.
- W55910774 hasConcept C2776397876 @default.
- W55910774 hasConcept C2779343474 @default.
- W55910774 hasConcept C33923547 @default.
- W55910774 hasConcept C41008148 @default.
- W55910774 hasConcept C517757529 @default.
- W55910774 hasConcept C72634772 @default.
- W55910774 hasConcept C77088390 @default.
- W55910774 hasConcept C86803240 @default.
- W55910774 hasConcept C98045186 @default.
- W55910774 hasConceptScore W55910774C111919701 @default.
- W55910774 hasConceptScore W55910774C115903868 @default.
- W55910774 hasConceptScore W55910774C151730666 @default.
- W55910774 hasConceptScore W55910774C169468491 @default.
- W55910774 hasConceptScore W55910774C177212765 @default.
- W55910774 hasConceptScore W55910774C187691185 @default.
- W55910774 hasConceptScore W55910774C2522767166 @default.
- W55910774 hasConceptScore W55910774C2524010 @default.
- W55910774 hasConceptScore W55910774C2776397876 @default.
- W55910774 hasConceptScore W55910774C2779343474 @default.
- W55910774 hasConceptScore W55910774C33923547 @default.
- W55910774 hasConceptScore W55910774C41008148 @default.
- W55910774 hasConceptScore W55910774C517757529 @default.
- W55910774 hasConceptScore W55910774C72634772 @default.
- W55910774 hasConceptScore W55910774C77088390 @default.
- W55910774 hasConceptScore W55910774C86803240 @default.
- W55910774 hasConceptScore W55910774C98045186 @default.
- W55910774 hasLocation W559107741 @default.
- W55910774 hasOpenAccess W55910774 @default.
- W55910774 hasPrimaryLocation W559107741 @default.
- W55910774 hasRelatedWork W183899764 @default.
- W55910774 hasRelatedWork W1968275812 @default.
- W55910774 hasRelatedWork W1992229674 @default.
- W55910774 hasRelatedWork W1995686039 @default.
- W55910774 hasRelatedWork W1999860436 @default.
- W55910774 hasRelatedWork W2008249782 @default.
- W55910774 hasRelatedWork W2014185412 @default.
- W55910774 hasRelatedWork W2079540667 @default.
- W55910774 hasRelatedWork W2081236526 @default.
- W55910774 hasRelatedWork W2094631282 @default.
- W55910774 hasRelatedWork W2101696854 @default.
- W55910774 hasRelatedWork W2114981588 @default.
- W55910774 hasRelatedWork W2128548442 @default.
- W55910774 hasRelatedWork W2149392898 @default.
- W55910774 hasRelatedWork W2161494099 @default.
- W55910774 hasRelatedWork W2520792696 @default.
- W55910774 hasRelatedWork W26761716 @default.
- W55910774 hasRelatedWork W2796076587 @default.
- W55910774 hasRelatedWork W2895735752 @default.
- W55910774 hasRelatedWork W2918486594 @default.
- W55910774 isParatext "false" @default.
- W55910774 isRetracted "false" @default.
- W55910774 magId "55910774" @default.
- W55910774 workType "article" @default.