Matches in SemOpenAlex for { <https://semopenalex.org/work/W2193529129> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W2193529129 endingPage "89" @default.
- W2193529129 startingPage "76" @default.
- W2193529129 abstract "The global deployment of cloud datacenters is enabling large scale scientific workflows to improve performance and deliver fast responses. This unprecedented geographical distribution of the computation is doubled by an increase in the scale of the data handled by such applications, bringing new challenges related to the efficient data management across sites. High throughput, low latencies or cost-related trade-offs are just a few concerns for both cloud providers and users when it comes to handling data across datacenters. Existing solutions are limited to cloud-provided storage, which offers low performance based on rigid cost schemes. In turn, workflow engines need to improvise substitutes, achieving performance at the cost of complex system configurations, maintenance overheads, reduced reliability and reusability. In this paper, we introduce OverFlow, a uniform data management system for scientific workflows running across geographically distributed sites, aiming to reap economic benefits from this geo-diversity. Our solution is environment-aware, as it monitors and models the global cloud infrastructure, offering high and predictable data handling performance for transfer cost and time, within and across sites. OverFlow proposes a set of pluggable services, grouped in a data scientist cloud kit. They provide the applications with the possibility to monitor the underlying infrastructure, to exploit smart data compression, deduplication and geo-replication, to evaluate data management costs, to set a tradeoff between money and time, and optimize the transfer strategy accordingly. The system was validated on the Microsoft Azure cloud across its 6 EU and US datacenters. The experiments were conducted on hundreds of nodes using synthetic benchmarks and real-life bio-informatics applications (A-Brain, BLAST). The results show that our system is able to model accurately the cloud performance and to leverage this for efficient data dissemination, being able to reduce the monetary costs and transfer time by up to three times." @default.
- W2193529129 created "2016-06-24" @default.
- W2193529129 creator A5006549758 @default.
- W2193529129 creator A5071296200 @default.
- W2193529129 creator A5077818565 @default.
- W2193529129 date "2016-01-01" @default.
- W2193529129 modified "2023-09-27" @default.
- W2193529129 title "OverFlow: Multi-Site Aware Big Data Management for Scientific Workflows on Clouds" @default.
- W2193529129 cites W1532114435 @default.
- W2193529129 cites W1646116162 @default.
- W2193529129 cites W1974508523 @default.
- W2193529129 cites W1978802375 @default.
- W2193529129 cites W1985613945 @default.
- W2193529129 cites W2029467255 @default.
- W2193529129 cites W2053571556 @default.
- W2193529129 cites W2060013153 @default.
- W2193529129 cites W2095515570 @default.
- W2193529129 cites W2100830825 @default.
- W2193529129 cites W2106686319 @default.
- W2193529129 cites W2136567909 @default.
- W2193529129 cites W2143163492 @default.
- W2193529129 cites W2147006751 @default.
- W2193529129 cites W2149587920 @default.
- W2193529129 cites W2166102903 @default.
- W2193529129 cites W2169466806 @default.
- W2193529129 cites W2171568320 @default.
- W2193529129 cites W2173213060 @default.
- W2193529129 cites W3147228328 @default.
- W2193529129 doi "https://doi.org/10.1109/tcc.2015.2440254" @default.
- W2193529129 hasPublicationYear "2016" @default.
- W2193529129 type Work @default.
- W2193529129 sameAs 2193529129 @default.
- W2193529129 citedByCount "32" @default.
- W2193529129 countsByYear W21935291292017 @default.
- W2193529129 countsByYear W21935291292018 @default.
- W2193529129 countsByYear W21935291292019 @default.
- W2193529129 countsByYear W21935291292020 @default.
- W2193529129 countsByYear W21935291292021 @default.
- W2193529129 countsByYear W21935291292022 @default.
- W2193529129 countsByYear W21935291292023 @default.
- W2193529129 crossrefType "journal-article" @default.
- W2193529129 hasAuthorship W2193529129A5006549758 @default.
- W2193529129 hasAuthorship W2193529129A5071296200 @default.
- W2193529129 hasAuthorship W2193529129A5077818565 @default.
- W2193529129 hasBestOaLocation W21935291292 @default.
- W2193529129 hasConcept C105339364 @default.
- W2193529129 hasConcept C111919701 @default.
- W2193529129 hasConcept C120314980 @default.
- W2193529129 hasConcept C157764524 @default.
- W2193529129 hasConcept C165696696 @default.
- W2193529129 hasConcept C1668388 @default.
- W2193529129 hasConcept C177212765 @default.
- W2193529129 hasConcept C32587265 @default.
- W2193529129 hasConcept C38652104 @default.
- W2193529129 hasConcept C41008148 @default.
- W2193529129 hasConcept C555944384 @default.
- W2193529129 hasConcept C75684735 @default.
- W2193529129 hasConcept C77088390 @default.
- W2193529129 hasConcept C79974875 @default.
- W2193529129 hasConceptScore W2193529129C105339364 @default.
- W2193529129 hasConceptScore W2193529129C111919701 @default.
- W2193529129 hasConceptScore W2193529129C120314980 @default.
- W2193529129 hasConceptScore W2193529129C157764524 @default.
- W2193529129 hasConceptScore W2193529129C165696696 @default.
- W2193529129 hasConceptScore W2193529129C1668388 @default.
- W2193529129 hasConceptScore W2193529129C177212765 @default.
- W2193529129 hasConceptScore W2193529129C32587265 @default.
- W2193529129 hasConceptScore W2193529129C38652104 @default.
- W2193529129 hasConceptScore W2193529129C41008148 @default.
- W2193529129 hasConceptScore W2193529129C555944384 @default.
- W2193529129 hasConceptScore W2193529129C75684735 @default.
- W2193529129 hasConceptScore W2193529129C77088390 @default.
- W2193529129 hasConceptScore W2193529129C79974875 @default.
- W2193529129 hasIssue "1" @default.
- W2193529129 hasLocation W21935291291 @default.
- W2193529129 hasLocation W21935291292 @default.
- W2193529129 hasLocation W21935291293 @default.
- W2193529129 hasOpenAccess W2193529129 @default.
- W2193529129 hasPrimaryLocation W21935291291 @default.
- W2193529129 hasRelatedWork W143242780 @default.
- W2193529129 hasRelatedWork W1688445866 @default.
- W2193529129 hasRelatedWork W2015855483 @default.
- W2193529129 hasRelatedWork W2052094875 @default.
- W2193529129 hasRelatedWork W2057304795 @default.
- W2193529129 hasRelatedWork W2329229441 @default.
- W2193529129 hasRelatedWork W2580692153 @default.
- W2193529129 hasRelatedWork W2899407724 @default.
- W2193529129 hasRelatedWork W3152278044 @default.
- W2193529129 hasRelatedWork W4313182617 @default.
- W2193529129 hasVolume "4" @default.
- W2193529129 isParatext "false" @default.
- W2193529129 isRetracted "false" @default.
- W2193529129 magId "2193529129" @default.
- W2193529129 workType "article" @default.