Matches in SemOpenAlex for { <https://semopenalex.org/work/W2950644528> ?p ?o ?g. }
- W2950644528 abstract "New scientific instruments are starting to generate an unprecedented amount of data. LOFAR, one of the Square Kilometre Array pathfinders, is already producing data on a petabyte scale. The calibration of these data presents a huge challenge for final users: a) extensive storage and computing resources are required; b) the installation and maintenance of the processing software is not trivial; and c) the requirements of (experimental) calibration pipelines are quickly evolving. After encountering some limitations in classical infrastructures, we investigated the viability of cloud infrastructures as a solution. We found that the installation and operation of LOFAR data calibration pipelines is not only possible, but can also be efficient in cloud infrastructures. The main advantages were: (1) ease of software installation and maintenance, and the availability of standard APIs and tools, widely used in the industry; this reduces the requirement for significant manual intervention, which can have a highly negative impact; (2) flexibility to adapt the infrastructure to the needs of the problem, especially as those demands change over time; (3) on-demand consumption of (shared) resources. We found no significant impediments associated with the speed of data transfer, the use of external block storage, or the memory available. However, the availability of scratch storage areas of an appropriate size is critical. Finally, we considered the cost-effectiveness of a commercial cloud like Amazon Web Services. While it is more expensive than the operation of a large, fully-utilised cluster completely dedicated to LOFAR data reduction, its costs are competitive if the number of datasets to be analysed is not high, or if the costs of maintaining the dedicated system become high. Coupled with the advantages discussed above, this suggests that a cloud infrastructure may be favourable for many users." @default.
- W2950644528 created "2019-06-27" @default.
- W2950644528 creator A5004450883 @default.
- W2950644528 creator A5008522448 @default.
- W2950644528 creator A5041257950 @default.
- W2950644528 creator A5063879293 @default.
- W2950644528 creator A5064882403 @default.
- W2950644528 creator A5069464314 @default.
- W2950644528 date "2017-04-17" @default.
- W2950644528 modified "2023-10-18" @default.
- W2950644528 title "Calibration of LOFAR data on the cloud" @default.
- W2950644528 cites W1022833465 @default.
- W2950644528 cites W148019499 @default.
- W2950644528 cites W1574680346 @default.
- W2950644528 cites W1936021078 @default.
- W2950644528 cites W2004206314 @default.
- W2950644528 cites W2055043387 @default.
- W2950644528 cites W2115755916 @default.
- W2950644528 cites W2249344705 @default.
- W2950644528 cites W2260770341 @default.
- W2950644528 cites W2304925187 @default.
- W2950644528 cites W2346304699 @default.
- W2950644528 cites W2462925613 @default.
- W2950644528 cites W2952288901 @default.
- W2950644528 cites W3099625438 @default.
- W2950644528 cites W3100367964 @default.
- W2950644528 cites W3100387858 @default.
- W2950644528 cites W3101837152 @default.
- W2950644528 cites W3121955845 @default.
- W2950644528 doi "https://doi.org/10.48550/arxiv.1704.05064" @default.
- W2950644528 hasPublicationYear "2017" @default.
- W2950644528 type Work @default.
- W2950644528 sameAs 2950644528 @default.
- W2950644528 citedByCount "0" @default.
- W2950644528 crossrefType "posted-content" @default.
- W2950644528 hasAuthorship W2950644528A5004450883 @default.
- W2950644528 hasAuthorship W2950644528A5008522448 @default.
- W2950644528 hasAuthorship W2950644528A5041257950 @default.
- W2950644528 hasAuthorship W2950644528A5063879293 @default.
- W2950644528 hasAuthorship W2950644528A5064882403 @default.
- W2950644528 hasAuthorship W2950644528A5069464314 @default.
- W2950644528 hasBestOaLocation W29506445281 @default.
- W2950644528 hasConcept C104892082 @default.
- W2950644528 hasConcept C105795698 @default.
- W2950644528 hasConcept C111919701 @default.
- W2950644528 hasConcept C120314980 @default.
- W2950644528 hasConcept C121332964 @default.
- W2950644528 hasConcept C165838908 @default.
- W2950644528 hasConcept C175309249 @default.
- W2950644528 hasConcept C2777904410 @default.
- W2950644528 hasConcept C2778755073 @default.
- W2950644528 hasConcept C2780590096 @default.
- W2950644528 hasConcept C2780598303 @default.
- W2950644528 hasConcept C33923547 @default.
- W2950644528 hasConcept C39432304 @default.
- W2950644528 hasConcept C41008148 @default.
- W2950644528 hasConcept C43521106 @default.
- W2950644528 hasConcept C62520636 @default.
- W2950644528 hasConcept C76155785 @default.
- W2950644528 hasConcept C77088390 @default.
- W2950644528 hasConcept C79974875 @default.
- W2950644528 hasConcept C87717796 @default.
- W2950644528 hasConceptScore W2950644528C104892082 @default.
- W2950644528 hasConceptScore W2950644528C105795698 @default.
- W2950644528 hasConceptScore W2950644528C111919701 @default.
- W2950644528 hasConceptScore W2950644528C120314980 @default.
- W2950644528 hasConceptScore W2950644528C121332964 @default.
- W2950644528 hasConceptScore W2950644528C165838908 @default.
- W2950644528 hasConceptScore W2950644528C175309249 @default.
- W2950644528 hasConceptScore W2950644528C2777904410 @default.
- W2950644528 hasConceptScore W2950644528C2778755073 @default.
- W2950644528 hasConceptScore W2950644528C2780590096 @default.
- W2950644528 hasConceptScore W2950644528C2780598303 @default.
- W2950644528 hasConceptScore W2950644528C33923547 @default.
- W2950644528 hasConceptScore W2950644528C39432304 @default.
- W2950644528 hasConceptScore W2950644528C41008148 @default.
- W2950644528 hasConceptScore W2950644528C43521106 @default.
- W2950644528 hasConceptScore W2950644528C62520636 @default.
- W2950644528 hasConceptScore W2950644528C76155785 @default.
- W2950644528 hasConceptScore W2950644528C77088390 @default.
- W2950644528 hasConceptScore W2950644528C79974875 @default.
- W2950644528 hasConceptScore W2950644528C87717796 @default.
- W2950644528 hasLocation W29506445281 @default.
- W2950644528 hasLocation W29506445282 @default.
- W2950644528 hasLocation W29506445283 @default.
- W2950644528 hasLocation W29506445284 @default.
- W2950644528 hasOpenAccess W2950644528 @default.
- W2950644528 hasPrimaryLocation W29506445281 @default.
- W2950644528 hasRelatedWork W1488196161 @default.
- W2950644528 hasRelatedWork W1509429107 @default.
- W2950644528 hasRelatedWork W1571604264 @default.
- W2950644528 hasRelatedWork W1595868330 @default.
- W2950644528 hasRelatedWork W2120762159 @default.
- W2950644528 hasRelatedWork W2213644644 @default.
- W2950644528 hasRelatedWork W2810357760 @default.
- W2950644528 hasRelatedWork W2897954339 @default.
- W2950644528 hasRelatedWork W2979262620 @default.
- W2950644528 hasRelatedWork W3111868337 @default.
- W2950644528 isParatext "false" @default.
- W2950644528 isRetracted "false" @default.