Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387544162> ?p ?o ?g. }
- W4387544162 abstract "The increasing volume and velocity of science data necessitate the frequent movement of enormous data volumes as part of routine research activities. As a result, limited wide-area bandwidth often leads to bottlenecks in research progress. However, in many cases, consuming applications (e.g., for analysis, visualization, and machine learning) can achieve acceptable performance on reduced-precision data, and thus researchers may wish to compromise on data precision to reduce transfer and storage costs. Error-bounded lossy compression presents a promising approach as it can significantly reduce data volumes while preserving data integrity based on user-specified error bounds. In this paper, we propose a novel data transfer framework called Ocelot that integrates error-bounded lossy compression into the Globus data transfer infrastructure. We note four key contributions: (1) Ocelot is the first integration of lossy compression in Globus to significantly improve scientific data transfer performance over wide area network (WAN). (2) We propose an effective machine-learning based lossy compression quality estimation model that can predict the quality of error-bounded lossy compressors, which is fundamental to ensure that transferred data are acceptable to users. (3) We develop optimized strategies to reduce the compression time overhead, counter the compute-node waiting time, and improve transfer speed for compressed files. (4) We perform evaluations using many real-world scientific applications across different domains and distributed Globus endpoints. Our experiments show that Ocelot can improve dataset transfer performance substantially, and the quality of lossy compression (time, ratio and data distortion) can be predicted accurately for the purpose of quality assurance." @default.
- W4387544162 created "2023-10-12" @default.
- W4387544162 creator A5000948819 @default.
- W4387544162 creator A5032231503 @default.
- W4387544162 creator A5046613458 @default.
- W4387544162 creator A5065464552 @default.
- W4387544162 creator A5066430343 @default.
- W4387544162 date "2023-07-01" @default.
- W4387544162 modified "2023-10-12" @default.
- W4387544162 title "Optimizing Scientific Data Transfer on Globus with Error-Bounded Lossy Compression" @default.
- W4387544162 cites W1499782454 @default.
- W4387544162 cites W1953696264 @default.
- W4387544162 cites W2047659476 @default.
- W4387544162 cites W2052440657 @default.
- W4387544162 cites W2060108852 @default.
- W4387544162 cites W2089118315 @default.
- W4387544162 cites W2103548189 @default.
- W4387544162 cites W2107745473 @default.
- W4387544162 cites W2125634634 @default.
- W4387544162 cites W2162566501 @default.
- W4387544162 cites W2164566630 @default.
- W4387544162 cites W2514139066 @default.
- W4387544162 cites W2562764966 @default.
- W4387544162 cites W2592114463 @default.
- W4387544162 cites W2741341431 @default.
- W4387544162 cites W2791997336 @default.
- W4387544162 cites W2808348679 @default.
- W4387544162 cites W2898617435 @default.
- W4387544162 cites W2901632366 @default.
- W4387544162 cites W2911892981 @default.
- W4387544162 cites W2912174957 @default.
- W4387544162 cites W2954999090 @default.
- W4387544162 cites W2959531572 @default.
- W4387544162 cites W2963030973 @default.
- W4387544162 cites W2983517508 @default.
- W4387544162 cites W2986871396 @default.
- W4387544162 cites W3021718926 @default.
- W4387544162 cites W3022664119 @default.
- W4387544162 cites W3174738244 @default.
- W4387544162 cites W3206053086 @default.
- W4387544162 cites W3210414979 @default.
- W4387544162 cites W3212420620 @default.
- W4387544162 cites W4226076355 @default.
- W4387544162 cites W4289533799 @default.
- W4387544162 doi "https://doi.org/10.1109/icdcs57875.2023.00064" @default.
- W4387544162 hasPublicationYear "2023" @default.
- W4387544162 type Work @default.
- W4387544162 citedByCount "0" @default.
- W4387544162 crossrefType "proceedings-article" @default.
- W4387544162 hasAuthorship W4387544162A5000948819 @default.
- W4387544162 hasAuthorship W4387544162A5032231503 @default.
- W4387544162 hasAuthorship W4387544162A5046613458 @default.
- W4387544162 hasAuthorship W4387544162A5065464552 @default.
- W4387544162 hasAuthorship W4387544162A5066430343 @default.
- W4387544162 hasConcept C111919701 @default.
- W4387544162 hasConcept C113775141 @default.
- W4387544162 hasConcept C11413529 @default.
- W4387544162 hasConcept C127413603 @default.
- W4387544162 hasConcept C134306372 @default.
- W4387544162 hasConcept C154945302 @default.
- W4387544162 hasConcept C165021410 @default.
- W4387544162 hasConcept C171146098 @default.
- W4387544162 hasConcept C25797200 @default.
- W4387544162 hasConcept C2779960059 @default.
- W4387544162 hasConcept C31258907 @default.
- W4387544162 hasConcept C33923547 @default.
- W4387544162 hasConcept C34388435 @default.
- W4387544162 hasConcept C41008148 @default.
- W4387544162 hasConcept C511840579 @default.
- W4387544162 hasConcept C557945733 @default.
- W4387544162 hasConcept C78548338 @default.
- W4387544162 hasConceptScore W4387544162C111919701 @default.
- W4387544162 hasConceptScore W4387544162C113775141 @default.
- W4387544162 hasConceptScore W4387544162C11413529 @default.
- W4387544162 hasConceptScore W4387544162C127413603 @default.
- W4387544162 hasConceptScore W4387544162C134306372 @default.
- W4387544162 hasConceptScore W4387544162C154945302 @default.
- W4387544162 hasConceptScore W4387544162C165021410 @default.
- W4387544162 hasConceptScore W4387544162C171146098 @default.
- W4387544162 hasConceptScore W4387544162C25797200 @default.
- W4387544162 hasConceptScore W4387544162C2779960059 @default.
- W4387544162 hasConceptScore W4387544162C31258907 @default.
- W4387544162 hasConceptScore W4387544162C33923547 @default.
- W4387544162 hasConceptScore W4387544162C34388435 @default.
- W4387544162 hasConceptScore W4387544162C41008148 @default.
- W4387544162 hasConceptScore W4387544162C511840579 @default.
- W4387544162 hasConceptScore W4387544162C557945733 @default.
- W4387544162 hasConceptScore W4387544162C78548338 @default.
- W4387544162 hasFunder F4320306076 @default.
- W4387544162 hasFunder F4320306084 @default.
- W4387544162 hasFunder F4320337506 @default.
- W4387544162 hasLocation W43875441621 @default.
- W4387544162 hasOpenAccess W4387544162 @default.
- W4387544162 hasPrimaryLocation W43875441621 @default.
- W4387544162 hasRelatedWork W108076602 @default.
- W4387544162 hasRelatedWork W2385628723 @default.
- W4387544162 hasRelatedWork W2547124190 @default.
- W4387544162 hasRelatedWork W2552401318 @default.
- W4387544162 hasRelatedWork W2912174957 @default.
- W4387544162 hasRelatedWork W3180760233 @default.