Matches in SemOpenAlex for { <https://semopenalex.org/work/W2951947775> ?p ?o ?g. }
- W2951947775 abstract "The performance of Deep-Learning (DL) computing frameworks rely on the performance of data ingestion and checkpointing. In fact, during the training, a considerable high number of relatively small files are first loaded and pre-processed on CPUs and then moved to accelerator for computation. In addition, checkpointing and restart operations are carried out to allow DL computing frameworks to restart quickly from a checkpoint. Because of this, I/O affects the performance of DL applications. In this work, we characterize the I/O performance and scaling of TensorFlow, an open-source programming framework developed by Google and specifically designed for solving DL problems. To measure TensorFlow I/O performance, we first design a micro-benchmark to measure TensorFlow reads, and then use a TensorFlow mini-application based on AlexNet to measure the performance cost of I/O and checkpointing in TensorFlow. To improve the checkpointing performance, we design and implement a burst buffer. We find that increasing the number of threads increases TensorFlow bandwidth by a maximum of 2.3× and 7.8× on our benchmark environments. The use of the tensorFlow prefetcher results in a complete overlap of computation on accelerator and input pipeline on CPU eliminating the effective cost of I/O on the overall performance. The use of a burst buffer to checkpoint to a fast small capacity storage and copy asynchronously the checkpoints to a slower large capacity storage resulted in a performance improvement of 2.6× with respect to checkpointing directly to slower storage on our benchmark environment." @default.
- W2951947775 created "2019-06-27" @default.
- W2951947775 creator A5001980517 @default.
- W2951947775 creator A5011376663 @default.
- W2951947775 creator A5016919024 @default.
- W2951947775 creator A5031738594 @default.
- W2951947775 creator A5039027821 @default.
- W2951947775 creator A5085178088 @default.
- W2951947775 creator A5086187734 @default.
- W2951947775 date "2018-11-01" @default.
- W2951947775 modified "2023-10-14" @default.
- W2951947775 title "Characterizing Deep-Learning I/O Workloads in TensorFlow" @default.
- W2951947775 cites W1986905947 @default.
- W2951947775 cites W1988404188 @default.
- W2951947775 cites W2117539524 @default.
- W2951947775 cites W2155893237 @default.
- W2951947775 cites W2397292972 @default.
- W2951947775 cites W2513383847 @default.
- W2951947775 cites W2542459869 @default.
- W2951947775 cites W2583711684 @default.
- W2951947775 cites W2606722458 @default.
- W2951947775 cites W2736230459 @default.
- W2951947775 cites W2787405437 @default.
- W2951947775 cites W2899366056 @default.
- W2951947775 cites W2900042580 @default.
- W2951947775 cites W2963410977 @default.
- W2951947775 cites W2963674387 @default.
- W2951947775 cites W3101543398 @default.
- W2951947775 cites W3106110717 @default.
- W2951947775 cites W3125962258 @default.
- W2951947775 cites W4245507143 @default.
- W2951947775 cites W4249935458 @default.
- W2951947775 doi "https://doi.org/10.1109/pdsw-discs.2018.00011" @default.
- W2951947775 hasPublicationYear "2018" @default.
- W2951947775 type Work @default.
- W2951947775 sameAs 2951947775 @default.
- W2951947775 citedByCount "32" @default.
- W2951947775 countsByYear W29519477752019 @default.
- W2951947775 countsByYear W29519477752020 @default.
- W2951947775 countsByYear W29519477752021 @default.
- W2951947775 countsByYear W29519477752022 @default.
- W2951947775 countsByYear W29519477752023 @default.
- W2951947775 crossrefType "proceedings-article" @default.
- W2951947775 hasAuthorship W2951947775A5001980517 @default.
- W2951947775 hasAuthorship W2951947775A5011376663 @default.
- W2951947775 hasAuthorship W2951947775A5016919024 @default.
- W2951947775 hasAuthorship W2951947775A5031738594 @default.
- W2951947775 hasAuthorship W2951947775A5039027821 @default.
- W2951947775 hasAuthorship W2951947775A5085178088 @default.
- W2951947775 hasAuthorship W2951947775A5086187734 @default.
- W2951947775 hasBestOaLocation W29519477752 @default.
- W2951947775 hasConcept C108583219 @default.
- W2951947775 hasConcept C111919701 @default.
- W2951947775 hasConcept C113775141 @default.
- W2951947775 hasConcept C11413529 @default.
- W2951947775 hasConcept C120314980 @default.
- W2951947775 hasConcept C124101348 @default.
- W2951947775 hasConcept C13280743 @default.
- W2951947775 hasConcept C154945302 @default.
- W2951947775 hasConcept C162324750 @default.
- W2951947775 hasConcept C173608175 @default.
- W2951947775 hasConcept C185798385 @default.
- W2951947775 hasConcept C205649164 @default.
- W2951947775 hasConcept C21547014 @default.
- W2951947775 hasConcept C2778915421 @default.
- W2951947775 hasConcept C2780009758 @default.
- W2951947775 hasConcept C41008148 @default.
- W2951947775 hasConcept C43521106 @default.
- W2951947775 hasConcept C45374587 @default.
- W2951947775 hasConceptScore W2951947775C108583219 @default.
- W2951947775 hasConceptScore W2951947775C111919701 @default.
- W2951947775 hasConceptScore W2951947775C113775141 @default.
- W2951947775 hasConceptScore W2951947775C11413529 @default.
- W2951947775 hasConceptScore W2951947775C120314980 @default.
- W2951947775 hasConceptScore W2951947775C124101348 @default.
- W2951947775 hasConceptScore W2951947775C13280743 @default.
- W2951947775 hasConceptScore W2951947775C154945302 @default.
- W2951947775 hasConceptScore W2951947775C162324750 @default.
- W2951947775 hasConceptScore W2951947775C173608175 @default.
- W2951947775 hasConceptScore W2951947775C185798385 @default.
- W2951947775 hasConceptScore W2951947775C205649164 @default.
- W2951947775 hasConceptScore W2951947775C21547014 @default.
- W2951947775 hasConceptScore W2951947775C2778915421 @default.
- W2951947775 hasConceptScore W2951947775C2780009758 @default.
- W2951947775 hasConceptScore W2951947775C41008148 @default.
- W2951947775 hasConceptScore W2951947775C43521106 @default.
- W2951947775 hasConceptScore W2951947775C45374587 @default.
- W2951947775 hasLocation W29519477751 @default.
- W2951947775 hasLocation W29519477752 @default.
- W2951947775 hasOpenAccess W2951947775 @default.
- W2951947775 hasPrimaryLocation W29519477751 @default.
- W2951947775 hasRelatedWork W1517776641 @default.
- W2951947775 hasRelatedWork W1572523360 @default.
- W2951947775 hasRelatedWork W2051963567 @default.
- W2951947775 hasRelatedWork W2093683727 @default.
- W2951947775 hasRelatedWork W2242574529 @default.
- W2951947775 hasRelatedWork W2391655055 @default.
- W2951947775 hasRelatedWork W3144161808 @default.
- W2951947775 hasRelatedWork W4310034804 @default.
- W2951947775 hasRelatedWork W4323049313 @default.