Matches in SemOpenAlex for { <https://semopenalex.org/work/W157097179> ?p ?o ?g. }
Showing items 1 to 92 of
92
with 100 items per page.
- W157097179 abstract "The Spider system at the Oak Ridge National Laboratory’s Leadership Computing Facility (OLCF) is the world’s largest scale Lustre parallel file system. Envisioned as a shared parallel file system capable of delivering both the bandwidth and capacity requirements of the OLCF’s diverse computational environment, the project had a number of ambitious goals. To support the workloads of the OLCF’s diverse computational platforms, the aggregate performance and storage capacity of Spider exceed that of our previously deployed systems by a factor of 6x 240 GB/sec, and 17x 10 Petabytes, respectively. Furthermore, Spider supports over 26,000 clients concurrently accessing the file system, which exceeds our previously deployed systems by nearly 4x. In addition to these scalability challenges, moving to a center-wide shared file system required dramatically improved resiliency and fault-tolerance mechanisms. This paper details our efforts in designing, deploying, and operating Spider. Through a phased approach of research and development, prototyping, deployment, and transition to operations, this work has resulted in a number of insights into large-scale parallel file system architectures, from both the design and the operational perspectives. We present in this paper our solutions to issues such as network congestion, performance baselining and evaluation, file system journaling overheads, and high availability in a system with tens of thousands of components. We also discuss areas of continued challenges, such as stressed metadata performance and the need for file system quality of service alongside with our efforts to address them. Finally, operational aspects of managing a system of this scale are discussed along with real-world data and observations." @default.
- W157097179 created "2016-06-24" @default.
- W157097179 creator A5014538652 @default.
- W157097179 creator A5019916149 @default.
- W157097179 creator A5033812535 @default.
- W157097179 creator A5063921474 @default.
- W157097179 creator A5072424179 @default.
- W157097179 creator A5075702553 @default.
- W157097179 creator A5077558876 @default.
- W157097179 date "2010-01-01" @default.
- W157097179 modified "2023-09-27" @default.
- W157097179 title "Lessons Learned in Deploying the World’s Largest Scale Lustre File System" @default.
- W157097179 cites W1494639486 @default.
- W157097179 cites W188363600 @default.
- W157097179 cites W2045579177 @default.
- W157097179 cites W2096263410 @default.
- W157097179 cites W2146087795 @default.
- W157097179 cites W2158587304 @default.
- W157097179 cites W2163785249 @default.
- W157097179 cites W2169772993 @default.
- W157097179 hasPublicationYear "2010" @default.
- W157097179 type Work @default.
- W157097179 sameAs 157097179 @default.
- W157097179 citedByCount "5" @default.
- W157097179 countsByYear W1570971792013 @default.
- W157097179 countsByYear W1570971792015 @default.
- W157097179 countsByYear W1570971792019 @default.
- W157097179 crossrefType "journal-article" @default.
- W157097179 hasAuthorship W157097179A5014538652 @default.
- W157097179 hasAuthorship W157097179A5019916149 @default.
- W157097179 hasAuthorship W157097179A5033812535 @default.
- W157097179 hasAuthorship W157097179A5063921474 @default.
- W157097179 hasAuthorship W157097179A5072424179 @default.
- W157097179 hasAuthorship W157097179A5075702553 @default.
- W157097179 hasAuthorship W157097179A5077558876 @default.
- W157097179 hasConcept C105339364 @default.
- W157097179 hasConcept C111919701 @default.
- W157097179 hasConcept C121332964 @default.
- W157097179 hasConcept C180699724 @default.
- W157097179 hasConcept C185544564 @default.
- W157097179 hasConcept C2225880 @default.
- W157097179 hasConcept C2775907726 @default.
- W157097179 hasConcept C2780940931 @default.
- W157097179 hasConcept C41008148 @default.
- W157097179 hasConcept C48044578 @default.
- W157097179 hasConcept C64448361 @default.
- W157097179 hasConcept C82820731 @default.
- W157097179 hasConcept C88520388 @default.
- W157097179 hasConcept C93518851 @default.
- W157097179 hasConcept C95637964 @default.
- W157097179 hasConceptScore W157097179C105339364 @default.
- W157097179 hasConceptScore W157097179C111919701 @default.
- W157097179 hasConceptScore W157097179C121332964 @default.
- W157097179 hasConceptScore W157097179C180699724 @default.
- W157097179 hasConceptScore W157097179C185544564 @default.
- W157097179 hasConceptScore W157097179C2225880 @default.
- W157097179 hasConceptScore W157097179C2775907726 @default.
- W157097179 hasConceptScore W157097179C2780940931 @default.
- W157097179 hasConceptScore W157097179C41008148 @default.
- W157097179 hasConceptScore W157097179C48044578 @default.
- W157097179 hasConceptScore W157097179C64448361 @default.
- W157097179 hasConceptScore W157097179C82820731 @default.
- W157097179 hasConceptScore W157097179C88520388 @default.
- W157097179 hasConceptScore W157097179C93518851 @default.
- W157097179 hasConceptScore W157097179C95637964 @default.
- W157097179 hasLocation W1570971791 @default.
- W157097179 hasOpenAccess W157097179 @default.
- W157097179 hasPrimaryLocation W1570971791 @default.
- W157097179 hasRelatedWork W142096122 @default.
- W157097179 hasRelatedWork W2033422105 @default.
- W157097179 hasRelatedWork W2039373661 @default.
- W157097179 hasRelatedWork W2095192766 @default.
- W157097179 hasRelatedWork W2099418300 @default.
- W157097179 hasRelatedWork W2270286113 @default.
- W157097179 hasRelatedWork W2293392140 @default.
- W157097179 hasRelatedWork W2320955485 @default.
- W157097179 hasRelatedWork W2435037835 @default.
- W157097179 hasRelatedWork W2564990060 @default.
- W157097179 hasRelatedWork W2791989636 @default.
- W157097179 hasRelatedWork W2892073027 @default.
- W157097179 hasRelatedWork W2989237515 @default.
- W157097179 hasRelatedWork W3043865438 @default.
- W157097179 hasRelatedWork W3047454825 @default.
- W157097179 hasRelatedWork W3122383853 @default.
- W157097179 hasRelatedWork W3128522791 @default.
- W157097179 hasRelatedWork W3128576955 @default.
- W157097179 hasRelatedWork W3159974995 @default.
- W157097179 hasRelatedWork W48626633 @default.
- W157097179 isParatext "false" @default.
- W157097179 isRetracted "false" @default.
- W157097179 magId "157097179" @default.
- W157097179 workType "article" @default.