Matches in SemOpenAlex for { <https://semopenalex.org/work/W4376875672> ?p ?o ?g. }
- W4376875672 abstract "Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC." @default.
- W4376875672 created "2023-05-18" @default.
- W4376875672 creator A5031397287 @default.
- W4376875672 creator A5034352366 @default.
- W4376875672 creator A5043129695 @default.
- W4376875672 creator A5062233562 @default.
- W4376875672 creator A5076633496 @default.
- W4376875672 date "2023-05-17" @default.
- W4376875672 modified "2023-09-26" @default.
- W4376875672 title "Design and implementation of I/O performance prediction scheme on HPC systems through large-scale log analysis" @default.
- W4376875672 cites W1488264517 @default.
- W4376875672 cites W1596936080 @default.
- W4376875672 cites W1678356000 @default.
- W4376875672 cites W2010628428 @default.
- W4376875672 cites W2070493638 @default.
- W4376875672 cites W2092939357 @default.
- W4376875672 cites W2095727900 @default.
- W4376875672 cites W2108691459 @default.
- W4376875672 cites W2130695501 @default.
- W4376875672 cites W2136245133 @default.
- W4376875672 cites W2140115351 @default.
- W4376875672 cites W2140136927 @default.
- W4376875672 cites W2157777898 @default.
- W4376875672 cites W2253710306 @default.
- W4376875672 cites W2342249984 @default.
- W4376875672 cites W2485543745 @default.
- W4376875672 cites W2559796885 @default.
- W4376875672 cites W2631751282 @default.
- W4376875672 cites W2899477092 @default.
- W4376875672 cites W2900042580 @default.
- W4376875672 cites W2902431547 @default.
- W4376875672 cites W2954028704 @default.
- W4376875672 cites W2985168981 @default.
- W4376875672 cites W2999414271 @default.
- W4376875672 cites W2999712294 @default.
- W4376875672 cites W3038118166 @default.
- W4376875672 cites W3097665371 @default.
- W4376875672 cites W3173224038 @default.
- W4376875672 cites W4206038948 @default.
- W4376875672 cites W4210732327 @default.
- W4376875672 cites W4241823868 @default.
- W4376875672 cites W4285600287 @default.
- W4376875672 cites W59652542 @default.
- W4376875672 doi "https://doi.org/10.1186/s40537-023-00741-4" @default.
- W4376875672 hasPublicationYear "2023" @default.
- W4376875672 type Work @default.
- W4376875672 citedByCount "0" @default.
- W4376875672 crossrefType "journal-article" @default.
- W4376875672 hasAuthorship W4376875672A5031397287 @default.
- W4376875672 hasAuthorship W4376875672A5034352366 @default.
- W4376875672 hasAuthorship W4376875672A5043129695 @default.
- W4376875672 hasAuthorship W4376875672A5062233562 @default.
- W4376875672 hasAuthorship W4376875672A5076633496 @default.
- W4376875672 hasBestOaLocation W43768756721 @default.
- W4376875672 hasConcept C111919701 @default.
- W4376875672 hasConcept C11413529 @default.
- W4376875672 hasConcept C120314980 @default.
- W4376875672 hasConcept C124101348 @default.
- W4376875672 hasConcept C134306372 @default.
- W4376875672 hasConcept C162324750 @default.
- W4376875672 hasConcept C172191483 @default.
- W4376875672 hasConcept C173608175 @default.
- W4376875672 hasConcept C206729178 @default.
- W4376875672 hasConcept C21547014 @default.
- W4376875672 hasConcept C2777115002 @default.
- W4376875672 hasConcept C2777904410 @default.
- W4376875672 hasConcept C2780940931 @default.
- W4376875672 hasConcept C33923547 @default.
- W4376875672 hasConcept C41008148 @default.
- W4376875672 hasConcept C44154836 @default.
- W4376875672 hasConcept C45374587 @default.
- W4376875672 hasConcept C77618280 @default.
- W4376875672 hasConcept C83283714 @default.
- W4376875672 hasConceptScore W4376875672C111919701 @default.
- W4376875672 hasConceptScore W4376875672C11413529 @default.
- W4376875672 hasConceptScore W4376875672C120314980 @default.
- W4376875672 hasConceptScore W4376875672C124101348 @default.
- W4376875672 hasConceptScore W4376875672C134306372 @default.
- W4376875672 hasConceptScore W4376875672C162324750 @default.
- W4376875672 hasConceptScore W4376875672C172191483 @default.
- W4376875672 hasConceptScore W4376875672C173608175 @default.
- W4376875672 hasConceptScore W4376875672C206729178 @default.
- W4376875672 hasConceptScore W4376875672C21547014 @default.
- W4376875672 hasConceptScore W4376875672C2777115002 @default.
- W4376875672 hasConceptScore W4376875672C2777904410 @default.
- W4376875672 hasConceptScore W4376875672C2780940931 @default.
- W4376875672 hasConceptScore W4376875672C33923547 @default.
- W4376875672 hasConceptScore W4376875672C41008148 @default.
- W4376875672 hasConceptScore W4376875672C44154836 @default.
- W4376875672 hasConceptScore W4376875672C45374587 @default.
- W4376875672 hasConceptScore W4376875672C77618280 @default.
- W4376875672 hasConceptScore W4376875672C83283714 @default.
- W4376875672 hasFunder F4320306084 @default.
- W4376875672 hasFunder F4320322120 @default.
- W4376875672 hasIssue "1" @default.
- W4376875672 hasLocation W43768756721 @default.
- W4376875672 hasOpenAccess W4376875672 @default.
- W4376875672 hasPrimaryLocation W43768756721 @default.
- W4376875672 hasRelatedWork W1577081734 @default.
- W4376875672 hasRelatedWork W1882733036 @default.