Matches in SemOpenAlex for { <https://semopenalex.org/work/W4322731236> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W4322731236 abstract "Apache Spark is one of the most popular, widely used and open-source distributed processing framework that can process huge site datasets in time efficient manner due to its in-memory computational capabilities. However, there are several factors that can affect the performance of an application which include the nature and size of the input dataset, computational capability of the system and nature and design of the algorithm. Hence, there are different parameters that are required to correctly predict the execution statistics of a Spark application which include execution time of jobs, stages and tasks, memory requirement and usage at the execution level and I/O cost in the form of read/ write shuffling of data. To address these challenges, a simulation and machine learning based prediction model is presented in this paper that takes only a few initial samples of execution statistics and predicts the performance and execution statistics of the Spark application with high accuracy. The proposed model is evaluated on the Wordcount application and Spark standalone mode and accuracy metrics show that the proposed model achieves high accuracy in predicting execution statistics." @default.
- W4322731236 created "2023-03-03" @default.
- W4322731236 creator A5014610162 @default.
- W4322731236 creator A5086249402 @default.
- W4322731236 date "2022-11-25" @default.
- W4322731236 modified "2023-10-18" @default.
- W4322731236 title "A Machine Learning Approach for Predicting Execution Statistics of Spark Application" @default.
- W4322731236 cites W2001172853 @default.
- W4322731236 cites W2029718725 @default.
- W4322731236 cites W2109734800 @default.
- W4322731236 cites W2127082188 @default.
- W4322731236 cites W2175075972 @default.
- W4322731236 cites W2415378597 @default.
- W4322731236 cites W2506418666 @default.
- W4322731236 cites W2530314904 @default.
- W4322731236 cites W2555053211 @default.
- W4322731236 cites W2598407763 @default.
- W4322731236 cites W2613656214 @default.
- W4322731236 cites W2787107741 @default.
- W4322731236 cites W2793682084 @default.
- W4322731236 cites W2796039710 @default.
- W4322731236 cites W2809559041 @default.
- W4322731236 cites W2901935513 @default.
- W4322731236 cites W3092711260 @default.
- W4322731236 cites W3217778767 @default.
- W4322731236 doi "https://doi.org/10.1109/pdgc56933.2022.10053356" @default.
- W4322731236 hasPublicationYear "2022" @default.
- W4322731236 type Work @default.
- W4322731236 citedByCount "0" @default.
- W4322731236 crossrefType "proceedings-article" @default.
- W4322731236 hasAuthorship W4322731236A5014610162 @default.
- W4322731236 hasAuthorship W4322731236A5086249402 @default.
- W4322731236 hasConcept C111919701 @default.
- W4322731236 hasConcept C119857082 @default.
- W4322731236 hasConcept C124101348 @default.
- W4322731236 hasConcept C154945302 @default.
- W4322731236 hasConcept C167927819 @default.
- W4322731236 hasConcept C173608175 @default.
- W4322731236 hasConcept C199360897 @default.
- W4322731236 hasConcept C2781215313 @default.
- W4322731236 hasConcept C2989134064 @default.
- W4322731236 hasConcept C41008148 @default.
- W4322731236 hasConcept C98045186 @default.
- W4322731236 hasConceptScore W4322731236C111919701 @default.
- W4322731236 hasConceptScore W4322731236C119857082 @default.
- W4322731236 hasConceptScore W4322731236C124101348 @default.
- W4322731236 hasConceptScore W4322731236C154945302 @default.
- W4322731236 hasConceptScore W4322731236C167927819 @default.
- W4322731236 hasConceptScore W4322731236C173608175 @default.
- W4322731236 hasConceptScore W4322731236C199360897 @default.
- W4322731236 hasConceptScore W4322731236C2781215313 @default.
- W4322731236 hasConceptScore W4322731236C2989134064 @default.
- W4322731236 hasConceptScore W4322731236C41008148 @default.
- W4322731236 hasConceptScore W4322731236C98045186 @default.
- W4322731236 hasLocation W43227312361 @default.
- W4322731236 hasOpenAccess W4322731236 @default.
- W4322731236 hasPrimaryLocation W43227312361 @default.
- W4322731236 hasRelatedWork W1587991081 @default.
- W4322731236 hasRelatedWork W2046590706 @default.
- W4322731236 hasRelatedWork W2114337652 @default.
- W4322731236 hasRelatedWork W2791738351 @default.
- W4322731236 hasRelatedWork W2989751065 @default.
- W4322731236 hasRelatedWork W3009370840 @default.
- W4322731236 hasRelatedWork W3195722949 @default.
- W4322731236 hasRelatedWork W4213239787 @default.
- W4322731236 hasRelatedWork W4322731236 @default.
- W4322731236 hasRelatedWork W4377131110 @default.
- W4322731236 isParatext "false" @default.
- W4322731236 isRetracted "false" @default.
- W4322731236 workType "article" @default.