Matches in SemOpenAlex for { <https://semopenalex.org/work/W2889789983> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W2889789983 abstract "Apache Spark is the most popular open-source framework today that uses an in-memory-oriented abstraction Resilient Distributed Dataset (RDD) to process large-scale data. Recently, research work on performance prediction and optimization for Spark platform continues to increase rapidly. However, selecting important configuration parameters in most wok is always dependent on the experience of domain experts yet. Therefore, configuration parameters selection based on machine learning algorithms is a non-trivial research issue. In this paper, a method based on machine learning to identify Spark important parameters ISIP is proposed. By providing a relatively important subset of configuration parameters, the parameter space for performance tuning on Spark can be reduced, thereby saving the time and effort of users or researchers. ISIP uses Mean-shift algorithm to cluster the applications based on the workload characteristics of the applications from Spark MLlib. Then the relationship between the performance and the configuration parameters is modeled by Regression Algorithm. In the meanwhile, the ranked list of parameters by their importance is provided respectively for each type of applications. The subset of most important configuration parameters consists of the parameters at the front of the list. The experimental results show that the effect of adjusting the subset of relatively important configuration parameters provided by ISIP is almost the same as the complete parameters set." @default.
- W2889789983 created "2018-09-27" @default.
- W2889789983 creator A5038032242 @default.
- W2889789983 creator A5049301997 @default.
- W2889789983 creator A5069539054 @default.
- W2889789983 creator A5089695189 @default.
- W2889789983 date "2018-01-01" @default.
- W2889789983 modified "2023-10-06" @default.
- W2889789983 title "A Method to Identify Spark Important Parameters Based on Machine Learning" @default.
- W2889789983 cites W2016381774 @default.
- W2889789983 cites W2037027640 @default.
- W2889789983 cites W2037351952 @default.
- W2889789983 cites W2072086117 @default.
- W2889789983 cites W2112474496 @default.
- W2889789983 cites W2175075972 @default.
- W2889789983 cites W2415420807 @default.
- W2889789983 doi "https://doi.org/10.1007/978-981-13-2203-7_42" @default.
- W2889789983 hasPublicationYear "2018" @default.
- W2889789983 type Work @default.
- W2889789983 sameAs 2889789983 @default.
- W2889789983 citedByCount "0" @default.
- W2889789983 crossrefType "book-chapter" @default.
- W2889789983 hasAuthorship W2889789983A5038032242 @default.
- W2889789983 hasAuthorship W2889789983A5049301997 @default.
- W2889789983 hasAuthorship W2889789983A5069539054 @default.
- W2889789983 hasAuthorship W2889789983A5089695189 @default.
- W2889789983 hasConcept C111919701 @default.
- W2889789983 hasConcept C119857082 @default.
- W2889789983 hasConcept C120314980 @default.
- W2889789983 hasConcept C121332964 @default.
- W2889789983 hasConcept C124101348 @default.
- W2889789983 hasConcept C134306372 @default.
- W2889789983 hasConcept C154945302 @default.
- W2889789983 hasConcept C177264268 @default.
- W2889789983 hasConcept C199360897 @default.
- W2889789983 hasConcept C2778476105 @default.
- W2889789983 hasConcept C2778755073 @default.
- W2889789983 hasConcept C2781215313 @default.
- W2889789983 hasConcept C29140674 @default.
- W2889789983 hasConcept C33923547 @default.
- W2889789983 hasConcept C36503486 @default.
- W2889789983 hasConcept C41008148 @default.
- W2889789983 hasConcept C62520636 @default.
- W2889789983 hasConcept C98045186 @default.
- W2889789983 hasConceptScore W2889789983C111919701 @default.
- W2889789983 hasConceptScore W2889789983C119857082 @default.
- W2889789983 hasConceptScore W2889789983C120314980 @default.
- W2889789983 hasConceptScore W2889789983C121332964 @default.
- W2889789983 hasConceptScore W2889789983C124101348 @default.
- W2889789983 hasConceptScore W2889789983C134306372 @default.
- W2889789983 hasConceptScore W2889789983C154945302 @default.
- W2889789983 hasConceptScore W2889789983C177264268 @default.
- W2889789983 hasConceptScore W2889789983C199360897 @default.
- W2889789983 hasConceptScore W2889789983C2778476105 @default.
- W2889789983 hasConceptScore W2889789983C2778755073 @default.
- W2889789983 hasConceptScore W2889789983C2781215313 @default.
- W2889789983 hasConceptScore W2889789983C29140674 @default.
- W2889789983 hasConceptScore W2889789983C33923547 @default.
- W2889789983 hasConceptScore W2889789983C36503486 @default.
- W2889789983 hasConceptScore W2889789983C41008148 @default.
- W2889789983 hasConceptScore W2889789983C62520636 @default.
- W2889789983 hasConceptScore W2889789983C98045186 @default.
- W2889789983 hasLocation W28897899831 @default.
- W2889789983 hasOpenAccess W2889789983 @default.
- W2889789983 hasPrimaryLocation W28897899831 @default.
- W2889789983 hasRelatedWork W160589420 @default.
- W2889789983 hasRelatedWork W2014244478 @default.
- W2889789983 hasRelatedWork W2029320154 @default.
- W2889789983 hasRelatedWork W2052310746 @default.
- W2889789983 hasRelatedWork W2072617662 @default.
- W2889789983 hasRelatedWork W2158743134 @default.
- W2889789983 hasRelatedWork W2243363624 @default.
- W2889789983 hasRelatedWork W2251801071 @default.
- W2889789983 hasRelatedWork W2560383405 @default.
- W2889789983 hasRelatedWork W2571303489 @default.
- W2889789983 hasRelatedWork W2573911191 @default.
- W2889789983 hasRelatedWork W2790180306 @default.
- W2889789983 hasRelatedWork W2809559041 @default.
- W2889789983 hasRelatedWork W2810302553 @default.
- W2889789983 hasRelatedWork W2905598077 @default.
- W2889789983 hasRelatedWork W2998966359 @default.
- W2889789983 hasRelatedWork W3050079029 @default.
- W2889789983 hasRelatedWork W3090452185 @default.
- W2889789983 hasRelatedWork W3097528317 @default.
- W2889789983 hasRelatedWork W3195722949 @default.
- W2889789983 isParatext "false" @default.
- W2889789983 isRetracted "false" @default.
- W2889789983 magId "2889789983" @default.
- W2889789983 workType "book-chapter" @default.