Matches in SemOpenAlex for { <https://semopenalex.org/work/W3119303730> ?p ?o ?g. }
Showing items 1 to 73 of
73
with 100 items per page.
- W3119303730 endingPage "150" @default.
- W3119303730 startingPage "137" @default.
- W3119303730 abstract "AbstractWhen dealing with the storage of large files, HDFS is one of the good choices as a distributed storage. Processing a large number of small files results in the performance bottleneck of HDFS. A massive number of small files will produce excessive metadata that leads to inefficient utilization of the Name Node memory, and frequent function calls will consume all over more time to process; therefore, it can be concluded that HDFS degrades when handling with small files. A detailed performance evaluation is being conducted to understand the impact of increasing small files in Hadoop for processing. This paper mainly evaluates sequential files, CombineFileInputFormat, HAR and Hadoop streaming techniques to deal with small file problem in HDFS. Empirical evaluation conducted in this paper shows that HAR and CombineFileInputFormat perform better and have consistent and stable results when increasing number of files for processing. KeywordsHadoopMapReduceHARHadoop streamingSequential fileCombineFileInputFormatSmall filesHDFS" @default.
- W3119303730 created "2021-01-18" @default.
- W3119303730 creator A5000047290 @default.
- W3119303730 creator A5033206439 @default.
- W3119303730 date "2021-01-01" @default.
- W3119303730 modified "2023-09-25" @default.
- W3119303730 title "Performance Evaluation of Merging Techniques for Handling Small Size Files in HDFS" @default.
- W3119303730 cites W1513810499 @default.
- W3119303730 cites W1972058033 @default.
- W3119303730 cites W2086878368 @default.
- W3119303730 cites W2234395665 @default.
- W3119303730 cites W2332323342 @default.
- W3119303730 cites W2392899412 @default.
- W3119303730 cites W2743185525 @default.
- W3119303730 cites W2770195522 @default.
- W3119303730 cites W2805755401 @default.
- W3119303730 cites W2807348664 @default.
- W3119303730 cites W2889740674 @default.
- W3119303730 cites W2895243923 @default.
- W3119303730 cites W3122551429 @default.
- W3119303730 cites W640741134 @default.
- W3119303730 doi "https://doi.org/10.1007/978-981-15-8335-3_13" @default.
- W3119303730 hasPublicationYear "2021" @default.
- W3119303730 type Work @default.
- W3119303730 sameAs 3119303730 @default.
- W3119303730 citedByCount "2" @default.
- W3119303730 countsByYear W31193037302022 @default.
- W3119303730 crossrefType "book-chapter" @default.
- W3119303730 hasAuthorship W3119303730A5000047290 @default.
- W3119303730 hasAuthorship W3119303730A5033206439 @default.
- W3119303730 hasConcept C111919701 @default.
- W3119303730 hasConcept C127413603 @default.
- W3119303730 hasConcept C149635348 @default.
- W3119303730 hasConcept C152043487 @default.
- W3119303730 hasConcept C2776029614 @default.
- W3119303730 hasConcept C2780513914 @default.
- W3119303730 hasConcept C41008148 @default.
- W3119303730 hasConcept C62611344 @default.
- W3119303730 hasConcept C66938386 @default.
- W3119303730 hasConcept C77088390 @default.
- W3119303730 hasConcept C93518851 @default.
- W3119303730 hasConcept C98045186 @default.
- W3119303730 hasConceptScore W3119303730C111919701 @default.
- W3119303730 hasConceptScore W3119303730C127413603 @default.
- W3119303730 hasConceptScore W3119303730C149635348 @default.
- W3119303730 hasConceptScore W3119303730C152043487 @default.
- W3119303730 hasConceptScore W3119303730C2776029614 @default.
- W3119303730 hasConceptScore W3119303730C2780513914 @default.
- W3119303730 hasConceptScore W3119303730C41008148 @default.
- W3119303730 hasConceptScore W3119303730C62611344 @default.
- W3119303730 hasConceptScore W3119303730C66938386 @default.
- W3119303730 hasConceptScore W3119303730C77088390 @default.
- W3119303730 hasConceptScore W3119303730C93518851 @default.
- W3119303730 hasConceptScore W3119303730C98045186 @default.
- W3119303730 hasLocation W31193037301 @default.
- W3119303730 hasOpenAccess W3119303730 @default.
- W3119303730 hasPrimaryLocation W31193037301 @default.
- W3119303730 hasRelatedWork W1524831999 @default.
- W3119303730 hasRelatedWork W1602964769 @default.
- W3119303730 hasRelatedWork W1968756140 @default.
- W3119303730 hasRelatedWork W1992683137 @default.
- W3119303730 hasRelatedWork W1992807924 @default.
- W3119303730 hasRelatedWork W2364113913 @default.
- W3119303730 hasRelatedWork W2382113126 @default.
- W3119303730 hasRelatedWork W2388215124 @default.
- W3119303730 hasRelatedWork W2900529157 @default.
- W3119303730 hasRelatedWork W1533329019 @default.
- W3119303730 isParatext "false" @default.
- W3119303730 isRetracted "false" @default.
- W3119303730 magId "3119303730" @default.
- W3119303730 workType "book-chapter" @default.