Matches in SemOpenAlex for { <https://semopenalex.org/work/W2912981391> ?p ?o ?g. }
- W2912981391 abstract "Apache Hadoop is an open source framework for distributed and parallel processing of big data jobs. It has its own distributed file system which facilitates local storage and processing on commodity hardware. Hadoop distributed file system is a core part of the Hadoop ecosystem which comprises of large number of configuration parameters. Customizing these parameters to enhance the throughput of the system, for a particular job, may require a lot of experience and skills. During the execution of a Hadoop job in a multi-node cluster, the communication among nodes takes place through switch. These switches have vendor-specific protocols to direct the flow of traffic. Software defined networking has made it possible to make networks more programmable and configurable. In this paper, we analysed the impact of Hadoop distributed file system parameters, like block size, replication factor, MapReduce parameter like number of mapper, and Hive query structure. We used faucet, an OpenFlow switch, to monitor the transfer of both packets in/out of the system to see whether network traffic information can be used to predict the impact of Hadoop parameters. We have also monitored CPU usage, disk usage, memory usage and the overall execution time during the execution of Hadoop jobs. Our investigation showed that customizing these configuration parameters of Hadoop does have an impact on network, system and execution time." @default.
- W2912981391 created "2019-02-21" @default.
- W2912981391 creator A5017935492 @default.
- W2912981391 creator A5040232737 @default.
- W2912981391 creator A5058515120 @default.
- W2912981391 date "2018-11-01" @default.
- W2912981391 modified "2023-09-24" @default.
- W2912981391 title "An Investigation of Hadoop Parameters in SDN-enabled Clusters" @default.
- W2912981391 cites W1564609096 @default.
- W2912981391 cites W1670376504 @default.
- W2912981391 cites W1967436269 @default.
- W2912981391 cites W1993892970 @default.
- W2912981391 cites W2046861417 @default.
- W2912981391 cites W2058991476 @default.
- W2912981391 cites W2077508888 @default.
- W2912981391 cites W2092055698 @default.
- W2912981391 cites W2119738171 @default.
- W2912981391 cites W2277359368 @default.
- W2912981391 cites W2295811915 @default.
- W2912981391 cites W2421190342 @default.
- W2912981391 cites W2500089430 @default.
- W2912981391 cites W2518793801 @default.
- W2912981391 cites W2560483358 @default.
- W2912981391 cites W2767422967 @default.
- W2912981391 cites W2773478689 @default.
- W2912981391 cites W2774384728 @default.
- W2912981391 cites W2783557733 @default.
- W2912981391 cites W2784211455 @default.
- W2912981391 cites W2787734386 @default.
- W2912981391 cites W2897797305 @default.
- W2912981391 doi "https://doi.org/10.1109/macs.2018.8628336" @default.
- W2912981391 hasPublicationYear "2018" @default.
- W2912981391 type Work @default.
- W2912981391 sameAs 2912981391 @default.
- W2912981391 citedByCount "0" @default.
- W2912981391 crossrefType "proceedings-article" @default.
- W2912981391 hasAuthorship W2912981391A5017935492 @default.
- W2912981391 hasAuthorship W2912981391A5040232737 @default.
- W2912981391 hasAuthorship W2912981391A5058515120 @default.
- W2912981391 hasConcept C105795698 @default.
- W2912981391 hasConcept C111919701 @default.
- W2912981391 hasConcept C120314980 @default.
- W2912981391 hasConcept C12590798 @default.
- W2912981391 hasConcept C127413603 @default.
- W2912981391 hasConcept C152043487 @default.
- W2912981391 hasConcept C157764524 @default.
- W2912981391 hasConcept C158379750 @default.
- W2912981391 hasConcept C192697461 @default.
- W2912981391 hasConcept C2524010 @default.
- W2912981391 hasConcept C2777210771 @default.
- W2912981391 hasConcept C2780940931 @default.
- W2912981391 hasConcept C31258907 @default.
- W2912981391 hasConcept C33923547 @default.
- W2912981391 hasConcept C41008148 @default.
- W2912981391 hasConcept C555944384 @default.
- W2912981391 hasConcept C62611344 @default.
- W2912981391 hasConcept C64448361 @default.
- W2912981391 hasConcept C66938386 @default.
- W2912981391 hasConcept C70061542 @default.
- W2912981391 hasConcept C75684735 @default.
- W2912981391 hasConcept C77270119 @default.
- W2912981391 hasConcept C78766204 @default.
- W2912981391 hasConcept C82820731 @default.
- W2912981391 hasConcept C88520388 @default.
- W2912981391 hasConceptScore W2912981391C105795698 @default.
- W2912981391 hasConceptScore W2912981391C111919701 @default.
- W2912981391 hasConceptScore W2912981391C120314980 @default.
- W2912981391 hasConceptScore W2912981391C12590798 @default.
- W2912981391 hasConceptScore W2912981391C127413603 @default.
- W2912981391 hasConceptScore W2912981391C152043487 @default.
- W2912981391 hasConceptScore W2912981391C157764524 @default.
- W2912981391 hasConceptScore W2912981391C158379750 @default.
- W2912981391 hasConceptScore W2912981391C192697461 @default.
- W2912981391 hasConceptScore W2912981391C2524010 @default.
- W2912981391 hasConceptScore W2912981391C2777210771 @default.
- W2912981391 hasConceptScore W2912981391C2780940931 @default.
- W2912981391 hasConceptScore W2912981391C31258907 @default.
- W2912981391 hasConceptScore W2912981391C33923547 @default.
- W2912981391 hasConceptScore W2912981391C41008148 @default.
- W2912981391 hasConceptScore W2912981391C555944384 @default.
- W2912981391 hasConceptScore W2912981391C62611344 @default.
- W2912981391 hasConceptScore W2912981391C64448361 @default.
- W2912981391 hasConceptScore W2912981391C66938386 @default.
- W2912981391 hasConceptScore W2912981391C70061542 @default.
- W2912981391 hasConceptScore W2912981391C75684735 @default.
- W2912981391 hasConceptScore W2912981391C77270119 @default.
- W2912981391 hasConceptScore W2912981391C78766204 @default.
- W2912981391 hasConceptScore W2912981391C82820731 @default.
- W2912981391 hasConceptScore W2912981391C88520388 @default.
- W2912981391 hasLocation W29129813911 @default.
- W2912981391 hasOpenAccess W2912981391 @default.
- W2912981391 hasPrimaryLocation W29129813911 @default.
- W2912981391 hasRelatedWork W2159709327 @default.
- W2912981391 hasRelatedWork W2329901628 @default.
- W2912981391 hasRelatedWork W2376128692 @default.
- W2912981391 hasRelatedWork W2570660620 @default.
- W2912981391 hasRelatedWork W2884064822 @default.
- W2912981391 hasRelatedWork W2912981391 @default.
- W2912981391 hasRelatedWork W3171051203 @default.
- W2912981391 hasRelatedWork W4252138843 @default.