Matches in SemOpenAlex for { <https://semopenalex.org/work/W2769059304> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W2769059304 endingPage "062018" @default.
- W2769059304 startingPage "062018" @default.
- W2769059304 abstract "With the era of big data emerging, Hadoop has become the de facto standard of big data processing platform. However, it is still difficult to get legacy applications, such as High Energy Physics (HEP) applications, to run efficiently on Hadoop platform. There are two reasons which lead to the difficulties mentioned above: firstly, random access is not supported on Hadoop File System (HDFS), secondly, it is difficult to make legacy applications adopt to HDFS streaming data processing mode. In order to address the two issues, a new read and write mechanism of HDFS is proposed. With this mechanism, data access is done on the local file system instead of through HDFS streaming interfaces. To enable files modified by users, three attributes including permissions, owner and group are imposed on Block objects. Blocks stored on Datanodes have the same attributes as the file they are owned by. Users can modify blocks when the Map task running locally, and HDFS is responsible to update the rest replicas later after the block modification finished. To further improve the performance of Hadoop system, a complete localization task execution mechanism is implemented for I/O intensive jobs. Test results show that average CPU utilization is improved by 10% with the new task selection strategy, data read and write performances are improved by about 10% and 30% separately." @default.
- W2769059304 created "2017-12-04" @default.
- W2769059304 creator A5004208626 @default.
- W2769059304 creator A5035084357 @default.
- W2769059304 creator A5049428400 @default.
- W2769059304 creator A5077655412 @default.
- W2769059304 date "2017-10-01" @default.
- W2769059304 modified "2023-10-18" @default.
- W2769059304 title "A New Data Access Mechanism for HDFS" @default.
- W2769059304 cites W2089229511 @default.
- W2769059304 cites W2119565742 @default.
- W2769059304 doi "https://doi.org/10.1088/1742-6596/898/6/062018" @default.
- W2769059304 hasPublicationYear "2017" @default.
- W2769059304 type Work @default.
- W2769059304 sameAs 2769059304 @default.
- W2769059304 citedByCount "2" @default.
- W2769059304 countsByYear W27690593042019 @default.
- W2769059304 countsByYear W27690593042020 @default.
- W2769059304 crossrefType "journal-article" @default.
- W2769059304 hasAuthorship W2769059304A5004208626 @default.
- W2769059304 hasAuthorship W2769059304A5035084357 @default.
- W2769059304 hasAuthorship W2769059304A5049428400 @default.
- W2769059304 hasAuthorship W2769059304A5077655412 @default.
- W2769059304 hasBestOaLocation W27690593041 @default.
- W2769059304 hasConcept C111919701 @default.
- W2769059304 hasConcept C152043487 @default.
- W2769059304 hasConcept C162324750 @default.
- W2769059304 hasConcept C187736073 @default.
- W2769059304 hasConcept C2524010 @default.
- W2769059304 hasConcept C2777210771 @default.
- W2769059304 hasConcept C2780451532 @default.
- W2769059304 hasConcept C2780940931 @default.
- W2769059304 hasConcept C33923547 @default.
- W2769059304 hasConcept C41008148 @default.
- W2769059304 hasConcept C47487241 @default.
- W2769059304 hasConcept C75684735 @default.
- W2769059304 hasConcept C77088390 @default.
- W2769059304 hasConceptScore W2769059304C111919701 @default.
- W2769059304 hasConceptScore W2769059304C152043487 @default.
- W2769059304 hasConceptScore W2769059304C162324750 @default.
- W2769059304 hasConceptScore W2769059304C187736073 @default.
- W2769059304 hasConceptScore W2769059304C2524010 @default.
- W2769059304 hasConceptScore W2769059304C2777210771 @default.
- W2769059304 hasConceptScore W2769059304C2780451532 @default.
- W2769059304 hasConceptScore W2769059304C2780940931 @default.
- W2769059304 hasConceptScore W2769059304C33923547 @default.
- W2769059304 hasConceptScore W2769059304C41008148 @default.
- W2769059304 hasConceptScore W2769059304C47487241 @default.
- W2769059304 hasConceptScore W2769059304C75684735 @default.
- W2769059304 hasConceptScore W2769059304C77088390 @default.
- W2769059304 hasLocation W27690593041 @default.
- W2769059304 hasOpenAccess W2769059304 @default.
- W2769059304 hasPrimaryLocation W27690593041 @default.
- W2769059304 hasRelatedWork W1991045564 @default.
- W2769059304 hasRelatedWork W2048832858 @default.
- W2769059304 hasRelatedWork W2077508888 @default.
- W2769059304 hasRelatedWork W2380217306 @default.
- W2769059304 hasRelatedWork W2789535578 @default.
- W2769059304 hasRelatedWork W2809486434 @default.
- W2769059304 hasRelatedWork W2811427771 @default.
- W2769059304 hasRelatedWork W3042976586 @default.
- W2769059304 hasRelatedWork W4283773839 @default.
- W2769059304 hasRelatedWork W4362687653 @default.
- W2769059304 hasVolume "898" @default.
- W2769059304 isParatext "false" @default.
- W2769059304 isRetracted "false" @default.
- W2769059304 magId "2769059304" @default.
- W2769059304 workType "article" @default.