Matches in SemOpenAlex for { <https://semopenalex.org/work/W1905719725> ?p ?o ?g. }
- W1905719725 endingPage "226" @default.
- W1905719725 startingPage "213" @default.
- W1905719725 abstract "Distributed storage systems are increasingly transitioning to the use of erasure codes since they offer higher reliability at significantly lower storage costs than data replication. However, these codes tradeoff recovery performance as they require multiple disk reads and network transfers for reconstructing an unavailable data block. As a result, most existing systems use an erasure code either optimized for storage overhead or recovery performance.In this paper, we present HACFS, a new erasure-coded storage system that instead uses two different erasure codes and dynamically adapts to workload changes. It uses a fast code to optimize for recovery performance and a compact code to reduce the storage overhead. A novel conversion mechanism is used to efficiently upcode and downcode data blocks between fast and compact codes. We show that HACFS design techniques are generic and successfully apply it to two different code families: Product and LRC codes.We have implemented HACFS as an extension to the Hadoop Distributed File System (HDFS) and experimentally evaluate it with five different workloads from production clusters. The HACFS system always maintains a low storage overhead and significantly improves the recovery performance as compared to three popular single-code storage systems. It reduces the degraded read latency by up to 46%, and the reconstruction time and disk/network traffic by up to 45%." @default.
- W1905719725 created "2016-06-24" @default.
- W1905719725 creator A5003555864 @default.
- W1905719725 creator A5049740011 @default.
- W1905719725 creator A5057017481 @default.
- W1905719725 creator A5067809666 @default.
- W1905719725 date "2015-02-16" @default.
- W1905719725 modified "2023-09-29" @default.
- W1905719725 title "A tale of two erasure codes in HDFS" @default.
- W1905719725 cites W1537045696 @default.
- W1905719725 cites W154253821 @default.
- W1905719725 cites W1974534485 @default.
- W1905719725 cites W1996042140 @default.
- W1905719725 cites W2035606364 @default.
- W1905719725 cites W2049400253 @default.
- W1905719725 cites W2104993419 @default.
- W1905719725 cites W2119565742 @default.
- W1905719725 cites W2124961791 @default.
- W1905719725 cites W2131645490 @default.
- W1905719725 cites W2138744797 @default.
- W1905719725 cites W2139274913 @default.
- W1905719725 cites W2141884312 @default.
- W1905719725 cites W2148575324 @default.
- W1905719725 cites W2150620836 @default.
- W1905719725 cites W2895239415 @default.
- W1905719725 cites W2964143852 @default.
- W1905719725 cites W2997709458 @default.
- W1905719725 cites W330091898 @default.
- W1905719725 doi "https://doi.org/10.5555/2750482.2750499" @default.
- W1905719725 hasPublicationYear "2015" @default.
- W1905719725 type Work @default.
- W1905719725 sameAs 1905719725 @default.
- W1905719725 citedByCount "35" @default.
- W1905719725 countsByYear W19057197252015 @default.
- W1905719725 countsByYear W19057197252016 @default.
- W1905719725 countsByYear W19057197252017 @default.
- W1905719725 countsByYear W19057197252018 @default.
- W1905719725 countsByYear W19057197252019 @default.
- W1905719725 countsByYear W19057197252020 @default.
- W1905719725 countsByYear W19057197252021 @default.
- W1905719725 countsByYear W19057197252022 @default.
- W1905719725 crossrefType "proceedings-article" @default.
- W1905719725 hasAuthorship W1905719725A5003555864 @default.
- W1905719725 hasAuthorship W1905719725A5049740011 @default.
- W1905719725 hasAuthorship W1905719725A5057017481 @default.
- W1905719725 hasAuthorship W1905719725A5067809666 @default.
- W1905719725 hasConcept C105795698 @default.
- W1905719725 hasConcept C111919701 @default.
- W1905719725 hasConcept C11413529 @default.
- W1905719725 hasConcept C120314980 @default.
- W1905719725 hasConcept C121332964 @default.
- W1905719725 hasConcept C12590798 @default.
- W1905719725 hasConcept C137529215 @default.
- W1905719725 hasConcept C163258240 @default.
- W1905719725 hasConcept C177264268 @default.
- W1905719725 hasConcept C194739806 @default.
- W1905719725 hasConcept C199360897 @default.
- W1905719725 hasConcept C24885549 @default.
- W1905719725 hasConcept C2776760102 @default.
- W1905719725 hasConcept C2778790127 @default.
- W1905719725 hasConcept C2779960059 @default.
- W1905719725 hasConcept C33923547 @default.
- W1905719725 hasConcept C41008148 @default.
- W1905719725 hasConcept C43214815 @default.
- W1905719725 hasConcept C57273362 @default.
- W1905719725 hasConcept C62520636 @default.
- W1905719725 hasConceptScore W1905719725C105795698 @default.
- W1905719725 hasConceptScore W1905719725C111919701 @default.
- W1905719725 hasConceptScore W1905719725C11413529 @default.
- W1905719725 hasConceptScore W1905719725C120314980 @default.
- W1905719725 hasConceptScore W1905719725C121332964 @default.
- W1905719725 hasConceptScore W1905719725C12590798 @default.
- W1905719725 hasConceptScore W1905719725C137529215 @default.
- W1905719725 hasConceptScore W1905719725C163258240 @default.
- W1905719725 hasConceptScore W1905719725C177264268 @default.
- W1905719725 hasConceptScore W1905719725C194739806 @default.
- W1905719725 hasConceptScore W1905719725C199360897 @default.
- W1905719725 hasConceptScore W1905719725C24885549 @default.
- W1905719725 hasConceptScore W1905719725C2776760102 @default.
- W1905719725 hasConceptScore W1905719725C2778790127 @default.
- W1905719725 hasConceptScore W1905719725C2779960059 @default.
- W1905719725 hasConceptScore W1905719725C33923547 @default.
- W1905719725 hasConceptScore W1905719725C41008148 @default.
- W1905719725 hasConceptScore W1905719725C43214815 @default.
- W1905719725 hasConceptScore W1905719725C57273362 @default.
- W1905719725 hasConceptScore W1905719725C62520636 @default.
- W1905719725 hasLocation W19057197251 @default.
- W1905719725 hasOpenAccess W1905719725 @default.
- W1905719725 hasPrimaryLocation W19057197251 @default.
- W1905719725 hasRelatedWork W130792636 @default.
- W1905719725 hasRelatedWork W1441763937 @default.
- W1905719725 hasRelatedWork W1510496002 @default.
- W1905719725 hasRelatedWork W154253821 @default.
- W1905719725 hasRelatedWork W1836955865 @default.
- W1905719725 hasRelatedWork W1999984505 @default.
- W1905719725 hasRelatedWork W2004958263 @default.
- W1905719725 hasRelatedWork W2029467255 @default.
- W1905719725 hasRelatedWork W2105185344 @default.