Matches in SemOpenAlex for { <https://semopenalex.org/work/W4230077428> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W4230077428 abstract "Deduplication is a storage saving technique that is highly successful in enterprise backup environments. On a file system, a single data block might be stored multiple times across different files, for example, multiple versions of a file might exist that are mostly identical. With deduplication, this data replication is localized and redundancy is removed -- by storing data just once, all files that use identical regions refer to the same unique data. The most common approach splits file data into chunks and calculates a cryptographic fingerprint for each chunk. By checking if the fingerprint has already been stored, a chunk is classified as redundant or unique. Only unique chunks are stored. This paper presents the first study on the potential of data deduplication in HPC centers, which belong to the most demanding storage producers. We have quantitatively assessed this potential for capacity reduction for 4 data centers (BSC, DKRZ, RENCI, RWTH). In contrast to previous deduplication studies focusing mostly on backup data, we have analyzed over one PB (1212 TB) of online file system data. The evaluation shows that typically 20% to 30% of this online data can be removed by applying data deduplication techniques, peaking up to 70% for some data sets. This reduction can only be achieved by a subfile deduplication approach, while approaches based on whole-file comparisons only lead to small capacity savings." @default.
- W4230077428 created "2022-05-11" @default.
- W4230077428 creator A5003807012 @default.
- W4230077428 creator A5011466225 @default.
- W4230077428 creator A5028324537 @default.
- W4230077428 creator A5028731194 @default.
- W4230077428 creator A5036494255 @default.
- W4230077428 creator A5049694671 @default.
- W4230077428 date "2012-11-01" @default.
- W4230077428 modified "2023-10-01" @default.
- W4230077428 title "A study on data deduplication in HPC storage systems" @default.
- W4230077428 cites W1969126835 @default.
- W4230077428 cites W1971212200 @default.
- W4230077428 cites W1998817683 @default.
- W4230077428 cites W2003131282 @default.
- W4230077428 cites W2003696547 @default.
- W4230077428 cites W2035415465 @default.
- W4230077428 cites W2038908732 @default.
- W4230077428 cites W2047484077 @default.
- W4230077428 cites W2056980397 @default.
- W4230077428 cites W2065077642 @default.
- W4230077428 cites W2070834743 @default.
- W4230077428 cites W2071789190 @default.
- W4230077428 cites W2073370301 @default.
- W4230077428 cites W2089536264 @default.
- W4230077428 cites W2098935637 @default.
- W4230077428 cites W2107745473 @default.
- W4230077428 cites W2110322986 @default.
- W4230077428 cites W2130975798 @default.
- W4230077428 cites W2134792144 @default.
- W4230077428 cites W2153793343 @default.
- W4230077428 cites W2160127232 @default.
- W4230077428 cites W2162090341 @default.
- W4230077428 cites W2167208373 @default.
- W4230077428 cites W2171796885 @default.
- W4230077428 cites W4236236547 @default.
- W4230077428 cites W4289127653 @default.
- W4230077428 doi "https://doi.org/10.1109/sc.2012.14" @default.
- W4230077428 hasPublicationYear "2012" @default.
- W4230077428 type Work @default.
- W4230077428 citedByCount "56" @default.
- W4230077428 countsByYear W42300774282013 @default.
- W4230077428 countsByYear W42300774282014 @default.
- W4230077428 countsByYear W42300774282015 @default.
- W4230077428 countsByYear W42300774282016 @default.
- W4230077428 countsByYear W42300774282017 @default.
- W4230077428 countsByYear W42300774282018 @default.
- W4230077428 countsByYear W42300774282019 @default.
- W4230077428 countsByYear W42300774282020 @default.
- W4230077428 countsByYear W42300774282021 @default.
- W4230077428 countsByYear W42300774282022 @default.
- W4230077428 countsByYear W42300774282023 @default.
- W4230077428 crossrefType "proceedings-article" @default.
- W4230077428 hasAuthorship W4230077428A5003807012 @default.
- W4230077428 hasAuthorship W4230077428A5011466225 @default.
- W4230077428 hasAuthorship W4230077428A5028324537 @default.
- W4230077428 hasAuthorship W4230077428A5028731194 @default.
- W4230077428 hasAuthorship W4230077428A5036494255 @default.
- W4230077428 hasAuthorship W4230077428A5049694671 @default.
- W4230077428 hasConcept C111919701 @default.
- W4230077428 hasConcept C152124472 @default.
- W4230077428 hasConcept C194739806 @default.
- W4230077428 hasConcept C2524010 @default.
- W4230077428 hasConcept C2777210771 @default.
- W4230077428 hasConcept C2780940931 @default.
- W4230077428 hasConcept C2780945871 @default.
- W4230077428 hasConcept C32587265 @default.
- W4230077428 hasConcept C33923547 @default.
- W4230077428 hasConcept C41008148 @default.
- W4230077428 hasConcept C7545210 @default.
- W4230077428 hasConcept C77088390 @default.
- W4230077428 hasConceptScore W4230077428C111919701 @default.
- W4230077428 hasConceptScore W4230077428C152124472 @default.
- W4230077428 hasConceptScore W4230077428C194739806 @default.
- W4230077428 hasConceptScore W4230077428C2524010 @default.
- W4230077428 hasConceptScore W4230077428C2777210771 @default.
- W4230077428 hasConceptScore W4230077428C2780940931 @default.
- W4230077428 hasConceptScore W4230077428C2780945871 @default.
- W4230077428 hasConceptScore W4230077428C32587265 @default.
- W4230077428 hasConceptScore W4230077428C33923547 @default.
- W4230077428 hasConceptScore W4230077428C41008148 @default.
- W4230077428 hasConceptScore W4230077428C7545210 @default.
- W4230077428 hasConceptScore W4230077428C77088390 @default.
- W4230077428 hasLocation W42300774281 @default.
- W4230077428 hasOpenAccess W4230077428 @default.
- W4230077428 hasPrimaryLocation W42300774281 @default.
- W4230077428 hasRelatedWork W2010612348 @default.
- W4230077428 hasRelatedWork W2016947394 @default.
- W4230077428 hasRelatedWork W2076214235 @default.
- W4230077428 hasRelatedWork W2077135008 @default.
- W4230077428 hasRelatedWork W2297121304 @default.
- W4230077428 hasRelatedWork W2560948934 @default.
- W4230077428 hasRelatedWork W3132887183 @default.
- W4230077428 hasRelatedWork W4230077428 @default.
- W4230077428 hasRelatedWork W4312090360 @default.
- W4230077428 hasRelatedWork W4378228047 @default.
- W4230077428 isParatext "false" @default.
- W4230077428 isRetracted "false" @default.
- W4230077428 workType "article" @default.