FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2971982003> ?p ?o ?g. }

• W2971982003 abstract "Migrating data into memory can significantly accelerate big-data applications by hiding low disk throughput. While prior work has mostly targeted caching frequently used data, the techniques employed do not benefit jobs that read cold data. For these jobs, the file system has to pro-actively migrate the inputs into memory. Successfully migrating cold inputs can result in a large speedup for many jobs, especially those that spend a significant part of their execution reading inputs. In this paper, we use data from the Google cluster trace to make the case that the conditions in production workloads are favorable for migration. We then design and implement DYRS, a framework for migrating cold data in big-data file systems. DYRS can adapt to match the available bandwidth on storage nodes, ensuring all nodes are fully utilized throughout the migration. In addition to balancing the load, DYRS optimizes the placement of each migration to maximize the number of successful migrations and eliminate stragglers at the end of a job. We evaluate DYRS using several Hive queries, a trace-based workload from Facebook, and the Sort application. Our results show that DYRS successfully adapts to bandwidth heterogeneity and effectively migrates data. DYRS accelerates Hive queries by up to 48%, and by 36% on average. Jobs in a trace-based workload experience a speedup of 33% on average. The mapper tasks in this workload have an even greater speedup of 46%. DYRS accelerates sort jobs by up to 20%." @default.
• W2971982003 created "2019-09-12" @default.
• W2971982003 creator A5069280173 @default.
• W2971982003 creator A5075120727 @default.
• W2971982003 creator A5079167224 @default.
• W2971982003 date "2019-05-01" @default.
• W2971982003 modified "2023-09-25" @default.
• W2971982003 title "DYRS: Bandwidth-Aware Disk-to-Memory Migration of Cold Data in Big-Data File Systems" @default.
• W2971982003 cites W1493566099 @default.
• W2971982003 cites W1502383304 @default.
• W2971982003 cites W1519276763 @default.
• W2971982003 cites W1579147384 @default.
• W2971982003 cites W1585096280 @default.
• W2971982003 cites W1903497807 @default.
• W2971982003 cites W1964691382 @default.
• W2971982003 cites W2038157364 @default.
• W2971982003 cites W2102849319 @default.
• W2971982003 cites W2105947650 @default.
• W2971982003 cites W2119528150 @default.
• W2971982003 cites W2119738171 @default.
• W2971982003 cites W2131645490 @default.
• W2971982003 cites W2131975293 @default.
• W2971982003 cites W2141249441 @default.
• W2971982003 cites W2157099238 @default.
• W2971982003 cites W2173213060 @default.
• W2971982003 cites W2189465200 @default.
• W2971982003 cites W2217945669 @default.
• W2971982003 cites W2334418087 @default.
• W2971982003 cites W2342245634 @default.
• W2971982003 cites W2470592085 @default.
• W2971982003 cites W2520189725 @default.
• W2971982003 cites W26797728 @default.
• W2971982003 cites W2807969855 @default.
• W2971982003 cites W2950590364 @default.
• W2971982003 cites W2953007714 @default.
• W2971982003 doi "https://doi.org/10.1109/ipdps.2019.00069" @default.
• W2971982003 hasPublicationYear "2019" @default.
• W2971982003 type Work @default.
• W2971982003 sameAs 2971982003 @default.
• W2971982003 citedByCount "1" @default.
• W2971982003 countsByYear W29719820032019 @default.
• W2971982003 crossrefType "proceedings-article" @default.
• W2971982003 hasAuthorship W2971982003A5069280173 @default.
• W2971982003 hasAuthorship W2971982003A5075120727 @default.
• W2971982003 hasAuthorship W2971982003A5079167224 @default.
• W2971982003 hasConcept C111919701 @default.
• W2971982003 hasConcept C138959212 @default.
• W2971982003 hasConcept C157764524 @default.
• W2971982003 hasConcept C173608175 @default.
• W2971982003 hasConcept C187691185 @default.
• W2971982003 hasConcept C2524010 @default.
• W2971982003 hasConcept C2776257435 @default.
• W2971982003 hasConcept C2778476105 @default.
• W2971982003 hasConcept C2780940931 @default.
• W2971982003 hasConcept C31258907 @default.
• W2971982003 hasConcept C33923547 @default.
• W2971982003 hasConcept C41008148 @default.
• W2971982003 hasConcept C555944384 @default.
• W2971982003 hasConcept C68339613 @default.
• W2971982003 hasConcept C75684735 @default.
• W2971982003 hasConcept C77088390 @default.
• W2971982003 hasConcept C88548561 @default.
• W2971982003 hasConceptScore W2971982003C111919701 @default.
• W2971982003 hasConceptScore W2971982003C138959212 @default.
• W2971982003 hasConceptScore W2971982003C157764524 @default.
• W2971982003 hasConceptScore W2971982003C173608175 @default.
• W2971982003 hasConceptScore W2971982003C187691185 @default.
• W2971982003 hasConceptScore W2971982003C2524010 @default.
• W2971982003 hasConceptScore W2971982003C2776257435 @default.
• W2971982003 hasConceptScore W2971982003C2778476105 @default.
• W2971982003 hasConceptScore W2971982003C2780940931 @default.
• W2971982003 hasConceptScore W2971982003C31258907 @default.
• W2971982003 hasConceptScore W2971982003C33923547 @default.
• W2971982003 hasConceptScore W2971982003C41008148 @default.
• W2971982003 hasConceptScore W2971982003C555944384 @default.
• W2971982003 hasConceptScore W2971982003C68339613 @default.
• W2971982003 hasConceptScore W2971982003C75684735 @default.
• W2971982003 hasConceptScore W2971982003C77088390 @default.
• W2971982003 hasConceptScore W2971982003C88548561 @default.
• W2971982003 hasLocation W29719820031 @default.
• W2971982003 hasOpenAccess W2971982003 @default.
• W2971982003 hasPrimaryLocation W29719820031 @default.
• W2971982003 hasRelatedWork W1537361812 @default.
• W2971982003 hasRelatedWork W1711322840 @default.
• W2971982003 hasRelatedWork W1998791291 @default.
• W2971982003 hasRelatedWork W2021932022 @default.
• W2971982003 hasRelatedWork W2036529822 @default.
• W2971982003 hasRelatedWork W2072034469 @default.
• W2971982003 hasRelatedWork W2101342918 @default.
• W2971982003 hasRelatedWork W2103476536 @default.
• W2971982003 hasRelatedWork W2130461433 @default.
• W2971982003 hasRelatedWork W2136582761 @default.
• W2971982003 hasRelatedWork W2198229603 @default.
• W2971982003 hasRelatedWork W2290124620 @default.
• W2971982003 hasRelatedWork W2316410352 @default.
• W2971982003 hasRelatedWork W2560591599 @default.
• W2971982003 hasRelatedWork W2765682507 @default.
• W2971982003 hasRelatedWork W2809962703 @default.
• W2971982003 hasRelatedWork W2903451134 @default.
• W2971982003 hasRelatedWork W2919949041 @default.

• next