FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3177419951> ?p ?o ?g. }

• W3177419951 abstract "Nowadays, it is a rapidly rising demand yet challenging issue to run large-scale applications on shared infrastructures such as data centers and clouds with low execution latency and high resource utilization. This paper reports our experience with Swift, a system capable of efficiently running real-time and interactive data processing jobs at cloud scale. Taking directed acyclic graph (DAG) as the job model, Swift achieves the design goal by three new mechanisms: 1) fine-grained scheduling that can efficiently partition a job into graphlets (i.e., sub-graphs) based on new shuffle heuristics and that does scheduling in the unit of graphlet, thus avoiding resource fragmentation and waste, 2) adaptive memory-based in-network shuffling that reduces IO overhead and data transfer time by doing shuffle in memory and allowing jobs to select the most efficient way to fulfill shuffling, and 3) lightweight fault tolerance and recovery that only prolong the whole job execution time slightly with the help of timely failure detection and fine-grained failure recovery. Experimental results show that Swift can achieve an average speedup of 2.11× on TPC-H, and 14.18× on Terasort when compared with Spark. Swift has been deployed in production, supporting as many as 140,000 executors and processing millions of jobs per day. Experiments with production traces show that Swift outperforms JetScope and Bubble Execution by 2.44× and 1.23× respectively." @default.
• W3177419951 created "2021-07-05" @default.
• W3177419951 creator A5003753200 @default.
• W3177419951 creator A5049298612 @default.
• W3177419951 creator A5054054476 @default.
• W3177419951 creator A5056168495 @default.
• W3177419951 creator A5069653714 @default.
• W3177419951 creator A5072506254 @default.
• W3177419951 creator A5077922409 @default.
• W3177419951 creator A5085979978 @default.
• W3177419951 date "2021-04-01" @default.
• W3177419951 modified "2023-10-16" @default.
• W3177419951 title "Swift: Reliable and Low-Latency Data Processing at Cloud Scale" @default.
• W3177419951 cites W1464363888 @default.
• W3177419951 cites W1566630565 @default.
• W3177419951 cites W1861377444 @default.
• W3177419951 cites W1890643295 @default.
• W3177419951 cites W1972115340 @default.
• W3177419951 cites W1985710418 @default.
• W3177419951 cites W2008503861 @default.
• W3177419951 cites W2022678927 @default.
• W3177419951 cites W2024463287 @default.
• W3177419951 cites W2054308357 @default.
• W3177419951 cites W2096125134 @default.
• W3177419951 cites W2100830825 @default.
• W3177419951 cites W2102709380 @default.
• W3177419951 cites W2102849319 @default.
• W3177419951 cites W2105947650 @default.
• W3177419951 cites W2119745055 @default.
• W3177419951 cites W2122465391 @default.
• W3177419951 cites W2126969025 @default.
• W3177419951 cites W2131975293 @default.
• W3177419951 cites W2139072600 @default.
• W3177419951 cites W2140094873 @default.
• W3177419951 cites W2141992894 @default.
• W3177419951 cites W2153972927 @default.
• W3177419951 cites W2160121678 @default.
• W3177419951 cites W2163310590 @default.
• W3177419951 cites W2163961697 @default.
• W3177419951 cites W2170616854 @default.
• W3177419951 cites W2172220707 @default.
• W3177419951 cites W2186615578 @default.
• W3177419951 cites W2189465200 @default.
• W3177419951 cites W2204432465 @default.
• W3177419951 cites W2289698129 @default.
• W3177419951 cites W2394680079 @default.
• W3177419951 cites W2402144811 @default.
• W3177419951 cites W2521597241 @default.
• W3177419951 cites W2537369414 @default.
• W3177419951 cites W2572234696 @default.
• W3177419951 cites W2576355797 @default.
• W3177419951 cites W2579247884 @default.
• W3177419951 cites W2799019920 @default.
• W3177419951 cites W2901305343 @default.
• W3177419951 cites W2912802084 @default.
• W3177419951 cites W2948371732 @default.
• W3177419951 cites W2963390429 @default.
• W3177419951 cites W2998104365 @default.
• W3177419951 cites W3029888401 @default.
• W3177419951 cites W3085940077 @default.
• W3177419951 cites W3105426077 @default.
• W3177419951 cites W78077100 @default.
• W3177419951 cites W2792524491 @default.
• W3177419951 cites W2899050079 @default.
• W3177419951 doi "https://doi.org/10.1109/icde51399.2021.00272" @default.
• W3177419951 hasPublicationYear "2021" @default.
• W3177419951 type Work @default.
• W3177419951 sameAs 3177419951 @default.
• W3177419951 citedByCount "0" @default.
• W3177419951 crossrefType "proceedings-article" @default.
• W3177419951 hasAuthorship W3177419951A5003753200 @default.
• W3177419951 hasAuthorship W3177419951A5049298612 @default.
• W3177419951 hasAuthorship W3177419951A5054054476 @default.
• W3177419951 hasAuthorship W3177419951A5056168495 @default.
• W3177419951 hasAuthorship W3177419951A5069653714 @default.
• W3177419951 hasAuthorship W3177419951A5072506254 @default.
• W3177419951 hasAuthorship W3177419951A5077922409 @default.
• W3177419951 hasAuthorship W3177419951A5085979978 @default.
• W3177419951 hasConcept C111919701 @default.
• W3177419951 hasConcept C116188536 @default.
• W3177419951 hasConcept C120314980 @default.
• W3177419951 hasConcept C127705205 @default.
• W3177419951 hasConcept C153740404 @default.
• W3177419951 hasConcept C162324750 @default.
• W3177419951 hasConcept C173608175 @default.
• W3177419951 hasConcept C199360897 @default.
• W3177419951 hasConcept C206729178 @default.
• W3177419951 hasConcept C21547014 @default.
• W3177419951 hasConcept C41008148 @default.
• W3177419951 hasConcept C63540848 @default.
• W3177419951 hasConcept C68339613 @default.
• W3177419951 hasConcept C76155785 @default.
• W3177419951 hasConcept C79974875 @default.
• W3177419951 hasConcept C82876162 @default.
• W3177419951 hasConceptScore W3177419951C111919701 @default.
• W3177419951 hasConceptScore W3177419951C116188536 @default.
• W3177419951 hasConceptScore W3177419951C120314980 @default.
• W3177419951 hasConceptScore W3177419951C127705205 @default.
• W3177419951 hasConceptScore W3177419951C153740404 @default.
• W3177419951 hasConceptScore W3177419951C162324750 @default.

• next