Matches in SemOpenAlex for { <https://semopenalex.org/work/W2912174032> ?p ?o ?g. }
- W2912174032 endingPage "22508" @default.
- W2912174032 startingPage "22495" @default.
- W2912174032 abstract "In order to reduce power and energy costs, giant cloud providers now mix online and batch jobs on the same cluster. Although the co-allocation of such jobs improves machine utilization, it challenges the data center scheduler and workload assignment in terms of quality of service, fault tolerance, and failure recovery, especially for latency critical online services. In this paper, we explore various characteristics of co-allocated online services and batch jobs from a production cluster containing 1.3k servers in Alibaba Cloud. From the trace data, we find the following: 1) For batch jobs with multiple tasks and instances, 50.8% failed tasks wait and halted after a very long time interval when their first and the only one instance fails. This wastes much time and resources as the remaining instances are running for an impossible successful termination. 2) For online services jobs, they are clustered in 25 categories according to their requested CPU, memory, and disk resources. Such clustering can help the co-allocation of online services jobs with batch jobs. 3) Servers are clustered into seven groups by CPU utilization, memory utilization, and their correlations. Machines with a strong correlation between CPU and memory utilization provides an opportunity for job co-allocation and resource utilization estimation. 4) The MTBF (mean time between failures) of instances are in the interval [400, 800] seconds while the average completion time of the 99th percentile is 1003 seconds. We also compare the cumulative distribution functions of jobs and servers and explain the differences and opportunities for workload assignment between them. Our findings and insights presented in this paper can help the community and data center operators better understand the workload characteristics, improve resource utilization, and failure recovery design." @default.
- W2912174032 created "2019-02-21" @default.
- W2912174032 creator A5028412854 @default.
- W2912174032 creator A5032183209 @default.
- W2912174032 creator A5036326577 @default.
- W2912174032 creator A5070719868 @default.
- W2912174032 creator A5081487025 @default.
- W2912174032 creator A5082606335 @default.
- W2912174032 date "2019-01-01" @default.
- W2912174032 modified "2023-10-18" @default.
- W2912174032 title "Characteristics of Co-Allocated Online Services and Batch Jobs in Internet Data Centers: A Case Study From Alibaba Cloud" @default.
- W2912174032 cites W1504230329 @default.
- W2912174032 cites W1965706740 @default.
- W2912174032 cites W1967327494 @default.
- W2912174032 cites W1984255960 @default.
- W2912174032 cites W1987918625 @default.
- W2912174032 cites W1992997388 @default.
- W2912174032 cites W2002227246 @default.
- W2912174032 cites W2003829707 @default.
- W2912174032 cites W2013244111 @default.
- W2912174032 cites W2052671641 @default.
- W2912174032 cites W2059605082 @default.
- W2912174032 cites W2066238258 @default.
- W2912174032 cites W2080048189 @default.
- W2912174032 cites W2087387294 @default.
- W2912174032 cites W2129542763 @default.
- W2912174032 cites W2131405329 @default.
- W2912174032 cites W2142442427 @default.
- W2912174032 cites W2143039774 @default.
- W2912174032 cites W2147738849 @default.
- W2912174032 cites W2155031841 @default.
- W2912174032 cites W2156077332 @default.
- W2912174032 cites W2166909680 @default.
- W2912174032 cites W2271655448 @default.
- W2912174032 cites W2276903495 @default.
- W2912174032 cites W2343187072 @default.
- W2912174032 cites W2394576783 @default.
- W2912174032 cites W2416799949 @default.
- W2912174032 cites W2512094163 @default.
- W2912174032 cites W2526534917 @default.
- W2912174032 cites W2620759855 @default.
- W2912174032 cites W2624693925 @default.
- W2912174032 cites W2734749680 @default.
- W2912174032 cites W2735710195 @default.
- W2912174032 cites W2750846724 @default.
- W2912174032 cites W2764100055 @default.
- W2912174032 cites W2770948260 @default.
- W2912174032 cites W2780067782 @default.
- W2912174032 cites W2781156794 @default.
- W2912174032 cites W2782674619 @default.
- W2912174032 cites W2782827549 @default.
- W2912174032 cites W2794492795 @default.
- W2912174032 cites W2891466177 @default.
- W2912174032 cites W2891812095 @default.
- W2912174032 cites W2891888092 @default.
- W2912174032 cites W2904589606 @default.
- W2912174032 cites W2908324607 @default.
- W2912174032 cites W2913946887 @default.
- W2912174032 cites W2914652233 @default.
- W2912174032 cites W2916242076 @default.
- W2912174032 cites W2917038071 @default.
- W2912174032 cites W4214894150 @default.
- W2912174032 doi "https://doi.org/10.1109/access.2019.2897898" @default.
- W2912174032 hasPublicationYear "2019" @default.
- W2912174032 type Work @default.
- W2912174032 sameAs 2912174032 @default.
- W2912174032 citedByCount "54" @default.
- W2912174032 countsByYear W29121740322019 @default.
- W2912174032 countsByYear W29121740322020 @default.
- W2912174032 countsByYear W29121740322021 @default.
- W2912174032 countsByYear W29121740322022 @default.
- W2912174032 countsByYear W29121740322023 @default.
- W2912174032 crossrefType "journal-article" @default.
- W2912174032 hasAuthorship W2912174032A5028412854 @default.
- W2912174032 hasAuthorship W2912174032A5032183209 @default.
- W2912174032 hasAuthorship W2912174032A5036326577 @default.
- W2912174032 hasAuthorship W2912174032A5070719868 @default.
- W2912174032 hasAuthorship W2912174032A5081487025 @default.
- W2912174032 hasAuthorship W2912174032A5082606335 @default.
- W2912174032 hasBestOaLocation W29121740321 @default.
- W2912174032 hasConcept C111919701 @default.
- W2912174032 hasConcept C11413529 @default.
- W2912174032 hasConcept C119857082 @default.
- W2912174032 hasConcept C153740404 @default.
- W2912174032 hasConcept C196921405 @default.
- W2912174032 hasConcept C2778476105 @default.
- W2912174032 hasConcept C31258907 @default.
- W2912174032 hasConcept C41008148 @default.
- W2912174032 hasConcept C73555534 @default.
- W2912174032 hasConcept C79974875 @default.
- W2912174032 hasConcept C93996380 @default.
- W2912174032 hasConceptScore W2912174032C111919701 @default.
- W2912174032 hasConceptScore W2912174032C11413529 @default.
- W2912174032 hasConceptScore W2912174032C119857082 @default.
- W2912174032 hasConceptScore W2912174032C153740404 @default.
- W2912174032 hasConceptScore W2912174032C196921405 @default.
- W2912174032 hasConceptScore W2912174032C2778476105 @default.
- W2912174032 hasConceptScore W2912174032C31258907 @default.