Matches in SemOpenAlex for { <https://semopenalex.org/work/W2894483539> ?p ?o ?g. }
Showing items 1 to 72 of
72
with 100 items per page.
- W2894483539 abstract "Containers have transformed the cluster management into an application oriented endeavor, thus being widely used as the deployment units (i.e., micro-services) of large scale cloud services. As opposed to VMs, containers allow for resource provisioning with fine granularity and their resource usage directly reflects the micro-service behaviors. Container management systems like Kubernetes and Mesos provision resources to containers according to the capacity requested by the developers. Resource usages estimated by the developers are grossly inaccurate. They tend to be risk-averse and over provision resources, as under-provisioning would cause poor runtime performance or failures. Without actually running the workloads, resource provisioning is challenging. However, benchmarking production workloads at scale requires huge manual efforts. In this work, we leverage IBM Monitoring service to profile the resource usage of production IBM Watson services in rolling windows by focusing on both evaluating how developers request resources and characterizing the actual resource usage. Our resource profiling study reveals two important characteristics of the cognitive workloads. 1. Stationarity. According to Augmented Dickey-Fuller test with 95% confidence, more than 95% of the container instances have stationary CPU usage while more than 85% have stationary memory usage, indicating that resource usage statistics do not change over time. We find for the majority of containers that the stationarity can be detected at the early stage of container execution and can hold throughout their lifespans. In addition, containers with non-stationary CPU or memory usage are also observed to implement predictable usage trends and patterns (e.g., trend stationarity or seasonality). 2. Predictability by container image. By clustering the containers based on their images, container resource usages within the same cluster are observed to exhibit strong statistical similarity. This suggests that the history of resource usage for one instance can be used to predict usage for future instances that run the same container image. Based on profiling results of running containers in rolling windows, we propose a resource usage advisory system to refine the requested resource values of the running and arriving containers as illustrated in Fig. 1. Our system continuously retrieves the resource usage metrics of running containers from IBM monitoring service and predicts the resource usage profiles in a container resource usage prediction agent. Upon the arrival of a new pod1, the resource profile advisor, proposed as a module in the web-hooked admission controller in Kubernetes, checks whether the resource profile of each container in the pod has been predicted with confidence. If a container's profile has been predicted and cached in the container resource profile database, the default requested values of containers are refined by the predicted ones; otherwise, containers are forwarded to the scheduler without any change. Similarly, a resource profile auto-scaler is proposed to update the requested resource values of containers for running pods2 as soon as the database is updated. Our study shows that developers request at least 1 core-per-second (cps) CPU and 1 GB memory for ≥ 70% of the containers, while ≥ 80% of the containers actually use less than 1 cps and 1GB. Additionally, ~ 20% of the containers are significantly under provisioned. We use resource usage data in one day to generate container resource profiles and evaluate our approach based on the actual usage on the following day. Without our system, average CPU (memory) usage for >90% of containers lies outside of 50% - 100% (70% - 100%) of the requested values. Our evaluation shows that our system can advise request values appropriately so that average and 95th percentile CPU (memory) usage for >90% of the containers are within 50% - 100% (70% - 100%) of the requested values. Furthermore, average CPU (memory) utilization across all pods is raised from 10% (26%) to 54% (88%)." @default.
- W2894483539 created "2018-10-05" @default.
- W2894483539 creator A5021663061 @default.
- W2894483539 creator A5027088517 @default.
- W2894483539 creator A5050254034 @default.
- W2894483539 creator A5079282603 @default.
- W2894483539 date "2018-10-11" @default.
- W2894483539 modified "2023-09-24" @default.
- W2894483539 title "Resource Profile Advisor for Containers in Cognitive Platform" @default.
- W2894483539 doi "https://doi.org/10.1145/3267809.3275448" @default.
- W2894483539 hasPublicationYear "2018" @default.
- W2894483539 type Work @default.
- W2894483539 sameAs 2894483539 @default.
- W2894483539 citedByCount "0" @default.
- W2894483539 crossrefType "proceedings-article" @default.
- W2894483539 hasAuthorship W2894483539A5021663061 @default.
- W2894483539 hasAuthorship W2894483539A5027088517 @default.
- W2894483539 hasAuthorship W2894483539A5050254034 @default.
- W2894483539 hasAuthorship W2894483539A5079282603 @default.
- W2894483539 hasConcept C111919701 @default.
- W2894483539 hasConcept C119857082 @default.
- W2894483539 hasConcept C127413603 @default.
- W2894483539 hasConcept C144133560 @default.
- W2894483539 hasConcept C153083717 @default.
- W2894483539 hasConcept C162853370 @default.
- W2894483539 hasConcept C171250308 @default.
- W2894483539 hasConcept C172191483 @default.
- W2894483539 hasConcept C192562407 @default.
- W2894483539 hasConcept C206345919 @default.
- W2894483539 hasConcept C2781018962 @default.
- W2894483539 hasConcept C31258907 @default.
- W2894483539 hasConcept C41008148 @default.
- W2894483539 hasConcept C70388272 @default.
- W2894483539 hasConcept C77088390 @default.
- W2894483539 hasConcept C78519656 @default.
- W2894483539 hasConcept C79974875 @default.
- W2894483539 hasConcept C86251818 @default.
- W2894483539 hasConceptScore W2894483539C111919701 @default.
- W2894483539 hasConceptScore W2894483539C119857082 @default.
- W2894483539 hasConceptScore W2894483539C127413603 @default.
- W2894483539 hasConceptScore W2894483539C144133560 @default.
- W2894483539 hasConceptScore W2894483539C153083717 @default.
- W2894483539 hasConceptScore W2894483539C162853370 @default.
- W2894483539 hasConceptScore W2894483539C171250308 @default.
- W2894483539 hasConceptScore W2894483539C172191483 @default.
- W2894483539 hasConceptScore W2894483539C192562407 @default.
- W2894483539 hasConceptScore W2894483539C206345919 @default.
- W2894483539 hasConceptScore W2894483539C2781018962 @default.
- W2894483539 hasConceptScore W2894483539C31258907 @default.
- W2894483539 hasConceptScore W2894483539C41008148 @default.
- W2894483539 hasConceptScore W2894483539C70388272 @default.
- W2894483539 hasConceptScore W2894483539C77088390 @default.
- W2894483539 hasConceptScore W2894483539C78519656 @default.
- W2894483539 hasConceptScore W2894483539C79974875 @default.
- W2894483539 hasConceptScore W2894483539C86251818 @default.
- W2894483539 hasLocation W28944835391 @default.
- W2894483539 hasOpenAccess W2894483539 @default.
- W2894483539 hasPrimaryLocation W28944835391 @default.
- W2894483539 hasRelatedWork W1003348184 @default.
- W2894483539 hasRelatedWork W2058501570 @default.
- W2894483539 hasRelatedWork W2064366207 @default.
- W2894483539 hasRelatedWork W2068734592 @default.
- W2894483539 hasRelatedWork W2605378472 @default.
- W2894483539 hasRelatedWork W2625203638 @default.
- W2894483539 hasRelatedWork W2889641497 @default.
- W2894483539 hasRelatedWork W2945306731 @default.
- W2894483539 hasRelatedWork W2995400176 @default.
- W2894483539 hasRelatedWork W4205720754 @default.
- W2894483539 isParatext "false" @default.
- W2894483539 isRetracted "false" @default.
- W2894483539 magId "2894483539" @default.
- W2894483539 workType "article" @default.