FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W1896151405> ?p ?o ?g. }

• W1896151405 abstract "Cluster computing has recently gone through an evolution from single processor systems to multicore/multi-socket systems. This has resulted in lowering the cost/performance ratio of the compute machines. Compute farms that host these machines tend to become heterogeneous over time due to incremental extensions, hardware upgrades and/or nodes being purchased for users with particular needs. This heterogeneity is not surprising given the wide range of processor, memory and network technologies that become available and the relatively small price difference between these various options. Different CPU architectures, memory capacities, communication and I/O interfaces of the participating compute nodes present many challenges to job scheduling and often result in under or over utilization of the compute resources. In general, it is not feasible for the application programmers to specifically optimize their programs for such a set of differing compute nodes, due to the difficulty and time-intensiveness of such a task. The trend of heterogeneous compute farms has coincided with resurgence in the virtualization technology. Virtualization technology is receiving widespread adoption, mainly due to the benefits of server consolidation and isolation, load balancing, security and fault tolerance. Virtualization has also generated considerable interest in the High Performance Computing (HPC) community, due to the resulting high availability, fault tolerance, cluster partitioning and accommodation of conflicting user requirements. However, the HPC community is still wary of the potential overheads associated with virtualization, as it results in slower network communications and disk I/O, which need to be addressed. The live migration feature, available to most virtualization technologies, can be leveraged to improve the throughput of a heterogeneous compute farm (HC) used for HPC applications. For this we mitigated the slow network communication in Xen; an open source virtual machine monitor. We present a detailed analysis of the communication framework of Xen and propose communication configurations that give 50% improvement over the conventional Xen network configuration. From a detailed study of the migration facility in Xen, we propose an improvement in the live migration facility specifically targeting HPC applications. This optimization gives around 50% improvement over the default migration facility of Xen. In this thesis, we also investigate resource scheduling in heterogeneous compute farm with the perspective of dynamic resource re-mapping. Our approach is to profile each job in the compute farm at runtime, and propose a better resource mapping compared to the initial allocation. We then migrate the job(s) to the best-suited homogeneous sub-cluster to improve overall throughput of the HC. For this, we develop a novel heterogeneity and virtualization-aware profiling framework, which is able to predict the CPU and communication characteristics of high performance scientific applications. Our experimental setup consists of a 32 node virtualized cluster with machines having CPU frequency between 2 GHz to 3 GHz. The framework was tested with a subset of NAS parallel benchmarks with the workload generated from Dror Feitelson’s workload archives. The prediction accuracy of our performance estimation model is over 80%. The framework implementation is lightweight, with an overhead of 3%. Our experiments show that we are able to improve the throughput of the compute farm by 25% and the time saved by the HC with our framework is over 30%. The framework can be readily extended to HCs supporting a cloud computing environment." @default.
• W1896151405 created "2016-06-24" @default.
• W1896151405 creator A5059402413 @default.
• W1896151405 date "2010-01-01" @default.
• W1896151405 modified "2023-09-26" @default.
• W1896151405 title "Adaptive Resource Relocation in Virtualized Heterogeneous Clusters" @default.
• W1896151405 cites W124520697 @default.
• W1896151405 cites W1483930278 @default.
• W1896151405 cites W1493147916 @default.
• W1896151405 cites W1499342788 @default.
• W1896151405 cites W1504808146 @default.
• W1896151405 cites W1505990572 @default.
• W1896151405 cites W1513326124 @default.
• W1896151405 cites W1518880257 @default.
• W1896151405 cites W1563494680 @default.
• W1896151405 cites W1565502159 @default.
• W1896151405 cites W1570807020 @default.
• W1896151405 cites W1571646234 @default.
• W1896151405 cites W1586654869 @default.
• W1896151405 cites W1588342738 @default.
• W1896151405 cites W1596562520 @default.
• W1896151405 cites W1596606311 @default.
• W1896151405 cites W1603470798 @default.
• W1896151405 cites W1647152777 @default.
• W1896151405 cites W1647989977 @default.
• W1896151405 cites W1784710995 @default.
• W1896151405 cites W1941646418 @default.
• W1896151405 cites W1965091139 @default.
• W1896151405 cites W1977367431 @default.
• W1896151405 cites W1977782389 @default.
• W1896151405 cites W1984869672 @default.
• W1896151405 cites W1997269120 @default.
• W1896151405 cites W2015702037 @default.
• W1896151405 cites W2024268382 @default.
• W1896151405 cites W2025397485 @default.
• W1896151405 cites W2039230357 @default.
• W1896151405 cites W2042120213 @default.
• W1896151405 cites W2049141927 @default.
• W1896151405 cites W2061048015 @default.
• W1896151405 cites W2064157002 @default.
• W1896151405 cites W2070963260 @default.
• W1896151405 cites W2071075503 @default.
• W1896151405 cites W2077390769 @default.
• W1896151405 cites W2080992740 @default.
• W1896151405 cites W2082998299 @default.
• W1896151405 cites W2083357144 @default.
• W1896151405 cites W2096611465 @default.
• W1896151405 cites W2097025565 @default.
• W1896151405 cites W2099545490 @default.
• W1896151405 cites W2100445737 @default.
• W1896151405 cites W2102061396 @default.
• W1896151405 cites W2105641992 @default.
• W1896151405 cites W2106843513 @default.
• W1896151405 cites W2106898095 @default.
• W1896151405 cites W2108376207 @default.
• W1896151405 cites W2112049462 @default.
• W1896151405 cites W2112168774 @default.
• W1896151405 cites W2117134475 @default.
• W1896151405 cites W2117577418 @default.
• W1896151405 cites W2117898742 @default.
• W1896151405 cites W2119870127 @default.
• W1896151405 cites W2123412159 @default.
• W1896151405 cites W2125895608 @default.
• W1896151405 cites W2128912217 @default.
• W1896151405 cites W2131726714 @default.
• W1896151405 cites W2143818983 @default.
• W1896151405 cites W2143966293 @default.
• W1896151405 cites W2145659598 @default.
• W1896151405 cites W2146848271 @default.
• W1896151405 cites W2150074609 @default.
• W1896151405 cites W2152408640 @default.
• W1896151405 cites W2154010459 @default.
• W1896151405 cites W2157779169 @default.
• W1896151405 cites W2160544331 @default.
• W1896151405 cites W2160644975 @default.
• W1896151405 cites W2168722543 @default.
• W1896151405 cites W2169755574 @default.
• W1896151405 cites W2241629006 @default.
• W1896151405 cites W2294047952 @default.
• W1896151405 cites W2523593032 @default.
• W1896151405 cites W2533494838 @default.
• W1896151405 cites W3483358 @default.
• W1896151405 cites W596572 @default.
• W1896151405 cites W1543167334 @default.
• W1896151405 doi "https://doi.org/10.25911/5d7a267ea3a59" @default.
• W1896151405 hasPublicationYear "2010" @default.
• W1896151405 type Work @default.
• W1896151405 sameAs 1896151405 @default.
• W1896151405 citedByCount "0" @default.
• W1896151405 crossrefType "dissertation" @default.
• W1896151405 hasAuthorship W1896151405A5059402413 @default.
• W1896151405 hasConcept C111919701 @default.
• W1896151405 hasConcept C120314980 @default.
• W1896151405 hasConcept C127413603 @default.
• W1896151405 hasConcept C142355369 @default.
• W1896151405 hasConcept C206729178 @default.
• W1896151405 hasConcept C21547014 @default.
• W1896151405 hasConcept C2779898492 @default.
• W1896151405 hasConcept C29140674 @default.
• W1896151405 hasConcept C41008148 @default.

• next