Kraken: Adaptive container provisioning for deploying dynamic DAGs in serverless platforms

Vivek M. Bhasi, Jashwant Raj Gunasekaran, Prashanth Thinakaran, Cyan Subhra Mishra, Mahmut Taylan Kandemir, Chita Das

Research output: Chapter in Book/Report/Conference proceedingConference contribution

38 Scopus citations

Abstract

The growing popularity of microservices has led to the proliferation of online cloud service-based applications, which are typically modelled as Directed Acyclic Graphs (DAGs) comprising of tens to hundreds of microservices. The vast majority of these applications are user-facing, and hence, have stringent SLO requirements. Serverless functions, having short resource provisioning times and instant scalability, are suitable candidates for developing such latency-critical applications. However, existing serverless providers are unaware of the workflow characteristics of application DAGs, leading to container over-provisioning in many cases. This is further exacerbated in the case of dynamic DAGs, where the function chain for an application is not known a priori. Motivated by these observations, we propose Kraken, a workflow-aware resource management framework that minimizes the number of containers provisioned for an application DAG while ensuring SLO-compliance. We design and implement Kraken on OpenFaaS and evaluate it on a multi-node Kubernetes-managed cluster. Our extensive experimental evaluation using DeathStarbench workload suite and real-world traces demonstrates that Kraken spawns up to 76% fewer containers, thereby improving container utilization and saving cluster-wide energy by up to 4x and 48%, respectively, when compared to state-of-the art schedulers employed in serverless platforms.

Original languageEnglish (US)
Title of host publicationSoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing
PublisherAssociation for Computing Machinery, Inc
Pages153-167
Number of pages15
ISBN (Electronic)9781450386388
DOIs
StatePublished - Nov 1 2021
Event12th Annual ACM Symposium on Cloud Computing, SoCC 2021 - Virtual, Online, United States
Duration: Nov 1 2021Nov 4 2021

Publication series

NameSoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing

Conference

Conference12th Annual ACM Symposium on Cloud Computing, SoCC 2021
Country/TerritoryUnited States
CityVirtual, Online
Period11/1/2111/4/21

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Kraken: Adaptive container provisioning for deploying dynamic DAGs in serverless platforms'. Together they form a unique fingerprint.

Cite this