Narrowing the Gap between Serverless and its State with Storage Functions

Tian Zhang, Dong Xie, Feifei Li, Ryan Stutsman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

52 Scopus citations


Serverless computing has gained attention due to its fine-grained provisioning, large-scale multi-Tenancy, and on-demand scaling. However, it also forces applications to externalize state in remote storage, adding substantial overheads. To fix this "data shipping problem"we built Shredder, a low-latency multi-Tenant cloud store that allows small units of computation to be performed directly within storage nodes. Storage tenants provide Shredder with JavaScript functions (or WebAssembly programs), which can interact directly with data without moving them over the network. The key challenge in Shredder is safely isolating thousands of tenant storage functions while minimizing data interaction costs. Shredder uses a unique approach where its data store and networking paths are implemented in native code to ensure performance, while isolated tenant functions interact with data using a V8-specific intermediate representation that avoids expensive cross-protection-domain calls and data copying. As a result, Shredder can execute 4 million remotely-invoked tenant functions per second spread over thousands of tenants with median and 99th-percentile response latencies of less than 50 µs and 500 µs, respectively. Our evaluation shows that Shredder achieves a 14% to 78% speedup against conventional remote storage when fetching items with just one to three data dependencies between them. We also demonstrate Shredder's effectiveness in accelerating data-intensive applications, including a k-hop query on social graphs that shows orders of magnitude gain.

Original languageEnglish (US)
Title of host publicationSoCC 2019 - Proceedings of the ACM Symposium on Cloud Computing
PublisherAssociation for Computing Machinery
Number of pages12
ISBN (Electronic)9781450369732
StatePublished - Nov 20 2019
Event10th ACM Symposium on Cloud Computing, SoCC 2019 - Santa Cruz, United States
Duration: Nov 20 2019Nov 23 2019

Publication series

NameSoCC 2019 - Proceedings of the ACM Symposium on Cloud Computing


Conference10th ACM Symposium on Cloud Computing, SoCC 2019
Country/TerritoryUnited States
CitySanta Cruz

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computational Theory and Mathematics


Dive into the research topics of 'Narrowing the Gap between Serverless and its State with Storage Functions'. Together they form a unique fingerprint.

Cite this