Kernel-level caching for optimizing I/O by exploiting inter-application data sharing

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

With applications becoming larger and the increasing load on high performance systems, it is important to tackle the I/O bottleneck problem from several angles. It is not only essential to optimize the I/O accesses of any one application, but also to be able to identify and exploit opportunities resulting front the sharing of datasets across applications. Clusters are rapidly becoming the platform of choice for demanding applications due to their cost-effectiveness and widespread deployment. Consequently, this paper attempts to optimize data sharing across applications concurrently executing on the cluster. Specifically, we propose and implement a kernel-level caching module at each node of a Linux cluster that can be used to service several processes of different applications. Using detailed evaluations on an actual Linux cluster this paper demonstrates the benefits of this module in optimizing intra and inter-application I/O requests.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Cluster Computing, CLUSTER 2002
EditorsBill Gropp, Rajkumar Buyya, Rob Pennington, Maxine Brown, Mark Baker, Dan Reed
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages425-432
Number of pages8
ISBN (Electronic)0769517455
DOIs
StatePublished - 2002
EventIEEE International Conference on Cluster Computing, CLUSTER 2002 - Chicago, United States
Duration: Sep 23 2002Sep 26 2002

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
Volume2002-January
ISSN (Print)1552-5244

Other

OtherIEEE International Conference on Cluster Computing, CLUSTER 2002
Country/TerritoryUnited States
CityChicago
Period9/23/029/26/02

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Signal Processing

Fingerprint

Dive into the research topics of 'Kernel-level caching for optimizing I/O by exploiting inter-application data sharing'. Together they form a unique fingerprint.

Cite this