TY - GEN
T1 - IOPin
T2 - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012
AU - Kim, Seong Jo
AU - Son, Seung Woo
AU - Liao, Wei Keng
AU - Kandemir, Mahmut
AU - Thakur, Rajeev
AU - Choudhary, Alok
PY - 2012
Y1 - 2012
N2 - Many I/O- and data-intensive scientific applications use parallel I/O software to access files in high performance. On modern parallel machines, the I/O software consists of several layers, including high-level libraries such as Parallel netCDF and HDF, middleware such as MPI-IO, and low-level POSIX interface supported by the file systems. For the I/O software developers, ensuring data flow is important among these software layers with performance close to the hardware limits. This task requires understanding the design of individual libraries and the characteristics of data flow among them. In this paper, we propose a dynamic instrumentation framework that can be used to understand the complex interactions across different I/O layers from applications to the underlying parallel file systems. Our preliminary experience indicates that the costs of using the proposed dynamic instrumentation is about 7% of the application execution time.
AB - Many I/O- and data-intensive scientific applications use parallel I/O software to access files in high performance. On modern parallel machines, the I/O software consists of several layers, including high-level libraries such as Parallel netCDF and HDF, middleware such as MPI-IO, and low-level POSIX interface supported by the file systems. For the I/O software developers, ensuring data flow is important among these software layers with performance close to the hardware limits. This task requires understanding the design of individual libraries and the characteristics of data flow among them. In this paper, we propose a dynamic instrumentation framework that can be used to understand the complex interactions across different I/O layers from applications to the underlying parallel file systems. Our preliminary experience indicates that the costs of using the proposed dynamic instrumentation is about 7% of the application execution time.
UR - http://www.scopus.com/inward/record.url?scp=84876582826&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84876582826&partnerID=8YFLogxK
U2 - 10.1109/SC.Companion.2012.14
DO - 10.1109/SC.Companion.2012.14
M3 - Conference contribution
AN - SCOPUS:84876582826
SN - 9780769549569
T3 - Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012
SP - 18
EP - 23
BT - Proceedings - 2012 SC Companion
Y2 - 10 November 2012 through 16 November 2012
ER -