TY - GEN
T1 - Large-scale graph processing on emerging storage devices
AU - Elyasi, Nima
AU - Choi, Changho
AU - Sivasubramaniam, Anand
PY - 2019/1/1
Y1 - 2019/1/1
N2 - Graph processing is becoming commonplace in many applications to analyze huge datasets. Much of the prior work in this area has assumed I/O devices with considerable latencies, especially for random accesses, using large amount of DRAM to trade-off additional computation for I/O accesses. However, emerging storage devices, including currently popular SSDs, provide fairly comparable sequential and random accesses, making these prior solutions inefficient. In this paper, we point out this inefficiency, and propose a new graph partitioning and processing framework to leverage these new device capabilities. We show experimentally on an actual platform that our proposal can give 2X better performance than a state-of-the-art solution.
AB - Graph processing is becoming commonplace in many applications to analyze huge datasets. Much of the prior work in this area has assumed I/O devices with considerable latencies, especially for random accesses, using large amount of DRAM to trade-off additional computation for I/O accesses. However, emerging storage devices, including currently popular SSDs, provide fairly comparable sequential and random accesses, making these prior solutions inefficient. In this paper, we point out this inefficiency, and propose a new graph partitioning and processing framework to leverage these new device capabilities. We show experimentally on an actual platform that our proposal can give 2X better performance than a state-of-the-art solution.
UR - http://www.scopus.com/inward/record.url?scp=85072312718&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85072312718&partnerID=8YFLogxK
M3 - Conference contribution
T3 - Proceedings of the 17th USENIX Conference on File and Storage Technologies, FAST 2019
SP - 309
EP - 316
BT - Proceedings of the 17th USENIX Conference on File and Storage Technologies, FAST 2019
PB - USENIX Association
T2 - 17th USENIX Conference on File and Storage Technologies, FAST 2019
Y2 - 25 February 2019 through 28 February 2019
ER -