ϵ-Approximate Coded Matrix Multiplication Is Nearly Twice as Efficient as Exact Multiplication

Haewon Jeong, Ateet Devulapalli, Viveck R. Cadambe, Flavio P. Calmon

Research output: Contribution to journalArticlepeer-review

16 Scopus citations

Abstract

We study coded distributed matrix multiplication from an approximate recovery viewpoint. We consider a system of P computation nodes where each node stores 1/m of each multiplicand via linear encoding. Our main result shows that the matrix product can be recovered with relative error from any m of the P nodes for any > 0. We obtain this result through a careful specialization of MatDot codes - a class of matrix multiplication codes previously developed in the context of exact recovery ( =0 ). Since prior results showed that MatDot codes achieve the best exact recovery threshold for a class of linear coding schemes, our result shows that allowing for mild approximations leads to a system that is nearly twice as efficient as exact reconstruction. For Entangled-Poly codes - which are generalizations of MatDot codes - we show that approximation reduces the recovery threshold from p2 q + q -1 to p2q , when the input matrices A, B are split respectively in to a p× q and q × p grids of equal-sized submatrices.

Original languageEnglish (US)
Pages (from-to)845-854
Number of pages10
JournalIEEE Journal on Selected Areas in Information Theory
Volume2
Issue number3
DOIs
StatePublished - Sep 2021

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Media Technology
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'ϵ-Approximate Coded Matrix Multiplication Is Nearly Twice as Efficient as Exact Multiplication'. Together they form a unique fingerprint.

Cite this