Robust alignment for panoramic stitching via an exact rank constraint

Yuelong Li, Mohammad Tofighi, Vishal Monga

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


We study the problem of image alignment for panoramic stitching. Unlike most existing approaches that are feature-based, our algorithm works on pixels directly, and accounts for errors across the whole images globally. Technically, we formulate the alignment problem as rank-1 and sparse matrix decomposition over transformed images, and develop an efficient algorithm for solving this challenging non-convex optimization problem. The algorithm reduces to solving a sequence of subproblems, where we analytically establish exact recovery conditions, convergence and optimality, together with convergence rate and complexity. We generalize it to simultaneously align multiple images and recover multiple homographies, extending its application scope toward vast majority of practical scenarios. The experimental results demonstrate that the proposed algorithm is capable of more accurately aligning the images and generating higher quality stitched images than the state-of-the-art methods.

Original languageEnglish (US)
Article number8684316
Pages (from-to)4730-4745
Number of pages16
JournalIEEE Transactions on Image Processing
Issue number10
StatePublished - Oct 2019

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Robust alignment for panoramic stitching via an exact rank constraint'. Together they form a unique fingerprint.

Cite this