Regime Sorting for Multiscale Vibrations and Phase-Based Motion Extraction

While phase-based motion magnification has shown great success in enhancing sub-pixel motion, super-pixel motion has proven more difficult to work with. As “small motion” is usually a major assumption in the derivation of optical flow, large-scale super-pixel motion has been shown to cause artifacts and limit the usability of the method in both magnification and extraction applications. Viable methods do exist and have shown promise for scenarios where unimportant large motions are present in an otherwise ideal video. Likewise, current rules of thumb suggest utilizing a pyramid approach, where the images are downsampled until the motion becomes sub-pixel and thus avoids the issue entirely. However, the approaches for effectively removing these large-scale, super-pixel motions neglect their potential importance for objects which exhibit both super- and sub-pixel motions of interest. Further, for such objects, downsampling could degrade and even obliterate the relevant sub-pixel motion. Therefore, an approach is conceived and developed exploiting this degradation in conjunction with complexity pursuit (a blind source separation technique) to allow for more effective and purposeful processing using the complex steerable pyramid. With greater information in the beginning, rules of thumb and temporal bandpassing can be utilized more effectively to extract viable motion measurements in both regimes of pixel motion.