Video Enhancement Based on A Robust Hampel Iterative SRR with a General Observation Model
Article Sidebar
Main Article Content
Abstract
This paper proposes a novel robust Super Resolution Reconstruction (SRR) framework that can enhance a real complex video sequence and is applicable to any noise models. Although SRR algorithms have received considerable attention within the traditional research community, these algorithms are typically very sensitive to their assumed model of data and noise, which limits their utility. The real noise models that corrupt the measured sequence are unknown; consequently, SRR algorithms using L1 or L2 norm may degrade the image sequence rather than enhance it therefore the robust norm applicable to several noise and data models is desired in SRR algorithms. This paper proposes a SRR framework based on the stochastic regularization technique of Bayesian MAP estimation by minimizing a cost function. In order to tolerate to any noise models, the Hampel norm is used for measuring the difference between the projected estimate of the high-resolution image and each low resolution image, and removing outliers in the data. Tikhonov regularization is used to remove artifacts from the final result and improve the rate of convergence. Moreover, in order to cope with real video sequences and complex motion sequences, this paper proposes a SRR General Observation Model (GOM or a±ne block-based transform) devoted to the case of nonisometric inter-frame motion. In the experimental section, the proposed framework can enhance real complex motion sequences, such as Suzie and Foreman sequence, and con¯rm the effectiveness of our algorithm and demonstrate its superiority to other SRR algorithms based on L1 and L2 norm for several noise models (such as AWGN, Poisson noise, Salt & Pepper noise and Speckle noise) at several noise power.
Article Details
This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge.
- Creative Commons Copyright License
The journal allows readers to download and share all published articles as long as they properly cite such articles; however, they cannot change them or use them commercially. This is classified as CC BY-NC-ND for the creative commons license.
- Retention of Copyright and Publishing Rights
The journal allows the authors of the published articles to hold copyrights and publishing rights without restrictions.
References
[2] S. C. Park, M. K. Park and M. G. Kang, "Super Resolution Image Reconstruction : A Technical Over-view," IEEE SP. Magazine, May 2003.
[3] V. Patanavijit and S. Jitapunkul, "An Iterative Super- Resolution Reconstruction of Image Sequences using a Bayesian Approach with BTV Prior and A±ne Block-Based Registration," CRV 2006, June 2006.
[4] V. Patanavijit and S. Jitapunkul, "General Observation Model for an Iterative Multiframe Regularized Super-Resolution Reconstruction for Video Enhancement," IEEE ISPACS 2008, Thailand, Feb. 2009.
[5] Rochefort, F. Champagnat, G. L. Besnerais and Jean- Francois Giovannelli, "An Improved Observation Model for Super-Resolution Under Afine Motion," IEEE Trans. on IP., vol. 15 no. 11, Nov. 2006.
[6] M. Elad and A. Feuer, "Restoration of a Single Super-resolution Image from Several Blurred, Noisy and Undersampled Measured Images," IEEE Trans. on Image Processing, Vol. 6, Dec. 1997.
[7] M. Elad and A. Feuer, "Superresolution Restoration of an Image Sequence: Adaptive Filtering Approach," IEEE Trans. on IP., Match 1999.
[8] R. R. Schultz and R. L. Stevenson, "A Bayesian Approach to Image Expansion for Improved Definition," IEEE Trans. on IP., May 1994.
[9] R. R. Schultz and R. L. Stevenson, "Extraction of High-Resolution Frames from Video Sequences," IEEE Transactions on Image Processing, June 1996.
[10] M. Elad and A. Feuer, "Restoration of a Single Super-resolution Image from Several Blurred, Noisy and Un-dersampled Measured Images," IEEE Trans. on Image Processing, Vol. 6, Dec. 1997.
[11] M. Elad and A. Feuer, "Super-Resolution Reconstruction of Image Sequences," IEEE Trans. on PAMI., Sep. 1999.
[12] M. Elad and Y. Hecov Hel-Or, "A Fast Super- Resolution Reconstruction Algorithm for Pure Translational Motion and Common Space-Invariant Blur," IEEE Trans. on IP., 2001.
[13] Bouman and K. Sauer, "A Generalized Gaussian Image Model for Edge-Preserving MAP Estimation," IEEE Trans. on IP., 2, 3, July 1993 : 293-310.
[14] M. Elad, "On the Original of the Bilateral Filter and Ways to Improve It," IEEE Trans. on IP., Oct. 2002.
[15] S. Farsiu, D. Robinson, M. Elad, P. Milanfar, "Advances and Challenges in Super-Resolution," Wiley Periodicals, Inc., 2004.
[16] S. Farsiu, D. Robinson, M. Elad and P. Milanfar, "Fast and Robust Multiframe Super Resolution," IEEE Trans. on Image Processing, Oct. 2004.
[17] S. Farsiu, M. Elad and P. Milanfar, "Multiframe Demosaicing and Super-Resolution of Color Images," IEEE Trans. on IP, 2006.
[18] S. Farsiu, M. Elad and P. Milanfar, "Video-to-Video Dynamic Super-Resolution for Grayscale and Color Sequences," EURASIP Journal on Applied Signal Processing, Hindawi Publishing Corporation, 2006.
[19] M. J. Black, A. Rangarajan, "On The Unification Of Line Processes, Outlier Rejection and Robust Statistics with Applications in Early Vision," International Journal of Computer Vision 19, 1, July 1996 : 57-92.
[20] M. J. Black, G. Sapiro, D. H. Marimont and D. Herrger, "Robust Anisotropic Diffusion," IEEE Trans. on IP., 1998.
[21] V. Patanavijit, "A Robust Iterative Multiframe SRR using Stochastic Regularization Technique based on Hampel Estimation," ECTI-CON 2008, ECTI Association Thailand, Krabi, Thailand, 2008.
[22] V. Patanavijit, "A Robust Iterative Multiframe SRR based on Hampel Stochastic Estimation with Hampel-Tikhonov Regularization," Proceeding of IEEE 19th International Conference on Pattern Recognition (ICPR 2008), Florida, USA, Dec. 2008.
[23] V. Patanavijit, "Video Enhancement Using A Robust Iterative SRR Based On A Hampel Stochastic Estimation," ECTI-CON 2009, ECTI Association Thailand, Pattaya, Thailand, May 2009.