Abstract

This study carves out a way to video coding that is motivated by the recent advancement in video inpainting. In the proposed video coding approach, the regions are mainly divided into two types namely, Local Motion Region and Global Motion Region. The regions are removed by using block based motion estimation in Local Motion Regions and the method of texture synthesis is used for obtaining the removed regions. Shearlet p-Laplacian based Partial Differential Equation (PDE) inpainting is carried out to recover the removed regions in Global Motion Regions. In both regions, Exemplar Selection (Region Removal) Process is based on the edges extracted from the input region. Wavelets like curvelets and contourlets are not very efficient when dealing with edges in multidimensional signals. In this study, a Discrete Shearlet Transform (DST) is used for edge detection. Using DST helps to improve the overall compression performance together with the Shearlet p-Laplacian based inpainting and texture synthesis Schemes. The Scheme has been integrated into H.264/AVC and achieves better bit rate saving.

Keywords:

Discrete shearlet transform, inpainting, texture synthesis, video coding,

References

1. Bertalmio, M., G. Sapiro, V. Caselles and C. Ballester 2000. Image inpainting. Proceedings of ACM SIGGRAPH, pp: 417-424.
   CrossRef    
2. Chang, C.L. and B. Gimod, 2006. Direction adaptive discrete wavelet transform via directional lifting and bandletization. Proceedings of IEEE International Conference on Image Processing. Atlanta, GA.
   
3. Dong, L., S. Xiaoyan, W. Feng, L. Shipeng and Z. Ya Qin, 2007. Image compression with edge based in painting. IEEE T. Circ. Syst. Vid., 17(10): 1273-1286.
   CrossRef    
4. Efros, A. and T. Leung, 1999. Texture synthesis by non-parametric sampling. Proceedings of International Conference on Computer Vision, pp: 1033-1038.
   CrossRef    
5. Gao, K., D. Labate and W. Lim 2009. Edge analysis and identification using the continuous shear let transform. Appl. Comput. Harmon. A., 27(1): 24-46.
   CrossRef    
6. Gerek, O.N. and A.E. Ctin, 2006. A 2-D Orientation adaptive prediction filter in lifting structures for image coding. IEEE T. Image Process., 15(1): 106-111.
   CrossRef    PMid:16435541    
7. Glenn, E., L. Demetrio and Q.L. Wang, 2008. Sparse directional image representation using discrete shear let transform. Appl. Comput. Harmon. A., 25(1): 25-46.
   CrossRef    
8. Guillermo, S., B. Aurelie, B. Marcelo and C. Vicent, 2010. A comprehensive framework for image in painting. IEEE T. Image Process., 19(10): 2634-2645.
   CrossRef    PMid:20435541    
9. Krutz, A., A. Glants, M. Haller and M. Droese, 2008. Multiple Background sprite generation using camera motion characterization for object-based video coding. Proceeding of 3DTV Conference: The True Vision-capture, Transmission and Display of 3D Video, pp: 313-316.
   CrossRef    
10. Kutyniok, G. and D. Labate, 2009. Resolution of the wavefront set using continuous shear lets. T. Am. Math. Soc., 361: 2719-2754.
    CrossRef    
11. Lorenzo, G., M. Fulvio and V. Piere, 2003. Ridgelet transform applied to motion compensated images. Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing. Hong Kong, pp: 6-10.
    
12. Lu, Y., G. Wen and W. Feng, 2001. Fast and robust sprite generation for MPEG-4 video coding, Proceedings of the 2nd IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, pp: 118-125.
    CrossRef    
13. Luo, L., F. Wu, S. Li, Z. Xiong and Z.Q. Zhuang, 2009. Advanced motion threading for 3D-wavelet video coding, signal processing. Image Commun., 19(7): 601-616.
    
14. Peter, J.B. and H.A. Edward, 1983. The lapalcian pyramid as a compact image code. IEEE T. Commun., 31(4): 532-540.
    CrossRef    
15. Rane, S., G. Sapiro and M. Bertalmio, 2003. Structure and Texture filling-in of missing image blocks in wireless transmission and compression applications. IEEE T. Image Process., 12(3): 296-303.
    CrossRef    PMid:18237909    
16. Raymond, H.C., Y.W. Wen and A.M. Yip, 2009. A Fast optimization transfer algorithm for image in painting in wavelet domain. IEEE T. Image Process., 18(7): 1467-1476.
    CrossRef    PMid:19473942    
17. Tony, F.C., S. Jianhong and M.Z. Hao, 2006. Total variation wavelet in painting. J. Math. Imaging Vis., 25(1): 107-125.
    CrossRef    
18. Velisavljevic, V., B. Beferull-Lozano, M. Vitterli and P.L. Dragotti, 2006. Direction lets: Anisotropic multidirectional representation with separable filtering. IEEE T. Image Process., 15: 1916-1933.
    CrossRef    PMid:16830912    
19. Yan, L., G. Wen and W. Feng 2003. Efficient background video coding with static sprite generation and arbitrary shape spatial prediction techniques. IEEE T. Circ. Syst. Vid., 13(5): 394-405.
    CrossRef    

Competing interests

The authors have no competing interests.

Open Access Policy

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Copyright

The authors have no competing interests.