Abstract

Stereo image quality assessment is a crucial and challenging issue in 3D video communication. One of major difficulties is how to weigh binocular masking effect. In order to establish the assessment mode more in line with the human visual system, Watson model is adopted, which defines visibility threshold under no distortion composed of contrast sensitivity, masking effect and error in this study. As a result, we propose an Objective Stereo Image Quality Assessment method (OSIQA), organically combining a new Left-Right view Image Quality Assessment (LR-IQA) metric and Depth Perception Image Quality Assessment (DP-IQA) metric. The new LR-IQA metric is first given to calculate the changes of perception coefficients in each sub-band utilizing Watson model and human visual system after wavelet decomposition of left and right images in stereo image pair, respectively. Then, a concept of absolute difference map is defined to describe abstract differential value between the left and right view images and the DP-IQA metric is presented to measure structure distortion of the original and distorted abstract difference maps through luminance function, error sensitivity and contrast function. Finally, an OSIQA metric is generated by using multiplicative fitting of the LR-IQA and DP-IQA metrics based on weighting. Experimental results shows that the proposed method are highly correlated with human visual judgments (Mean Opinion Score) and the correlation coefficient and monotony are more than 0.92 under five types of distortions such as Gaussian blur, Gaussian noise, JP2K compression, JPEG compression and H.264 compression.

Keywords:

3D video communication, human visual system, image quality assessment, stereo image processing, visual perception,

References

1. Akhter, R., Z. Sazzad and Y. Horita, 2010. No-reference stereoscopic image quality assessment. Proceeding of SPIE, 7524(75240T).
   CrossRef    
2. Benoit, A., P.L. Callet, P. Campisi and R. Cousseau, 2008a. Using disparity for quality assessment of stereoscopic images. Proceeding of 15th IEEE International Conference on Image Processing (ICIP, 2008), pp: 389-392.
   CrossRef    
3. Benoit, A., P.L. Callet, P. Campisi and R. Cousseau, 2008b. Quality assessment of stereoscopic images. EURASIP J. Image Video Process., 659024. Doi: 10.1155/2008/659024.
   CrossRef    
4. Boev, A. and M. Poikela, 2010. Technical Report D5.3.
   Direct Link
5. Campisi, P., P.L. Callet and E. Marini, 2007. Stereoscopic images quality assessment. Proceeding of EUSIPCO, Poznan, Poland.
   
6. Chou, C. and Y. Li, 1995. A qerceptually tuned sub-band image coder based on the measure of just-noticeable distortion profile. IEEE T. Circ. Syst. Vid., 5(6): 467-476.
   CrossRef    
7. Daly, S., 1992. The visible difference predictor: An algorithm for the assessment of image fidelity. Proceeding of SPIE,1616: 2-15.
   CrossRef    
8. Fan, Y., Y. Kung and B. Lin, 2011. Three-dimensional auto-stereoscopic image recording, mapping and synthesis system for multiview 3D display. IEEE T. Magn., 47(3): 683-686.
   CrossRef    
9. Gotchev, A., G.B. Akar and T. Capin, 2011. Three-Dimensional media for mobile devices. Proc. IEEE, 99(4): 708-741.
   CrossRef    
10. Horita, Y., Y. Kawai and Y. Minami, 2000. Quality evaluation model of coded stereoscopic color image. Proceeding of SPIE, 4067: 389-398.
    CrossRef    
11. Ijsselsteijn, W.A., H.D. Ridder and J. January 03, 20132000. Subjective evaluation of stereoscopic images: Effects of camera parameters and display duration. IEEE T. Circ. Syst. Vid., 10(2): 225-233.
    
12. ITU-R Recommendation BT.500-11, 2002. Methodology for the Subjective Assessment Evaluation of the Quality of Television Pictures. ITU, Geneva, Switzerland.
    
13. ITU-T Recommendation P.910, 2008. Subjective Video Quality Assessment Methods for Multimedia Applications. ITU, Geneva, Switzerland.
    
14. JM 17.2, 2011.
    Direct Link
15. Lambooij, M., W.A. Ijsselsteijn and M. Fortuin, 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. J. Imaging Sci. Techn., 53(3): 0302011-03020114.
    CrossRef    
16. Mannos, J. and D. Sakrison, 1974. The effects of a visual fidelity criterion on the encoding of images. IEEE T. Inform. Theory, 20(4): 525-536.
    CrossRef    
17. MPEG, 1998.
    Direct Link
18. Sazzad, Z.M.P., S. Yamanaka, Y. Kawayokeita and Y. Horita, 2009. Stereoscopic image quality prediction. Proceeding of International Workshop on Quality of Multimedia Experience (QoMEx, 2009), pp: 180-185.
    CrossRef    
19. Shao, F., G.Y. Jiang, M. Yu, K. Chen and S. Ho, 2012. Asymmetric coding of multi-view video plus depth based 3-D video for view rendering. IEEE Multimedia, 14(1): 157-167.
    CrossRef    
20. Shen, L., J.C. Lang and Z.Y. Zhang, 2009. Quality assessment of stereo images with stereo vision. Proceeding of 2nd International Congress on Image and Signal Processing (CISP '09), pp: 1-4.
    CrossRef    
21. Tam, W.J., 2007. Image and depth quality of asymmetrically coded stereoscopic video for 3D-TV. Joint Video Team Document, ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6. JVT-W094.
    
22. Wandell, B., 1995. Foundations of Vision. 1st Edn., Sinauer Associates Inc., Sunderland, MA.
    PMid:7839619    
23. Wang, X., M. Yu, Y. Yang and G.Y. Jiang, 2009. Research on subjective stereoscopic image quality assessment. Proceeding of SPIE, 7255: 725501-725509.
    CrossRef    
24. Wang, X., G.Y. Jiang, J.M. Zhou, Y. Zhang, F. Shao, Z.J. Peng and M. Yu, 2012. Visibility threshold of compressed stereoscopic image: Effects of asymmetric coding. Imag. Sci. J., Doi: 10.1179/1743131X11Y.0000000035.
    CrossRef    
25. Yang, J., C.P. Hou, L.L. Shen and Z.Y. Zhang, 2008. Objective evaluation method for stereo image quality based on PSNR. J. Tianjin Univ., Sci. Technol., 41(12): 1448-1452.
    
26. Zhang, J. and T.M. Le, 2010. A new no-reference quality metric for JPEG 2000 images. IEEE T. Consum. Electr., 56(2): 734-750.
    CrossRef    
27. Zhou, W., A. Bovik, H. Sheikh and E. Simoncelli, 2004. Image quality assessment: From error visibility to structural similarity. IEEE T. Image Process., 13(4): 600-612.
    CrossRef    
28. Zhou, J.M., G.Y. Jiang, X.Y. Mao, M. Yu, F. Shao, Z.J. Peng and Y. Zhang, 2011. Subjective quality analyses of stereoscopic images in 3DTV system. Proceeding of IEEE Visual Communications and Image Processing (VCIP'2011) Conference. Tainan, pp: 1-4.
    

Competing interests

The authors have no competing interests.

Open Access Policy

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Copyright

The authors have no competing interests.