Rendering and Display of Light Field Images Using Conjugate Perspective Coherence Cameras

被引:1
|
作者
Zhou Mengtao [1 ]
Lou Yimin [1 ]
Hu Juanmei [1 ]
Fend Yushun [1 ]
Wu Fengmin [1 ]
机构
[1] Zhejiang Sci Tech Univ, Dept Phys, Key Lab Opt Field Manipulat Zhejiang Prov, Hangzhou 310018, Peoples R China
关键词
Light field display; Light field image; Perspective coherence; Rendering pipeline; Computer graphics;
D O I
10.3788/gzxb20235204.0411002
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Light field display is an important true Three-dimensional(3D) display technology. It can provide the observers with rich 3D perception such as binocular parallax, motion parallax, monocular focusing, and so on. Light field display technology has a wide range of applications in various fields such as industrial and agricultural production, daily life, military defense, game and entertainment. It is a platform technology, so it has attracted much attention. High-quality light field display requires a large amount of light field image information. How to quickly acquire light field image information is still an important challenge in this field. The light field information acquisition technique mainly includes two categories one is optical acquisition technique and the other is digital rendering method. Optical acquisition technique can capture light field information of real scenes, but the acquisition system is complex and requires precise calibration. The digital rendering method uses computer technique to generate light field images. It can be combined with computer graphics technology to render special artistic effects flexibly. Model-based Rendering (MBR) and Image-based Rendering(IBR)are two typical digital rendering methods. The MBR method can get high-quality light field images, but the rendering efficiency needs to be improved. The IBR method renders faster, but the image quality needs to be enhanced. Both of these methods suffer from the pseudoscopic problem of 3D images. In order to improve the rendering efficiency and quality of light field images, a rendering algorithm of light field image and display system based on conjugate perspective coherence camera are proposed. The algorithm is called Conjugate Multiple Viewpoint Rendering (CMVR). The depth mapping relationship between a normal perspective camera and a conjugate perspective camera is analyzed. The conjugate perspective cameras are constructed and used to render the light field images without pseudoscopic problem in one step. Therefore, the image encoding process is avoided. At the same time, the perspective coherence between the conjugate cameras is used to reduce the redundant calculation and accelerate the rendering process. Compared with traditional algorithms, the proposed algorithm has strong parallel processing capability and is suitable for existing graphics processing hardware to accelerate the process. The rendering pipeline for light field images is built using a hybrid programming technique of CPU and GPU. The test results show that the CMVR algorithm can achieve good image quality comparable to the rendering pipeline of commercial application program interface OpenGL. The rendering efficiency of CMVR algorithm is higher than traditional single viewpoint rendering algorithm when the viewpoint number is larger. The CMVR algorithm is insensitive to the number of viewpoints, and is especially suitable for the rendering of high-density light field images. And the more viewpoints are rendered, the more obvious the efficiency improvement is. In addition, the algorithm can also be effectively compatible with texture mapping, lighting and other technologies in computer graphics to achieve realistic scene rendering. In order to verify the correctness of the algorithm, a light field display system is built. The display system is mainly composed of a light source, a high-resolution LCD display screen, a lens array and a diffuser screen. The 3D images of virtual scenes with good horizontal and vertical parallax are outputted by using the rendered light field images and display system. Vivid 3D imaging effects are obtained. The proposed algorithm can provide an effective tool for fast rendering of light field images. It can also be used in dynamic 3D display, augmented reality, virtual reality, and other fields.
引用
收藏
页数:10
相关论文
共 14 条
  • [1] Bishop G., 1986, Computer Graphics, V20, P103, DOI 10.1145/15886.15897
  • [2] EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION
    BOLLES, RC
    BAKER, HH
    MARIMONT, DH
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) : 7 - 55
  • [3] Parallel multi-view polygon rasterization for 3D light field display
    Guan, Yanxin
    Sang, Xinzhu
    Xing, Shujun
    Chen, Yingying
    Li, Yuanhang
    Chen, Duo
    Yu, Xunbo
    Yan, Binbin
    [J]. OPTICS EXPRESS, 2020, 28 (23) : 34406 - 34421
  • [4] Halle M., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P243, DOI 10.1145/280814.280884
  • [5] 3-D DISPLAY SYSTEM USING A COMPUTER GENERATED INTEGRAL PHOTOGRAPH
    IGARASHI, Y
    MURATA, H
    UEDA, M
    [J]. JAPANESE JOURNAL OF APPLIED PHYSICS, 1978, 17 (09) : 1683 - 1684
  • [6] [李勇 Li Yong], 2011, [光子学报, Acta Photonica Sinica], V40, P1706
  • [7] 3D integral imaging display by smart pseudoscopic-to-orthoscopic conversion (SPOC)
    Navarro, H.
    Martinez-Cuenca, R.
    Saavedra, G.
    Martinez-Corral, M.
    Javidi, B.
    [J]. OPTICS EXPRESS, 2010, 18 (25): : 25573 - 25583
  • [8] [桑新柱 Sang Xinzhu], 2017, [激光与光电子学进展, Laser & Optoelectronics Progress], V54, P050006
  • [9] Perspective on the development and application of light-field cameras in flow diagnostics
    Tan, Zu Puayen
    Thurow, Brian S.
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (10)
  • [10] High performance imaging using large camera arrays
    Wilburn, B
    Joshi, N
    Vaish, V
    Talvala, EV
    Antunez, E
    Barth, A
    Adams, A
    Horowitz, M
    Levoy, M
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 765 - 776