Research Progress of Vergence-Accommodation Conflict in Near-Eye Display Based on Augmented Reality

被引:2
|
作者
Wang Shulong [1 ]
Lin Zijian [2 ]
Xu Shixiang [1 ]
Wang Yu [3 ]
Yang Kun [3 ]
Huang Yidan [2 ]
Chen Enguo [2 ]
机构
[1] Shenzhen Univ, Coll Phys & Optoelect Engn, Shenzhen 518060, Guangdong, Peoples R China
[2] Fuzhou Univ, Natl & Local United Engn Lab Flat Panel Display T, Coll Phys & Informat Engn, Fuzhou 350108, Fujian, Peoples R China
[3] Nanyang Lida Opt Elect Co Ltd, Nanyang 473003, Henan, Peoples R China
关键词
near-eye display; augmented reality; vergence-accommodation conflict; depth information; WAVE-GUIDE DISPLAY; 3-DIMENSIONAL DISPLAY; ILLUMINATION SYSTEM; FREEFORM LENSES; VIRTUAL-REALITY; FRONT CONTROL; DESIGN; VIEW; MODULATION; DEPTH;
D O I
10.3788/AOS231074
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Significance As the entrance technology of metaverse, augmented reality (AR) is highly likely to become the next generation computing platform. Near-eye display is the core foundation for the development and application of AR technology and is the direct medium for people to receive virtual information and combine reality. Near-eye display optical systems are the core component of AR, and the maturity of the display module is part of AR technology popularization. The vergence-accommodation conflict (VAC) of near-eye display systems is a key challenge restricting the large-scale AR application. Human beings obtain 80% of external information by human eye vision. To obtain the 3D display effect, near-eye display optical systems will simulate the real scenes through both eyes, displaying the independent pictures of the two eyes with certain parallax to make the brain perceive the 3D display effect. Meanwhile, the eye lens is always focused on the virtual image plane of the micro-display of the optical system, which indicates the fixed eye accommodation distance. Due to the setting of the left and right eye images with parallax, the brain will perceive the distance of the 3D image objects, and then the convergence distance of human eyes will change with the built-in image source. As a result, a mismatch is caused between the convergence distance and the accommodation distance, which is a VAC problem. When the user is in this state for a long time, visual fatigue, dizziness, and vomiting will occur. The VAC problem in the near-eye display optical system causes the display scene to deviate from people's perception in the real world, which brings bad user experience and is a major challenge to be solved for the long-term utilization and popularization of AR devices. Progress VAC is an insurmountable technical challenge in the development of AR display technology. We classify its solutions to provide references for selecting solutions suitable for different technical development needs, and review current VAC solutions, classifying them as solutions without depth information, with partial depth information, and with complete depth information (Fig. 2). In the VAC solutions without depth information, we mainly introduce Maxwellian display technology, which takes the image as a single point beam through the eye lens photocentric position and subsequently images it directly onto the retina. Thus, the limitation that the eye lens must be forced to focus can be addressed, which means the human eye lens can observe the image in different diopter states and the VAC problem can be overcome. Lin et al. implemented a MEMS-based Maxwellian display system to achieve a 33 degrees x 22 degrees display field of view with an exit pupil distance of 10 mm, converging the imaging beam into a 5 mu m spot with the best imaging quality when the spot is at the photocentric position of the human eyes. The Maxwellian technique requires the converging light to form a beam point that matches the pupil position, resulting in the natural limitation and drawback of this solution in the exit pupil range and needs to be matched with a corresponding pupil extension technique. In the VAC solutions with partial depth information, we mainly introduce multi-focal plane display technology (physical multi-focal plane and virtual multi-focal plane) and adjustable focus display technology. Cheng et al. equipped two microdisplays to implement a two-focal plane AR near-eye display module by spatial multiplexing [Fig. 6(c)]. The display solution achieves a 40 degrees display field of view, an exit pupil distance of 20 mm, and an eyebox aperture of 6 mm, enabling two different focal planes at 1.25 m and 5 m distances. In the VAC solutions with complete depth information, we introduce integrated imaging and computational holography solution. Hua et al. employed an integrated imaging unit as a stereo microdisplay image source combined with a free-form prism to form an AR near-eye display module with depth information, achieving a 33.4 degrees display field of view, an exit pupil distance of 19 mm, and an eyebox aperture of 6.5 mm [Fig. 9(a)]. Zhang et al. achieved complex amplitude wavefront reconstruction of image information by cascading amplitude holograms to provide complete depth information for AR near-eye display. Finally, the undesirable effects of VAC are eliminated to achieve a 4.8 degrees display field of view (9.4x secondary magnification) with an exit pupil distance of 10 mm. Conclusions and Prospects We present a systematic review of VAC solutions in AR near-eye display optical systems. Meanwhile, the focus is on the basic principles of the VAC problem and the technical features, implementation methods, and representative literature of current near-eye display optical solutions. The VAC problem is contrary to the physiological characteristics of human eyes in daily observation and is an inevitable difficulty for AR to enhance viewing comfort. In current VAC solutions, Maxwellian near-eye display, variable focus, and multi-focal plane near-eye display solutions have relative advantages in design and image quality.
引用
收藏
页数:19
相关论文
共 171 条
  • [1] Creating the Future: Augmented Reality, the next Human-Machine Interface
    Abrash, Michael
    [J]. 2021 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2021,
  • [2] A Compact Retinal Scan Near-Eye Display
    Akutsu, Katsuyuki
    Seino, Susumu
    Ogawa, Yusuke
    Ohki, Kenji
    Takahashi, Atsushi
    Ueda, Daisuke
    Ogawa, Ryo
    Imamura, Teppei
    Yoshikaie, Akira
    [J]. ACM SIGGRAPH 2019 EMERGING TECHNOLOGIES (SIGGRAPH '19), 2019,
  • [3] WAVE-FRONT CONTROL USING LIQUID-CRYSTAL DEVICES
    AMAKO, J
    MIURA, H
    SONEHARA, T
    [J]. APPLIED OPTICS, 1993, 32 (23): : 4323 - 4329
  • [4] Head Mounted Display using holographic optical element
    Ando, T
    Yamasaki, K
    Okamoto, M
    Shimizu, E
    [J]. PRACTICAL HOLOGRAPHY XII, 1998, 3293 : 183 - 189
  • [5] [Anonymous], 2023, Himax
  • [6] [Anonymous], 2023, Microsoft HoloLens[
  • [7] [Anonymous], 2023, Sonysemicon
  • [8] [Anonymous], 2023, JBD
  • [9] [Anonymous], 2023, Celluon
  • [10] [Anonymous], 2023, Tianma