An EEG-Based Mental Workload Evaluation for AR Head-Mounted Display Use in Construction Assembly Tasks

被引:5
|
作者
Qin, Yimin [1 ]
Bulbul, Tanyel [2 ]
机构
[1] VirginiaTech, Myers Lawson Sch Construct, Bishop Favrao Hall,1345 Perry St, Blacksburg, VA 24061 USA
[2] VirginiaTech, Myers Lawson Sch Construct, 410A Bishop Favrao Hall, 1345 Perry St, Blacksburg, VA 24061 USA
关键词
Augmented reality (AR); Electroencephalogram (EEG); Mental workload; Wood frame assembly; AUGMENTED REALITY; SAFETY; ISSUES;
D O I
10.1061/JCEMD4.COENG-13438
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Augmented reality (AR) has become one of the most pervasive technologies for immersive applications with potential to improve worker performance in construction. However, the cognitive impact of using AR is still being studied and a comprehensive assessment of changes on user's cognitive status is needed. This study proposed an electroencephalogram (EEG)-based mental workload evaluation method for a wood frame assembly, comparing the differences between two information display types (conformal model and paper layout). Additionally, a task performance analysis was conducted for completion rate and accuracy. The experiment recruited thirty construction students with similar backgrounds who were novice AR users. The findings indicated that AR improved the assembling efficiency with significantly higher completion (p<0.001) in comparison to the paper display. Furthermore, both mean and maximum values during the task process were analyzed to compare the difference between the displays, where AR display generated significantly less mental work in mean (p=0.007) and maximal (p=0.030) values. The comparison of the changing trends of mental workload increment in assembly revealed that AR display maintained lower mental workload and smaller fluctuation (standard deviation) during the entire assembly. The outcomes examined the usability of AR head-mounted display (HMD) in the construction assembly task with a moment-to-moment physiological evaluation of user's mental workload. This work shows that EEG-based mental workload evaluation can be used as an effective method for revealing changes in workers' mental status in real time during assembly, which has implications for future research in areas such as hazard recognition and situational awareness evaluation.
引用
收藏
页数:13
相关论文
共 23 条
  • [1] Evaluating the training transfer of Head-Mounted Display based training for assembly tasks
    Werrlich, Stefan
    Phuc-Anh Nguyen
    Notni, Gunther
    [J]. 11TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2018), 2018, : 297 - 302
  • [2] Evaluation of physical workload affected by mass and center of mass of head-mounted display
    Chihara, Takanori
    Seo, Akihiko
    [J]. APPLIED ERGONOMICS, 2018, 68 : 204 - 212
  • [3] Towards an EEG Based Mental Workload Evaluation Method for Construction Workers' HMD AR Use
    Qin, Yimin
    Bulbul, Tanyel
    [J]. CONSTRUCTION RESEARCH CONGRESS 2020: COMPUTER APPLICATIONS, 2020, : 659 - 667
  • [4] VR/AR Head-mounted Display System-based Measurement and Evaluation of Dynamic Visual Acuity
    Jung-Ho, Kim
    Ho-Jun, Son
    Seung-Hyun, Lee
    Soon-Chul, Kwon
    [J]. JOURNAL OF EYE MOVEMENT RESEARCH, 2019, 12 (08):
  • [5] Electroencephalogram-based mental workload prediction for using Augmented Reality head mounted display in construction assembly: A deep learning approach
    Qin, Yimin
    Bulbul, Tanyel
    [J]. AUTOMATION IN CONSTRUCTION, 2023, 152
  • [6] Towards EEG-Based Eye-Tracking for Interaction Design in Head-Mounted Devices
    Dietrich, Marc Philipp
    Winterfeldt, Gotz
    von Mammen, Sebastian
    [J]. 2017 IEEE 7TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - BERLIN (ICCE-BERLIN), 2017, : 227 - 232
  • [7] Validity of primary driving tasks in head-mounted display-based driving simulators
    Hartfiel, Bert
    Stark, Rainer
    [J]. VIRTUAL REALITY, 2021, 25 (03) : 819 - 833
  • [8] Validity of primary driving tasks in head-mounted display-based driving simulators
    Bert Hartfiel
    Rainer Stark
    [J]. Virtual Reality, 2021, 25 : 819 - 833
  • [9] Do Head-Mounted Display Stereo Deficiencies Affect 3D Pointing Tasks in AR and VR?
    Batmaz, Anil Ufuk
    Machuca, Mayra Donaji Barrera
    Duc Minh Pham
    Stuerzlinger, Wolfgang
    [J]. 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 585 - 592
  • [10] Reliability over time of EEG-based mental workload evaluation during Air Traffic Management (ATM) tasks
    Arico, Pietro
    Borghini, Gianluca
    Di Flumeri, Gianluca
    Colosimo, Alfredo
    Graziani, Ilenia
    Imbert, Jean-Paul
    Granger, Geraud
    Benhacene, Railene
    Terenzi, Michela
    Pozzi, Simone
    Babiloni, Fabio
    [J]. 2015 37TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2015, : 7242 - 7245