Identification and classification of construction equipment operators' mental fatigue using wearable eye-tracking technology

被引:104
|
作者
Li, Jue [1 ,2 ]
Li, Heng [2 ]
Umer, Waleed [3 ]
Wang, Hongwei [4 ]
Xing, Xuejiao [2 ,5 ]
Zhao, Shukai [6 ]
Hou, Jun [7 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan, Hubei, Peoples R China
[2] Hong Kong Polytech Univ, Dept Bldg & Real Estate, Hung Hom, Kowloon, Hong Kong, Peoples R China
[3] King Fahd Univ Petr & Minerals, Construct Engn & Management, Dhahran, Saudi Arabia
[4] Huazhong Univ Sci & Technol, Sch Management, Wuhan, Hubei, Peoples R China
[5] Huazhong Univ Sci & Technol, Sch Civil Engn & Mech, Wuhan, Hubei, Peoples R China
[6] Shenzhen Hailong Construct Technol Co Ltd, Shenzhen, Guangdong, Peoples R China
[7] Chongqing China State Hailong Liangjiang Construc, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Mental fatigue identification and classification; Construction equipment operator; Eye-tracking; Machine learning; Toeplitz Inverse Covariance-Based Clustering; ATTENTION; RISK; RECOGNITION; VALIDATION; MANAGEMENT; SLEEPINESS; SIGNALS; STRESS; SYSTEM; SAFETY;
D O I
10.1016/j.autcon.2019.103000
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In the construction industry, the operator's mental fatigue is one of the most important causes of construction equipment-related accidents. Mental fatigue can easily lead to poor performance of construction equipment operations and accidents in the worst case scenario. Hence, it is necessary to propose an objective method that can accurately detect multiple levels of mental fatigue of construction equipment operators. To address such issue, this paper develops a novel method to identify and classify operator's multi-level mental fatigue using wearable eye-tracking technology. For the purpose, six participants were recruited to perform a simulated excavator operation experiment to obtain relevant data. First, a Toeplitz Inverse Covariance-Based Clustering (TICC) method was used to determine the number of levels of mental fatigue using relevant subjective and objective data collected during the experiments. The results revealed the number of mental fatigue levels to be 3 using TICC-based method. Second, four eye movement feature-sets suitable for different construction scenarios were extracted and supervised learning algorithms were used to classify multi-level mental fatigue of the operator. The classification performance analysis of the supervised learning algorithms showed Support Vector Machine (SVM) was the most suitable algorithm to classify mental fatigue in the face of various construction scenarios and subject bias (accuracy between 79.5% and 85.0%). Overall, this study demonstrates the feasibility of applying wearable eye-tracking technology to identify and classify the mental fatigue of construction equipment operators.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [1] Evaluating the impact of mental fatigue on construction equipment operators' ability to detect hazards using wearable eye-tracking technology
    Li, Jue
    Li, Heng
    Wang, Hongwei
    Umer, Waleed
    Fu, Hong
    Xing, Xuejiao
    AUTOMATION IN CONSTRUCTION, 2019, 105
  • [2] Deep learning-based construction equipment operators' mental fatigue classification using wearable EEG sensor data
    Mehmood, Imran
    Li, Heng
    Qarout, Yazan
    Umer, Waleed
    Anwer, Shahnawaz
    Wu, Haitao
    Hussain, Mudasir
    Antwi-Afari, Maxwell Fordjour
    ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [3] Eye-Tracking in Assessment of the Mental Workload of Harvester Operators
    Naskrent, Bartlomiej
    Grzywinski, Witold
    Polowy, Krzysztof
    Tomczak, Arkadiusz
    Jelonek, Tomasz
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (09)
  • [4] Detecting Eye Contact using Wearable Eye-Tracking Glasses
    Ye, Zhefan
    Li, Yin
    Fathi, Alireza
    Han, Yi
    Rozga, Agata
    Abowd, Gregory D.
    Rehg, James M.
    UBICOMP'12: PROCEEDINGS OF THE 2012 ACM INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING, 2012, : 699 - 704
  • [5] Influence of visual environments on struck-by hazards for construction equipment operators through virtual eye-tracking
    Hong, Juwon
    Song, Sangkil
    Kang, Hyuna
    Choi, Jinwoo
    Hong, Taehoon
    Lee, Dong-Eun
    Automation in Construction, 2024, 161
  • [6] Influence of visual environments on struck-by hazards for construction equipment operators through virtual eye-tracking
    Hong, Juwon
    Song, Sangkil
    Kang, Hyuna
    Choi, Jinwoo
    Hong, Taehoon
    Lee, Dong-Eun
    AUTOMATION IN CONSTRUCTION, 2024, 161
  • [7] APPLICATION OF EYE-TRACKING TECHNOLOGY AS A DIAGNOSTIC TOOL FOR ASSESSING FLIGHT OPERATORS. PART 1: ANALISE OF FLIGHT OPERATORS' ATTENTION DISTRIBUTION AND SWITCHING USING EYE-TRACKING
    Arinicheva, Olga
    Lebedeva, Natalia
    Malishevskii, Aleksei
    TRANSPORT PROBLEMS, 2020, 15 (03) : 167 - 179
  • [8] Using eye-tracking technology to identify learning styles: Behaviour patterns and identification accuracy
    Luo, Zhanni
    EDUCATION AND INFORMATION TECHNOLOGIES, 2021, 26 (04) : 4457 - 4485
  • [9] Using eye-tracking technology to identify learning styles: Behaviour patterns and identification accuracy
    Zhanni Luo
    Education and Information Technologies, 2021, 26 : 4457 - 4485
  • [10] Using Eye-tracking to investigate the different 3D representation on students' mental model construction
    Chen, Sheng-Chang
    She, Hsiao-Ching
    Hsiao, Mi-Shan
    15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT 2015), 2015, : 388 - 390