Identification and classification of construction equipment operators' mental fatigue using wearable eye-tracking technology

被引:104
|
作者
Li, Jue [1 ,2 ]
Li, Heng [2 ]
Umer, Waleed [3 ]
Wang, Hongwei [4 ]
Xing, Xuejiao [2 ,5 ]
Zhao, Shukai [6 ]
Hou, Jun [7 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan, Hubei, Peoples R China
[2] Hong Kong Polytech Univ, Dept Bldg & Real Estate, Hung Hom, Kowloon, Hong Kong, Peoples R China
[3] King Fahd Univ Petr & Minerals, Construct Engn & Management, Dhahran, Saudi Arabia
[4] Huazhong Univ Sci & Technol, Sch Management, Wuhan, Hubei, Peoples R China
[5] Huazhong Univ Sci & Technol, Sch Civil Engn & Mech, Wuhan, Hubei, Peoples R China
[6] Shenzhen Hailong Construct Technol Co Ltd, Shenzhen, Guangdong, Peoples R China
[7] Chongqing China State Hailong Liangjiang Construc, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Mental fatigue identification and classification; Construction equipment operator; Eye-tracking; Machine learning; Toeplitz Inverse Covariance-Based Clustering; ATTENTION; RISK; RECOGNITION; VALIDATION; MANAGEMENT; SLEEPINESS; SIGNALS; STRESS; SYSTEM; SAFETY;
D O I
10.1016/j.autcon.2019.103000
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In the construction industry, the operator's mental fatigue is one of the most important causes of construction equipment-related accidents. Mental fatigue can easily lead to poor performance of construction equipment operations and accidents in the worst case scenario. Hence, it is necessary to propose an objective method that can accurately detect multiple levels of mental fatigue of construction equipment operators. To address such issue, this paper develops a novel method to identify and classify operator's multi-level mental fatigue using wearable eye-tracking technology. For the purpose, six participants were recruited to perform a simulated excavator operation experiment to obtain relevant data. First, a Toeplitz Inverse Covariance-Based Clustering (TICC) method was used to determine the number of levels of mental fatigue using relevant subjective and objective data collected during the experiments. The results revealed the number of mental fatigue levels to be 3 using TICC-based method. Second, four eye movement feature-sets suitable for different construction scenarios were extracted and supervised learning algorithms were used to classify multi-level mental fatigue of the operator. The classification performance analysis of the supervised learning algorithms showed Support Vector Machine (SVM) was the most suitable algorithm to classify mental fatigue in the face of various construction scenarios and subject bias (accuracy between 79.5% and 85.0%). Overall, this study demonstrates the feasibility of applying wearable eye-tracking technology to identify and classify the mental fatigue of construction equipment operators.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [21] An Eye Movement Study on Scientific Papers Using Wearable Eye Tracking Technology
    Chanijani, Seyyed Saleh Mozaffari
    Al-Naser, Mohammad
    Bukhari, Syed Saqib
    Borth, Damian
    Allen, Shanley E. M.
    Dengel, Andreas
    2016 NINTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU), 2016, : 19 - 24
  • [22] Assessing illumination fatigue in tunnel workers through eye-tracking technology: A laboratory study
    Li, Jing
    Zhu, Jingzheng
    Guan, Cheng
    ADVANCED ENGINEERING INFORMATICS, 2024, 59
  • [23] Development of a New Eye Movement Measurement Device Using Eye-Tracking Analysis Technology
    Tatara, Shunya
    Toda, Haruo
    Maeda, Fumiatsu
    Handa, Tomoya
    APPLIED SCIENCES-BASEL, 2023, 13 (10):
  • [24] Mental Fatigue Monitoring Using a Wearable Transparent Eye Detection System
    Sampei, Kota
    Ogawa, Miho
    Torres, Carlos Cesar Cortes
    Sato, Munehiko
    Miki, Norihisa
    MICROMACHINES, 2016, 7 (02):
  • [25] Assessing the feasibility of using eye-tracking technology for assessment of external HMI
    Lehet, David
    Novotny, Jan
    2022 SMART CITIES SYMPOSIUM PRAGUE (SCSP), 2022,
  • [26] The study of ethno-cultural identity using eye-tracking technology
    Kovalev, Artem T.
    Menshikova, Galina Ya
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2016, 51 : 329 - 329
  • [27] Exploring visual attention to erotic stimuli using eye-tracking technology
    Lykins, Amy
    Meana, Marta
    PSYCHOPHYSIOLOGY, 2008, 45 : S3 - S3
  • [28] Quantifying the qualities of aesthetics in product design using eye-tracking technology
    Khalighy, Shahabeddin
    Green, Graham
    Scheepers, Christoph
    Whittet, Craig
    INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2015, 49 : 31 - 43
  • [29] Understanding Human Behaviour in Flight Operation Using Eye-Tracking Technology
    Korek, Wojciech Tomasz
    Mendez, Arthur
    Asad, Hafiz Ul
    Li, Wen-Chin
    Lone, Mudassir
    ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS. COGNITION AND DESIGN, EPCE 2020, PT II, 2020, 12187 : 304 - 320
  • [30] Measuring Outcomes of Mohs Defect Reconstruction Using Eye-Tracking Technology
    Dey, Jacob K.
    Ishii, Lisa E.
    Boahene, Kofi D. O.
    Byrne, Patrick J.
    Ishii, Masaru
    JAMA FACIAL PLASTIC SURGERY, 2019, 21 (06) : 518 - 525