Accelerating Human-in-the-loop Machine Learning: Challenges and Opportunities

被引：54

作者：

Xin, Doris ^{[1
]}

Ma, Litian ^{[1
]}

Liu, Jialin ^{[1
]}

Macke, Stephen ^{[1
]}

Song, Shuchen ^{[1
]}

Parameswaran, Aditya ^{[1
]}

机构：

[1] Univ Illinois Urbana Champaign UIUC, Champaign, IL 61820 USA

来源：

PROCEEDINGS OF THE SECOND WORKSHOP ON DATA MANAGEMENT FOR END-TO-END MACHINE LEARNING | 2018年

基金：

美国国家科学基金会;

关键词：

D O I：

10.1145/3209889.3209897

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Development of machine learning (ML) workflows is a tedious process of iterative experimentation: developers repeatedly make changes to workflows until the desired accuracy is attained. We describe our vision for a "human-in-the-loop" ML system that accelerates this process: by intelligently tracking changes and intermediate results over time, such a system can enable rapid iteration, quick responsive feedback, introspection and debugging, and background execution and automation. We finally describe Helix, our preliminary attempt at such a system that has already led to speedups of upto 10x on typical iterative workflows against competing systems.

引用

页数：4

共 50 条

[31] Human-in-the-Loop Learning for Dynamic Congestion Games
Li, Hongbo
Duan, Lingjie
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 11159 - 11171
[32] Information Filtering Method for Twitter Streaming Data Using Human-in-the-Loop Machine Learning
Suzuki, Yu
Nakamura, Satoshi
DATABASE AND EXPERT SYSTEMS APPLICATIONS (DEXA 2018), PT II, 2018, 11030 : 167 - 175
[33] Active Learning for Human-in-the-Loop Customs Inspection
Kim, Sundong
Mai, Tung-Duong
Han, Sungwon
Park, Sungwon
Nguyen, D. K. Thi
So, Jaechan
Singh, Karandeep
Cha, Meeyoung
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12039 - 12052
[34] Computational human performance modelling for human-in-the-Loop machine systems
Kolivand, Hoshang
Balas, Valentina E.
Paul, Anand
Ramachandran, Varatharajan
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (04) : 5350 - 5358
[35] Human-in-the-loop Reinforcement Learning for Emotion Recognition
Tan, Swee Yang
Yau, Kok-Lim Alvin
2024 IEEE 14TH SYMPOSIUM ON COMPUTER APPLICATIONS & INDUSTRIAL ELECTRONICS, ISCAIE 2024, 2024, : 21 - 26
[36] Human-in-the-Loop Low-Shot Learning
Wan, Sen
Hou, Yimin
Bao, Feng
Ren, Zhiquan
Dong, Yunfeng
Dai, Qionghai
Deng, Yue
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (07) : 3287 - 3292
[37] Towards the Safety of Human-in-the-Loop Robotics: Challenges and Opportunities for Safety Assurance of Robotic Co-Workers
Eder, Kerstin
Harper, Chris
Leonards, Ute
2014 23RD IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN), 2014, : 660 - 665
[38] Human-in-the-Loop Wireless Communications: Machine Learning and Brain-Aware Resource Management
Kasgari, Ali Taleb Zadeh
Saad, Walid
Debbah, Merouane
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (11) : 7727 - 7743
[39] Human-in-the-Loop Machine Learning to Increase Video Accessibility for Visually Impaired and Blind Users
Yuksel, Beste F.
Fazli, Pooyan
Mathur, Umang
Bisht, Vaishali
Kim, Soo Jung
Lee, Joshua Junhee
Jin, Seung Jung
Siu, Yue-Ting
Miele, Joshua A.
Yoon, Ilmi
PROCEEDINGS OF THE 2020 ACM DESIGNING INTERACTIVE SYSTEMS CONFERENCE (DIS 2020), 2020, : 47 - 60
[40] Addressing the data bottleneck in medical deep learning models using a human-in-the-loop machine learning approach
Mosqueira-Rey, Eduardo
Hernandez-Pereira, Elena
Bobes-Bascaran, Jose
Alonso-Rios, David
Perez-Sanchez, Alberto
Fernandez-Leal, Angel
Moret-Bonillo, Vicente
Vidal-Insua, Yolanda
Vazquez-Rivera, Francisca
NEURAL COMPUTING & APPLICATIONS, 2024, 36 (05): : 2597 - 2616

← 1 2 3 4 5 →