Worker Performance in a Situated Crowdsourcing Market

被引:2
|
作者
Goncalves, Jorge [1 ]
Hosio, Simo [1 ]
Liu, Yong [2 ]
Kostakos, Vassilis [1 ]
机构
[1] Univ Oulu, Dept Comp Sci & Engn, Pentti Kaiteran Katu 1,POB 4500, FI-90014 Oulu, Finland
[2] Aalto Univ, Sch Business, Runebergsgatan 14-16, FI-00100 Helsinki, Finland
基金
芬兰科学院;
关键词
user studies; touch screens; empirical studies in HCI; computer supported collaborative work; tablet computers; PAY; MOTIVATION;
D O I
10.1093/iwc/iwv035
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present an empirical study that investigates crowdsourcing performance in a situated market. Unlike online markets, situated crowdsourcing markets consist of workers who become serendipitously available for work in a particular location and context. So far, the literature has lacked a systematic study of task performance and uptake in such markets under varying incentives. In a 3-week field study, we demonstrate that in a situated crowdsourcing market, task uptake and accuracy are generally comparable with online markets. We also show that increasing task rewards in situated crowdsourcing leads to increased task uptake but not accuracy, while decreasing task rewards leads to decreases in both task uptake and accuracy.
引用
收藏
页码:612 / 624
页数:13
相关论文
共 50 条
  • [1] Crowdsourcing GO: Effect of Worker Situation on Mobile Crowdsourcing Performance
    Ikeda, Kazushi
    Hoashi, Keiichiro
    [J]. PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17), 2017, : 1142 - 1153
  • [2] Predicting Crowdsourcing Worker Performance with Knowledge Tracing
    Wang, Zizhe
    Sun, Hailong
    Han, Tao
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT II, 2020, 12275 : 352 - 359
  • [3] Mobile and situated crowdsourcing
    Gonsalves, Jorge
    Hosio, Simo
    Vukovic, Maja
    Konomi, ShinIchi
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2017, 102 : 1 - 3
  • [4] Facilitating Collocated Crowdsourcing on Situated Displays
    Hosio, Simo
    Goncalves, Jorge
    van Berkel, Niels
    Klakegg, Simon
    Konomi, Shin'Ichi
    Kostakos, Vassilis
    [J]. HUMAN-COMPUTER INTERACTION, 2018, 33 (5-6): : 335 - 371
  • [5] Independent Worker Selection In Crowdsourcing
    Li, Ang
    Jiang, Wenjun
    Li, Xueqi
    Chen, Xinrong
    Wang, Guojun
    [J]. 2020 IEEE 19TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2020), 2020, : 1174 - 1179
  • [6] Preserving worker privacy in crowdsourcing
    Hiroshi Kajino
    Hiromi Arai
    Hisashi Kashima
    [J]. Data Mining and Knowledge Discovery, 2014, 28 : 1314 - 1335
  • [7] Preserving worker privacy in crowdsourcing
    Kajino, Hiroshi
    Arai, Hiromi
    Kashima, Hisashi
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 28 (5-6) : 1314 - 1335
  • [8] Crowdsourcing for Situated Dialog Systems in a Moving Car
    Misu, Teruhisa
    [J]. 15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4, 2014, : 125 - 129
  • [9] Crowdsourcing Situated & Subjective Knowledge for Decision Support
    Hosio, Simo
    Goncalves, Jorge
    van Berkel, Niels
    Klakegg, Simon
    [J]. UBICOMP'16 ADJUNCT: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, : 1478 - 1483
  • [10] Situated and Ubiquitous Crowdsourcing with Volunteers during Disasters
    Ludwig, Thomas
    Kotthaus, Christoph
    Pipek, Volkmar
    [J]. UBICOMP'16 ADJUNCT: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, : 1441 - 1447