Turing learning: a metric-free approach to inferring behavior and its application to swarms

被引:21
|
作者
Li, Wei [1 ]
Gauci, Melvin [2 ]
Gross, Roderich [1 ]
机构
[1] Univ Sheffield, Dept Automat Control & Syst Engn, Mappin St, Sheffield S1 3JD, S Yorkshire, England
[2] Harvard Univ, Wyss Inst Biol Inspired Engn, 3 Blackfan Cir, Boston, MA 02115 USA
基金
英国工程与自然科学研究理事会;
关键词
System identification; Turing test; Collective behavior; Swarm robotics; Coevolution; Machine learning; REALITY GAP; COEVOLUTION; ROBOTS; EVOLUTION; MODELS;
D O I
10.1007/s11721-016-0126-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose Turing Learning, a novel system identification method for inferring the behavior of natural or artificial systems. Turing Learning simultaneously optimizes two populations of computer programs, one representing models of the behavior of the system under investigation, and the other representing classifiers. By observing the behavior of the system as well as the behaviors produced by the models, two sets of data samples are obtained. The classifiers are rewarded for discriminating between these two sets, that is, for correctly categorizing data samples as either genuine or counterfeit. Conversely, the models are rewarded for 'tricking' the classifiers into categorizing their data samples as genuine. Unlike other methods for system identification, Turing Learning does not require predefined metrics to quantify the difference between the system and its models. We present two case studies with swarms of simulated robots and prove that the underlying behaviors cannot be inferred by a metric-based system identification method. By contrast, Turing Learning infers the behaviors with high accuracy. It also produces a useful by-product-the classifiers-that can be used to detect abnormal behavior in the swarm. Moreover, we show that Turing Learning also successfully infers the behavior of physical robot swarms. The results show that collective behaviors can be directly inferred from motion trajectories of individuals in the swarm, which may have significant implications for the study of animal collectives. Furthermore, Turing Learning could prove useful whenever a behavior is not easily characterizable using metrics, making it suitable for a wide range of applications.
引用
收藏
页码:211 / 243
页数:33
相关论文
共 50 条
  • [21] Incremental class learning approach and its application to handwritten digit recognition
    Mandziuk, J
    Shastri, L
    INFORMATION SCIENCES, 2002, 141 (3-4) : 193 - 217
  • [22] Incremental Class Learning approach and its application to Handwritten Digit Recognition
    Mandziuk, J
    Shastri, L
    ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3, 1998, : 203 - 206
  • [23] HIDDEN MARKOV MODEL APPROACH TO SKILL LEARNING AND ITS APPLICATION TO TELEROBOTICS
    YANG, J
    XU, YS
    CHEN, CS
    IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1994, 10 (05): : 621 - 631
  • [24] A learning approach to precision speed control of servomotors and its application to a VCR
    Kim, YH
    Ha, IJ
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 1999, 7 (04) : 466 - 477
  • [25] CMAC STRUCTURE OPTIMIZATION WITH Q-LEARNING APPROACH AND ITS APPLICATION
    Yu, Weiwei
    Madani, Kurosh
    Sabourin, Christophe
    NCTA 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON NEURAL COMPUTATION THEORY AND APPLICATIONS, 2011, : 283 - 288
  • [26] A new fluid factor and its application using a deep learning approach
    Liu, Changcheng
    Ghosh, Deva Prasad
    Salim, Ahmed Mohamed Ahmed
    Chow, Weng Sum
    GEOPHYSICAL PROSPECTING, 2019, 67 (01) : 140 - 149
  • [27] A REINFORCEMENT LEARNING APPROACH FOR OPTIMIZATION OF CHEMOTHERAPY AND ITS APPLICATION IN OPTIMAL CONTROL
    Pakdel, A. Fani
    Rezazadeh, M.
    Sustany, M. Naghiby
    ANNALS OF ONCOLOGY, 2012, 23 : 459 - 459
  • [28] A Boosting Framework for Visuality-Preserving Distance Metric Learning and Its Application to Medical Image Retrieval
    Yang, Liu
    Jin, Rong
    Mummert, Lily
    Sukthankar, Rahul
    Goode, Adam
    Zheng, Bin
    Hoi, Steven C. H.
    Satyanarayanan, Mahadev
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) : 30 - 44
  • [29] Couple Metric Learning Based on Separable Criteria with Its Application in Cross-View Gait Recognition
    Wang, Kejun
    Xing, Xianglei
    Yan, Tao
    Lv, Zhuowen
    BIOMETRIC RECOGNITION (CCBR 2014), 2014, 8833 : 347 - 356
  • [30] Behavior recognition with ground reaction force estimation and its application to imitation learning
    Ariki, Yuka
    Morimoto, Jun
    Hyon, Sang-Ho
    2008 IEEE/RSJ INTERNATIONAL CONFERENCE ON ROBOTS AND INTELLIGENT SYSTEMS, VOLS 1-3, CONFERENCE PROCEEDINGS, 2008, : 2029 - +