Spontaneous talking gestures using Generative Adversarial Networks

被引：13
|
作者：
Rodriguez, Igor [1 ]
Maria Martinez-Otzeta, Jose [1 ]
Irigoien, Itziar [1 ]
Lazkano, Elena [1 ]
机构：
[1] Univ Basque Country, Fac Informat, Comp Sci & Artificial Intelligence, Manuel Lardizabal 1, Donostia San Sebastian 20018, Spain
来源：
ROBOTICS AND AUTONOMOUS SYSTEMS | 2019年 / 114卷
关键词：
Social robotics; Generative learning models; Motion generation; Principal coordinate analysis; Body language expression; Generative adversarial networks;
D O I：
10.1016/j.robot.2018.11.024
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
This paper presents a talking gesture generation system based on Generative Adversarial Networks, along with an evaluation of its adequateness. The talking gesture generation system produces a sequence of joint positions of the robot's upper body which keeps in step with an uttered sentence. The suitability of the approach is demonstrated with a real robot. Besides, the motion generation method is compared with other (non-deep) generative approaches. A two-step comparison is made. On the one hand, a statistical analysis is performed over movements generated by each approach by means of Principal Coordinate Analysis. On the other hand, the robot motion adequateness is measured by calculating the end effectors' jerk, path lengths and 3D space coverage. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码：57 / 65
页数：9
相关论文
共 50 条
  • [1] Phylogenetic inference using generative adversarial networks
    Smith, Megan L.
    Hahn, Matthew W.
    BIOINFORMATICS, 2023, 39 (09)
  • [2] Handwriting Profiling Using Generative Adversarial Networks
    Ghosh, Arna
    Bhattacharya, Biswarup
    Chowdhury, Somnath Basu Roy
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4927 - 4928
  • [3] VOICE IMPERSONATION USING GENERATIVE ADVERSARIAL NETWORKS
    Gao, Yang
    Singh, Rita
    Raj, Bhiksha
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2506 - 2510
  • [4] Image Inpainting Using Generative Adversarial Networks
    Luo H.-L.
    Ao Y.
    Yuan P.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (10): : 1891 - 1898
  • [5] Speaker anonymization using generative adversarial networks
    Jafari, Aya
    Al-Mousa, Amjed
    Jafar, Iyad
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (02) : 3345 - 3359
  • [6] Generative Adversarial Networks Using Adaptive Convolution
    Nguyen, Nhat M.
    Ray, Nilanjan
    2019 16TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2019), 2019, : 129 - 134
  • [7] Virtual sawing using generative adversarial networks
    Batrakhanov, Daniel
    Zolotarev, Fedor
    Eerola, Tuomas
    Lensu, Lasse
    Kalviainen, Heikki
    PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [8] Face Aging using Generative Adversarial Networks
    Hao, Junru
    Li, Dongyu
    Yan, Hongyu
    2021 2ND INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2021), 2021, : 460 - 466
  • [9] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [10] Speech-Driven Expressive Talking Lips with Conditional Sequential Generative Adversarial Networks
    Sadoughi, Najmeh
    Busso, Carlos
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (04) : 1031 - 1044
12345