Spontaneous talking gestures using Generative Adversarial Networks

被引：13

作者：

Rodriguez, Igor ^{[1
]}

Maria Martinez-Otzeta, Jose ^{[1
]}

Irigoien, Itziar ^{[1
]}

Lazkano, Elena ^{[1
]}

机构：

[1] Univ Basque Country, Fac Informat, Comp Sci & Artificial Intelligence, Manuel Lardizabal 1, Donostia San Sebastian 20018, Spain

来源：

ROBOTICS AND AUTONOMOUS SYSTEMS | 2019年 / 114卷

关键词：

Social robotics; Generative learning models; Motion generation; Principal coordinate analysis; Body language expression; Generative adversarial networks;

D O I：

10.1016/j.robot.2018.11.024

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper presents a talking gesture generation system based on Generative Adversarial Networks, along with an evaluation of its adequateness. The talking gesture generation system produces a sequence of joint positions of the robot's upper body which keeps in step with an uttered sentence. The suitability of the approach is demonstrated with a real robot. Besides, the motion generation method is compared with other (non-deep) generative approaches. A two-step comparison is made. On the one hand, a statistical analysis is performed over movements generated by each approach by means of Principal Coordinate Analysis. On the other hand, the robot motion adequateness is measured by calculating the end effectors' jerk, path lengths and 3D space coverage. (C) 2019 Elsevier B.V. All rights reserved.

引用

页码：57 / 65

页数：9

共 50 条

[41] Smart Monitoring of Crops Using Generative Adversarial Networks
Kerdegari, Hamideh
Razaak, Manzoor
Argyriou, Vasileios
Remagnino, Paolo
COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2019, PT I, 2019, 11678 : 554 - 563
[42] Radar Waveform Synthesis Using Generative Adversarial Networks
Saarinen, Vesa
Koivunen, Visa
2020 IEEE RADAR CONFERENCE (RADARCONF20), 2020,
[43] Spectral Image Visualization Using Generative Adversarial Networks
Chen, Siyu
Liao, Danping
Qian, Yuntao
PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 388 - 401
[44] NEURAL AUDIO DECORRELATION USING GENERATIVE ADVERSARIAL NETWORKS
Anemuller, Carlotta
Thiergart, Oliver
Habets, Emanuel A. P.
2023 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS, WASPAA, 2023,
[45] A survey on text generation using generative adversarial networks
de Rosa, Gustavo H.
Papa, Joao P.
PATTERN RECOGNITION, 2021, 119
[46] Text to Image Translation using Generative Adversarial Networks
Viswanathan, Adithya
Mehta, Bhavin
Bhavatarini, M. P.
Mamatha, H. R.
2018 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2018, : 1468 - 1474
[47] Staff line Removal using Generative Adversarial Networks
Konwer, Aishik
Bhunia, Ayan Kumar
Bhowmick, Abir
Bhunia, Ankan Kumar
Banerjee, Prithaj
Roy, Partha Pratim
Pal, Umapada
2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1103 - 1108
[48] Emotional Speech Generator by using Generative Adversarial Networks
Asakura, Takuya
Akama, Shunsuke
Shimokawara, Eri
Yamaguchi, Toru
Yamamoto, Shoji
SOICT 2019: PROCEEDINGS OF THE TENTH INTERNATIONAL SYMPOSIUM ON INFORMATION AND COMMUNICATION TECHNOLOGY, 2019, : 9 - 14
[49] Enhanced droplet analysis using generative adversarial networks
Pham, Tan-Hanh
Burgers, Travis
Nguyen, Kim-Doang
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2025, 231
[50] Cast Shadow Generation Using Generative Adversarial Networks
Taif, Khasrouf
Ugail, Hassan
Mehmood, Irfan
COMPUTATIONAL SCIENCE - ICCS 2020, PT V, 2020, 12141 : 481 - 495

← 1 2 3 4 5 →