Spontaneous talking gestures using Generative Adversarial Networks

被引：13

作者：

Rodriguez, Igor ^{[1
]}

Maria Martinez-Otzeta, Jose ^{[1
]}

Irigoien, Itziar ^{[1
]}

Lazkano, Elena ^{[1
]}

机构：

[1] Univ Basque Country, Fac Informat, Comp Sci & Artificial Intelligence, Manuel Lardizabal 1, Donostia San Sebastian 20018, Spain

来源：

ROBOTICS AND AUTONOMOUS SYSTEMS | 2019年 / 114卷

关键词：

Social robotics; Generative learning models; Motion generation; Principal coordinate analysis; Body language expression; Generative adversarial networks;

D O I：

10.1016/j.robot.2018.11.024

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper presents a talking gesture generation system based on Generative Adversarial Networks, along with an evaluation of its adequateness. The talking gesture generation system produces a sequence of joint positions of the robot's upper body which keeps in step with an uttered sentence. The suitability of the approach is demonstrated with a real robot. Besides, the motion generation method is compared with other (non-deep) generative approaches. A two-step comparison is made. On the one hand, a statistical analysis is performed over movements generated by each approach by means of Principal Coordinate Analysis. On the other hand, the robot motion adequateness is measured by calculating the end effectors' jerk, path lengths and 3D space coverage. (C) 2019 Elsevier B.V. All rights reserved.

引用

页码：57 / 65

页数：9

共 50 条

[21] Learning to Distort Images Using Generative Adversarial Networks
Chen, Li-Heng
Bampis, Christos G.
Li, Zhi
Bovik, Alan C.
IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 2144 - 2148
[22] Brain Tumor Segmentation Using Generative Adversarial Networks
Ali, Abid
Sharif, Muhammad
Muhammad Shahzad Faisal, Ch
Rizwan, Atif
Atteia, Ghada
Alabdulhafith, Maali
IEEE ACCESS, 2024, 12 : 183525 - 183541
[23] Conditional Independence Testing using Generative Adversarial Networks
Bellot, Alexis
van der Schaar, Mihaela
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
[24] A Method Using Generative Adversarial Networks for Robustness Optimization
Feldkamp, Niclas
Bergmann, Soeren
Conrad, Florian
Strassburger, Steffen
ACM TRANSACTIONS ON MODELING AND COMPUTER SIMULATION, 2022, 32 (02):
[25] Mixed Data Imputation Using Generative Adversarial Networks
Khan, Wasif
Zaki, Nazar
Ahmad, Amir
Masud, Mohammad Mehedy
Ali, Luqman
Ali, Nasloon
Ahmed, Luai A.
IEEE ACCESS, 2022, 10 : 124475 - 124490
[26] Recognizing English Cursive Using Generative Adversarial Networks
Yu, Xinrui
Saniie, Jafar
2020 IEEE INTERNATIONAL CONFERENCE ON ELECTRO INFORMATION TECHNOLOGY (EIT), 2020, : 293 - 296
[27] Human Video Synthesis Using Generative Adversarial Networks
Azeem, Abdullah
Riaz, Waqar
Siddique, Abubakar
Saifullah
Junaid, Tahir
FIFTH INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2020, 11526
[28] CALPAGAN: Calorimetry for Particles Using Generative Adversarial Networks
Simsek, Ebru
Isildak, Bora
Dogru, Anil
Aydogan, Reyhan
Bayrak, Burak
Ertekin, Seyda
PROGRESS OF THEORETICAL AND EXPERIMENTAL PHYSICS, 2024, 2024 (08):
[29] Plasmonic sensor using generative adversarial networks integration
Islam, Nazrul
Hasan, Mia Mohammad Shoaib
Shibly, Imam Hossain
Rashid, Bajlur
Abu Yousuf, Mohammad
Haider, Firoz
Aoni, Rifat Ahmmed
Ahmed, Rajib
OPTICS EXPRESS, 2024, 32 (20): : 34184 - 34198
[30] Phase Retrieval Using Conditional Generative Adversarial Networks
Uelwer, Tobias
Oberstrass, Alexander
Harmeling, Stefan
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 731 - 738

← 1 2 3 4 5 →