A Dance Performance with a Humanoid Robot using a Real-time Gesture Responsive Framework

被引:0
|
作者
Hong, Hui-Ting [1 ,2 ]
Chen, Chu-Yin [1 ]
Tanguy, Arnaud [2 ]
Kheddar, Abderrahmane [2 ,3 ]
机构
[1] Univ Paris 8 Vincennes St Denis, Lab Image Arts & Contemporary Art AIAC, Digital Images & Virtual Real INREV Team, St Denis, France
[2] Univ Montpellier, Montpellier Lab Informat Robot & Microelect LIRMM, CNRS, Montpellier, France
[3] CNRS AIST Joint Robot Lab JRL, IRL3218, Tsukuba, Ibaraki, Japan
关键词
D O I
10.1109/RO-MAN60168.2024.10731316
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a lightweight, real-time gesture responsive framework designed to investigate dynamics of human-robot interaction in live dance performances, merging aspects from choreography and robotics. In particular, it is tailored for artists to integrate human-sized humanoid robots into their dances seamlessly, offering an intuitive solution without the complexities of mastering robot control systems. Unlike existing interaction methods relying on wearable sensors or predetermined music cues, our framework, integrated in a task-space controller, enables the robot to dynamically respond to the dancer's movements, generating unpredictable yet artistically meaningful gestures without the need for body-mounted sensors. This design choice emphasizes the artistic intention behind the improvisation, illustrating that it is not merely about creating movements spontaneously but rather a way of expression in intuition guided by perception. We assess our framework on the HRP-4 humanoid robot and the result has been successfully demonstrated in a public human-robot dance performance at the Arts Center of Enghien-les-Bains's 23/24 season launch event, aiming to contribute to the exploration of co-creation between human and human-sized humanoid robot in improvised dance performances.
引用
收藏
页码:1550 / 1555
页数:6
相关论文
共 50 条
  • [41] Experimental Investigations into Using Motion Capture State Feedback for Real-Time Control of a Humanoid Robot
    Popescu, Mihaela
    Mronga, Dennis
    Bergonzani, Ivan
    Kumar, Shivesh
    Kirchner, Frank
    SENSORS, 2022, 22 (24)
  • [42] Real-time Stabilization of a Falling Humanoid Robot using Hand Contact: An Optimal Control Approach
    Wang, Shihao
    Hauser, Kris
    2017 IEEE-RAS 17TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTICS (HUMANOIDS), 2017, : 454 - 460
  • [43] Robotic re-embodiment: controlling a humanoid robot by thought using real-time fMRI
    Cohen, O.
    Mendelsohn, A.
    Koppel, M.
    Druon, S.
    Lengagne, S.
    Kheddar, A.
    Malach, R.
    Friedman, D.
    JOURNAL OF MOLECULAR NEUROSCIENCE, 2013, 51 : S29 - S29
  • [44] Real-time pattern generation for humanoid robot to walk on rough terrain using preview control
    Khanmohammadi, Sohrab
    Ghiasi, Amir R.
    Samadi, Farshad
    ICECCO'12: 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTER AND COMPUTATION, 2012, : 78 - 81
  • [45] Real-time Gesture Recognition and Robot control through Blob Tracking
    Ravipati, Deepika
    Karreddi, Prathyusha
    Patlola, Amulya
    2014 IEEE STUDENTS' CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER SCIENCE (SCEECS), 2014,
  • [46] Real-Time Face and Gesture Analysis for Human-Robot Interaction
    Wallhoff, Frank
    Rehrl, Tobias
    Mayer, Christoph
    Radig, Bernd
    REAL-TIME IMAGE AND VIDEO PROCESSING 2010, 2010, 7724
  • [47] A Real-Time Robot Motion Generation System Based on Human Gesture
    Haramaki, Toshiyuki
    Goto, Kenta
    Tsutsumi, Hokuto
    Yatsuda, Akihito
    Nishino, Hiroaki
    ADVANCES ON BROADBAND AND WIRELESS COMPUTING, COMMUNICATION AND APPLICATIONS, BWCCA-2018, 2019, 25 : 135 - 146
  • [48] A distributed real-time system framework design for multi-robot cooperative systems using real-time CORBA
    Song, I
    Karray, F
    Guedea, F
    PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL, 2003, : 793 - 798
  • [49] UML framework for the design of real-time robot controllers
    Carroll, L
    Tondu, B
    Baron, C
    Geffroy, JC
    EURO-PAR'99: PARALLEL PROCESSING, 1999, 1685 : 511 - 514
  • [50] Real-time planning of humanoid robot's gait for force controlled manipulation
    Harada, K
    Kajita, S
    Kanehiro, F
    Fujiwara, K
    Kaneko, K
    Yokoi, K
    Hirukawa, H
    2004 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1- 5, PROCEEDINGS, 2004, : 616 - 622