Content-Based Management of Human Motion Data: Survey and Challenges

被引:15
|
作者
Sedmidubsky, Jan [1 ]
Elias, Petr [1 ]
Budikova, Petra [1 ]
Zezula, Pavel [1 ]
机构
[1] Masaryk Univ, Fac Informat, Dept Machine Learning & Data Proc, Brno 60200, Czech Republic
关键词
Motion segmentation; Skeleton; Semantics; Three-dimensional displays; Task analysis; Immune system; Data processing; Action detection; content-based processing; deep features; metric learning; motion capture data; skeleton sequences; similarity; sub-sequence search; CAPTURE DATA; ACTION RECOGNITION; CLASSIFICATION; SEGMENTATION; RETRIEVAL; NETWORKS; BEHAVIOR; FEATURES; VIDEO;
D O I
10.1109/ACCESS.2021.3075766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Digitization of human motion using skeleton representations offers exciting possibilities for a large number of applications but, at the same time, requires innovative techniques for their effective and efficient processing. Content-based processing of skeleton data has developed rapidly in recent years, focusing mainly on specialized prototypes with limited consideration of generic data management possibilities. In this survey article, we synthesize and categorize the existing approaches and outline future research challenges brought by the increasing availability of human motion data. In particular, we first discuss the problems of suitable representation and segmentation of continuous skeleton data obtained from various sources. Then, we concentrate on comparison models for assessing the similarity of time-restricted pieces of motions, as required by any content-based management operation. Next, we review the techniques for evaluating similarity queries over collections of motion sequences and filtering query-relevant parts from continuous motion streams. Finally, we summarize the usability of existing techniques in perspective application domains and discuss the new challenges related to current technological and infrastructural developments. We especially assess the existing techniques from the perspective of scalability and propose future research directions for dealing with large and diverse volumes of skeleton data.
引用
收藏
页码:64241 / 64255
页数:15
相关论文
共 50 条
  • [1] Content-based retrieval for human motion data
    Chiu, CY
    Chao, SP
    Wu, MY
    Yang, SN
    Lin, HC
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2004, 15 (03) : 446 - 466
  • [2] Efficient content-based retrieval of motion capture data
    Müller, M
    Röder, T
    Clausen, M
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 677 - 685
  • [3] Content-based human motion retrieval with automatic transition
    Gao, Yan
    Ma, Lizhuang
    Chen, Yiqiang
    Liu, Junfa
    [J]. ADVANCES IN COMPUTER GRAPHICS, PROCEEDINGS, 2006, 4035 : 360 - 371
  • [4] Issues and Challenges for Content-Based Video Search Engines A Survey
    Adly, Ahmad Sedky
    Abdelwahab, M. S.
    Hegazy, Islam
    Elarif, Taha
    [J]. 2020 21ST INTERNATIONAL ARAB CONFERENCE ON INFORMATION TECHNOLOGY (ACIT), 2020,
  • [5] An efficient algorithm for content-based human motion retrieval
    Gao, Yan
    Ma, Lizhuang
    Liu, Junfa
    Wu, Xiaomao
    Chen, Zhihua
    [J]. TECHNOLOGIES FOR E-LEARNING AND DIGITAL ENTERTAINMENT, PROCEEDINGS, 2006, 3942 : 970 - 979
  • [6] Content-based cross search for human motion data using time-varying mesh and motion capture data
    Yamasaki, Toshihiko
    Aizawa, Kiyoharu
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 2006 - 2009
  • [7] Content-based CAD assembly model retrieval: Survey and future challenges
    Lupinetti, Katia
    Pernot, Jean-Philippe
    Monti, Marina
    Giannini, Franca
    [J]. COMPUTER-AIDED DESIGN, 2019, 113 : 62 - 81
  • [8] Content-based human motion retrieval with scene description language
    Dept. of Computer Science and Eng., Shanghai Jiaotong Univ., Shanghai 200030, China
    [J]. J. Shanghai Jiaotong Univ. Sci., 2006, 4 (452-459+464):
  • [9] Content-Based Human Motion Retrieval with Scene Description Language
    高岩
    马利庄
    吴小毛
    陈志华
    [J]. Journal of Shanghai Jiaotong University(Science), 2006, (04) : 452 - 459
  • [10] Generic Content-Based Retrieval of Marker-Based Motion Capture Data
    Lv, Na
    Jiang, Zifei
    Huang, Yan
    Meng, Xiangxu
    Meenakshisundaram, Gopi
    Peng, Jingliang
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (06) : 1969 - 1982