Metadata Service for Random Frame Reading of Video Stored in Distributed File System

被引：9
|
作者：
Xu, Yang [1 ]
Gao, Le [1 ]
Li, Yin [2 ,3 ]
Huang, Xiaobing [1 ]
Li, Dong [1 ]
机构：
[1] South China Univ Technol, Sch Software, Guangzhou Higher Educ Mega Ctr, 382 Zhonghuan Rd East, Guangzhou 510006, Guangdong, Peoples R China
[2] Inst Software Applicat Technol, Guangzhou, Guangdong, Peoples R China
[3] Chinese Acad Sci GZIS, 1121 Haibin Rd, Guangzhou 511458, Guangdong, Peoples R China
来源：
INTERNATIONAL CONFERENCE ON BIG DATA AND INTERNET OF THINGS (BDIOT 2017) | 2017年
关键词：
Distributed video file; Random access of frame; Video Meta data; GOP; I Frame;
D O I：
10.1145/3175684.3175704
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Aiming at solving the problem in video processing for the distributed storage of massive video, this paper presents a high performance video frame random access service based on Hadoop Distributed File System(HDFS). The model provides a design of the Video Meta Data(VMD) service on the base of HDFS distributed file system. The VMD contains the information meta and the I frame dictionary of the video file, which are used to locate and decode video frames. The I frame dictionary contains the timestamps and frame numbers of all I frames of the video. By getting the information of I frames in VMD, the application can quickly located the frames of video file which is scattered in different data nodes.
引用
收藏
页码：27 / 31
页数：5
相关论文
共 49 条
  • [1] A Flattened Metadata Service for Distributed File Systems
    Li, Siyang
    Liu, Fenlin
    Shu, Jiwu
    Lu, Youyou
    Li, Tao
    Hu, Yang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (12) : 2641 - 2657
  • [2] A Distributed Cache Framework for Metadata Service of Distributed File Systems
    Sun, Yao
    Liu, Jie
    Ye, Dan
    Zhong, Hua
    [J]. 2013 19TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2013), 2013, : 51 - 58
  • [3] Clover: A distributed file system of expandable metadata service derived from HDFS
    Wang, Youwei
    Zhou, Jiang
    Ma, Can
    Wang, Weiping
    Meng, Dan
    Kei, Jason
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2012, : 126 - 134
  • [4] Metadata Namespace Management of Distributed File System
    Luo, Baoshan
    Zhang, Xinyan
    Tan, Zhipeng
    [J]. 14TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS, ENGINEERING AND SCIENCE (DCABES 2015), 2015, : 21 - 25
  • [5] DMFSsim: a Distributed Metadata File System Simulator
    Wu, Qimeng
    Xie, Ke
    Zhu, Mingfa
    Xiao, Limin
    Ruan, Li
    [J]. INDUSTRIAL INSTRUMENTATION AND CONTROL SYSTEMS, PTS 1-4, 2013, 241-244 : 1556 - 1561
  • [6] λFS: A Scalable and Elastic Distributed File System Metadata Service using Serverless Functions
    Carver, Benjamin
    Han, Runzhou
    Zhang, Jingyuan
    Zheng, Mai
    Cheng, Yue
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, ASPLOS 2023, VOL 4, 2023, : 394 - 411
  • [7] A Novel Distributed File System Using Blockchain Metadata
    Deepa S. Kumar
    S. Dija
    M. D. Sumithra
    M. Abdul Rahman
    Praseeda B. Nair
    [J]. Wireless Personal Communications, 2023, 129 : 501 - 520
  • [8] Metadata Indexing Sub-system for Distributed File System
    Niu Dejiao
    Cai Tao
    Zhan Yongzhao
    Ju Shiguang
    [J]. ELECTRICAL INFORMATION AND MECHATRONICS AND APPLICATIONS, PTS 1 AND 2, 2012, 143-144 : 864 - 868
  • [9] A Novel Distributed File System Using Blockchain Metadata
    Kumar, Deepa S.
    Dija, S.
    Sumithra, M. D.
    Rahman, M. Abdul
    Nair, Praseeda B.
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2023, 129 (01) : 501 - 520
  • [10] Research on Metadata Management Scheme of Distributed File System
    Huo, Lin
    Yi, Ran
    [J]. 2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATIONS (CSA), 2015, : 37 - 41
12345