FaasRS: Remote Sensing Image Processing System on Serverless Platform

被引:4
|
作者
Yang, Guang [1 ]
Liu, Jie [2 ]
Qu, Muzi [1 ]
Wang, Shuai [3 ]
Ye, Dan [2 ]
Zhong, Hua [1 ]
机构
[1] Chinese Acad Sci, Univ Chinese Acad Sci, Inst Software, Beijing, Peoples R China
[2] Chinese Acad Sci, State Key Lab Comp Sci, Inst Software, Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
serverless; remote sensing; cloud computing; FaaS; big data analysis;
D O I
10.1109/COMPSAC51774.2021.00044
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Big data processing is now the primary mission in remote sensing processing, fortunately, cloud computing provides a feasible approach to perform it efficiently. But the work of resource provisioning, scheduling, and scaling is still inevitable in most cloud computing solutions, it poses a considerable challenge to data analyst. The emerging serverless architecture presents a new paradigm to provide a cloud service, the user only needs to upload function codes and leaves all the other server management jobs to the service provider. It reveals a new possibility of remote sensing processing. This paper presents FaasRS, a framework to process remote sensing images upon serverless platform. FaasRS is built on AWS Lambda, it exposes only simple APIs to operate images, and builds DAG for user's algorithm. FaasRS splits task by splitting the image into small tiles based on geospatial region, and uses each Lambda worker to perform the computation for one tile. To reduce the redundant operations, we also make optimizations based on the algorithm DAG. FaasRS shows favorable performance and scalability in our evaluation. In the comparison with Spark and Ray, FaasRS shows a significant performance improvement in different type of RS processing jobs.
引用
收藏
页码:258 / 267
页数:10
相关论文
共 50 条
  • [1] Remote Sensing Image Processing Based On CUDA Platform
    Zhao, Yinghui
    Wang, Guanghua
    Jiang, Congfeng
    Hu, Xu
    [J]. EPLWW3S 2011: 2011 INTERNATIONAL CONFERENCE ON ECOLOGICAL PROTECTION OF LAKES-WETLANDS-WATERSHED AND APPLICATION OF 3S TECHNOLOGY, VOL 3, 2011, : 414 - 418
  • [2] Remote sensing study based on IRSA remote sensing image processing system
    Peng, L
    Zhao, ZM
    Cui, LL
    Wang, L
    [J]. IGARSS 2004: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM PROCEEDINGS, VOLS 1-7: SCIENCE FOR SOCIETY: EXPLORING AND MANAGING A CHANGING PLANET, 2004, : 4829 - 4832
  • [3] The Design of Image Processing Software Based on UAV Remote Sensing Platform
    Guo, Yong
    Duan, Haijun
    Lu, Shuai
    Ma, Chao
    [J]. AOPC 2020: OPTICAL SENSING AND IMAGING TECHNOLOGY, 2020, 11567
  • [4] An Infrared Image Processing System for Mobile Remote Sensing
    Wen, Gaojin
    Zhong, Can
    Wang, Zhe
    Lin, Zhaorong
    Xu, Yun
    [J]. 2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 661 - 665
  • [5] A remote sensing image processing system based on MapReduce
    Pan, Xin
    [J]. DESIGN, MANUFACTURING AND MECHATRONICS (ICDMM 2015), 2016, : 674 - 680
  • [6] Workflow-based image processing grid platform and remote sensing application
    Cluster and Grid Computing Laboratory, Huazhong University of Science and Technology, Wuhan 430074, China
    不详
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao, 2006, 5 (702-708):
  • [7] DEVELOPMENT OF IMAGE PROCESSING SYSTEM FOR FISHERY REMOTE SENSING.
    Komura, Fuminobu
    Yoda, Haruo
    Kubo, Yutaka
    Fukahata, Shinsaku
    [J]. Hitachi Review, 1984, 33 (02): : 103 - 108
  • [8] A REMOTE SENSING IMAGE CLOUD PROCESSING SYSTEM BASED ON HADOOP
    Pan, Xin
    Zhang, Suli
    [J]. 2012 IEEE 2ND INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENT SYSTEMS (CCIS) VOLS 1-3, 2012, : 492 - 494
  • [9] Digital Image Processing in Remote Sensing
    Fonseca, Leila M. G.
    Namikawa, Laercio M.
    Castejon, Emiliano F.
    [J]. 2009 TUTORIALS OF THE XXII BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING (SIBGRAPI 2009), 2009, : 59 - 71
  • [10] Processing of hyperspectral remote sensing image
    Li, DR
    Zhang, LP
    [J]. INTERNATIONAL SYMPOSIUM ON MULTISPECTRAL IMAGE PROCESSING, 1998, 3545 : 8 - 14