Value Iteration on Multicore Processors

被引：0
|
作者：
Jain, Anuj [1 ]
Sahni, Sartaj [2 ]
机构：
[1] Adobe Syst Inc, Lehi, UT 84043 USA
[2] Univ Florida, CISE Dept, Gainesville, FL USA
来源：
2020 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY (ISSPIT 2020) | 2020年
基金：
美国国家科学基金会;
关键词：
Reinforcement Learning; Markov Decision Process; Value Iteration; Multicore; Parallelization;
D O I：
10.1109/ISSPIT51521.2020.9408773
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
Value Iteration (VI) is a powerful, though time consuming, approach to solve reinforcement learning problems modeled as Markov Decision Processes (MDPs). In this paper, we explore strategies to run the sate-of-the-art cache efficient algorithm for VI developed by us [1], [2] on a multicore processor. We demonstrate a speedup of up to 2.59 on a 10-core multiprocessor using 20 threads on popular benchmark data. The speedup for the parallelized portion of the computation is up to 5.89.
引用
收藏
页数：7
相关论文
共 50 条
  • [1] Threads Scheduling and Load Balancing with Loop Iteration in Multicore Processors: A Case Study with OpenMP
    Islam, Md Sirajul
    Rouff, Mohammad Abdur
    2021 3RD INTERNATIONAL CONFERENCE ON SUSTAINABLE TECHNOLOGIES FOR INDUSTRY 4.0 (STI), 2021,
  • [2] Leveraging Value Locality for Efficient Design of a Hybrid Cache in Multicore Processors
    Arjomand, Mohammad
    Jadidi, Amin
    Kandemir, Mahmut T.
    Das, Chita R.
    2017 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2017, : 1 - 8
  • [3] Multicore processors as array processors: Research opportunities
    Cappello, Peter
    IEEE 17th International Conference on Application-Specific Systems, Architectures and Processors, Proceedings, 2006, : 169 - 169
  • [4] String search on multicore processors
    Scarpazza, Daniele Paolo
    Villa, Oreste
    Petrini, Fabrizio
    DR DOBBS JOURNAL, 2008, 33 (04): : 20 - +
  • [5] Performance analysis and multicore processors
    Carleton, G
    Shands, W
    DR DOBBS JOURNAL, 2006, 31 (05): : 22 - +
  • [6] Models of Communication for Multicore Processors
    Schoeberl, Martin
    Sorensen, Rasmus Bo
    Sparso, Jens
    2015 IEEE 18TH INTERNATIONAL SYMPOSIUM ON REAL-TIME DISTRIBUTED COMPUTING WORKSHOPS, 2015, : 9 - 16
  • [7] Multithreaded technology & multicore processors
    Szydlowski, C
    DR DOBBS JOURNAL, 2005, 30 (05): : 58 - 60
  • [8] Optimizing software for multicore processors
    Verplanke, Edwin
    DR DOBBS JOURNAL, 2007, 32 (06): : 44 - +
  • [9] Multicore processors for science and engineering
    Gorder, Pam Frost
    COMPUTING IN SCIENCE & ENGINEERING, 2007, 9 (02) : 3 - 7
  • [10] Parallelization of PageRank on Multicore Processors
    Kumar, Tarun
    Sondhi, Parikshit
    Mittal, Ankush
    DISTRIBUTED COMPUTING AND INTERNET TECHNOLOGY, 2012, 7154 : 129 - +
12345