Finding an Optimal Geometric Configuration for TDOA Location Systems With Reinforcement Learning

被引:5
|
作者
Li, Shengxiang [1 ]
Liu, Guangyi [1 ]
Ding, Siyuan [2 ]
Li, Haisi [1 ]
Li, Ou [1 ]
机构
[1] PLA Strategy Support Force Informat Engn Univ, Zhengzhou 450001, Peoples R China
[2] Key Lab Expt Phys & Computat Math, Beijing 100038, Peoples R China
关键词
Transmitters; Reinforcement learning; Geometry; Electromagnetics; Task analysis; Estimation; Neural networks; Geometry optimaztion; passive location; TDOA; reinforcement learning; actor-critic;
D O I
10.1109/ACCESS.2021.3075475
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In TDOA passive location tasks, the geometric configuration can greatly affect the positioning precision due to the complicated characteristics of electromagnetic environment. How to find an appropriate path to a good geometry to locate the transmitter accurately is vital in practical location tasks. This paper proposes a novel geometry optimization method based on deep reinforcement learning. In the proposed method, stations are regarded as mobile agents that can receive wireless signals decide where to go. All agents are controlled by an actor-critic learner, which is trained on the experiences collected from executing the TDOA location task repeatedly. To evaluate the trained agents, a TDOA location simulator environment with complex electromagnetic characteristics is developed. The empirical results show that, the learner mastered useful strategies and navigated to optimal geometric configurations efficiently. A visual depiction of highlights of the learner's behavior in TDOA passive location tasks can be viewed in the video provided in the supplementary material.
引用
收藏
页码:63388 / 63397
页数:10
相关论文
共 50 条
  • [1] A Multiagent Reinforcement Learning Solution for Geometric Configuration Optimization in Passive Location Systems
    Li, Shengxiang
    Li, Haisi
    Ke, Ke
    Li, Ou
    Liu, Guangyi
    Ding, Siyuan
    Bai, Yijie
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [2] Finding Optimal Trajectory Points for TDOA/FDOA Geo-Location Sensors
    Ren, Ran
    Fowler, Mark L.
    Wu, N. Eva
    [J]. 2009 43RD ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, VOLS 1 AND 2, 2009, : 817 - 822
  • [3] A Geometric Perspective on Optimal Representations for Reinforcement Learning
    Bellemare, Marc G.
    Dabney, Will
    Dadashi, Robert
    Taiga, Adrien Ali
    Castro, Pablo Samuel
    Le Roux, Nicolas
    Schuurmans, Dale
    Lattimore, Tor
    Lyle, Clare
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [4] The Optimal Path Finding Algorithm Based on Reinforcement Learning
    Khekare, Ganesh
    Verma, Pushpneel
    Dhanre, Urvashi
    Raut, Seema
    Sheikh, Shahrukh
    [J]. INTERNATIONAL JOURNAL OF SOFTWARE SCIENCE AND COMPUTATIONAL INTELLIGENCE-IJSSCI, 2020, 12 (04): : 1 - 18
  • [5] Qualitative Reinforcement Learning to Accelerate Finding An Optimal Policy
    Telgerdi, Fatemeh
    Khalilian, Alireza
    Pouyan, Ali Akbar
    [J]. 2014 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND KNOWLEDGE ENGINEERING (ICCKE), 2014, : 575 - 580
  • [6] FINDING THE OPTIMAL SEQUENCE OF FEATURES SELECTION BASED ON REINFORCEMENT LEARNING
    Bi, Song
    Liu, Lei
    Han, Cunwu
    Sun, Dehui
    [J]. 2014 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2014, : 347 - 350
  • [7] Propagation Speed Free Emitter Location Finding using TDOA
    Cakir, O.
    Kaya, I.
    Yazgan, A.
    [J]. 2013 21ST TELECOMMUNICATIONS FORUM (TELFOR), 2013, : 405 - 407
  • [8] Research on configuration of tri-satellites and location precision of TDOA
    Li W.-H.
    [J]. Yuhang Xuebao/Journal of Astronautics, 2010, 31 (03): : 701 - 706
  • [9] Finding Geometric Facilities with Location Privacy
    Eyal Nussbaum
    Michael Segal
    Oles Holembovskyy
    [J]. Algorithmica, 2023, 85 : 3572 - 3601
  • [10] Finding Geometric Medians with Location Privacy
    Nussbaum, Eyal
    Segal, Michael
    [J]. 2020 IEEE 19TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2020), 2020, : 1874 - 1881