An Autonomous Navigation Method for Intelligent Vehicles in Urban Battlefield

doi:10.3969/j.issn.1006-2475.2024.01.015

Abstract

Abstract: Abstract: The urban battlefield is the main position of conventional warfare and daily security， and excellent urban battlefield penetration capabilities can help our fighters better and faster complete reconnaissance， strike， rescue and other tasks. However， the complex street environment in the city， and the possibility of interception by enemy targets， make the urban battlefield environment complex and changeable， greatly increasing the difficulty of completing the mission. Traditional path planning methods rely on accurate static maps and rule constraints， and lack flexibility and adaptability. Therefore， this paper proposes an autonomous navigation method for intelligent vehicles in urban battlefield， and designs discrete action spaces and reward functions based on task completion. Firstly， this paper takes the urban battlefield penetration task as an example to design the state space and action space， and selects a suitable deep reinforcement learning algorithm. Then， based on Gazebo simulation platform and ROS， the algorithm flow framework and experimental scheme are designed. The experimental results show that the intelligent car using this method in the urban battlefield environment can effectively pass through obstacles and avoid enemy units to reach the designated place， which improves the success rate of penetration.

Key words: Key words: urban battlefield, path planning, deep reinforcement learning, autonomous navigation

CLC Number:

TP399

LI Peng, XU Luo. An Autonomous Navigation Method for Intelligent Vehicles in Urban Battlefield[J]. Computer and Modernization, 2024, 0(01): 92-98.

References

［1］ BELL M G H. Hyperstar: A multi-path astar algorithm for risk averse vehicle navigation［J］. Transportation Research Part B: Methodological，2009，43（1）:97-107.
［2］ TAN G Z， HE H， AARON S. Global optimal path planning for mobile robot based on improved Dijkstra algorithm and ant system algorithm［J］. Journal of Central South University of Technology， 2006，13（1）:80-86.
［3］袁泉，吕迅捷. 基于PRM算法的移动小车路径规划优化研究［J］. 宁波工程学院学报， 2020，32（4）:31-35.
［4］ ASQUI L， ANDALUZ V H， SANCHEZ J S， et al. Path planning based in algorithm rapidly-exploring random tree RRT［J］. Journal of Computational and Theoretical Nanoscience， 2018，24（11）:8831-8836.
［5］吕佳，邱建岗. 智能汽车主动避障的改进蚁群路径规划方法［J］. 机械设计与制造， 2023，383（1）:55-59.
［6］常宁东，冯春，程鹏达，等. 基于Bekker理论改进遗传算法的野外路径优化方法研究［J］. 光学精密工程， 2023，31（5）:767-775.
［7］蔺文轩，谢文俊，张鹏，等. 基于分组优化改进粒子群算法的无人机三维路径规划［J］. 火力与指挥控制， 2023，48（1）:20-25.
［8］谌海云，陈华胄，刘强. 基于改进人工势场法的多无人机三维编队路径规划［J］. 系统仿真学报， 2020，32（3）:414-420.
［9］刘亚军，郭凤娟. 基于Agent的UAV智能导航技术研究［J］. 现代导航， 2014，5（2）:79-83.
［10］ MALDONADO-RAMIREZ A， RIOS-CABRERA R， LOPE
Z-JUAREZ I. A visual path-following learning approach for industrial robots using DRL［J］. Robotics and Computer-Integrated Manufacturing，2021，71. DOI: 10.1016/j.rcim.20
21.102130.
［11］ YU L， WU F H， XU Z H， et al. UAV path design with connectivity constraint based on deep reinforcement learning［J］. Physical Communication， 2022，52（5）. DOI:10.1016/j.phycom.2021.101582.
［12］李茹杨，彭慧民，李仁刚，等. 强化学习算法与应用综述［J］. 计算机系统应用， 2020，29（12）:13-25.
［13］ JIANXIN L， YITING C， XIUNIAO Z， et al. An improved DQN path planning algorithm［J］. The Journal of Supercomputing， 2022，78（1）:616-639.
［14］李杨，闫冬梅，刘磊. 基于输出层具有噪声的DQN的无人车路径规划［J］. 应用数学和力学， 2023，44（4）:450-460.
［15］司鹏搏，吴兵，杨睿哲，等. 基于DDPG三维无人机路径规划［J］. 高技术通讯， 2022，32（10）:1049-1057.
［16］孟晨阳，郝崇清，李冉，等. 基于改进DDPG算法的复杂环境下AGV路径规划方法研究［J］. 计算机应用研究， 2022，39（3）:681-687.
［17］李丽，郑嘉利，王哲，等. 基于异步优势动作评价的RFID室内定位算法［J］. 计算机科学， 2020，47（2）:233-238.
［18］ CHEN D Z， QI Q， ZHUANG Z R， et al. Mean field deep reinforcement learning for fair and efficient UAV control［J］. IEEE Internet of Things Journal， 2021，8（2）:813-828.
［19］ CHEN I M， CHAN C Y. Deep reinforcement learning based path tracking controller for autonomous vehicle［J］. Journal of Automobile Engineering，2021，235（2/3）:541-551.
［20］胡致远，王征，杨洋，等. 改进PPO算法的AUV路径规划研究［J］. 电光与控制， 2023，30（1）:87-91.
［21］袁帅，张莉莉，顾琦然，等. 移动机器人优先采样D3QN路径规划方法研究［J］. 小型微型计算机系统， 2023，44（5）:923-929.
［22］中国地质大学（武汉）. 基于D3QN的无人船自适应路径规划方法、设备及存储介质:CN202110118727.X［P］. 2021-05-14.
［23］陈立家，孙中泽，黄立文，等. 一种基于深度强化学习的船舶智能避碰方法［J］. 武汉理工大学学报（交通科学与工程版）， 2023，47（1）:191-196.
［24］王莹莹，周佳加，高峰，等. 基于课程式双重DQN的水下无人航行器路径规划［J］. 实验室研究与探索， 2022，41（3）:244-248.
［25］朱少凯，孟庆浩，金晟，等. 基于深度强化学习的室内视觉局部路径规划［J］. 智能系统学报， 2022，17（5）:908-918.
［26］杨璐，王一权，刘佳琦，等. 基于融合离散动作的双延迟深度确定性策略梯度算法的自动驾驶端到端行为决策方法［J］. 交通信息与安全， 2022，40（1）:144-152.
［27］白晓煊. 基于任务完成度的舰艇平台体系贡献率评估方法研究［J］. 舰船电子工程， 2022，42（9）:151-154.

[1]	JIAO Jian, JI Yuanfa, SUN Xiyan, WU Jianhui, LIANG Weibin. Multiple Unmanned Aerial Vehicles Three-dimensional Cooperative Route Planning Based on Improved GWO Algorithm [J]. Computer and Modernization, 2024, 0(10): 1-6.
[2]	YANG Yufeng1, 2, XIA Xiaoyun2, CHEN Zefeng3, LIAO Weizhi2, LI Jiwu2. Dung Beetle Optimization Algorithm Integrating Multiple Strategies for Take-out Order Distribution Route Optimization [J]. Computer and Modernization, 2024, 0(09): 25-32.
[3]	WANG Qian, HUANG Miao, Tao Lili. PCB Board Welding Path Optimization Based on Improved Cuckoo Algorithm [J]. Computer and Modernization, 2024, 0(07): 82-86.
[4]	WANG Jian-ming1, WANG Xin1, LI Yang-hui2, WANG Dian-long1. Path Planning of Parking Robot Based on Improved D3QN Algorithm [J]. Computer and Modernization, 2024, 0(03): 7-14.
[5]	HAN Xue. Multi Path Planning Based on Constrained Clustering and Particle Swarm Optimization [J]. Computer and Modernization, 2023, 0(08): 7-11.
[6]	ZHANG Guo-you, SONG Shi-feng. Traffic Light Control Optimization Based On D3QN [J]. Computer and Modernization, 2023, 0(07): 30-35.
[7]	DENG Yun-zheng, HUANG Yi-hu. Improved DWA Obstacle Avoidance Algorithm in Dense Obstacle Environment [J]. Computer and Modernization, 2023, 0(07): 48-53.
[8]	LAI Jian-bin, FENG Gang. An Experience Replay Strategy Based on Mixed Samples [J]. Computer and Modernization, 2023, 0(06): 33-38.
[9]	DU Chuan-sheng, GAO Huan-bing, HOU Yu-xiang, WANG Zi-jian. Path Planning of Fire Robot Based on Improved Bidirectional A* Algorithm [J]. Computer and Modernization, 2023, 0(04): 15-19.
[10]	WANG Zi-wei. Multi-robot Path Planning Based on Double Fuzzy Inference and Improved DWA Algorithm [J]. Computer and Modernization, 2023, 0(04): 20-25.
[11]	TIAN Xiao-zhuang, LI Song, FU Guo-ping, TAN Qi-yun, SHAN De-shuai, WANG Wei-guang, WANG Zhu. Time-optimal Obstacle Avoidance Path Planning for UAV Inspection [J]. Computer and Modernization, 2023, 0(03): 43-47.
[12]	SHEN Hao-yang, CHEN Xiao-lei, YUAN Jun-ling, HAN Lu. Fast Path Planning Algorithm in 3D Space for UAV [J]. Computer and Modernization, 2023, 0(02): 6-11.
[13]	WANG Kuo, HAO Fu-zhen. Optimization of Plant Growth Simulation Algorithm for Vehicle Routing Problem with Time Windows [J]. Computer and Modernization, 2022, 0(12): 26-32.
[14]	DING Zhong-lin, LI Yang, CAO Wei, TAN Yu-hao, XU Bo. Deep Q-learning Based Task Offloading in Power IoT [J]. Computer and Modernization, 2022, 0(11): 75-80.
[15]	WU Shui-ming, JI Zhi-yuan, WANG Zhen-yu, JING Dong-sheng. Power Information Network Intrusion Detection Algorithm Based on Dueling-DDQN [J]. Computer and Modernization, 2021, 0(12): 43-47.