高级搜索

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

面向FDA-MIMO近程探测器的SG-DDPG低截获点状波束设计

贾金伟 高敏 韩壮志 刘利民 尹园威

贾金伟, 高敏, 韩壮志, 刘利民, 尹园威. 面向FDA-MIMO近程探测器的SG-DDPG低截获点状波束设计[J]. 电子与信息学报. doi: 10.11999/JEIT260010
引用本文: 贾金伟, 高敏, 韩壮志, 刘利民, 尹园威. 面向FDA-MIMO近程探测器的SG-DDPG低截获点状波束设计[J]. 电子与信息学报. doi: 10.11999/JEIT260010
JIA Jinwei, GAO Min, HAN Zhuangzhi, LIU Limin, YIN Yuanwei. SG-DDPG low intercept point beam design for FDA-MIMO short-range detector[J]. Journal of Electronics & Information Technology. doi: 10.11999/JEIT260010
Citation: JIA Jinwei, GAO Min, HAN Zhuangzhi, LIU Limin, YIN Yuanwei. SG-DDPG low intercept point beam design for FDA-MIMO short-range detector[J]. Journal of Electronics & Information Technology. doi: 10.11999/JEIT260010

面向FDA-MIMO近程探测器的SG-DDPG低截获点状波束设计

doi: 10.11999/JEIT260010 cstr: 32379.14.JEIT260010
详细信息
    作者简介:

    贾金伟:男,陆军工程大学博士生,研究方向为:电子对抗、雷达信号处理、无线电引信抗干扰等

    高敏:男,博士,陆军工程大学教授,博士生导师,研究方向为:无线电引信抗干扰、无线电引信设计等

    韩壮志:男,博士,陆军工程大学教授,博士生导师,研究方向为:电子对抗、雷达信号处理、无线电引信抗干扰等

    刘利民:男,博士,陆军工程大学教授,博士生导师,研究方向为:电子对抗、雷达信号处理等

    尹园威:男,博士,陆军工程大学讲师,研究方向为:电子对抗、雷达信号处理等

    通讯作者:

    韩壮志 zhuangzhi_signal@163.com

  • 中图分类号: TN974

SG-DDPG low intercept point beam design for FDA-MIMO short-range detector

  • 摘要: 点状波束可有效提高近程探测器空域低截获能力,本文聚焦于频控阵(FDA-MIMO)阵元频偏设置对波束合成的影响这一关键因素,提出了基于阶段化引导深度确定性策略梯度(SG-DDPG)强化学习算法的低截获点状波束设计技术。首先构建了波束空域低截获性能评估模型,然后设计了多维阶段化引导奖励函数,通过Actor-Critic模型运用梯度上升的方法最大化奖励值,得到当前环境下波束汇聚性能较好的阵元频偏,突破了公式法计算阵元频偏需要近程探测器落角接近垂直的技术瓶颈。仿真表明,SG-DDPG算法优化后的阵元频偏使得FDA-MIMO波束在波束汇聚性能和低截获性能明显好于其他经典频偏设置方法,并适用于近程探测器各种落角下的低截获波束设计,有效提高了近程探测器的低截获性能。
  • 图  1  FDA的发射阵列示意图

    图  2  空域低截获性能评估原理图

    图  3  本文的逻辑简图

    图  4  SG-DDPG算法模型图

    图  5  SG-DDPG算法智能体训练累计奖励和平均奖励曲线

    图  6  波束截获面积和平均截获面积随智能体训练变化趋势图

    图  7  三维波束图

    图  8  二维俯视图

    图  9  波束在距离维的切面图

    图  10  波束在角度维的切面图

    图  11  立方指数频偏方法FDA-MIMO波束图

    图  12  对数频偏方法FDA-MIMO波束图

    图  13  本文所提算法的FDA-MIMO波束图

    图  14  在(200 m,30°)处汇聚的FDA-MIMO波束图

    图  15  在(30 m,45°)处汇聚的FDA-MIMO波束图

    图  16  在$ \left(10\text{m},60{^{\circ}}\right) $处汇聚的FDA-MIMO波束图

    图  17  落角10°时不同高度下近程探测器波束的截获面积

    图  18  落角45°时不同高度下近程探测器波束的截获面积

    图  19  落角60°时不同高度下近程探测器波束的截获面积

    图  20  落角85°时不同高度下近程探测器波束的截获面积

    表  1  SG-DDPG算法伪代码

     算法:SG-DDPG
     初始化:运用随机的网络参数$ \omega $和$ \theta $分别初始化Critic训练网络$ {Q}_{\omega }\left(s,a\right) $和Actor训练网络$ {\mu }_{\theta }\left(s\right) $,复制相同的参数$ {\omega }^{\prime}\leftarrow \omega $、$ {\theta }^{\prime}\leftarrow \theta $,分别
     初始化Critic目标网络$ {Q}_{{{\omega }^{-}}} $和Actor目标网络$ {\mu }_{{{\theta }^{-}}} $
     迭代过程:
     for回合$ e=1\rightarrow \text{E} $ do:
       初始化随机过程$ N $,用于动作探索
       获取环境初始状态$ {s}_{1} $
       for迭代步数$ t=1\rightarrow T $ do:
         根据当前策略和噪声选择动作$ {a}_{t}={\mu }_{\theta }\left({s}_{t}\right)+N $
         执行动作$ {a}_{t} $,获得奖励$ {r}_{t} $,环境状态变为$ {s}_{t} $
         将$ \left({s}_{t},{a}_{t},{r}_{t},{s}_{t+1}\right) $存储进经验回放池$ \mathbf{R} $
         从$ \mathbf{R} $中采样N个元组$ {\left\{\left({s}_{i},{a}_{i},{r}_{i},{s}_{i+1}\right)\right\}}_{i=1,\cdots ,N} $
         对每个元组,运用目标网络计算$ {y}_{i}={r}_{i}+\gamma {Q}_{{{\omega }^{-}}}\left({s}_{i+1},{\mu }_{{{\theta }^{-}}}\left({{{s}^{\prime}}}_{i}\right)\right) $
         通过最小化目标损失$ L=\dfrac{1}{N}\displaystyle\sum \nolimits_{i=1}^{N}{\left({y}_{i}-{Q}_{\omega }\left({s}_{i},{a}_{i}\right)\right)}^{2} $,更新Critic训练网络
         计算数据的策略梯度,更新Actor训练网络:
    $ {\nabla }_{\theta }J\approx {\left.\dfrac{1}{N}\displaystyle\sum \nolimits_{i=1}^{N}{\nabla }_{\theta }{\mu }_{\theta }\left({s}_{i}\right){\nabla }_{a}{Q}_{w}\left({s}_{i},a\right)\right| }_{a={{\mu }_{\theta }}\left({s}_{i}\right)} $
         更新目标网络:
    $ {\omega }^{-}\leftarrow \tau \omega +\left(1-\tau \right){\omega }^{-} $
    $ {\theta }^{-}\leftarrow \tau \theta +\left(1-\tau \right){\theta }^{-} $
         end for
       end for
    下载: 导出CSV

    表  2  不同简化模型的定量结果

    低截获评估模型奖惩函数角度维半波束宽度($ {^{\circ}} $)↓距离维半波束宽度(m)↓截获面积($ {\text{m}}^{2} $)↓速度(s)↓
    ×21.289.390771965
    ×13.62.732561352
    9.911613984
    下载: 导出CSV

    表  3  仿真参数设置

    仿真参数仿真参数
    阵元数量/个6点状波束期望角度/$ {^{\circ}} $30
    中心频率/GHz10点状波束期望距离/米30
    各阵元频偏/MHz0、246.71、249.18、254.1、257.11、258.1(由本文所提算法生成)
    下载: 导出CSV

    表  4  仿真参数设置

    仿真参数 仿真参数
    阵元数量/个 6 中心频率f0/GHz 10
    基础频偏Δf 5 KHz
    立方指数频偏情形
    各阵元频偏/MHz
    0.005、0.04、0.135、0.32、0.625、1.08
    对数频偏情形
    各阵元频偏/Hz
    0、3466、5493、6931、8047、8959
    本文所提算法
    各阵元频偏/MHz
    0、246.71、249.18、254.1、257.11、258.1
    下载: 导出CSV

    表  5  仿真参数设置

    仿真参数 仿真参数
    阵元数量/个 6 中心频率f0/GHz 10
    下载: 导出CSV

    表  6  仿真参数设置

    仿真参数 波束宽度
    近程探测器落角/$ {^{\circ}} $ 15、45、60、85 Log-FDA $ 14.1{^{\circ}} $
    离地高度/m 10–1000 Cub-FDA $ 12.3{^{\circ}} $
    阵元数量/个 6 SG-DDPG算法 $ 9.9{^{\circ}} $
    基础频率/GHz 10 公式法(落角$ 10{^{\circ}} $) $ 28{^{\circ}} $
    公式法(落角$ 60{^{\circ}} $) $ 16{^{\circ}} $ 公式法(落角$ 45{^{\circ}} $) $ 23{^{\circ}} $
    公式法(落角$ 85{^{\circ}} $) $ 9.5{^{\circ}} $
    下载: 导出CSV
  • [1] 魏铭宇, 郝新红, 杨瑾, 等. 基于稀疏贝叶斯学习的调频引信抗扫频干扰方法[J]. 兵工学报, 2026, 47(2): 109–118. doi: 10.12382/bgxb.2024.1148.

    WEI Mingyu, HAO Xinhong, YANG Jin, et al. Anti-sweep jamming method for frequency modulation fuze based on sparse bayesian learning[J]. Acta Armamentarii, 2026, 47(2): 109–118. doi: 10.12382/bgxb.2024.1148.
    [2] 贾金伟, 高敏, 韩壮志, 等. 无线电近炸引信抗信息型干扰技术研究综述[J]. 系统工程与电子技术, 2025, 47(4): 1074–1107. doi: 10.12305/j.issn.1001-506X.2025.04.06.

    JIA Jinwei, GAO Min, HAN Zhuangzhi, et al. Overview of anti-information interference technology for radio proximity fuze[J]. Systems Engineering and Electronic, 2025, 47(4): 1074–1107. doi: 10.12305/j.issn.1001-506X.2025.04.06.
    [3] 张宇鸿. 激光/无线电复合引信环境建模与仿真[D]. [硕士论文], 南京理工大学, 2020. doi: 10.27241/d.cnki.gnjgu.2020.001697.

    ZHANG Yuhong. Environment modeling and simulation of laser/radio composite fuze[D]. [Master dissertation], Nanjing University of Science & Technology, 2020. doi: 10.27241/d.cnki.gnjgu.2020.001697.
    [4] 付春, 潘曦, 宋承天. 调频连续波激光与无线电复合探测技术[J]. 太赫兹科学与电子信息学报, 2016, 14(1): 40–45. doi: 10.11805/TKYDA201601.0040.

    FU Chun, PAN Xi, and SONG Chengtian. Frequency modulated continuous wave laser and radio compound detecting technology[J]. Journal of Terahertz Science and Electronic Information Technology, 2016, 14(1): 40–45. doi: 10.11805/TKYDA201601.0040.
    [5] 段亚博. 调频连续波体制激光与无线电复合引信探测技术研究[D]. [博士论文], 北京理工大学, 2017. doi: 10.26948/d.cnki.gbjlu.2017.000046.

    DUAN Yabo. Research on detection technology of frequency modulated continuous-wave (FMCW) laser and radio combination fuze[D]. [Ph. D. dissertation], Beijing: Beijing Institute of Technology, 2017. doi: 10.26948/d.cnki.gbjlu.2017.000046.
    [6] 于洪海, 闫晓鹏, 贾瑞丽, 等. M序列伪码调相脉冲多普勒引信抗干扰性能研究[J]. 兵工学报, 2020, 41(3): 417–425. doi: 10.3969/j.issn.1000-1093.2020.03.001.

    YU Honghai, YAN Xiaopeng, JIA Ruili, et al. Research on anti-jamming performance of m-sequence pseudo-random code phase modulation pulse doppler fuze[J]. Acta Armamentarii, 2020, 41(3): 417–425. doi: 10.3969/j.issn.1000-1093.2020.03.001.
    [7] 杨芷薇. 伪码调相脉冲多普勒引信干扰技术研究[D]. [硕士论文], 西安电子科技大学, 2023. doi: 10.27389/d.cnki.gxadu.2023.001879.

    YANG Zhiwei. Research on jamming technology of pseudo-code phase-modulated pulse doppler fuze[D]. [Master dissertation], Xidian University, 2023. doi: 10.27389/d.cnki.gxadu.2023.001879.
    [8] 乔彩霞, 郝新红, 陈齐乐, 等. 基于相关旁瓣平均的混沌码与线性调频复合调制无线电引信抗数字射频存储干扰方法[J]. 兵工学报, 2020, 41(4): 641–648. doi: 10.3969/j.issn.1000-1093.2020.04.003.

    QIAO Caixia, HAO Xinhong, CHEN Qile, et al. Anti-DRFM-jamming method based on averaging of range side lobes for hybrid modulation radio fuze[J]. Acta Armamentarii, 2020, 41(4): 641–648. doi: 10.3969/j.issn.1000-1093.2020.04.003.
    [9] JIA Jinwei, LIU Limin, LIANG Yuying, et al. Anti-sorting signal design for radio frequency stealth radar based on cosine-exponential nonlinear chaotic mapping[J]. Wireless Networks, 2024, 30(6): 4811–4824. doi: 10.1007/s11276-022-03149-9.
    [10] DAO Xinyu, GAO Min, ZHANG Zhongyuan, et al. Design of multi-parameter composite modulated signal for anti-deceptive jamming[J]. AEU-International Journal of Electronics and Communications, 2021, 132: 153646. doi: 10.1016/j.aeue.2021.153646.
    [11] 刘强, 张敏, 郭福成, 等. 基于迭代二次优化算法的低截获波形序列设计[J]. 电子与信息学报, 2024, 46(5): 2048–2056. doi: 10.11999/JEIT231333.

    LIU Qiang, ZHANG Min, GUO Fucheng, et al. Low-intercept waveform sequence design based on iterative quadratic optimization algorithm[J]. Journal of Electronics & Information Technology, 2024, 46(5): 2048–2056. doi: 10.11999/JEIT231333.
    [12] LIU Xinyu, YUAN Ye, ZHANG Tianxian, et al. Integrated transmit waveform and RIS phase shift design for LPI detection and communication[J]. IEEE Transactions on Wireless Communications, 2024, 23(6): 5663–5679. doi: 10.1109/TWC.2023.3327685.
    [13] LIU Xinyu, YUAN Ye, ZHANG Tianxian, et al. LPI radar signal design resistant to identification by ESM systems[J]. IEEE Transactions on Aerospace and Electronic Systems, 2023, 59(6): 9233–9246. doi: 10.1109/TAES.2023.3316630.
    [14] GONG Shixian, WEI Xizhang, and LI Xiang. ECCM scheme against interrupted sampling repeater jammer based on time-frequency analysis[J]. Journal of Systems Engineering and Electronics, 2014, 25(6): 996–1003. doi: 10.1109/JSEE.2014.00114.
    [15] CHEN Jian, WU Wenzhen, XU Shiyou, et al. Band pass filter design against interrupted-sampling repeater jamming based on time-frequency analysis[J]. IET Radar, Sonar & Navigation, 2019, 13(10): 1646–1654. doi: 10.1049/iet-rsn.2018.5658.
    [16] 巩朋成, 吴云韬. 基于ADMM改进的低截获FDA-MIMO雷达发射波束设计[J]. 通信学报, 2022, 43(4): 133–142. doi: 10.11959/j.issn.1000−436x.2022065.

    GONG Pengcheng and WU Yuntao. Improved transmit beamforming design based on ADMM for low probability of intercept of FDA-MIMO radar[J]. Journal on Communications, 2022, 43(4): 133–142. doi: 10.11959/j.issn.1000−436x.2022065.
    [17] 巩朋成, 王兆彬, 谭海明, 等. 杂波背景下基于交替方向乘子法的低截获频控阵MIMO雷达收发联合优化方法[J]. 电子与信息学报, 2021, 43(5): 1267–1274. doi: 10.11999/JEIT200445.

    GONG Pengcheng, WANG Zhaobin, TAN Haiming, et al. Joint design of the transmit and receive beamforming via alternating direction method of multipliers for LPI of frequency diverse array MIMO radar in the presence of clutter[J]. Journal of Electronics & Information Technology, 2021, 43(5): 1267–1274. doi: 10.11999/JEIT200445.
    [18] GONG Pengcheng, ZHANG Zhuoyu, WU Yuntao, et al. Joint design of transmit waveform and receive beamforming for LPI FDA-MIMO radar[J]. IEEE Signal Processing Letters, 2022, 29: 1938–1942. doi: 10.1109/LSP.2022.3205206.
    [19] CHENG Xu, LI Mengliang, CIUONZO D, et al. Suppressing interrupted sampling repeater jamming by transceiver design of fully polarimetric wideband radars[J]. IEEE Sensors Journal, 2024, 24(24): 41572–41584. doi: 10.1109/JSEN.2024.3486761.
    [20] 董二娃, 郝新红, 闫晓鹏, 等. 扫频式干扰对超宽带无线电引信干扰机理[J]. 兵工学报, 2023, 44(4): 1006–1014. doi: 10.12382/bgxb.2022.0088.

    DONG Erwa, HAO Xinhong, YAN Xiaopeng, et al. Research on interference mechanism of swept-frequency jamming to UWB radio fuze[J]. Acta Armamentarii, 2023, 44(4): 1006–1014. doi: 10.12382/bgxb.2022.0088.
    [21] 闫岩, 崔占忠. 超宽带无线电引信抗干扰性能研究[J]. 兵工学报, 2010, 31(1): 13–17.

    YAN Yan and CUI Zhanzhong. Anti-jamming performance of ultra wideband radio fuze[J]. Acta Armamentarii, 2010, 31(1): 13–17. (查阅网上资料, 未找到本条文献的doi, 请核对).
    [22] 朱航, 侯林胜, 康国钦, 等. 无载波超宽带引信组合脉冲功率谱快速拟合方法[J]. 电子与信息学报, 2023, 45(11): 3927–3934. doi: 10.11999/JEIT230415.

    ZHU Hang, HOU Linsheng, KANG Guoqin, et al. A fast fitting method for combined pulse power spectrum of carrier-free ultra wide-band fuze[J]. Journal of Electronics & Information Technology, 2023, 45(11): 3927–3934. doi: 10.11999/JEIT230415.
    [23] 杨兵, 武凯玮, 梁彦斌, 等. 基于蒙特卡洛的大到暴雨条件下毫米波引信回波特性研究[J]. 兵工学报, 2024, 45(S1): 252–261. doi: 10.12382/bgxb.2024.0665.

    YANG Bing, WU Kaiwei, LIANG Yanbin, et al. Research on echo characteristics of millimeter-wave fuze under heavy rainfall conditions based on monte carlo method[J]. Acta Armamentarii, 2024, 45(S1): 252–261. doi: 10.12382/bgxb.2024.0665.
    [24] 林琳. 非大气窗口毫米波传播特性及近程探测技术研究[D]. [硕士论文], 南京理工大学, 2017.

    LIN Lin. Research on millimeter wave propagation characteristics and short-range detection technology in non-atmospheric window[D]. [Master dissertation], Nanjing University of Science & Technology, 2017. (查阅网上资料, 未找到本条文献的英文信息, 请核对).
    [25] 张红旗, 陈彬, 李晓. 一种相位编码脉冲压缩V波段脉冲多普勒引信设计[J]. 航空兵器, 2020, 27(1): 33–38. doi: 10.12132/ISSN.1673-5048.2019.0128.

    ZHANG Hongqi, CHEN Bin, and LI Xiao. Design of V-band pulse-doppler fuze with phase coded pulse compression[J]. Aero Weaponry, 2020, 27(1): 33–38. doi: 10.12132/ISSN.1673-5048.2019.0128.
    [26] 范旭慧, 王宇翼, 王安义, 等. 鲁棒自适应稀疏阵列波束形成[J]. 电子与信息学报, 2026, 48(1): 202–211. doi: 10.11999/JEIT250952.

    FAN Xuhui, WANG Yuyi, WANG Anyi, et al. Robust adaptive beamforming for sparse arrays[J]. Journal of Electronics & Information Technology, 2026, 48(1): 202–211. doi: 10.11999/JEIT250952.
    [27] SINGMAN M P and NARAYANAN R M. Applying machine learning to adaptive array signal processing weight generation[J]. IEEE Transactions on Aerospace and Electronic Systems, 2024, 60(4): 4952–4962. doi: 10.1109/TAES.2024.3382620.
    [28] 王文钦, 张顺生. 频控阵雷达技术研究进展综述[J]. 雷达学报, 2022, 11(5): 830–849. doi: 10.12000/JR22141.

    WANG Wenqin and ZHANG Shunsheng. Recent advances in frequency diverse array radar techniques[J]. Journal of Radars, 2022, 11(5): 830–849. doi: 10.12000/JR22141.
    [29] KHAN W, QURESHI I M, and SAEED S. Frequency diverse array radar with logarithmically increasing frequency offset[J]. IEEE Antennas and Wireless Propagation Letters, 2015, 14: 499–502. doi: 10.1109/LAWP.2014.2368977.
    [30] GAO Kuandong, WANG Wenqin, CAI Jingye, et al. Decoupled frequency diverse array range-angle-dependent beampattern synthesis using non-linearly increasing frequency offsets[J]. IET Microwaves, Antennas & Propagation, 2016, 10(8): 880–884. doi: 10.1049/iet-map.2015.0658.
    [31] LIU Yimin, RUAN Hang, WANG Lei, et al. The random frequency diverse array: A new antenna structure for uncoupled direction-range indication in active sensing[J]. IEEE Journal of Selected Topics in Signal Processing, 2017, 11(2): 295–308. doi: 10.1109/JSTSP.2016.2627183.
    [32] 贾金伟, 高敏, 韩壮志, 等. 基于FDA-MIMO的无线电引信低截获点状波束设计方法[J]. 兵工学报, 2025, 46(9): 282–298. doi: 10.12382/bgxb.2024.1122.

    JIA Jinwei, GAO Min, HAN Zhuangzhi, et al. Research on the design method of low intercepting point-like beam of radio fuze based on FDA-MIMO[J]. Acta Armamentarii, 2025, 46(9): 282–298. doi: 10.12382/bgxb.2024.1122.
    [33] JIA Jinwei, GAO Min, LIANG Yuying, et al. Research on optimal convergence design of low intercept point-like beam for FDA-MIMO radio detector based on beam entropy[J]. Entropy, 2025, 27(4): 421. doi: 10.3390/e27040421.
    [34] 李斌, 沈立, 赵传信, 等. 基于柔性演员-评论家的通感算融合网络稳健资源优化[J]. 电子与信息学报, 2025, 47(4): 948–957. doi: 10.11999/JEIT240716.

    LI Bin, SHEN Li, ZHAO Chuanxin, et al. Robust resource optimization in integrated sensing, communication, and computing networks based on soft actor-critic[J]. Journal of Electronics & Information Technology, 2025, 47(4): 948–957. doi: 10.11999/JEIT240716.
    [35] ANTONIK P, WICKS W C, GRIFFITHS H D, et al. Frequency diverse array radars[C]. 2006 IEEE Conference on Radar, Verona, USA, 2006: 470–475. doi: 10.1109/RADAR.2006.1631800.
    [36] ZHU Jingjing, ZHU Shengqi, XU Jingwei, et al. Simultaneous detection and discrimination of mainlobe deceptive jammers in FDA-MIMO radar[J]. IEEE Transactions on Aerospace and Electronic Systems, 2023, 59(6): 7499–7513. doi: 10.1109/TAES.2023.3291683.
    [37] YUAN Tao, HE Feng, DONG Zhen, et al. Suppress mainlobe deceptive jamming target under unambiguous range compensation based on FDA-MIMO radar[J]. IEEE Transactions on Aerospace and Electronic Systems, 2024, 60(5): 6853–6868. doi: 10.1109/TAES.2024.3407729.
    [38] LYNCH D. Introduction to RF Stealth[M]. Raleigh: Science Technology Publishing Inc., 2004: 51–55.
  • 加载中
图(20) / 表(6)
计量
  • 文章访问数:  15
  • HTML全文浏览量:  4
  • PDF下载量:  3
  • 被引次数: 0
出版历程
  • 修回日期:  2026-04-17
  • 录用日期:  2026-04-17
  • 网络出版日期:  2026-05-05

目录

    /

    返回文章
    返回