高级搜索

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

TaGate:事务感知的多芯粒流控框架

李开,  付文文,  杨乾明,  曾坤,  张见,  王永文

李开, 付文文, 杨乾明, 曾坤, 张见, 王永文. TaGate:事务感知的多芯粒流控框架[J]. 电子与信息学报. doi: 10.11999/JEIT260795
引用本文: 李开, 付文文, 杨乾明, 曾坤, 张见, 王永文. TaGate:事务感知的多芯粒流控框架[J]. 电子与信息学报. doi: 10.11999/JEIT260795
LI Kai, FU Wenwen, YANG Qianming, ZENG Kun, ZHANG Jian, WANG Yongwen. TaGate: A Transaction-aware Multi-chiplet Flow Control Framework[J]. Journal of Electronics & Information Technology. doi: 10.11999/JEIT260795
Citation: LI Kai, FU Wenwen, YANG Qianming, ZENG Kun, ZHANG Jian, WANG Yongwen. TaGate: A Transaction-aware Multi-chiplet Flow Control Framework[J]. Journal of Electronics & Information Technology. doi: 10.11999/JEIT260795

TaGate:事务感知的多芯粒流控框架

doi: 10.11999/JEIT260795 cstr: 32379.14.JEIT260795
基金项目: 国防科技大学自主科研基金项目
详细信息
    作者简介:

    李开:男,在读博士研究生,研究方向为微处理器体系结构设计,邮箱 klinudt@nudt.edu.cn

    付文文:男,助理研究员,研究方向为微处理器体系结构设计,邮箱 fuwenwen94@nudt.edu.cn

    杨乾明:男,副研究员,研究方向为微处理器体系结构设计

    曾坤:男,副研究员,研究方向为微处理器体系结构设计

    张见:男,助理研究员,研究方向为微处理器体系结构设计

    王永文:男,研究员,研究方向为高性能微处理器体系结构及其实现技术

    通讯作者:

    付文文 fuwenwen94@nudt.edu.cn

  • 中图分类号: TN402;TP393

TaGate: A Transaction-aware Multi-chiplet Flow Control Framework

Funds: Innovation Research Foundation of National University of Defense Technology
  • 摘要: 多芯粒系统为维护全局缓存一致性而频繁地在芯粒间进行事务交互,产生了大量跨芯粒通信负载。一致性事务由多个按序执行的流量控制单元(Flow control unit, Flit)组成,当多个跨芯粒事务Flit并发时,后序Flit可能经同一芯粒接口传输,造成回传汇聚。相较于芯粒内片上网络(Network on Chip, NoC),芯粒间互连链路具有高延迟、低带宽的固有特征,无法承载回传汇聚产生的突发流量,导致事务Flit在接口处持续堆积,形成严重的拥塞热点。芯粒接口拥塞不仅会沿路由路径扩散阻碍本地NoC流量正常传输,还会使跨芯粒的一致性事务延迟持续攀升,使拥塞在多芯粒间扩散传播,导致系统全局性能恶化。然而,现有的流量控制研究多关注于链路优化,由于缺乏协议层视图,难以主动识别和干预一致性事务的流量拥塞问题。为此本文提出了TaGate框架,该框架基于事务语义感知进行跨层协同,将协议层的有序依赖关系映射到链路层流控策略,从而实现事务自适应的流量线速传输。经验证,TaGate能够有效避免回传汇聚现象,在高负载场景下消除了芯粒接口拥塞,并在维持芯粒间互连带宽的同时,本地事务平均延迟损失降低15%以上。
  • 图  1  事务流量回传汇聚示意图

    图  2  事务流量拥塞扩散示意图

    图  3  TaGate总体架构示意图

    图  4  事务语义感知机制示意图

    图  5  事务依赖关系映射示意图

    图  6  自适应线速流控示意图

    图  7  TaGate实现结构示意图

    图  8  Flit解析逻辑示意图

    图  9  回传检测逻辑示意图

    图  10  算法执行流程示意图

    图  11  回传流量汇聚对比示意图

    图  12  回传通道FIFO占用变化

    图  13  各类事务下回传通道占用变化

    图  14  不同流量规模下FIFO占用分布

    图  15  不同流量规模下本地事务延迟CDF

    图  16  UCIe吞吐实时变化

    表  1  芯粒互连特征参数表

    特征 片内互连 芯粒间互连
    互连介质 片上金属层 基板 硅桥 中介层
    互连线距 <1 μm
    (BEOL金属层)
    100–130 μm
    (C4凸点)
    25–55 μm
    (桥内<4 μm)
    25–55 μm
    (BEOL<2 μm)
    带宽 单链路带宽 2 Tb/s 256 GB/s(UCIe-S) 512 GB/s(UCIe-A) 819 GB/s(HBM3)
    带宽密度 >10 TB/s(聚合) 224 GB/s/mm 10.5 Tbps/mm 819 GB/s/堆栈
    单跳延迟 1–3 cycles(~1 ns) 10–100 ns
    (协议栈往返)
    2–5 ns 2–3 ns
    下载: 导出CSV

    表  2  芯粒互连特征参数表

    范围 参数类型 配置值
    系统 芯粒数量 4
    拓扑结构 芯粒间拓扑结构 2×2 Mesh
    NoC拓扑结构 4×4 Mesh
    路由算法 XY维度序路由
    芯粒间互连 UCIe时钟频率 1.5GHz
    D2D直连接口 4个/芯粒边界
    接口FIFO深度 128
    芯粒 NoC时钟频率 2 GHz
    缓存一致性协议 AMBA CHI
    TaGate 注入缓冲区大小 256 flits
    令牌桶深度 112(16阈值)
    令牌生成速率 三级动态调整
    *接口FIFO深度为回传通道的缓冲大小
    *注入缓冲区在接收端专门用于缓冲Pre-Flit
    下载: 导出CSV

    表  3  混合流量场景下相关测试数据

    类型 无流控 TaGate流控 变化率
    本地事务平均延迟 506166 ps 426791 ps –15.68%
    本地事务最大延迟 2013500 ps 1855000 ps –7.87%
    通道FIFO最大占用 128 Flits 107 Flits –16.41%
    跨芯粒事务平均延迟 596496 ps 609613 ps +1.75%
    跨芯粒事务最大延迟 2757500 ps 1994500 ps –27.67%
    UCIe平均带宽 82% 81% –1.00%
    下载: 导出CSV
  • [1] SCHÄTZLE F, FALQUEZ C, HO N, et al. Modeling Chiplet-to-Chiplet (C2C) communication for chiplet-based co-design[C]. Proceedings of the ISC High Performance 2025 Research Paper Proceedings (40th International Conference), Hamburg, Germany, 2025: 1–11. doi: 10.23919/ISC.2025.11018303.
    [2] MALLYA M B, GOEL B, and SOURDIS I. MEMPLEX: A memory system with replication and migration of data for multi-chiplet NUMA architectures[C]. Proceedings of the 39th ACM International Conference on Supercomputing (ICS '25), Salt Lake City, USA, 2025: 1219–1233. doi: 10.1145/3721145.3725776.
    [3] MAROÑAS M, NAVARRO A, AYGUADÉ E, et al. Mitigating the NUMA effect on task-based runtime systems[J]. The Journal of Supercomputing, 2023, 79(13): 14287–14312. doi: 10.1007/s11227-023-05164-9.
    [4] MUSAVI M, IRABOR E, DAS A, et al. Communication characterization of AI workloads for large-scale multi-chiplet accelerators[C]. Proceedings of 2025 IEEE International Symposium on Circuits and Systems (ISCAS), London, United Kingdom, 2025: 1–5. doi: 10.1109/ISCAS56072.2025.11043311.
    [5] NAGARAJAN V, SORIN D J, HILL M D, et al. A Primer on Memory Consistency and Cache Coherence[M]. 2nd ed. Cham, Switzerland: Springer, 2020: 91–106. doi: 10.1007/978-3-031-01764-3.
    [6] LI Weihang, GOENS A, OSWALD N, et al. Determining the minimum number of virtual networks for different coherence protocols[C]. Proceedings of 2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA), Buenos Aires, Argentina, 2024: 182–197. doi: 10.1109/ISCA59077.2024.00023.
    [7] MATOUSSI O. NoC performance model for efficient network latency estimation[C]. Proceedings of Design, Automation & Test in Europe Conference & Exhibition (DATE), Grenoble, France, 2021: 994–999. doi: 10.23919/DATE51398.2021.9474101.
    [8] BHASKAR A V and VENKATESH T G. Performance analysis of network-on-chip in many-core processors[J]. Journal of Parallel and Distributed Computing, 2021, 147: 196–208. doi: 10.1016/j.jpdc.2020.09.013.
    [9] LIU Yafei, LI Xiangyu, and YIN Shouyi. Review of chiplet-based design: System architecture and interconnection[J]. Science China Information Sciences, 2024, 67(10): 200401. doi: 10.1007/s11432-023-3926-8.
    [10] 卢美璇, 许浩博, 王颖, 等. 芯粒集成芯片架构-封装协同设计[J]. 电子与信息学报, 2025, 47(9): 2994–3009. doi: 10.11999/JEIT250626.

    LU Meixuan, XU Haobo, WANG Ying, et al. Co-design of architecture and packaging in chiplet[J]. Journal of Electronics & Information Technology, 2025, 47(9): 2994–3009. doi: 10.11999/JEIT250626.
    [11] ZHANG Jinming, CHEN Zhihong, YE Yaoyao, et al. IPDR: An inter-chiplet priority-driven deadlock resolution for 2-D/2.5-D multichiplet systems[J]. IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2025, 33(9): 2424–2437. doi: 10.1109/TVLSI.2025.3583289.
    [12] DAS SHARMA D. An introduction to the universal chiplet interconnect express® (UCIe®)[J]. ACM Computing Surveys, 2026, 58(13): 347. doi: 10.1145/3819235.
    [13] DAS SHARMA D, CHOUDHARY S, ONUFRYK P, et al. On-package memory with universal chiplet interconnect express (UCIe): A low power, high bandwidth, low latency and low cost approach[C]. Proceedings of 2025 IEEE Symposium on High-Performance Interconnects (HOTI), San Jose, USA, 2025: 87–96. doi: 10.1109/HOTI66940.2025.00027.
    [14] 王知非, 黄之闻, 叶天辰, 等. 面向芯粒互连的单端64 Gb/s全双工收发机设计[J]. 电子与信息学报, 2025, 47(9): 2979–2993. doi: 10.11999/JEIT250506.

    WANG Zhifei, HUANG Zhiwen, YE Tianchen, et al. A 64Gb/s single-ended simultaneous bi-directional transceiver for die-to-die interfaces[J]. Journal of Electronics & Information Technology, 2025, 47(9): 2979–2993. doi: 10.11999/JEIT250506.
    [15] AN S, OH J, and LIU Ming. Server chiplet networking[C]. Proceedings of the 24th ACM Workshop on Hot Topics in Networks (HotNets '25), UMD Campus College Park, USA, 2025: 289–299. doi: 10.1145/3772356.3772389.
    [16] ZHOU Shize, FAN Wenjie, LI Siyue, et al. An adaptive congestion-aware approximate communication (ACAC) scheme and implementation for network-on-chip systems[J]. Integration, 2026, 106: 102561. doi: 10.1016/j.vlsi.2025.102561.
    [17] MERINO A, ESCUDERO-SAHUQUILLO J, GARCIA P J, et al. A hybrid solution to provide end-to-end flow control and congestion management in high-performance interconnection networks[C]. Proceedings of 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Philadelphia, USA, 2024: 8–17. doi: 10.1109/CCGrid59990.2024.00011.
    [18] QI Xingyun, LAI Mingche, DONG Dezun, et al. PFT: A congestion avoidance method based on proactive flow throttling at endpoints[C]. Proceedings of 2021 IFIP/IEEE International Symposium on Integrated Network Management (IM), Bordeaux, France, 2021: 572–578.
    [19] LU Chengdi, CHEN Yuang, ZHANG Fangyu, et al. FAFC: Fast and accurate flow control in data center networks[J]. IEEE Transactions on Network and Service Management, 2026, 23: 6927–6941. doi: 10.1109/TNSM.2026.3726287.
    [20] 周武, 倪天明, 徐冬雨, 等. 面向芯粒互连网络的故障与拥塞联合感知自适应路由算法[J]. 电子与信息学报, 2025, 47(9): 3155–3166. doi: 10.11999/JEIT250294.

    ZHOU Wu, NI Tianming, XU Dongyu, et al. A joint fault and congestion-aware adaptive routing algorithm for chiplet interconnect networks[J]. Journal of Electronics & Information Technology, 2025, 47(9): 3155–3166. doi: 10.11999/JEIT250294.
    [21] 徐冬雨, 欧阳一鸣, 黄正峰, 等. 一种基于自适应容错链路的片上网络设计与研究[J]. 电子与信息学报, 2024, 46(11): 4092–4100. doi: 10.11999/JEIT240162.

    XU Dongyu, OUYANG Yiming, HUANG Zhengfeng, et al. A design of on-chip network with self-adaptive fault-tolerant link[J]. Journal of Electronics & Information Technology, 2024, 46(11): 4092–4100. doi: 10.11999/JEIT240162.
    [22] KONDOTH L, SHANKARAN R, SHENG Q Z, et al. A survey of adaptive routing techniques in two-dimensional network-on-chip architectures[J]. IEEE Communications Surveys & Tutorials, 2026, 28: 3195–3234. doi: 10.1109/COMST.2025.3636503.
    [23] 周宏伟, 陈志强, 曾坤, 等. 多芯粒网络中负载均衡的死锁解决算法[J]. 国防科技大学学报, 2025, 47(2): 146–154. doi: 10.11887/j.cn.202502013.

    ZHOU Hongwei, CHEN Zhiqiang, ZENG Kun, et al. Load-balanced deadlock resolution algorithm in multi-chiplet network[J]. Journal of National University of Defense Technology, 2025, 47(2): 146–154. doi: 10.11887/j.cn.202502013.
    [24] CHEN Zhiqiang, FU Wenwen, WANG Yongwen, et al. A deadlock-free bridge module for inter-chiplet cache-coherent communication in an open chiplet ecosystem[C]. Proceedings of 2026 IEEE International Symposium on High Performance Computer Architecture (HPCA), Sydney, Australia, 2026: 1–13. doi: 10.1109/HPCA68181.2026.11408455.
    [25] MAJUMDER P, KIM S, HUANG Jiayi, et al. Remote control: A simple deadlock avoidance scheme for modular systems-on-chip[J]. IEEE Transactions on Computers, 2021, 70(11): 1928–1941. doi: 10.1109/TC.2020.3029682.
  • 加载中
图(16) / 表(3)
计量
  • 文章访问数:  10
  • HTML全文浏览量:  2
  • PDF下载量:  0
  • 被引次数: 0
出版历程
  • 收稿日期:  2026-05-31
  • 修回日期:  2026-11-05
  • 录用日期:  2026-11-05
  • 网络出版日期:  2026-11-20

目录

    /

    返回文章
    返回