.png){kind=icon}
返回
A Stage-Level Network Parallelization Method Based on Depth Decomposition
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3353221.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Parallel computational operations can significantly enhance network computational efficiency, and such processing has a wide range of applications across different spatial scales in networks. However, in the stage-wise level of networks, the majority still defaults to maintaining a serial single-chain structure. We propose a method of splitting across the depth dimension in multiple consecutive stacked computational units, extending such parallel computational operations to the stage-wise level of the network. This type of processing does not introduce excessive computational latency at the network stage level, and the additional computation primarily comes from the Fusion structures between different branches and the widened stage Transition layers. However, due to the relatively small proportion of this additional computational load compared to the entire network and its ease of maintenance, it is manageable. Compared to the performance of a single chain network scaled in depth, the introduction of parallel structures compresses its depth and diversifies the width of the network stage level. Improved the relationship between the initial network's accuracy and computational efficiency within a certain range. Through subsequent improvements to the stage transition layers and the introduction of branch attention, the performance of the parallelized structure can be further enhanced. In conclusion, our approach provides a viable practice for introducing parallel structures within the stage level of stage-wise networks. By transforming the original serial structure of continuously stacked computational units in the stage level into a parallel structure with multiple subnets, we can achieve superior overall performance compared to the original network within a certain range. The code is available at https://github.com/forrest996/ResNet_P.
Keyword:
Deep learning
neural networks
parallelization
computational efficiency
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Determination of the optical band-gap energy of cubic and hexagonal boron nitride using luminescence excitation spectroscopy使用发光激发光谱法测定立方和六方氮化硼的光学带隙能
OAAI
OAAI分享收藏A novel and efficient xanthenic dye–organometallic ion‐pair complex for photoinitiating polymerization一种用于光引发聚合的新型高效的黄原胶染料-有机金属离子对配合物
PREAI
分享收藏Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
PREAI
分享收藏Energy-Efficient Robot Configuration and Motion Planning Using Genetic Algorithm and Particle Swarm Optimization基于遗传算法和粒子群算法的节能机器人配置和运动规划.png)
EnergiesOAAI
EnergiesIF0
OAAI分享收藏Investigation of Ti mesh-supported anodes for direct borohydride fuel cells直接硼氢化物燃料电池用钛网支撑阳极的研究
PREAI
分享收藏Structural study of lanthanides(III) in aqueous nitrate and chloride solutions by EXAFS通过EXAFS对硝酸盐和氯化物水溶液中镧系元素 (III) 的结构研究
PREAI
分享收藏
查看更多内容