arrow
返回

Multi -objective evolutionary optimization for hardware -aware neural network pruning

delete2024-07-01
delete4
delete
OA
AI
洪文静 封面图
洪文静 (Wenjing Hong)
G
Guiying Li
S
Shengcai Liu
杨
杨朋 (Peng Yang)
汤
汤珂 (Ke Tang) *
DOI:10.1016/j.fmre.2022.07.013delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Neural network pruning is a popular approach to reducing the computational complexity of deep neural networks. In recent years, as growing evidence shows that conventional network pruning methods employ inappropriate proxy metrics, and as new types of hardware become increasingly available, hardware-aware network pruning that incorporates hardware characteristics in the loop of network pruning has gained growing attention. Both network accuracy and hardware efficiency (latency, memory consumption, etc.) are critical objectives to the success of network pruning, but the conflict between the multiple objectives makes it impossible to find a single optimal solution. Previous studies mostly convert the hardware-aware network pruning to optimization problems with a single objective. In this paper, we propose to solve the hardware-aware network pruning problem with Multi-Objective Evolutionary Algorithms (MOEAs). Specifically, we formulate the problem as a multi-objective optimization problem, and propose a novel memetic MOEA, namely HAMP, that combines an efficient portfolio- based selection and a surrogate-assisted local search, to solve it. Empirical studies demonstrate the potential of MOEAs in providing simultaneously a set of alternative solutions and the superiority of HAMP compared to the state-of-the-art hardware-aware network pruning method.
Keyword:
Multi-objective optimization
Evolutionary algorithm
Neural network pruning
Hardware-aware machine learning
Hardware efficiency
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Fundamental Research 封面图
Fundamental Research
IF:
6.3
论文数:
1.3K
被引数:
2.6K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
Multiobjective evolutionary algorithms: A survey of the state of the art
err2011-03-01
err1.8K
PREAI
errZhou, Aimin; Qu, Bo-Yang; Li, Hui; Zhao, Shi-Zheng; Suganthan, Ponnuthurai Nagaratnam; Zhang, Qingfu
err分享
err收藏
err分享
err收藏
A review of multiobjective test problems and a scalable test problem toolkit
err2006-10-01
err1.5K
errOAAI
errHuband, Simon; Hingston, Phil; Barone, Luigi; While, Lyndon
err分享
err收藏
学者 查看更多内容