.png){kind=icon}
返回
Survey: Exploiting Data Redundancy for Optimization of Deep Learning
.png){kind=icon}
OA
AI
DOI：10.1145/3564663.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Data redundancy is ubiquitous in the inputs and intermediate results of Deep Neural Networks (DNN). It offers many significant opportunities for improving DNN performance and efficiency and has been explored in a large body of work. These studies have scattered in many venues across several years. The targets they focus on range from images to videos and texts, and the techniques they use to detect and exploit data redundancy also vary in many aspects. There is not yet a systematic examination and summary of the many efforts, making it difficult for researchers to get a comprehensive view of the prior work, the state of the art, differences and shared principles, and the areas and directions yet to explore. This article tries to fill the void. It surveys hundreds of recent papers on the topic, introduces a novel taxonomy to put the various techniques into a single categorization framework, offers a comprehensive description of the main methods used for exploiting data redundancy in improving multiple kinds of DNNs on data, and points out a set of research opportunities for future exploration.
Keyword:
Data redundancy
representation redundancy
deep neural network
convolutional neural network
transformer
期刊
IF:
28
论文数:
2.5K
被引数:
3.5W
机构
引用论文
Enhanced Efficiency 3D Convolution Based on Optimal FPGA Accelerator基于优化FPGA加速器的高效三维卷积.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏Late diagenesis of illite-smectite in the Podhale Basin, southern Poland: Chemistry, morphology, and preferred orientationGeosphereOAAI
GeosphereIF0
OAAI分享收藏分享收藏分享收藏Tracking disease progression by searching paths in a temporal network of biological processesPLOS ONEOAAI
PLOS ONEIF0
OAAI分享收藏分享收藏
查看更多内容