.png){kind=icon}
.png){kind=icon}
Return
Toward Energy-Efficient Collaborative Inference Using Multisystem Approximations
.png){kind=icon}
PRE
AI
DOI：10.1109/JIOT.2024.3365306.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Cooperative inference applications have seen considerable potential with distributed deep neural networks (DDNNs). One use for DDNNs is the classification of 3-D objects from a set of 2-D images or views. This approach is also known as multiview convolutional neural networks (MVCNNs). However, due to the intensive computational demands, substantial communication overhead, high-inference delay, and energy limits, it is difficult to deploy MVCNN on resource-constrained edge devices. This article proposes for the first time the concept of distributed approximate systems (DRAX), which employs a multidevice approach to approximate computing and uses synergistic approximations of various edge computing systems to enable energy-efficient collaborative DDNN inference. DRAX performs a significance-aware approximation of multiple nodes and prunes the large design space using the nonuniform contribution of various perspectives/views to the final inference to achieve optimal quality-energy tradeoff. In addition, we also propose a novel remaining energy-aware heuristic, which dynamically chooses the approximation degree based on the user-provided quality bounds and further increases the system lifetime. The experimental results obtained from a prototype of a 12-view 3-D object classification system implemented on an Intel Stratix IV FPGA development board demonstrate substantial energy savings ( 2.6 x to 8 ) for minimal (<1%) application-level quality loss.
Keywords:
Three-dimensional displays
Energy efficiency
Collaboration
Feature extraction
Convolutional neural networks
Object recognition
Image edge detection
Approximate computing
collaborative systems
DNN inference
energy efficient
multiview
Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W
