arrow
Return

Neuromorphic computing chip with spatiotemporal elasticity for multi-intelligent-tasking robots

delete2022-06-29
delete27
PRE
AI
M
Ma, Songchen
J
Jing Pei
W
Weihao Zhang
G
Guanrui Wang
D
Dahu Feng
于福临 (Fangwen Yu)
C
Chenhang Song
H
Huanyu Qu
C
Cheng Ma
M
Mingsheng Lu
F
Faqiang Liu
W
Wenhao Zhou
Y
Yujie Wu
林逸晗 cover
林逸晗 (Yihan Lin)
H
Hongyi Li
T
Taoyi Wang
J
Jiuru Song
X
Xue Liu
G
Guoqi Li
R
Rong Zhao
L
Luping Shi *
DOI:10.1126/scirobotics.abk2948delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advances in artificial intelligence have enhanced the abilities of mobile robots in dealing with complex and dynamic scenarios. However, to enable computationally intensive algorithms to be executed locally in multi-task robots with low latency and high efficiency, innovations in computing hardware are required. Here, we report TianjicX, a neuromorphic computing hardware that can support true concurrent execution of multiple cross-computing-paradigm neural network (NN) models with various coordination manners for robotics. With spatiotemporal elasticity, TianjicX can support adaptive allocation of computing resources and scheduling of execution time for each task. Key to this approach is a high-level model, Rivulet, which bridges the gap between robotic-level requirements and hardware implementations. It abstracts the execution of NN tasks through distribution of static data and streaming of dynamic data to form the basic activity context, adopts time and space slices to achieve elastic resource allocation for each activity, and performs configurable hybrid synchronous-asynchronous grouping. Thereby, Rivulet is capable of supporting independent and interactive execution. Building on Rivulet with hardware design for realizing spatiotemporal elasticity, a 28-nanometer TianjicX neuromorphic chip with event-driven, high parallelism, low latency, and low power was developed. Using a single TianjicX chip and a specially developed compiler stack, we built a multi-intelligent-tasking mobile robot, Tianjicat, to perform a cat-and-mouse game. Multiple tasks, including sound recognition and tracking, object recognition, obstacle avoidance, and decision-making, can be concurrently executed. Compared with NVIDIA Jetson TX2, latency is substantially reduced by 79.09 times, and dynamic power is reduced by 50.66%.
Keywords:
NEURAL-NETWORKS
PROCESSOR
SYSTEM

Journal

Science Robotics cover
Science Robotics
IF:
27.5
Papers:
919
Citations:
1.4W

Organization

T
tsinghua university
Scholars:
11.7W
Papers: 10.0W
Citations: 137