arrow
Return

A Deep Reinforcement Learning Framework for High-Dimensional Circuit Linearization

delete2022-09-01
delete3
delete
OA
AI
C
Chao Rong
J
Jeyanandh Paramesh
L
L.R. Carley *
DOI:10.1109/TCSII.2022.3183156delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Despite the successes of Reinforcement Learning (RL) in recent years, tasks that require exploring over long trajectories with limited feedback and searching in high-dimensional space remain challenging. This brief proposes a deep RL framework for high-dimensional circuit linearization with an efficient exploration strategy leveraging a scaled dot-product attention scheme and search on the replay technique. As a proof of concept, a 5-bit digital-to-time converter (DTC) is built as the environment, and an RL agent learns to tune the calibration words of the delay stages to minimize the integral nonlinearity (INL) with only scalar feedback. The policy network which selects calibration words is trained by the Soft Actor-Critic (SAC) algorithm. Our results show that the proposed RL framework can reduce the INL to less than 0.5 LSB within 60, 000 trials, which is much smaller than the size of searching space.
Keywords:
Calibration
Delays
Training
Linearity
Codes
Phase locked loops
Reinforcement learning
Deep reinforcement learning
circuits calibration
high-dimensional searching
attention scheme

Journal

I
IEEE Transactions on Circuits and Systems and Express Briefs
IF:
4.9
Papers:
8.8K
Citations:
2.5W

Organization

C
Carnegie Mellon University
Scholars:
1.4W
Papers: 1.4W
Citations: 2.7W
Cited Papers

Cited Papers

Physico-mechanical, thermal and morphological properties of furfuryl alcohol/2-ethylhexyl methacrylate/halloysite nanoclay wood polymer nanocomposites (WPNCs)
err2017-07-01
err0
errOAAI
errMd. Rezaur Rahman; Sinin Hamdan; Josephine Chang Hui Lai; Mohammad Jawaid; Fahmi Asyadi bin Md Yusof
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
Intraorbital Encephalocele in an Adult Patient Presenting With Pulsatile Exophthalmos -Case Report-
err2010-01-01
err0
errOAAI
errHirofumi MORIHARA; Kiichiro ZENKE; Daisuke SHODA; Satoshi FUJIWARA; Satoshi SUEHIRO; Takao HATAKEYAMA
errShare
errSave
Finite-time analysis of the multiarmed bandit problem
err2002-01-01
err4.2K
PREAI
errAuer, P; Cesa-Bianchi, N; Fischer, P
errShare
errSave
Assessment of reservoir sedimentation of irrigation dams in northern Ghana
err2019-09-25
err0
PREAI
errThomas A. Adongo; Nicholas Kyei-Baffour; Felix K. Abagale; Wilson A. Agyare
errShare
errSave
Mismatch Analysis of DTCs With an Improved BIST-TDC in 28-nm CMOS
err2022-01-01
err10
errOAAI
errChen, Peng; Yin, Jun; Zhang, Feifei; Mak, Pui-In; Martins, Rui P.; Staszewski, Robert Bogdan
errShare
errSave
researcher View more