logo
CanyamAI summaries for academic research
language
MobileMobile
  • Phone FeatureWeChat Mini Program
EnglishEnglish
noticeNotice
BlogBlog
delete
arrow
Back
S

Shalabh Bhatnagar

indian institute of science

30H-index
362Paper Count
4.6KCitation Count
Published Papers 40
Publication Date
logo
An Actor–Critic Algorithm With Function Approximation for Risk Sensitive Cost Markov Decision Processes
errIEEE Transactions on Automatic Control
IF7
err2025-07-28
err0
PREAI
errSoumyajit Guin; Vivek S. Borkar; Shalabh Bhatnagar
errShare
errSave
Generalized Simultaneous Perturbation-Based Gradient Search With Reduced Estimator Bias
errIEEE Transactions on Automatic Control
IF7
err2025-07-01
err0
PREAI
errSoumen Pachal; Shalabh Bhatnagar; Prashanth L. A.
errShare
errSave
n -step temporal difference learning with optimal n
errAutomatica
IF5.9
err2025-06-18
err0
PREAI
errLakshmi Mandal; Shalabh Bhatnagar
errShare
errSave
Truncated Cauchy random perturbations for smoothed functional-based stochastic optimization
errAUTOMATICA
IF5.9
err2024-04-01
err2
PREAI
errMondal, Akash; Prashanth, L. A.; Bhatnagar, Shalabh
errShare
errSave
Energy Management in a Cooperative Energy Harvesting Wireless Sensor Network
errIEEE COMMUNICATIONS LETTERS
IF4.4
err2024-01-01
err2
errOAAI
errBarat, Arghyadeep; Prabuchandran, K. J.; Bhatnagar, Shalabh
errShare
errSave
A Generalized Minimax Q-Learning Algorithm for Two-Player Zero-Sum Stochastic Games
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2022-09-01
err4
errOAAI
errDiddigi, Raghuram Bharadwaj; Kamanchi, Chandramouli; Bhatnagar, Shalabh
errShare
errSave
Generalized Second-Order Value Iteration in Markov Decision Processes
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2022-08-01
err3
errOAAI
errKamanchi, Chandramouli; Diddigi, Raghuram Bharadwaj; Bhatnagar, Shalabh
errShare
errSave
Stochastic Approximation With Iterate-Dependent Markov Noise Under Verifiable Conditions in Compact State Space With the Stability of Iterates Not Ensured
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2021-12-01
err5
PREAI
errKarmakar, Prasenjit; Bhatnagar, Shalabh
errShare
errSave
Asynchronous Stochastic Approximations With Asymptotically Biased Errors and Deep Multiagent Learning
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2021-09-01
err0
errOAAI
errRamaswamy, Arunselvan; Bhatnagar, Shalabh; Quevedo, Daniel E.
errShare
errSave
Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge
errIEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS
IF8.4
err2021-01-01
err148
errOAAI
errSingla, Abhik; Padakandla, Sindhu; Bhatnagar, Shalabh
errShare
errSave
Novel First Order Bayesian Optimization with an Application to Reinforcement Learning
errAPPLIED INTELLIGENCE
IF3.5
err2020-09-30
err15
PREAI
errPrabuchandran, K. J.; Penubothula, Santosh; Kamanchi, Chandramouli; Bhatnagar, Shalabh
errShare
errSave
Reinforcement learning algorithm for non-stationary environments
errAPPLIED INTELLIGENCE
IF3.5
err2020-06-18
err72
PREAI
errPadakandla, Sindhu; Prabuchandran, K. J.; Bhatnagar, Shalabh
errShare
errSave
Random Directions Stochastic Approximation With Deterministic Perturbations
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2020-06-01
err5
errOAAI
errPrashanth, L. A.; Bhatnagar, Shalabh; Bhavsar, Nirav; Fu, Michael; Marcus, Steven, I
errShare
errSave
Analysis of Stochastic Approximation Schemes With Set-Valued Maps in the Absence of a Stability Guarantee and Their Stabilization
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2020-03-01
err4
errOAAI
errYaji, Vinayaka G.; Bhatnagar, Shalabh
errShare
errSave
Stability of Stochastic Approximations With Controlled Markov Noise and Temporal Difference Learning
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2019-06-01
err9
errOAAI
errRamaswamy, Arunselvan; Bhatnagar, Shalabh
errShare
errSave
An online prediction algorithm for reinforcement learning with linear function approximation using cross entropy method
errMACHINE LEARNING
IF2.9
err2018-07-03
err10
errOAAI
errJoseph, Ajin George; Bhatnagar, Shalabh
errShare
errSave
Analysis of Gradient Descent Methods With Nondiminishing Bounded Errors
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2018-05-01
err10
errOAAI
errRamaswamy, Arunselvan; Bhatnagar, Shalabh
errShare
errSave
A Linearly Relaxed Approximate Linear Program for Markov Decision Processes
errIEEE TRANSACTIONS ON AUTOMATIC CONTROL
IF7
err2018-04-01
err22
errOAAI
errLakshminarayanan, Chandrashekar; Bhatnagar, Shalabh; Szepesvari, Csaba
errShare
errSave
An incremental off-policy search in a model-free Markov decision process using a single sample path
errMACHINE LEARNING
IF2.9
err2018-02-13
err2
errOAAI
errJoseph, Ajin George; Bhatnagar, Shalabh
errShare
errSave
A stability criterion for two timescale stochastic approximation schemes
errAUTOMATICA
IF5.9
err2017-05-01
err14
PREAI
errLakshminarayanan, Chandrashekar; Bhatnagar, Shalabh
errShare
errSave

Research Directions

No research directions
Co-authors
Cooperation Journals
C
Csaba Szepesvári
H-index: 57 · Papers: 471
D
Daniel E. Quevedo
H-index: 53 · Papers: 408
M
Michael C. Fu
H-index: 49 · Papers: 610
V
Vivek S. Borkar
H-index: 49 · Papers: 543
S
Steven I. Marcus
H-index: 48 · Papers: 321
View more