.png){kind=icon}
返回
The value-complexity trade-off for reinforcement learning based brain-computer interfaces
.png){kind=icon}
PRE
AI
DOI：10.1088/1741-2552/abc8d8.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Objective. One of the recent developments in the field of brain-computer interfaces (BCI) is the reinforcement learning (RL) based BCI paradigm, which uses neural error responses as the reward feedback on the agent's action. While having several advantages over motor imagery based BCI, the reliability of RL-BCI is critically dependent on the decoding accuracy of noisy neural error signals. A principled method is needed to optimally handle this inherent noise under general conditions. Approach. By determining a trade-off between the expected value and the informational cost of policies, the info-RL (IRL) algorithm provides optimal low-complexity policies, which are robust under noisy reward conditions and achieve the maximal obtainable value. In this work we utilize the IRL algorithm to characterize the maximal obtainable value under different noise levels, which in turn is used to extract the optimal robust policy for each noise level. Main results. Our simulation results of a setting with Gaussian noise show that the complexity level of the optimal policy is dependent on the reward magnitude but not on the reward variance, whereas the variance determines whether a lower complexity solution is favorable or not. We show how this analysis can be utilized to select optimal robust policies for an RL-BCI and demonstrate its use on EEG data. Significance. We propose here a principled method to determine the optimal policy complexity of an RL problem with a noisy reward, which we argue is particularly useful for RL-based BCI paradigms. This framework may be used to minimize initial training time and allow for a more dynamic and robust shared control between the agent and the operator under different conditions.
Keyword:
brain– computer interface
EEG
ErrP
noise
reinforcement learning
control information
complexity
期刊
IF:
3.8
论文数:
4.0K
被引数:
1.4W
机构
引用论文
Teaching brain-machine interfaces as an alternative paradigm to neuroprosthetics control.png)
SCIENTIFIC REPORTS
OAAI
SCIENTIFIC REPORTSIF3.9
OAAI分享收藏A Review of Error-Related Potential-Based Brain-Computer Interfaces for Motor Impaired PeopleIEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Towards error categorisation in BCI: single-trial EEG classification between different errors走向BCI中的错误分类: 不同错误之间的单次试验脑电图分类OAAI
OAAI分享收藏Errare machinale est: the use of error-related potentials in brain-machine interfacesErrare machinale est: 在脑机接口中使用与错误相关的电位OAAI
OAAI分享收藏
查看更多内容