.png){kind=icon}
返回
Solving multi-armed bandit problems using a chaotic microresonator comb
.png){kind=icon}
OA
AI
DOI：10.1063/5.0173287.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The Multi-Armed Bandit (MAB) problem, foundational to reinforcement learning-based decision-making, addresses the challenge of maximizing rewards amid multiple uncertain choices. While algorithmic solutions are effective, their computational efficiency diminishes with increasing problem complexity. Photonic accelerators, leveraging temporal and spatial-temporal chaos, have emerged as promising alternatives. However, despite these advancements, current approaches either compromise computation speed or amplify system complexity. In this paper, we introduce a chaotic microresonator frequency comb (chaotic comb) to tackle the MAB problem, where each comb mode is assigned to a slot machine. Through a proof-of-concept experiment, we employ 44 comb modes to address an MAB with 44 slot machines, demonstrating performance competitive with both conventional software algorithms and other photonic methods. Furthermore, the scalability of decision making is explored with up to 512 slot machines using experimentally obtained temporal chaos in different time slots. Power-law scalability is achieved with an exponent of 0.96, outperforming conventional software-based algorithms. Moreover, we find that a numerically calculated chaotic comb accurately reproduces experimental results, paving the way for discussions on strategies to increase the number of slot machines. (c) 2024 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Keyword:
RANDOM BIT GENERATION
KERR-FREQUENCY COMBS
DYNAMICS
期刊
IF:
5.3
论文数:
1.5K
被引数:
5.5K
机构
引用论文
High-yield, wafer-scale fabrication of ultralow-loss, dispersion-engineered silicon nitride photonic circuits超低损耗，色散工程氮化硅光子电路的高产量，晶片规模制造.png)
NATURE COMMUNICATIONS
OAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏The cathodic behavior of microwave-treated manganese dioxide in lithium nonaqueous cells微波处理的二氧化锰在非水锂电池中的阴极行为
PREAI
分享收藏Minimal-post-processing 320-Gbps true random bit generation using physical white chaosOPTICS EXPRESSOAAI
OPTICS EXPRESSIF3.3
OAAI分享收藏分享收藏Photonics for artificial intelligence and neuromorphic computing用于人工智能和神经形态计算的光子学NATURE PHOTONICSOAAI
NATURE PHOTONICSIF32.9
OAAI分享收藏分享收藏Controlling chaotic itinerancy in laser dynamics for reinforcement learningSCIENCE ADVANCESOAAI
SCIENCE ADVANCESIF12.5
OAAI分享收藏
查看更多内容