arrow
返回

Compact biologically inspired camera with computational compound eye

delete2024-04-23
delete1
delete
OA
AI
S
Shubin Liu
X
Xuning Liu
W
Weijie Fan
M
Meng-Xuan Zhang
李磊 封面图
李磊 (Lei Li) *
DOI:10.1515/nanoph-2023-0782delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The growing interests have been witnessed in the evolution and improvement of artificial compound eyes (CE) inspired by arthropods. However, the existing CE cameras are suffering from a defocusing problem due to the incompatibility with commercial CMOS cameras. Inspired by the CEs of South American Shrimps, we report a compact biologically inspired camera that enables wide-field-of-view (FOV), high-resolution imaging and sensitive 3D moving trajectory reconstruction. To overcome the defocusing problem, a deep learning architecture with distance regulation is proposed to achieve wide-range-clear imaging, without any hardware or complex front-end design, which greatly reduces system complexity and size. The architecture is composed of a variant of Unet and Pyramid-multi-scale attention, with designed short, middle and long distance regulation. Compared to the current competitive well-known models, our method is at least 2 dB ahead. Here we describe the high-resolution computational-CE camera with 271 ommatidia, with a weight of 5.4 g an area of 3 x 3 cm(2 )and 5-mm thickness, which achieves compatibility and integration of CE with commercial CMOS. The experimental result illustrates this computational-CE camera has competitive advantages in enhanced resolution and sensitive 3D live moving trajectory reconstruction. The compact camera has promising applications in nano-optics fields such as medical endoscopy, panoramic imaging and vision robotics.
Keyword:
compound eye
imaging system
deep learning
integrated optics

期刊

Nanophotonics 封面图
Nanophotonics
IF:
6.6
论文数:
3.0K
被引数:
1.6W

机构

S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
U
university of melbourne
学者数:
5.7W
论文数: 5.4W
被引数: 69
引用论文

引用论文

Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field具有极端景深的三叶虫启发神经纳米光子光场相机
err2022-04-19
err95
errOAAI
errFan, Qingbin; Xu, Weizhu; Hu, Xuemei; Zhu, Wenqi; Yue, Tao; Zhang, Cheng; Yan, Feng; Chen, Lu; Lezec, Henri J.; Lu, Yanqing; Agrawal, Amit; Xu, Ting
err分享
err收藏
Varifocal Metalens for Optical Sectioning Fluorescence Microscopy用于光学切片荧光显微镜的变焦超透镜
err2021-06-07
err129
errOAAI
errLuo, Yuan; Chu, Cheng Hung; Vyas, Sunil; Kuo, Hsin Yu; Chia, Yu Hsin; Chen, Mu Ku; Shi, Xu; Tanaka, Takuo; Misawa, Hiroaki; Huang, Yi-You; Tsai, Din Ping
err分享
err收藏
Ignorance Is Bliss: General and Robust Cancellation of Decoherence via No-Knowledge Quantum Feedback
err2014-07-10
err0
errOAAI
errStuart S. Szigeti; Andre R. R. Carvalho; James G. Morley; Michael R. Hush
err分享
err收藏
Smart Compound Eyes Enable Tunable Imaging智能复眼可实现可调谐成像
err2019-07-08
err97
PREAI
errMa, Zhuo-Chen; Hu, Xin-Yu; Zhang, Yong-Lai; Liu, Xue-Qing; Hou, Zhi-Shan; Niu, Li-Gang; Zhu, Lin; Han, Bing; Chen, Qi-Dai; Sun, Hong-Bo
err分享
err收藏
Fabricating microlens arrays by surface wrinkling
err2006-11-24
err349
PREAI
errChan, Edwin P.; Crosby, Alfred J.
err分享
err收藏
Miniature optoelectronic compound eye camera微型光电复眼相机
err2022-09-26
err63
errOAAI
errHu, Zhi-Yong; Zhang, Yong-Lai; Pan, Chong; Dou, Jian-Yu; Li, Zhen-Ze; Tian, Zhen-Nan; Mao, Jiang-Wei; Chen, Qi-Dai; Sun, Hong-Bo
err分享
err收藏
err分享
err收藏
Deep learning enables parallel camera with enhanced- resolution and computational zoom imaging
errPHOTONIX
IF19.1
err2023-06-13
err10
errOAAI
errLiu, Shu-Bin; Xie, Bing-Kun; Yuan, Rong-Ying; Zhang, Meng-Xuan; Xu, Jian-Cheng; Li, Lei; Wang, Qiong-Hua
err分享
err收藏
学者 查看更多内容