.png){kind=icon}
返回
Instance Segmentation in the Dark
.png){kind=icon}
OA
AI
DOI：10.1007/s11263-023-01808-8.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Existing instance segmentation techniques are primarily tailored for high-visibility inputs, but their performance significantly deteriorates in extremely low-light environments. In this work, we take a deep look at instance segmentation in the dark and introduce several techniques that substantially boost the low-light inference accuracy. The proposed method is motivated by the observation that noise in low-light images introduces high-frequency disturbances to the feature maps of neural networks, thereby significantly degrading performance. To suppress this feature noise, we propose a novel learning method that relies on an adaptive weighted downsampling layer, a smooth-oriented convolutional block, and disturbance suppression learning. These components effectively reduce feature noise during downsampling and convolution operations, enabling the model to learn disturbance-invariant features. Furthermore, we discover that high-bit-depth RAW images can better preserve richer scene information in low-light conditions compared to typical camera sRGB outputs, thus supporting the use of RAW-input algorithms. Our analysis indicates that high bit-depth can be critical for low-light instance segmentation. To mitigate the scarcity of annotated RAW datasets, we leverage a low-light RAW synthetic pipeline to generate realistic low-light data. In addition, to facilitate further research in this direction, we capture a real-world low-light instance segmentation dataset comprising over two thousand paired low/normal-light images with instance-level pixel-wise annotations. Remarkably, without any image preprocessing, we achieve satisfactory performance on instance segmentation in very low light (4% AP higher than state-of-the-art competitors), meanwhile opening new opportunities for future research. Our code and dataset are publicly available to the community ().
Keyword:
Instance segmentation
Feature denoising
Low-light image dataset
Object detection
期刊
IF:
9.3
论文数:
4.0K
被引数:
2.8W
机构
引用论文
分享收藏Effects of heated seat and foot heater on thermal comfort and heater energy consumption in vehicle加热座椅和脚加热器对车内热舒适性和加热器能耗的影响.png)
Ergonomics
ErgonomicsIF0
PREAI
分享收藏ARVino - outdoor augmented reality visualisation of viticulture GIS dataARVino-葡萄栽培GIS数据的户外增强现实可视化
OAAI
OAAI分享收藏Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏6-Deoxyerythronolide B Analogue Production in Escherichia coli through Metabolic Pathway EngineeringBiochemistry
BiochemistryIF0
PREAI
分享收藏分享收藏
查看更多内容