返回
Segmentation-aware image super-resolution with generative adversarial networks
DOI:10.1007/s00530-025-01668-x.png)
摘要
En 中文
Deep neural networks have greatly facilitated the research in the area of image super-resolution. Existing super-resolution networks primarily focus on optimizing visual image quality, and there has been little work considering the potential use of the super-resolved image for machine vision tasks, such as semantic segmentation. In this paper, we propose a segmentation-aware image super-resolution network, by incorporating machine-related semantic segmentation task requirement. To achieve this, we propose to generate super-resolved images by employing generative adversarial networks, where the super-resolution network functions as the generator, while the discriminator consists of the popular real/fake classification branch and an additional task branch. With this specially-designed multi-branch discriminator, segmentation task requirement is used as an added training objective provided to the generator for producing super-resolved images with segmentation awareness. Moreover, by performing alternative training between the generator and the discriminator, we dynamically enhance the capacity of task branch along with the super-resolving process, achieving generalization ability for the resulting super-resolved image. Experimental results show that, for the semantic segmentation task, our proposed method is at most 6.8 higher than competing methods in terms of mIoU score. Furthermore, our method can also generate visually better super-resolved images at the same time.
Keyword:
Deep learning
Generative adversarial network
Image super-resolution
Semantic segmentation
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
Chapter 12 Lysosomal Proton Pump Activity: Supravital Cell Staining with Acridine Orange Differentiates Leukocyte Subpopulations第12章溶酶体质子泵活性: 吖啶橙超细胞染色区分白细胞亚群
Differences in Sport-Related Concussion History, Reporting Behavior, and Return to Learn and Sport Timelines in Public versus Private High School Student Athletes
Brain Injury
IF0
Distant regulatory elements in a Sox10‐βGEO BAC transgene are required for expression of Sox10 in the enteric nervous system and other neural crest‐derived tissuesSox10-βgeo BAC转基因中的远距离调控元件是肠神经系统和其他神经源性组织中 Sox10 表达所必需的
Red, green, and blue electrochromism in ambipolar poly(amine–amide–imide)s based on electroactive tetraphenyl‐p‐phenylenediamine units基于电活性四苯基 p-苯二胺单元的双极性聚 (胺-酰胺-酰亚胺) 中的红色,绿色和蓝色电致变色

