.png){kind=icon}
返回
GrainedCLIP and DiffusionGrainedCLIP: Text-Guided Advanced Models for Fine-Grained Attribute Face Image Processing
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3313248.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Text-guided image processing has made tremendous progress in recent years. Most existing methods generally focus on using visual-language pre-training models for text-guided image processing. However, their applications to achieve text-guided fine-grained attribute face image processing (e.g., editing a smiling face to change from showing teeth to a closed-mouth smile) lead to poor performance due to the limited fine-grained semantic knowledge learned by existing visual-language pre-training models. To alleviate this problem, we propose a novel visual-language pre-training model based on fine-grained facial attribute features, which we call GrainedCLIP. Based on GrainedCLIP, we further propose a new text-guided fine-grained attribute face image processing model, which we call DiffusionGrainedCLIP. Our experimental results showed that GrainedCLIP outperformed existing methods, achieving 12.61 R@ 1 and 12.17 R@ 1 in text-to-image and image-to-text retrieval evaluation metrics, respectively, on the FFHQ dataset. Furthermore, compared to state-of-the-art text-guided face image processing methods, Diffusion GrainedCLIP significantly improved 55.37% in semantic consistency and 49.38% in face identity preservation on the FFHQ dataset.
Keyword:
Facial features
Image processing
Visualization
Feature extraction
Task analysis
Computational modeling
Training
Face recognition
Visual-language pre-training models
fine-grained facial attributes
text-guided face image processing
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
分享收藏Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
PREAI
分享收藏分享收藏Varicella-zoster virus inhibits autophagosome-lysosome fusion and the degradation stage of mTOR-mediated autophagic flux.png)
Virology
VirologyIF0
PREAI
分享收藏Real-Time Face Mask Detector Using YOLOv3 Algorithm and Haar Cascade Classifier基于YOLOv3算法和Haar级联分类器的实时口罩检测器
OAAI
OAAI分享收藏分享收藏
查看更多内容