.png){kind=icon}
返回
Does Formula-Driven Supervised Learning Work on Small Datasets?
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3320639.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Does formula-driven supervised learning (FDSL) work effectively with fine-tuning on small datasets? Additionally, how many natural images do a network pre-trained with FDSL require to acquire sufficient image features? FDSL is a pre-training method that employs mathematical formulas to automatically generate images and their corresponding labels. These questions are crucial to address, as the acquisition of features valuable for natural image recognition tasks necessitates the opportunity to learn a certain number of natural images through pre-training and fine-tuning to achieve optimal results. Furthermore, because FDSL is progressively gaining attention as a promising method to mitigate concerns about privacy violations, fairness protection, and labor-intensive efforts associated with annotating natural images, clarifying its effectiveness and limitations is essential for widespread adoption. In this study, we compare FDSL with ImageNet-1k pre-training and training from scratch through fine-tuning on datasets of the order of 100 to 10,000 images. Through our experiments, we discovered that (i) there is a significant difference from ImageNet-1k pre-training when using datasets containing approximately 100 to 1,000 images, and (ii) approximately 50,000 images are required for FDSL to be equivalent to ImageNet-1k pre-training. Moreover, we verified the validity of the hyper-parameters during fine-tuning. We firmly believe that this study elucidates the current limitations of FDSL and offers valuable guidance for future research, ultimately contributing to the field of computer vision.
Keyword:
Task analysis
Transformers
Image recognition
Training
Fractals
Ethics
Convolutional neural networks
Supervised learning
Data integrity
Data models
Pre-training
fine-tuning
formula-driven supervised learning
data-efficient training
small dataset
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
分享收藏Molecular and Pharmacological Characterization of GABAA Receptors in the Rat Pituitary大鼠垂体中GABAA 受体的分子和药理学特征
PREAI
分享收藏Effect of viscosity on the electrical properties of conducting thermoplastic composites made by compression molding of a powder mixture粘度对通过粉末混合物的压缩成型制成的导电热塑性复合材料的电性能的影响
PREAI
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏分享收藏Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
PREAI
分享收藏
查看更多内容