返回
Model Soups for Various Training and Validation Data
DOI:10.3390/ai3040048.png)
摘要
En 中文
Model soups synthesize multiple models after fine-tuning them with different hyperparameters based on the accuracy of the validation data. They train different models on the same training and validation data sets. In this study, we maximized the model fine-tuning accuracy using the inference time and memory cost of a single model. We extended the model soups to create subsets of k training and validation data using a method similar to k-fold cross-validation and trained models on these subsets. First, we showed the correlation between the validation and test data when the models are synthesized, such that their training data contain validation data. Thereafter, we showed that synthesizing k of these models, after synthesizing models based on subsets of the same training and validation data, provides a single model with high test accuracy. This study provides a method for learning models with both high accuracy and reliability for small datasets such as medical images.
Keyword:
fine-tuning
computer vision
pattern recognition
deep learning
machine learning
期刊
A
IF:
5
论文数:
1.1K
被引数:
941
机构
引用论文
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?
Electrochemical synthesis of phosphorus-doped graphene quantum dots for free radical scavenging电化学合成磷掺杂石墨烯量子点及其自由基清除性能
Recycling of NdFeB Magnets from Electric Drive Motors of (Hybrid) Electric Vehicles从 (混合动力) 电动汽车的驱动电机中回收NdFeB磁体

