arrow
返回

Convolutional Neural Networks-Based Lung Nodule Classification: A Surrogate-Assisted Evolutionary Algorithm for Hyperparameter Optimization

delete2021-10-01
delete44
PRE
AI
M
Miao Zhang
李慧琦 封面图
李慧琦 (Huiqi Li) *
S
Shirui Pan *
J
Juan Lyu
L
Ling, Steve
S
Steven W. Su
DOI:10.1109/TEVC.2021.3060833delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article investigates deep neural networks (DNNs)-based lung nodule classification with hyperparameter optimization. Hyperparameter optimization in DNNs is a computationally expensive problem, and a surrogate-assisted evolutionary algorithm has been recently introduced to automatically search for optimal hyperparameter configurations of DNNs, by applying computationally efficient surrogate models to approximate the validation error function of hyperparameter configurations. Different from existing surrogate models adopting stationary covariance functions (kernels) to measure the difference between hyperparameter points, this article proposes a nonstationary kernel that allows the surrogate model to adapt to functions whose smoothness varies with the spatial location of inputs. A multilevel convolutional neural network (ML-CNN) is built for lung nodule classification, and the hyperparameter configuration is optimized by the proposed nonstationary kernel-based Gaussian surrogate model. Our algorithm searches with a surrogate for optimal setting via a hyperparameter importance-based evolutionary strategy, and the experiments demonstrate our algorithm outperforms manual tuning and several well-established hyperparameter optimization methods, including random search, grid search, the tree-structured parzen estimator (TPE) approach, Gaussian processes (GP) with stationary kernels, and the recently proposed hyperparameter optimization via RBF and dynamic (HORD) coordinate search.
Keyword:
Optimization
Kernel
Neural networks
Lung
Feature extraction
Gaussian processes
Convolutional neural networks
AutoML
evolutionary algorithm
hyperparameter optimization
lung nodule classification
nonstationary kernel
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Evolutionary Computation 封面图
IEEE Transactions on Evolutionary Computation
IF:
12
论文数:
1.8K
被引数:
2.4W

机构

H
Harbin Engineering University
学者数:
1.9W
论文数: 1.3W
被引数: 1.3W
M
Monash University
学者数:
5.4W
论文数: 5.4W
被引数: 79
B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
学者 查看更多机构
引用论文

引用论文

Colorectal cancer statistics, 20172017结直肠癌统计
err2017-03-01
err363
errOAAI
errSiegel, Rebecca L.; Miller, Kimberly D.; Fedewa, Stacey A.; Ahnen, Dennis J.; Meester, Reinier G. S.; Barzi, Afsaneh; Jemal, Ahmedin
err分享
err收藏
Polymerization Equilibria
err1984-01-01
err0
PREAI
errHans-Georg Elias
err分享
err收藏
A Test Method for Determining Total Metals with an Indicator Paper and Its Performance Characteristics
err2004-10-01
err0
PREAI
errV. M. Ostrovskaya; E. A. Reshetnyak; N. A. Nikitina; A. V. Panteleimonov; Yu. V. Kholin
err分享
err收藏
MCS-GPM: Multi-Constrained Simulation Based Graph Pattern Matching in Contextual Social Graphs
err2018-06-01
err42
PREAI
errLiu, Guanfeng; Liu, Yi; Zheng, Kai; Liu, An; Li, Zhixu; Wang, Yang; Zhou, Xiaofang
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
The Lung Image Database Consortium, (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT Scans肺图像数据库联盟 (LIDC) 和图像数据库资源倡议 (IDRI): ct扫描上完整的肺结节参考数据库
err2011-01-24
err1.8K
errOAAI
errArmato, Samuel G., III; McLennan, Geoffrey; Bidaut, Luc; McNitt-Gray, Michael F.; Meyer, Charles R.; Reeves, Anthony P.; Zhao, Binsheng; Aberle, Denise R.; Henschke, Claudia I.; Hoffman, Eric A.; Kazerooni, Ella A.; MacMahon, Heber; van Beek, Edwin J. R.; Yankelevitz, David; Biancardi, Alberto M.; Bland, Peyton H.; Brown, Matthew S.; Engelmann, Roger M.; Laderach, Gary E.; Max, Daniel; Pais, Richard C.; Qing, David P-Y; Roberts, Rachael Y.; Smith, Amanda R.; Starkey, Adam; Batra, Poonam; Caligiuri, Philip; Farooqi, Ali; Gladish, Gregory W.; Jude, C. Matilda; Munden, Reginald F.; Petkovska, Iva; Quint, Leslie E.; Schwartz, Lawrence H.; Sundaram, Baskaran; Dodd, Lori E.; Fenimore, Charles; Gur, David; Petrick, Nicholas; Freymann, John; Kirby, Justin; Hughes, Brian; Casteele, Alessi Vande; Gupte, Sangeeta; Sallam, Maha; Heath, Michael D.; Kuhn, Michael H.; Dharaiya, Ekta; Burns, Richard; Fryd, David S.; Salganicoff, Marcos; Anand, Vikram; Shreter, Uri; Vastagh, Stephen; Croft, Barbara Y.; Clarke, Laurence P.
err分享
err收藏
Perspectives on Nitrogen-Fixing Bacillus Species
err2021-05-25
err0
PREAI
errShekhar Jain; Ajit Varma; Devendra Kumar Choudhary
err分享
err收藏
err分享
err收藏
学者 查看更多内容