.png){kind=icon}
返回
.png){kind=icon}
.png){kind=icon}
摘要
En 中文
Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e., compute clients) are idle much of the time, waiting for the next generation to be created. Evolutionary neural architecture search (ENAS), a class of EAs that optimizes the architecture and hyperparameters of deep neural networks, is particularly vulnerable to this issue. This paper proposes a generic asynchronous evaluation strategy (AES) that is then adapted to work with ENAS. AES increases throughput by maintaining a queue of up to K individuals ready to be sent to the workers for evaluation and proceeding to the next generation as soon as M << K individuals have been evaluated. A suitable value for M is determined experimentally, balancing diversity and efficiency. To showcase the generality and power of AES, it was first evaluated in eight-line sorting network design (a single-population optimization task with limited evaluation-time variability), achieving an over two-fold speedup. Next, it was evaluated in 11-bit multiplexer design (a single-population discovery task with extended variability), where a 14-fold speedup was observed. It was then scaled up to ENAS for image captioning (a multi-population openended-optimization task), resulting in an over two-fold speedup. In all problems, a multifold performance improvement was observed, suggesting that AES is a promising method for parallelizing the evolution of complex systems with long and variable evaluation times, such as those in ENAS.
期刊
暂无期刊信息
机构
引用论文
Analysis of semi-asynchronous multi-objective evolutionary algorithm with different asynchronies具有不同异步性的半异步多目标进化算法分析.png)
SOFT COMPUTING.png)
SOFT COMPUTINGIF2.5
PREAI
.png){kind=icon}
分享.png){kind=icon}
收藏Avoiding excess computation in asynchronous evolutionary algorithms避免异步进化算法中的过度计算EXPERT SYSTEMS
OAAI
EXPERT SYSTEMSIF2.3
OAAI分享收藏
Defect-driven synthesis of self-assembled single crystal titanium nanowires via electrochemistry
PREAI
分享收藏Hybrid image analysis model for hashtag recommendation through the use of deep learning methods
PREAI
分享收藏
查看更多内容