arrow
Return

Insight Gained from Migrating a Machine Learning Model to Intelligence Processing Units

delete2024-07-17
delete0
delete
OA
AI
H
Hieu Trung Le *
Z
Zhenhua He
M
Mai Le
D
Dhruva K. Chakravorty
L
Lisa M. Pérez
A
Akhil Chilumuru
Y
Yan Yao
J
Jiefu Chen
DOI:10.1145/3626203.3670527delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The discoveries in this paper show that Intelligence Processing Units (IPUs) offer a viable accelerator alternative to GPUs for machine learning (ML) applications within the fields of materials science and battery research. We investigate the process of migrating a model from GPU to IPU and explore several optimization techniques, including pipelining and gradient accumulation, aimed at enhancing the performance of IPU-based models. Furthermore, we have effectively migrated a specialized model to the IPU platform. This model is employed for predicting effective conductivity, a parameter crucial in ion transport processes, which govern the performance of multiple charge and discharge cycles of batteries. The model utilizes a Convolutional Neural Network (CNN) architecture to perform prediction tasks for effective conductivity. The performance of this model on the IPU is found to be comparable to its execution on GPUs. We also analyze the utilization and performance of Graphcore's Bow IPU. Through benchmark tests, we observe significantly improved performance with the Bow IPU when compared to its predecessor, the Colossus IPU.
Keywords:
ACES (Accelerating Computing for Emerging Sciences)
Graphics Processing Unit
ResNet50
Intelligence Processing Unit
Classification
Prediction
Convolution Neural Network
Optimization

Journal

P
Practice and Experience in Advanced Research Computing
IF:
0
Papers:
3
Citations:
0

Organization

T
Texas A&M University System
Scholars:
4.4W
Papers: 4.0W
Citations: 4.0K