arrow
Return

Insight Gained from Migrating a Machine Learning Model to Intelligence Processing Units

delete2024-07-17
delete0
delete
OA
AI
H
Hieu Trung Le *
Z
Zhenhua He
M
Mai Le
D
Dhruva K. Chakravorty
L
Lisa M. Pérez
A
Akhil Chilumuru
Y
Yan Yao
J
Jiefu Chen
DOI:10.1145/3626203.3670527delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The discoveries in this paper show that Intelligence Processing Units (IPUs) offer a viable accelerator alternative to GPUs for machine learning (ML) applications within the fields of materials science and battery research. We investigate the process of migrating a model from GPU to IPU and explore several optimization techniques, including pipelining and gradient accumulation, aimed at enhancing the performance of IPU-based models. Furthermore, we have effectively migrated a specialized model to the IPU platform. This model is employed for predicting effective conductivity, a parameter crucial in ion transport processes, which govern the performance of multiple charge and discharge cycles of batteries. The model utilizes a Convolutional Neural Network (CNN) architecture to perform prediction tasks for effective conductivity. The performance of this model on the IPU is found to be comparable to its execution on GPUs. We also analyze the utilization and performance of Graphcore's Bow IPU. Through benchmark tests, we observe significantly improved performance with the Bow IPU when compared to its predecessor, the Colossus IPU.
Keywords:
ACES (Accelerating Computing for Emerging Sciences)
Graphics Processing Unit
ResNet50
Intelligence Processing Unit
Classification
Prediction
Convolution Neural Network
Optimization

Journal

P
Practice and Experience in Advanced Research Computing
IF:
0
Papers:
3
Citations:
0

Organization

T
Texas A&M University System
Scholars:
4.4W
Papers: 4.0W
Citations: 4.0K
Cited Papers

Cited Papers

Challenges in speeding up solid-state battery development
err2023-02-23
err449
PREAI
errJanek, Juergen; Zeier, Wolfgang G.
errShare
errSave
Accelerated Materials Design of Lithium Superionic Conductors Based on First-Principles Calculations and Machine Learning Algorithms
err2013-04-05
err204
PREAI
errFujimura, Koji; Seko, Atsuto; Koyama, Yukinori; Kuwabara, Akihide; Kishida, Ippei; Shitara, Kazuki; Fisher, Craig A. J.; Moriwake, Hiroki; Tanaka, Isao
errShare
errSave
A History of Vision Screening
err2009-10-09
err0
PREAI
errTina M. Appelboom
errShare
errSave
Visual screening of Swedish children: An ophthalmological evaluation
err2002-01-15
err0
errOAAI
errGun Kvarnström; Peter Jakobsson; Gunnar Lennerstrand
errShare
errSave
Optimising Communication Overhead in Federated Learning Using NSGA-II
err2022-04-15
err0
PREAI
errJosé Ángel Morell; Zakaria Abdelmoiz Dahi; Francisco Chicano; Gabriel Luque; Enrique Alba
errShare
errSave
THE ORINDA VISION STUDY
err1959-09-01
err0
PREAI
errHenry B. Peters; Henrik L. Blum; Jerome W. Bettman; Frank Johnson; Victor Fellows
errShare
errSave
no more