arrow
Return

Physics informed token transformer for solving partial differential equations

delete2024-02-21
delete3
delete
OA
AI
C
Cooper Lorsung
Z
Zijie Li
A
Amir Barati Farimani *
DOI:10.1088/2632-2153/ad27e3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Solving partial differential equations (PDEs) is the core of many fields of science and engineering. While classical approaches are often prohibitively slow, machine learning models often fail to incorporate complete system information. Over the past few years, transformers have had a significant impact on the field of Artificial Intelligence and have seen increased usage in PDE applications. However, despite their success, transformers currently lack integration with physics and reasoning. This study aims to address this issue by introducing Physics Informed Token Transformer (PITT). The purpose of PITT is to incorporate the knowledge of physics by embedding PDEs into the learning process. PITT uses an equation tokenization method to learn an analytically-driven numerical update operator. By tokenizing PDEs and embedding partial derivatives, the transformer models become aware of the underlying knowledge behind physical processes. To demonstrate this, PITT is tested on challenging 1D and 2D PDE operator learning tasks. The results show that PITT outperforms popular neural operator models and has the ability to extract physically relevant information from governing equations.
Keywords:
machine learning
neural operators
physics informed

Journal

M
Machine Learning-Science and Technology
IF:
4.6
Papers:
1.1K
Citations:
3.4K

Organization

C
Carnegie Mellon University
Scholars:
1.4W
Papers: 1.4W
Citations: 2.7W
Cited Papers

Cited Papers

Reduced-order modeling of fluid flows with transformers
err2023-05-22
err17
PREAI
errHemmasian, AmirPouya; Farimani, Amir Barati
errShare
errSave
tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow
err2018-07-30
err281
PREAI
errXie, You; Franz, Erik; Chu, Mengyu; Thuerey, Nils
errShare
errSave
Surrogate modeling of melt pool temperature field using deep learning
err2023-04-01
err13
errOAAI
errHemmasian, AmirPouya; Ogoke, Francis; Akbari, Parand; Malen, Jonathan; Beuth, Jack; Farimani, Amir Barati
errShare
errSave
Orexins and male reproduction
err2019-01-01
err0
errOAAI
errPallav Sengupta; Sulagna Dutta; Maiza Tusimin; IvanRolland Karkada
errShare
errSave
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
err2021-03-18
err1.0K
errOAAI
errLu, Lu; Jin, Pengzhan; Pang, Guofei; Zhang, Zhongqiang; Karniadakis, George Em
errShare
errSave
Comparative effectiveness of family problem-solving therapy (F-PST) for adolescents after traumatic brain injury: Protocol for a randomized, multicenter, clinical trial
err2018-06-01
err0
errOAAI
errBrad G. Kurowski; Terry Stancin; H. Gerry Taylor; Kelly A. McNally; Michael W. Kirkwood; Amy Cassedy; Eileen King; McKenna Sklut; Megan E. Narad; Shari L. Wade
errShare
errSave
researcher View more