arrow
Return

ViTO: Vision Transformer-Operator

delete2024-08-01
delete1
delete
OA
AI
O
Oded Ovadia *
A
Adar Kahana
P
Panos Stinis
E
Eli Turkel
D
Dan Givoli
G
George Em Karniadakis
DOI:10.1016/j.cma.2024.117109delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We combine vision transformers with operator learning to solve diverse inverse problems described by partial differential equations (PDEs). Our approach, named Vision Transformer- Operator (ViTO), combines a U-Net based architecture with a vision transformer. We apply ViTO to solve inverse PDE problems of increasing complexity, including the wave equation, the Navier-Stokes equations, and the Darcy equation. We focus on the more challenging case of super-resolution, where the input dataset, for the inverse problem, is at a significantly coarser resolution than the output. The results are comparable to or exceed the leading operator network benchmarks for accuracy. Furthermore, ViTO's architecture has a small number of trainable parameters (less than 10% of the leading competitor), resulting in a performance speed-up of over 5 times when averaged over the various test cases.
Keywords:
Deep learning
Vision Transformers
Scientific machine learning
Inverse problems
Super-resolution
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computer Methods in Applied Mechanics and Engineering cover
Computer Methods in Applied Mechanics and Engineering
IF:
7.3
Papers:
1.3W
Citations:
5.6W

Organization

P
Pacific Northwest National Laboratory
Scholars:
9.0K
Papers: 6.3K
Citations: 14
B
Brown University
Scholars:
2.4W
Papers: 2.2W
Citations: 3.2W
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
T
Tel Aviv University
Scholars:
3.7W
Papers: 3.0W
Citations: 3.6W
researcher View more organizations