.png){kind=icon}
.png){kind=icon}
Return
Texplorer: Efficient Tensor Program Optimization for GPUs Using a Highly Constrained Search Space
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2026.3675079.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Optimizing tensor programs for deep learning inference is costly, often requiring hours of search over massive search spaces (<inline-formula><tex-math notation="LaTeX">$>\! 10^{10}$</tex-math></inline-formula>). Prior machine learning–guided approaches are stochastic and inefficient because they treat both the search and programs as black boxes, overlooking two key properties: 1) the search space is highly structured, with large regions of invalid or low-performing configurations, and 2) tensor programs exhibit analyzable patterns in memory access and pipelined execution. We present Texplorer, a deterministic tensor program optimizer that exploits these structures for robust and efficient search. Texplorerintroduces a three-stage pruning algorithm to eliminate invalid, redundant, and inefficient candidates, shrinking the search space from billions to thousands. It replaces costly learned models with a lightweight analytical cost model that captures GPU pipeline and memory behavior, enabling accurate, training-free performance prediction and strong cross-operator generalization. Finally, Texplorerintegrates pruning and cost modeling into a one-pass analytical evaluation pipeline that ranks all remaining candidates, enabling rapid convergence without iterative retraining or stochastic sampling. Across 144 operators and 11 DNNs on NVIDIA V100, A100, and H100 GPUs, Texplorermatches state-of-the-art performance while reducing search time by up to <inline-formula><tex-math notation="LaTeX">$300\times$</tex-math></inline-formula>. An enhanced variant, <b>Texplorer<inline-formula><tex-math notation="LaTeX">$^{+}$</tex-math><alternatives><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msup><mml:mrow/><mml:mo>+</mml:mo></mml:msup></mml:math><inline-graphic xlink:href="li-ieq3-3675079.gif" xmlns:xlink="http://www.w3.org/1999/xlink"/></alternatives></inline-formula></b>, further improves performance by up to 3.1% with up to <inline-formula><tex-math notation="LaTeX">$72\times$</tex-math></inline-formula> faster tuning.
Keywords:
Tensor program tuning
Compiler optimization
Journal
IF:
6
Papers:
5.2K
Citations:
1.1W