.png){kind=icon}
返回
fVDB: A Deep-Learning Framework for Sparse, Large-Scale, and High-Performance Spatial Intelligence
.png){kind=icon}
OA
AI
DOI：10.1145/3658226.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present fVDB, a novel GPU-optimized framework for deep learning on large-scale 3D data. fVDB provides a complete set of differentiable primitives to build deep learning architectures for common tasks in 3D learning such as convolution, pooling, attention, ray-tracing, meshing, etc. fVDB simultaneously provides a much larger feature set (primitives and operators) than established frameworks with no loss in efficiency: our operators match or exceed the performance of other frameworks with narrower scope. Furthermore, fVDB can process datasets with much larger footprint and spatial resolution than prior works, while providing a competitive memory footprint on small inputs. To achieve this combination of versatility and performance, fVDB relies on a single novel VDB index grid acceleration structure paired with several key innovations including GPU accelerated sparse grid construction, convolution using tensorcores, fast ray tracing kernels using a Hierarchical Digital Differential Analyzer algorithm (HDDA), and jagged tensors. Our framework is fully integrated with PyTorch enabling interoperability with existing pipelines, and we demonstrate its effectiveness on a number of representative tasks such as large-scale point-cloud segmentation, high resolution 3D generative modeling, unbounded scale Neural Radiance Fields, and large-scale point cloud reconstruction.
Keyword:
Deep learning frameworks
spatial intelligence
GPU
sparse convolution
point cloud processing
neural rendering
期刊
IF:
9.5
论文数:
4.8K
被引数:
3.6W
机构
引用论文
Targeted stem cells expressing TRAIL as a therapy for lung Cancer TACTICAL: a phase I/II trial.png)
Lung Cancer
OAAI
Lung CancerIF0
OAAI分享收藏Taichi: A Language for High-Performance Computation on Spatially Sparse Data StructuresTaichi: 一种用于空间稀疏数据结构的高性能计算的语言OAAI
OAAI分享收藏Preparation of Cyclo‐Phen‐Type Ligands: Chelators of Metal Ions as Potential Therapeutic Agents in the Treatment of Neurodegenerative DiseasesChemBioChem
ChemBioChemIF0
PREAI
分享收藏
查看更多内容