1
Return

Kernel Reboot: Breaking the Boundaries of Neural Tangent Kernels for Neural Fields

delete2026-05-13
delete0
PRE
AI
A
Amir Mallak
A
Alaa Maalouf
L
Lior Wolf
D
Daniela Rus
D
Dan Rosenbaum
DOI:10.1109/tpami.2026.3692624delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Neural fields (NFs) map continuous coordinates to signals such as color or density, but fast high-quality reconstruction from sparse observations remains difficult. Classical Neural Tangent Kernel (NTK) regression gives closed-form fits, yet it is fundamentally linear and cannot accumulate reusable task priors. We develop three algorithms that address these gaps. NTK-KIP learns a distilled support set of coordinates (and optional labels) so that a finite NTK can inpaint large missing regions from little observed data, yielding a compact non-linear representation instead of a raw kernel solve. MetaQuill meta-learns a shared initialization for an INR so that new scenes can be adapted by updating only a small task-specific weight offset, which provides true feature learning and a reusable prior. Finally, MetaQuill-KIP fuses both ideas: it seeds the task with a KIP-style non-linear warm start, then refines only that small offset around the meta-learned initialization. MetaQuill-KIP achieves high-PSNR reconstructions and semantically plausible inpainting under very sparse observations, while requiring only lightweight per-instance adaptation, whereas diffusion-style baselines typically depend on large pretrained generative priors and costly per-image tuning. This shows that NTK-driven neural fields can be made both non-linear and meta-learnable, narrowing the gap between analytic kernels and practical few-shot reconstruction.
Keywords:
Machine learning
representations
data structures
and transforms
vision and scene understanding
computer vision
knowledge retrieval
neural nets

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
831
Citations:
9.8W

Organization

T
tel aviv university
Scholars:
4.8K
Papers: 1.8K
Citations: 1
U
university of haifa
Scholars:
952
Papers: 530
Citations: 0
M
massachusetts institute of technology
Scholars:
3.3K
Papers: 1.2K
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers