arrow
返回

Learning Generative Models Using Denoising Density Estimators

delete2024-12-01
delete3
delete
OA
AI
S
Siavash Bigdeli *
G
Geng Lin
L
L. A. Dunbar
T
Tiziano Portenier
M
Matthias Zwicker
DOI:10.1109/TNNLS.2023.3308191delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Learning probabilistic models that can estimate the density of a given set of samples, and generate samples from that density, is one of the fundamental challenges in unsupervised machine learning. We introduce a new generative model based on denoising density estimators (DDEs), which are scalar functions parametrized by neural networks, that are efficiently trained to represent kernel density estimators of the data. Leveraging DDEs, our main contribution is a novel technique to obtain generative models by minimizing the Kullback-Leibler (KL)-divergence directly. We prove that our algorithm for obtaining generative models is guaranteed to converge consistently to the correct solution. Our approach does not require specific network architecture as in normalizing flows (NFs), nor use ordinary differential equation (ODE) solvers as in continuous NFs. Experimental results demonstrate substantial improvement in density estimation and competitive performance in generative model training.
Keyword:
Denoising autoencoders (DAEs)
density estimation
energy models
generative modeling
score-matching

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

暂无机构信息
引用论文

引用论文

Regular dendritic patterns induced by nonlocal time-periodic forcing
err2000-12-01
err0
errOAAI
errT. Börzsönyi; T. Tóth-Katona; Á. Buka; L. Gránásy
err分享
err收藏
err分享
err收藏
Deep associative learning for neural networks神经网络的深度联想学习
err2021-07-01
err6
PREAI
errLiu, Jia; Zhang, Wenhua; Liu, Fang; Xiao, Liang
err分享
err收藏
Structure and thermoelectric behavior of polyaniline-based/ CNT-composite
err2022-04-01
err0
PREAI
errAyat Abd-Elsalam; Hussein O. Badr; Ahmed A. Abdel-Rehim; Iman S. El-Mahallawi
err分享
err收藏
学者 查看更多内容