.png){kind=icon}
.png){kind=icon}
Return
Probability density estimation beyond the dichotomy Parametric/ Non-Parametric methods
.png){kind=icon}
OA
AI
DOI：10.1016/j.ins.2026.123538.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Probability density estimation is an essential task not only in statistics but also in machine learning and many applied scientific disciplines. Traditional methods to derive the probability density function from data belong to either of two classes: parametric or non-parametric techniques. The methodology developed in the present work overcomes this dichotomy by combining original deep learning tools with advanced symbolic regression. In the first step, neural networks with a specific architecture, called PDF-Nets, are trained to predict the local pdf given a set of observations using a self-tuning inhomogeneous binning approach. In the second step, symbolic regression extracts the mathematical expression exploiting the PDF-Net results. Various improvements of symbolic regression for this task have been devised to overcome the weaknesses of the available algorithms, more oriented towards classification and regression. The final result is an analytic expression describing the pdf with minimal prior constraints about its mathematical form. The performances of the developed tools, substantiated by a series of systematic numerical tests, prove that they are very competitive with the most advanced available techniques in terms of accuracy and that their competitive advantages become more evident the sparser the data and the higher the level of noise affecting the data.
Keywords:
Density Estimation
Genetic Programming
Information Theory
Neural Networks
Symbolic Regression
Journal
IF:
6.8
Papers:
540
Citations:
6.2W