.png){kind=icon}
Return
Rate Entropy Function
.png){kind=icon}
PRE
AI
DOI：10.1109/LCOMM.2023.3236167.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We consider the rate entropy function, which is the infimum of average mutual information with conditional entropy distortion constraint. Conditional entropy distortion is actually the expected distortion of logarithmic loss. It can be regarded a generalized distortion since it does not satisfy non-negativity. Like rate distortion function, the rate entropy function is essentially a variation problem with no general solution. So we propose three methods to construct a particular solution. Accordingly, closed-form expressions of rate entropy function for the uniform source and several additive sources are derived. Particularly, neither squared error nor magnitude error distortion exists for the Cauchy source due to the absence of first-order and higher-order moments, but the entropy distortion does. Entropy distortion varies depending on the source. For Gaussian sources, entropy distortion is equivalent to squared error distortion. In the case of vector Gaussian sources, entropy distortion is equivalent to the determinant of error covariance matrix, which is different from both covariance matrix distortion and trace distortion.
Keywords:
Entropy
Distortion
Rate-distortion
Additives
Distortion measurement
Covariance matrices
Mutual information
Rate entropy function
logarithmic loss
entropy distortion measure
uniform source
additive source
Journal
IF:
4.4
Papers:
1.3W
Citations:
2.2W
Organization
No organization information available
Cited Papers
Monitoring of long‐term vegetation dynamics and responses to droughts of various timescales in Inner Mongolia.png)
Ecosphere
OAAI
EcosphereIF0
OAAIShareSave
Rapamycin Attenuates Splenomegaly in both Intrahepatic and Prehepatic Portal Hypertensive Rats by Blocking mTOR Signaling PathwayPLOS ONEOAAI
PLOS ONEIF0
OAAIShareSaveShareSaveShareSaveShareSave
View more