返回
Rate Entropy Function
DOI:10.1109/LCOMM.2023.3236167.png)
摘要
En 中文
We consider the rate entropy function, which is the infimum of average mutual information with conditional entropy distortion constraint. Conditional entropy distortion is actually the expected distortion of logarithmic loss. It can be regarded a generalized distortion since it does not satisfy non-negativity. Like rate distortion function, the rate entropy function is essentially a variation problem with no general solution. So we propose three methods to construct a particular solution. Accordingly, closed-form expressions of rate entropy function for the uniform source and several additive sources are derived. Particularly, neither squared error nor magnitude error distortion exists for the Cauchy source due to the absence of first-order and higher-order moments, but the entropy distortion does. Entropy distortion varies depending on the source. For Gaussian sources, entropy distortion is equivalent to squared error distortion. In the case of vector Gaussian sources, entropy distortion is equivalent to the determinant of error covariance matrix, which is different from both covariance matrix distortion and trace distortion.
Keyword:
Entropy
Distortion
Rate-distortion
Additives
Distortion measurement
Covariance matrices
Mutual information
Rate entropy function
logarithmic loss
entropy distortion measure
uniform source
additive source
期刊
IF:
4.4
论文数:
1.3W
被引数:
2.2W
机构
暂无机构信息
引用论文
Monitoring of long‐term vegetation dynamics and responses to droughts of various timescales in Inner Mongolia
Ecosphere
IF0
Rapamycin Attenuates Splenomegaly in both Intrahepatic and Prehepatic Portal Hypertensive Rats by Blocking mTOR Signaling Pathway
PLOS ONE
IF0

