A New Estimator for Shannon Entropy

  • Havva Alizadeh Noughabi Department of Computer Engineering, University of Gonabad, Gonabad, Iran
  • Jalil Jarrahiferiz Department of Mathematics, Birjand Branch, Islamic Azad University, Birjand, Iran
Keywords: Information theory, sample entropy, spacings, local linear model, mean squared error


In this paper, we propose a new estimator for Shannon entropy of a continuous random variable. Consistency and other properties of the new estimator is stated. Through a Monte Carlo simulation, the mean squared error of the proposed estimator is compared with some prominent estimators, namely Vasicek’s estimator, Van Es’s estimator, and Correa’s estimator. Finally, it is shown that the proposed estimator has smaller mean squared error than the other estimators.


Download data is not yet available.