Maximum Entropy for Determining the Transition Probability Matrix of a Markov Chain with a Specified Stationary Distribution

  • Zohre Nikooravesh
Keywords: Entropy rate, optimization problem, infinite state space

Abstract

In this paper, we try to find the unknown transition probability matrix of a Markov chain that has a specific stationary distribution. Numerous Markov chains can be found with this property, but among these Markov chains, we want to choose one with the highest entropy rate. In this case, we claim that the Markov chain where the rows of its transition probability matrix are of identical distribution to the stationary distribution, has the maximum entropy rate.

Downloads

Download data is not yet available.
Published
2020-03-20
Section
Articles