Markov Property
The likelihood of a future state depends on present state only.
P(Xtāā£Xtā1ā,Xtā2ā,...,X1ā)=P(Xtāā£Xtā1ā) Markov Chain
A stochastic process with Markov property.
Hidden Markov Model (HMM)
The state is not directly visible, but output dependent on the state is visible.