How? They have a hard cut off context, and randomly generates next state from that. That is the definition of a markov chain.
It is a markov chain with a pretty large state at every point, but still a markov chain.
