Testing Markov chains in Java

Question

I have been given a question where I am supposed to write a Java function that implements the markov chain and returns an array of its probabilities. I have looked at both these