Keywords: undiscounted multi-chain Markov decision problem; block upper-triangular form; single-chain Markov decision problem; optimal solution; finite state; linear programming algorithm; polynomial-in-time transformation; chain number reduction