Yue, Wuyi: Markov Decision Processes with Their Applications