Vitalsource Technologies, Inc. Discrete-time Markov Chains