Real Analysis Methods for Markov Processes