Rigorous Analysis Of Markov Processes With Applications To Quantum Information