Essays in Problems in Sequential Decisions and Large-Scale Randomized Algorithms