Mathematical Tools And Convergence Results For Dynamics Over Networks