Graphs in Perturbation Theory: Algebraic Structure and Asymptotics