Gravitational Compton Scattering from the Worldline Formalism