On the $L^p$ continuity of singular Fourier integral operators