Convergence of spectral discretizations of the Vlasov-Poisson system