We extend the formulation of the distributed Lagrange multiplier (DLM) approach for particulate flows to high-order methods within the spectral/ hp element framework. We implement the rigid-body motion constraint inside the particle via a penalty method. The high-order DLM method demonstrates spectral convergence rate, i.e. discretization errors decrease exponentially as the order of spectral polynomials increases. We provide detailed comparisons between the spectral DLM method, direct numerical simulations, and the force coupling method for a number of 2D and 3D benchmark flow problems. We also validate the spectral DLM method with available experimental data for a transient problem. The new DLM method can potentially be very effective in many-moving body problems, where a smaller number of grid points is required in comparison with low-order methods.