Short-range order in the quantum XXZ honeycomb lattice material BaCo2(PO4)2

We present observations of highly frustrated quasi-two-dimensional (2D) magnetic correlations in the honeycomb lattice layers of the S_eff =1 /2 compound γ -BaCo₂(PO₄₎₂ (γ -BCPO). Specific heat shows a broad peak comprised of two weak kink features at T_{N 1}∼6 K and T_{N 2}∼3.5 K, the relative weights of which can be modified by sample annealing. Neutron powder diffraction measurements reveal short range quasi-2D order that is established below T_{N 1} and T_{N 2}, at which two separate, incompatible, short range magnetic orders onset: commensurate antiferromagnetic correlations with correlation length ξ_c=60 ±2 Å (T_{N 1}) and in quasi-2D helical domains with ξ_h=350 ±11 Å (T_{N 2}). The ac magnetic susceptibility response lacks frequency dependence, ruling out spin freezing. Inelastic neutron scattering data on γ -BCPO is compared with linear spin wave theory, and two separate parameter regions of the XXZ J₁-J₂-J₃ model with ferromagnetic nearest-neighbor exchange J₁ are favored, both near regions of high classical degeneracy. High energy coherent excitations (∼10 meV) persist up to at least 40 K, suggesting strong in-plane correlations persist above T_N. These data show that γ -BCPO is a rare highly frustrated, quasi-2D S_eff =1 /2 honeycomb lattice material which resists long range magnetic order and spin freezing.