Propagation of chaos and residual dependence in Gibbs measures on finite sets

We compare a mean-field Gibbs distribution on a finite state space on $N$ spins to that of an explicit simple mixture of product measures. This illustrates the situation beyond the so-called increasing propagation of chaos introduced by Ben Arous and Zeitouni 1999, where marginal distributions of size $k=o(N)$ are compared to product measures.