Generalized XY model with competing antiferromagnetic and antinematic interactions

I study effects of q-order antinematic (ANq) interactions on the critical behavior of the antiferromagnetic (AF) XY model on a square lattice. It is found that the evolution of the phase diagram topology of such AF-ANq models with the parameter q does not follow the same line as for the corresponding FM-Nq models with the ferromagnetic (FM) and q-order nematic (Nq) interactions. Their phase diagrams are similar only for odd values of the parameter q. In such cases the respective phases reported in the FM-Nq models are observed in the AF-ANq models on each of the two AF-coupled sublattices and the corresponding phase transitions are concluded to be of the same kind. On the other hand, for even values of q the phase diagrams of the AF-ANq models are different from the FM-Nq models and their topology does not change with q. Besides the pure AF and ANq phases, observed at higher temperatures in the regions of the dominant respective couplings, at low temperatures there is a new canted (C)AF phase, which results from the competition between the AF and ANq ordering tendencies and has no counterpart in the FM-Nq model. The phase transitions to the CAF phase from both AF and ANq phases appear to be of the Berezinskii-Kosterlitz-Thouless nature.