Radiative Transfer Modeling of Lyα Emitters. II. New Effects on Galaxy Clustering

We study the clustering properties of z ~ 5.7 Lyα emitters (LAEs) in a cosmological reionization simulation with a full Lyα radiative transfer calculation. Lyα radiative transfer substantially modifies the intrinsic Lyα emission properties, compared to observed ones, depending on the density and velocity structure environment around the Lyα-emitting galaxy. This environment-dependent Lyα selection introduces new features in LAE clustering, suppressing (enhancing) the line-of-sight (transverse) density fluctuations and giving rise to scale-dependent galaxy bias. In real space, the contours of the three-dimensional two-point correlation function of LAEs appear to be prominently elongated along the line of sight on large scales, an effect that is opposite to and much stronger than the linear redshift-space distortion effect. The projected two-point correlation function is greatly enhanced in amplitude by a factor of up to a few, compared to the case without the environment-dependent selection effect. The new features in LAE clustering can be understood with a simple, physically motivated model, where Lyα selection depends on matter density, velocity, and their gradients. We discuss the implications and consequences of the effects on galaxy clustering from Lyα selection in interpreting clustering measurements and in constraining cosmology and reionization from LAEs.