In relativistic magnetized plasmas, asymmetry in the number densities of left- and right-handed fermions, i.e., a non-zero chiral chemical potential mu_5, leads to an electric current along the magnetic field. This causes a chiral dynamo instability for a uniform mu_5, but our simulations reveal dynamos even for fluctuating mu_5 with zero mean. This generates small-scale magnetic helicity and turbulence. A large-scale mu_5 emerges due to chirality conservation. These effects amplify a mean magnetic field via the magnetic alpha effect and produce a universal scale-invariant mu_5 spectrum.