Testing a proposed "planarity" tool for studying satellite systems: On the alleged consistency of Milky Way satellite galaxy planes with $\Lambda$CDM

The existence of planes of satellite galaxies has been identified as a long-standing challenge to $\Lambda$CDM cosmology, due to the rarity of satellite systems in cosmological simulations that are as extremely flattened and as strongly kinematically correlated as observed structures. Here we investigate a recently proposed new metric to measure the overall degree of ''planarity'' of a satellite system, which was used to claim consistency between the Milky Way satellite plane and $\Lambda$CDM. We study the behavior of the ''planarity'' metric under several features of anisotropy present in $\Lambda$CDM satellite systems but unrelated to satellite planes. Specifically, we consider the impact of oblate or prolate distributions, the number of satellites, clustering of satellites, and radial and asymmetric distributions ('lopsidedness'). We also investigate whether the metric is independent of the orientation of the studied satellite system. We find that all of these features of anisotropy result in the metric inferring an increased degree of ''planarity'', despite none of them having any direct relation to satellite planes. The metric is also highly sensitive to the orientation of the studied system (or chosen coordinate system): there is almost no correlation between the metric's reported degrees of ''planarity'' for identical random systems rotated by 90{\deg}. Our results demonstrate that the new proposed metric is unsuitable to measure overall ''planarity'' in satellite systems. Consequently, no consistency of the observed Milky Way satellite plane with $\Lambda$CDM can be inferred using this metric.