Understanding the grain size-dependent failure behavior of polycrystalline graphene is important for its applications both structurally and functionally. Here we perform molecular dynamics simulations to study the failure behavior of polycrystalline graphene by varying both grain size and distribution. We show that polycrystalline graphene fails in a brittle mode and grain boundary junctions serve as the crack nucleation sites. We also show that its breaking strength and average grain size follow an inverse pseudo Hall-Petch relation, in agreement with experimental measurements. Further, we find that this inverse pseudo Hall-Petch relation can be naturally rationalized by the weakest-link model, which describes the failure behavior of brittle materials. Our present work reveals insights into controlling the mechanical properties of polycrystalline graphene and provides guidelines for the applications of polycrystalline graphene in flexible electronics and nano-electronic-mechanical devices.