Generalizing causal effect estimates to larger populations while accounting for (uncertainty in) effect modifiers using a scaled Bayesian bootstrap with application to estimating the effect of family planning on employment in Nigeria

Strategies are needed to generalize causal effects from a sample that may differ systematically from the population of interest. In a motivating case study, interest lies in the causal effect of family planning on empowerment-related outcomes among urban Nigerian women, while estimates of this effect and its variation by covariates are available only from a sample of women in six Nigerian cities. Data on covariates in target populations are available from a complex sampling design survey. Our approach, analogous to the plug-in g-formula, takes the expectation of conditional average treatment effects from the source study over the covariate distribution in the target population. This method leverages generalizability literature from randomized trials, applied to a source study using principal stratification for identification. The approach uses a scaled Bayesian bootstrap to account for the complex sampling design. We also introduce checks for sensitivity to plausible departures of assumptions. In our case study, the average effect in the target population is higher than in the source sample based on point estimates and sensitivity analysis shows that a strong omitted effect modifier must be present in at least 40% of the target population for the 95% credible interval to include the null effect.