Causally estimating the effect of YouTube's recommender system using counterfactual bots

When problematic behaviors are observed on online platforms such as YouTube, it is generally unclear to what extent they reflect biases in the platform's algorithms versus user preferences. Effective interventions require answering such questions, but disentangling algorithmic influence from user intentions with non-experimental data is extremely difficult. Here we introduce an experimental method for causally estimating the effect of platform recommendations that explicitly compares real user behavior with "counterfactual" bots that first imitate users and then rely exclusively on recommendations. We find that recommendations, on average, push users to more moderate content, suggesting that user preferences play the dominant role in determining consumption. More broadly, our method has implications for studying situations in which user preferences and algorithms interact.