At YouTube, balancing ad load and user happiness is a major concern. One way we
measure this tradeoff is through live experiments, which we run on a small
percentage of traffic. For example, by holding back certain ad formats we can build
metrics around the impact of YouTube advertising on the user experience. In this
talk we will discuss the benefits and challenges of running large-scale advertising
experiments.