Why Short-Video Apps Pushing New Content Boosts Creators — But Skews Tests

Short-video apps like TikTok constantly decide which new videos to push into your feed. Showing a fresh video to a small group of people to see if it takes off is called 'exploration.' A new research paper, based on four large experiments run on an unnamed major short-video platform, looked at how this process affects both viewers and creators.

First, the good news for the people making videos: when the app deliberately explores new content, it encourages creators to post more. Over eight months, creators posted 8.55% more videos, and the number of people posting at least once went up by 7.10%. That means surfacing fresh content isn't just about finding hits — it also rewards creators with attention, which pushes them to keep producing.

For viewers, the effect was mixed. Over a year, exploration led to 1.74% more video views, but total watch time actually dropped by 2.13%. So you're clicking on more things, but spending slightly less time glued to the screen. That's an important trade-off for platforms that measure success in watch time.

The researchers also uncovered a measurement trap. When testing changes, apps usually split users into two groups. But both groups draw from the same shared pool of videos. If the test changes how many videos are created or which ones survive, it changes the pool for everyone — which makes the test results misleading. The study shows that unless each group has its own completely separate video library (which is unrealistic), you can't reliably see the long-term effect. So a three-week test can't even tell you if the final outcome is positive or negative.