BlogYouTube stats

3 Versions, 1 Winner: YouTube's A/B Test for Thumbnails

YouTube can pick between up to 3 thumbnails on the same video. What it really measures, who has access, and how to prepare versions that teach you something.

3 min read

Picking between two thumbnails on gut feeling is over. YouTube Studio has a built-in A/B test for titles and thumbnails: you submit several versions, YouTube shows them to different viewers and tells you which one to keep.

The winner isn't the one that gets the most clicks

This is the part to remember. YouTube doesn't pick between versions by number of clicks, but by the watch time each one generates. A clickbait thumbnail that gets the click and then disappoints loses to a more honest thumbnail that keeps people watching.

The requirements

  • Up to 3 versions: thumbnails, titles, or both.
  • Only in YouTube Studio on desktop.
  • Your channel needs advanced features turned on.
  • Not eligible: Shorts, scheduled live streams, Premieres (until they've become regular videos), private videos, videos made for kids or age-restricted videos.

How it works, step by step

  1. In YouTube Studio on desktop, open the video's details.
  2. Start an A/B test and choose what you're comparing: thumbnails, titles, or both.
  3. Add your 2 or 3 versions and confirm.
  4. Let it run: the test usually wraps up in under two weeks, sometimes in a few days depending on the number of impressions.

Three possible results

ResultWhat it meansWhat to do next
WinnerOne version does clearly better than the othersKeep it, and note what sets it apart
Performed sameNo real difference between the versionsThey were too close: test a bolder idea
InconclusiveNo difference clear enough to make a callKeep your favorite and change more next time

Versions that teach you something

A useful test compares two ideas, not two shades. Change just one big thing at a time so you know what made the difference:

  • With or without your face.
  • With or without text.
  • The subject in close-up, or a wider scene.
  • Two opposite emotions.
  • A light background or a dark background.

A selling point for thumbnail designers

If you make thumbnails for clients, offer them the test. Delivering two or three versions and letting YouTube decide means selling a measured result rather than an opinion. The test runs from the client's channel, in their YouTube Studio.

Keep reading

All articles →

From theory to practice.

Prospecting, inspiration and thumbnail tools in one workspace. Free to start, no credit card.

Start for free