How the benchmark works
One prompt, every AI video model, one run each - then every output is scored on the same rubric. This page explains how, what the numbers mean, and how to use the data.
Last updated 15 October 2026 · 40 models, 64 prompts, 16 categories
What is tested
Every model we track answers the same set of prompts, grouped by the job they stand for. The categories are: Cinematic Scenes, Product Videos, Characters & Dialogue, Motion & Physics, Nature & Landscape, Food & Lifestyle, Animation & Stylized, Text on Screen, Animals & Creatures, Sports & Action, Sci-Fi & Fantasy, Music & Dance, Vertical & Social, Talking Head & Lip Sync, Camera Control, Fire, Smoke & Fluid.
Each prompt has its own page with every model's output side by side (all prompts), and the leaderboard ranks the models on their average score.
How each model is run
- Every model runs every prompt once, through the Wiro API, with the model's default settings. The first successful output is the one published: no second attempt for a better result, no cherry-picking.
- Clips are 5 seconds long, at the resolution closest to 720p, in the aspect ratio of the prompt's category.
- A run that returns nothing, or an empty file, is tried again. A model that still returns nothing is marked as failed on that prompt and left out of its average.
How outputs are scored
Each output is rated from 0 to 5, in half steps, on 8 criteria. The scale is fixed rather than a curve against the other models: 5 is flawless on that criterion, 4 is good with one small imperfection, and anything with a clearly visible flaw is 3 or below.
- Prompt adherence21%
- Motion & consistency19%
- Camera & framing12%
- Quality & detail11%
- Look & lighting9%
- Realism & physics8%
- Text rendering10%
- Audio10%
A criterion that does not apply - text rendering when the prompt asks for no words on screen, audio when the model returns no sound - is skipped and its weight is shared by the rest. A result's score is the weighted average of its criteria; a model's score on the leaderboard is the average over every prompt it was scored on.
Scores are given by an AI judge - a vision model working from the written rubric - not by the companies behind the models. For every clip the judge looks at eight frames spread across it, turns the prompt into a checklist of subjects and steps, and checks the sound from the file itself: whether there is a track at all and, when the prompt asks for speech, a transcript of it. Every clip is published next to its score, so anyone can check a score against the clip.
Limits
- One run per prompt: these models are random, and a second run can come out better or worse.
- An AI judge can be wrong about a single output. A model's average over many prompts is far more reliable than any one score.
- Providers sometimes update a model behind the same name. Every result carries the date it was run.
- Speed and price are not part of the score.
How it stays current
A notable new model is added within about 48 hours of reaching Wiro and is run on every prompt. New prompts are added only when every existing prompt has a result from every model.
Download the data
- Leaderboard (CSV) - one row per model: score, prompts scored, the average on each criterion and its best category.
- Every result (CSV) - one row per prompt and model: status, score, each criterion, the judge's note and the dates.
The scores and rankings are licensed under CC BY 4.0: use, share and adapt them, with credit to Video Models. Images and videos remain subject to the terms of the model that produced them.
How to cite
Wiro AI (2026). Video Models benchmark: AI video model leaderboard, updated 15 October 2026 [Data set]. https://videomodels.ai/leaderboard/. Licensed under CC BY 4.0.
@misc{videomodels2026,
author = {{Wiro AI}},
title = {Video Models benchmark: AI video model leaderboard},
year = {2026},
howpublished = {\url{https://videomodels.ai/leaderboard/}},
note = {Data set, updated 2026-10-15. CC BY 4.0}
}
Spotted a wrong score or a broken result? Tell us and we will look at it.