HyperAI
Command Palette
Search for a command to run...
Video Generation
Creating realistic video sequences from scratch, often conditioned on text prompts, images, or other modalities.
Leaderboard
100 models total
Benchmarks
VBench
UCF-101
MAGVIT (-L-CG, 128x128, class-conditional)
HumanML3D
MLD
nuScenes
MSR-VTT
DAVIS
HDTF
KTH
SAVP-VAE
KIT Motion-Language
Moving MNIST
PredFormer
VideoInstruct
PLLaVA-34B
BAIR Robot Pushing
Kinetics-600 12 frames, 64x64
MAGVIT
RealEstate-10K
CelebV-HQ
StyleGAN-V
TikTok
MEAD
Kinetics-600
AIST++
Human3.6M
IAM4VP
InterHuman
K-600
Pexels
TikTok dataset
VIPSeg
Droid
MCL-JCV
RT-1
Inter-X
InterMask
Sky Time-lapse
UCF-101 16 frames, 64x64, Unconditional
Video Diffusion Model
UCF-101 16 frames, Unconditional, Single GPU
TGAN-F
Inter4K Test Set
Large Motion Test Set
MagicBench
SS-V2
UCF-101 16 frames, 128x128, Unconditional
TGANv2 (2020)
WebVid Test Set
WebVid-10M
YouTube-VOS
BAIR
BEAT
CaMN
Cityscapes 128x128
SRVP
DAVIS & WebVid-10M
EvalCrafter Text-to-Video (ECTV) Dataset
VideoCrafter2
Landscape
MSRVTT-Personalization
MT-Bench
open-sora prompt sets
Something-Something (V2)
MAGVIT
SynpickVP
SVG-Det
VBench-Long
Video-Phy
ActionSense
AIOZ-GDANCE
AIST++
Chronomagic-Bench-150
CityScapes
DMVFN
CSG-405
DAVIS 2019
DyMVHumans
EgoVid
EMTD
FullBench
Motion-X
HumanTOMATO
OakInk2
PATS
Private dataset
TED-talks
VGGSound
AVSync15
BAIR robot pushing dataset
Bridge
BridgeData V2
Chronomagic-Bench-1649
CineBrain
Consistent4D
CountBench
DAVIS-2017
DMVFN
DL3DV
EchoNet-Dynamic
EVA-Bench
Human Motion Video
ImageNet-1K
Kinetics-700
KITTI
KITTI-360
Kubric-Dynamic
Kubric-Static
LOVEU-TGVE-2023
OpenVid-1K
OpenVid-1M
PortraitOneMin
RAVDESS
RWTH-2014T
SkillVid
Tai-Chi-HD
TFG-1000
TikTok Benchmark
VACE-Benchmark
VBench-2
VBench-2.0
VFHQ
VGG-Sound
VideoCreation
Vimeo90K
YTVIS2021
(T&DT^Human)2M
4K360Vid
Agibot
AudioCaps
AvED-Bench
Cam-DAVIS
CAMUS
Cartoon
CelebV-Text
collected test set
Combinatorial generalization dataset
CookGen
CSL-Daily
CT-RATE
Custom Test Set
Custom test set of 100 long movies
CyberHost
EditVerseBench-Appearance
Ego-Exo4D
EPIC-KITCHENS-100
FaceForensics
FiVE-Bench
FlashBench
Frame Out evaluation dataset
FramePack-F1
GOT-10k
HamNoSys
HDTF, CelebV-HQ, CelebV-Text
How2Sign
HumanAct12
MDM
HumanVid
ICE
ImageNet 256×256
in-house dataset
Internet Dataset
Landscapes
Language-Table
MakeAnything dataset
MiraData
MMD video dataset
MotionX/MotionX++
MoveBench
MovieGen
MSTed
NSD
Nymeria
ODV360
Open-VFX
our collected dataset
PhyGenBench
RealEstate
RealTalk
SkyReels-V2
T$^3$Bench
TheGreatestHits
VANS-Data-100K
VBench-I2V
VBench1
VGGSound+
VidChapters-7M
VPBench
VPBench-Edit
VPBench-Inp
Waymo
WEB360
WebVid
VideoFactory
YoutubeVIS-2021
100 wild cases
1080P
114 animation instructions and SVG pairs
1X World Model
20 user prompts
200k video dataset
28 publicly sourced videos
360-1M
40 research papers
4K-Σ
97 single-face personalization data
ActivityNet-Captions
Actors-HQ
AIGC-LipSync Benchmark
AnchorCrafter HOI
Animate3D
AUTSL
AVISET
AVSpeech
BDD-A
Bear into Water
benchmark test set
BIKING
Bilibili dataset
Bouncing Balls
Bounded Generation Dataset
Bridge-V2
Bridgedata
CARLA
CarlaSC
CATER-GEN-v1
CATER-GEN-v2
CCv2
Celeb-V
Challenging Test Set
CI-VID
CIFAR10
CineFaceBench
Classic Test Set
CLEVRER
CLIP
Collected Dataset
Collected dataset (DAVIS, TGVE, Web)
combined test set
Coref-SV
CREMA-D
curated 100 real-world videos
curated 360°-perspective video pairs
Custom
Custom benchmark
custom dataset
Custom Multi-Shot Multi-Reference Test Set
Custom test set (50 prompts)
DADA-2000
DAVIS & WebVid
DAVIS and YouTube
DAVIS-17
DAVIS-7
DAVIS+WebVid
DEMIX
Dex-YCB
DH-FaceEmoVid-150
Double Moving MNIST
Double Take
Drag-a-Move
DreamBooth
DreamShot Test Set
Dual-Human
DualArm
Duck and Pile
DynaVid-Camera
DynaVid-Human
EchoMimicV2 Testing Dataset (EMTD)
EchoNet-Pediatric
EgoDex
EgoFHO
EmoVid
Epic-Field
EPIC-KITCHENS
Epic100
Evalcrafter
Evaluation set from [42]
Evermotion
FakeAVCeleb
FF++
Fixed-Camera-to-AV
Flag Simulation Dataset
FlexBench
FlexiAct, Pexels, DAVIS 2017, Seedream
Fluoroscopy
Follow-Your-Pose-V2 benchmark
Frame In evaluation dataset
Gen-dataset
General
GenEx-DB
GOD
Google Scanned Objects (GSO)
GPT-4o-generated infinite game benchmark
H2O
HAA500
Habitat
HandSense
HD-VILA-100M
HDTF Test Set
HOI4D
HorizonSuite
HowTo100M
Trinity Speech-Gesture Dataset
I2MSV
I2V
IDEA400
ImageNet
ImageNet 256x256
in-the-wild dataset
in-the-wild human videos
Internal validation dataset
JavisBench-mini
Kinetics
NUWA (128×128)
Kinetics-600 12 frames, 128x128
DVD-GAN
Kinetics-600 48 frames, 64x64
DVD-GAN
KineTy dataset
Koala-36M
KTH 64x64 cond10 pred30
SRVP
LAVID
LOVEU-TGVE
LSA64
LV100
MagicBrush
MAZES
Memory Maze
MetaHuman test benchmark
Minecraft
Minecraft (MineRL)
MineRL
Mip-NeRF360, Tanks and Temples
MMLottie-2M
MNTE
Modified Double Moving MNIST
MovieGen-Bench
MPI-Sintel
MCnet [villegas2017mcnet]
MPVBench
MS-Bench
Multi-Character Bench
Multi-ID test set
Multi-Subject and Motion Dataset
Multi-subject customization benchmark
MuseDance
MVImgNet
navtest
NTU RGB+D Action Recognition Dataset
NTU-120
nuPlan
nuPlan-turns
OAVE
Occ3D-nuScenes
Occ3D-Waymo
OGameData
Oliver
OmniGen2
OmnimatteRF
open-domain
OpenDV
OpenS2V
OpenS2V-Eval
OpenSafari
OpenVid
our 40 samples in the user study
Our Dataset
our evaluation set
OvO-Easy
OvO-Hard
Panda-70M
PANOVID
PE Video Dataset (PVD)
PHOENIX-2014T
PHQ360
PhysGaussian
Pixels
Procgen
Proposed Dataset
Re10K
Real10K
Records-Test-5K
ResponseNet
RIDING
RLBench
RoboNet
Rubber and Sand
Rubber hits Metal
RWTH-2014
S2VTime
Sakuga testset
Sakuga-42M
ScanNet++
Scene generation
SceneBench
SEED-DV
Short Dataset
ShotWeaver40K
Show-Oliver
Single Moving MNIST
SkeleMotion-3D
Sketchfab28
SKY
Soul-Bench
SpatialVid
Street Scene
Swing Dance
SynCamVideo-Dataset
SynFMC
Synthesized dataset
SYNTHIA
T2I-Benchmark
T2MSV
T2V
TaiChi
TalkingFace-Wild
TalkingHead-1KH
TalkingPose
TCIA/RJ
TECO–Minecraft
TED
TED-talk#
Test Set (69 clips)
TGI-Bench
TGVE 2023
TikTokDress
TMD
Motion Anything
TrailerFaces
PG-SWGAN-3D
UBC
UBC-Fashion
Unic-Benchmark
Unseen dance videos
VC4VG-Bench
VEG-Bench
VFS benchmark
ViCo
video-to-4D
video-to-4D generation
VideoPhy-2
VidProM
ViPE
VistoryBench
ViViD Dataset
VoxCeleb
VoxCeleb2
VPLM
VPLM test
VVT
Wan2.1
WLASL
WLASL-2000
WOD
WonderJourney
workshop dataset
WorldScore
XPose
YouCook2
YouTube Talking Video
YouTube Dancing
Few-shot Video-to-Video