HyperAIHyperAI

Command Palette

Search for a command to run...

Console

Lipreading On Lrw 1000

Metrics

Top-1 Accuracy

Results

Performance results of various models on this benchmark

Paper Title
SyncVSR (Word Boundary)58.2SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
3D-ResNet + Bi-GRU + MixUp + Label Smooth + Cosine LR (Word Boundary)55.7%Learn an Effective Lip Reading Model without Pains
3D Conv + ResNet-18 + MS-TCN + Multi-Head Visual-Audio Memory53.8Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading
3D Conv + ResNet-18 + Bi-GRU + Visual-Audio Memory50.82%Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video
3D-ResNet + Bi-GRU + MixUp + Label Smooth + Cosine LR48.3%Learn an Effective Lip Reading Model without Pains
3D Conv + ResNet-18 + Bi-GRU (Face Cutout)45.24%Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition
DFTN41.93%Deformation Flow Based Two-Stream Network for Lip Reading
GLMIM38.79%Mutual Information Maximization for Effective Lip Reading
PCPG38.7%Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading
0 of 9 row(s) selected.
Lipreading On Lrw 1000 | SOTA | HyperAI