HyperAI
Command Palette
Search for a command to run...
Code Generation
Generating executable source code from natural language descriptions or specifications.
Leaderboard
100 models total
Benchmarks
MBPP
HumanEval
AgentCoder (GPT-4)
Live-CodeBench
LPW (GPT-4o)
HumanEval+
MBPP+
Big-CodeBench
CodeForces
CodeContests
MBPP-sanitized
APPS
ELABORATIONSET
EvalPlus (HumanEval)
SAFIM
ExecRepoBench
LiveCodeBench V4
MultiPL-E
CoNaLa
MarianCG
DS-1000
EffiBench
HumanEval Plus
MBPP Plus
MBPP-ET
WikiSQL
NL2SQL-RULE
EvalPlus
HumanEval-ET
LiveCodeBench v6
LiveCodeBench-v5
MATH
Django
MarianCG
LBPP
miniF2F-test
HumanEval-X
HumanEvalFix
RES-Q
QurrentOS-coder + Claude 3.5 Sonnet
BigCodeBench-full
BigCodeBench-Hard
FEA-Bench
LeetCode
McEval
MiniF2F
ProofNet
WebApp1K-React
o1-preview
xCodeEval
GSM-8K
CoNaLa-Ext
BART W/ Mined
EvoEval
FM-BENCH
HumanEvalExplain
HumanEvalSynthesis
Industrial scene layout generation benchmark
Mercury
OpenEval
WebApp1k-Duo-React
AIME-24
APPS+
BIRD-SQL
Human-Eval
Secure Code Generation Benchmark
SymBench
TempEval-2013
48 VRP variants
Aider
AIME-25
AMC
Human Eval
HumanEval-Decompile
IndusCP
LGPs
LogicDeduction
NL2Formula-70K
NL4OPT
Olympiad-Bench
Plot2Code
RTLLM v1.1
RTLLM v2.0
Spider
SWE-Bench
TACO
APPS-Comp.
APPS-Interv.
APPS-Intro.
ARC
Bird
BITE benchmark
CanItEdit
Case2Code
CWEval
ECCO (Python)
EvoCodeBench
HQ
Leandojo
LiveCodeBench-Reason
LiveCodeBench-Test
Mercury (Python)
MiniF2F-Valid
PIE (C++)
SafeSQL
SecCodePLT+
Shellcode_IA32
CodeBERT
Slide2Code
SLIDESBENCH
TDE
Text2Analysis
Transform-Text
WikiTQ
3-shot
Aider Polyglot
APPS-Dyn
ARC-AGI-1
Audio-16-bit
Audio-8-bit
Audio-MFCC
BigCodeBench-Complete
BigCodeBench-Instruct
GPT-4o-2024-05-13
CodeContest
CodeContest-Dyn
CodeContests-Dyn
CodeNet-Test
CodeXGLUE - CONCODE
CodeT5
CONCODE
CRUX-Eval
DiffBench
DNA
FullStack-Bench-Html
GEMM
HumanEval-Multi
HumanEvalPack
ICMP
IGMP
LiveBench
MATH-500
MBL
MBXP
MXEval
Playgol
Pol-Hawaiian
Pol-Niue
Pol-Samoan
Pol-Tongan
Ptk-Huishu
REPOCOD
RepoEval
RTLLM-based generation benchmark
Syn.
Text
USACO 2025
VENUS
VerilogEval-Human v2
VerilogEval-v2
Web-Bench
xCodeEval-Dyn
128-sample transfer set
1D-ARC
AlgoLisp
CodeSearchNet
ContraCode
College CoT
COTA
Countdown
EvalPerf
Extract Theorem
FloCo
FloCo-T5
LeetCode Contest Benchmark
LiveCode
MBPP-R
MHA
MINERVA-MATH
Molecular Synthesis
ParEval
Planetarium
PolyBench
RepoGenesis
RestBench
rSDE-Bench
Torchdata-Manual
VerilogEval
VerilogEval2.0