HyperAI
Command Palette
Search for a command to run...
Math & Logical Reasoning
Assessing mathematical computation, logical deduction, and formal reasoning abilities across arithmetic, algebra, and logic puzzles.
Leaderboard
100 models total
Benchmarks
GSM-8K
AlphaLLM (with MCTS)
MATH-500
Search-o1
MATH
AIME-24
DeepSeek-r1
Olympiad-Bench
AIME-2024
AMC-23
SVAMP
GPT-4 (Teaching-Inspired)
AIME-25
Math-Vista
GPQA-Diamond
MINERVA-MATH
GPQA
MathVerse
Minerva
MATH-Vision
College-Math
AMC
AIME-2025
Strategy-QA
AMC 2023
HumanEval
MMLU
Olympiad
MM-Star
MBPP
AQuA
FOLIO
MMLU-Pro
ASDiv
Live-CodeBench
MM MU
AIME
BBH
ProofWriter
WE-MATH
TheoremQA
MAWPS
GSM-Hard
MathQA
MultiArith
Text-davinci-002 (175B)(zero-shot-cot)
ProntoQA
MMLU-STEM
Dyna-Math
Gaokao
LogiQA
ARC-c
Arc-Challenge
MM-Vet
miniF2F-test
ProofAug
TabMWP
M3CoT
GPQA-D
MMMU-Pro
Common-senseQA
MGSM
GaoKao 2023 En
Hallusion Bench
AGI Eval
Sudoku
Countdown
AI2D
Omni-Math
GaokaoEn 2023
ReClor
XLNet-large
MBPP+
ScienceQA
GeoQA
HumanEval+
MM-Bench
gsm-symbolic
ChartQA
RuleTaker
DeepMind-Mathematics
Drop
Syllogistic reasoning dataset (16k)
AR-LSAT
GSM8K_100
MMLU-Math
Sat
SuperGPQA
BoolQ
Hi-ToM
KOR-Bench
LogicVista
Thm.QA
Trivia QA
Game-of-24
GSM-Plus
LogicBench
MMLU-Redux
Open-BookQA
SAT-Math
Arc-Easy
CSQA
HMMT-25
TruthfulQA
CharXiv
HMMT 2025
LogicAsker
PIQA
WebInstruct
ARC
BBEH
Date Understanding
Geometry 3K
MMLU-pro-Math
multilingual syllogism benchmark
OlympiadBench-Math
PRM800K
TextVQA
Boardgame QA
CounterBench
Logical Deduction
MMMU-Val
Arithmetic
CRUX-Eval
EMMA
Extended-Multi-LogiEval
GQA
Hella-Swag
LogicNLI
M-MMLU
MathVL-test
MM-Math
MSVAMP
PARARULE Plus
ProofNet
XWinograd
ASDiv-A
ATHENA (roberta-large)
BIG-bench (Formal Fallacies Syllogisms Negation)
BIG-bench (Penguins In A Table)
BIG-bench (Reasoning About Colored Objects)
BIG-bench (Temporal Sequences)
BLInD
Causal graphs (branching factor 1.4)
CMATH
Gaokao 2023
Geometry
LeetCode
Logic
LogiQA 2.0
MATH Level-5
MATH-OAI
MATH(OOD)
MMK12
MultiEval_SLR
RealWorldQA
AoPS24
AQUA-RAT
Counting
E-GSM
GeoMath
GraphInstruct
Graphwiz
GSM8k-Aug
HMMT
HotpotQA
LLaVA-Bench
LogDed7
MATH-Hard
Mini-ARC
Mixed
MMBench-V1.1
OCW
RAVEN
RECV Climate Fever
RECV PHEMEPlus
RECV Vitamin C
SEED-I
Syllogistic corpus
TREC_trials
Zebra Logic
APPS
BIG-Bench Hard
CLUTRR
FinanceBench
IFEval
LawBench
LiveCode
LiveCodeBench-v2
MNIST Sudoku
MQA
OlyBench
OlympiaBench
SEED-Bench
V*
Zebra puzzle
AddSub
ANLI
Apex
ARC-AGI
blocksworld
CFA
CN Middle School 24
Coin Flip
EvalPlus
ExamQA
FrontierMath
GAOKAO-Eval
GaoKaoBench-Math
Human Eval
iGSM
IMO AnswerBench
LCB
Leandojo benchmark
Lila (IID)
Lila (OOD)
Codex (Few-Shot, 175B)
Math Derivations
Math Odyssey
MATH-Level1
Mathematics
Med QA
MiniF2F
MIP-MATH
MMLU Elementary Math
MMLU-P
MuSiQue
NSA-LR
Olymp.
Olympia-Math
Olympiad Bench (O-Bench)
POPE
Re-ARC
SingleEq
SPATIALRGPT-BENCH
TAB
TableBench
TruthfulQA MC1
xlam-function-calling-60k
AMC12
ARC-e
ASDiv-Aug
BARC-100
CMMLU
CoMT
Counting Polygons / Stars FFHQ
DM
Doc-VQA
ECQA
FlowVerse†
Geo3k
HallBench
HolStep (Conditional)
MPNN-DagLSTM
Last Letter Concat.
LiveBench-Reasoning
MATH-L3&L4
Math10K
MathVerse_V
MMLU-high
MV-MATH
Olympiad MATH
SciQ
SciQA
SGPQA-1k
StrQA
SUM
UMWP
A-OKVQA
Add & Mul
AIME 2020–2024
AIMO Val.
ATKINS
BBH-Logic
Beyond-AIME
BIG-Bench Extra Hard (BBEH)
BIG-bench (Logic Grid Puzzle)
BIG-bench (StrategyQA)
Bongard-HOI
Calendar
CHEMMC
CLRS
Commonsense Reasoning
Count Down 4
CRUX
CVR
Date
Deepcoder
Game 24
Gaokao-2023-Math-En
Geo170K
GSM
GSM-H
GSM-IC
GSM8K-Hard
GSM8K-platinum
GSM8K-Rephrased
Hallusion
HE
HolStep (Unconditional)
FormulaNet
HotPot QA
I-RAVEN
Kosinski's dataset
L.C.Bench
Legal calculation dataset
List Func
List Functions
LiveBench
Math Equation Balancer
Math-np
MATH-Rephrased
Mathematical Reasoning
MathVerse (Vision Only)
MathVerse_mini
MathVision-full
MathVista_mini
MATTER
MBPP-Test
Meetings
MEGA-Bench
MetaMath_s
MinMath
MMATH
MMLU Pro Eng.
MMLU Pro Physics
MultiLogicNMR
MultiLogicNMR_NL
MultiLogicNMR_OOD
MultiPL-E
MuSiQue (Rephrased)
MuSR
ObjCnt
Objects Tracking
OCWCourses
OJBench
OlymMATH-EN-EASY
PathVQA
Playgol-str
QUAN
QUANTUMQA
R1-Onevision-Bench
RAVEN-FAIR
RBench
RMultiplex200K
RobustFill
Robustmath
RuWorldTree
SATURN-2.6k
SeekWorld-China
SeekWorld-Global
SLAKE
Smolbenchmark
SIQA
Sport
STEM
SVRT
Symbolic Reasoning
Trips
VQA-RAD
Wino Grande
Winograd Automatic
Word Sort
XMATHVISTA
2Wiki-MultiHopQA
Abductive
AdvHotpotQA
AGIE Gaokao Math
AGIE SAT Math
Alice Problem
AMC10
AMC24
Ape210k
bank
BirdsElec
Blood
Bongard-LOGO
CLEVR-Math
CodeForces
CoinFlips
Color Ordering
CoQA
CosmosQA
Credit
credit-g
Cryptonite
Deductive
DM-Math
Emotion
Even Pixels
Factual Recall
FAMMA
Financial PhraseBank
FinMR
FinQA
FormalMath500
Fresh-Gaokao-Math-2023
Gaokao-Math-2023
Gaokao24
GeomVerse
Geomverse-109
GLUE
GPQA-diamond-100
GSM8K-Test
GSM8K-V
Heart
HMMT24
Holiday Puzzle
HR-Bench
HumanEval-Multi
HumanEval-Single
HumanEval-Split
Humanity's Last Exam
I-RVN
IMDB
Income
Inductive
IndVal
INEQ-437
Internal
JEC-QA
LexEval
LiveCodeBench-v5
LMB
MATH-Test
Math23k
MATH500-100
Mathematics Dataset
MedQA-USMLE
MGSM-SYMBOLIC
MiniF2F-Solving
MiniF2F-Valid
Lean GPT-f
MiniWob
MM-Reason
MME
MMLU College
MMMU-Finance
MMMU-Pro_standard
MMMU-Pro_vision
MR-GSM8K
MSMARCO-NLG
MultiChallenge
MuSiQue-Ans
n-ary addition
NR
O-RVN
OPS
p-hop induction
ParaRules
PGM
PMC-VQA
ProcessBench
ProverQA
PutnamBench
PYMATH
RepublicQA
ROCStories
Rotten Tomatoes
RVN-F
RVP
sentiment analysis
SimpleCircuitEval
SpaRP-S
SST-2
SYNLOGIC-Val
TAL
TAL-SCQ
UGPhysics
Unicode Analogy
Unicode Analogy OOD
Unilaw-R1-Eval
Visual Navigation
Visual Sudoku
Visual Tiling
VisualProbe
VSP
Web
Wino
ZebraLogicBench
Zeta
3-Term DNF
4x4 Mult
5x5 Mult
A→D
ACPBench
AdvBench
AfriMGSM
AIME 24/25
Alpaca-Eval 2.0
ANLI-A1
ANLI-A2
Arena-Hard
bAbI
BBH-Hard
BIG-bench
BIG-bench (Logical Fallacy Detection)
BLINK
BRUMO2025
CarpEN
ChartBench
Checkmate-in-One
CL-Math
CLE
CNMO24
CodeContests
CombiBench
Contexthub
Corr2Cause
Emotic
EvoChart-QA
Flickr-30K
FlowVerse
FormalMATH-Lite
Geometric Shapes
GSM-IC2
GSM-ICM
GSM-Infinite
GSM8K-Aug-NL
GUIDEBENCH
HAGeo-409
HaluEval
Hella
InfoVQA
L-Wilder
Lam.
LiveBench-Math
LiveCodeBech
LLC
M3-Exam
MA
MATH-100
MathVerse testmini
MathVista-GPS
MathVista-Math
MAXM
Maze
MBPP-sanitized
Medical calculation dataset
MJ-Bench
MLVU
MME-RealWorld (Reasoning)
MMLU-Pro-Chem
MMLUPro-STEM
MMStar-Math
MMT
MMVU
MO-INT-20
MT-MATH100
Muir-Bench
Multi-Step Arithmetic
MultiHiertt
MV-Bench
NQ-Open
NumGLUE
NuminaMath-CoT
Odyssey-MATH
OlymBench
OlymMATH
OlympiadBench-674
Omni-MATH-200
Omni-MATH-500
OpenImages
parities
PhysReason
PlotQA
preference learning
ProofNet-test
ProsQA
ProverBench
PubMedQA
Python Puzzles
RACE-High
Scicode
SE
SEEDBench-2-Plus
simple path prediction
SimpleQA
Simulated Aerial Imagery Dataset
SIQA
Sonnet Writing
SQA
SQuAD 2
SuperGPQA-1k
SVAMP (1:N)
ATHENA (roberta-large)
SVIP-Test
SVIP-TestStep
TallyQA
Trip-planning
TSO
VCR
Video-MME
Video-MMMU
Visual7W
VisualCoT
VL-RewardBench
VQA-v2
WG
WikiTQ
WildVision
Word_sorting
XMMMLU
XMMMU
1D-ARC
AfriXNLI
AIHub
AIME22-24
ARC-AGI 2
ARC-AGI-1
ARC-AGI-100
ARG
ARQMath
BCB (Instruct)
Belebele
Binary Addition
Binary Multiplication
Binary Relation Composition
BLINK-Jigsaw
Boolean Exp
Branching (Bfactor=1.4)
Bucket Sort
C-Eval
Causal Jud
CC
ChartQA-Pro
Cladder
CLEAR
CLEVR
COGS
Commencenseqa
CommonsenseQA-CoT
Compute Sqrt
Conic10K
ConTRoL
CRUXEval-O
Cycle Navigation
Deduction
DeepMath500
DU
Ego-Schema
Einstein's puzzle
ENIGMATA-Eval
Even Pairs
FERMAT
FeTaQA
FunctionQA
Gaokao Math
GENERAL REASONING
Geoint
Global MMLU Lite
GPQA extended set
GPQA^{Sup}
GSM240K
Hendryck's MATH
HiTab
HR-4K
HR-8K
HumanEval Plus
HumanEval-FIM
HumanEval-MF
IIBench
IMO-30
InfoTabs
JEEBench-Math
JudgeBench
K12
Kaggle filtered
Kaggle unfiltered
L&O-NAE-SAT
LeetCodeDataset
LegalBench
LINGOLY
LiveCodeBench-Output
LiveCodeBench-v1.0
Logic RL
LogicNMR
LongBench-v2
LTL
LTLRandom35
M-IMO
M-MO
Mamo-ComplexLP
MATH minival
Process Supervision (GPT-4)
Math-Vision (test)
Math-Vista (testmini)
Mathematical Reasoning Avg.
MathMC
MathToF
GPT-4 (Teaching-Inspired)
MathVista-GEO
MedM-CQA
MedXpertQA
Mine.
Minerva Algebra
Missing Duplicate
MME-Real
MMLU (Mathematics)
MMLU(humanities)
MMMU Health & Medicine
MMMU-Math
MMMUv
MMStar (test)
MMVP
MNLI
MNR
Modular Arithmetic
MT-AIME2024
MUL
Multi-LogiEval(nm)
MuSLR-Bench
Navigate
NL4OPT
NoisyCausal
NumGLUE Task 2 (Chemistry)
NUPA Test
Object Cnt
OBQA
Odds First
Olym.
OlympiadB
OmniMedVQA
OOD Math
OOD Non-Math
OptiBench
Out-of-Domain Reasoning Avg.
Parity Check
Perception-Test
PGPS9K
Physics
PolyMath
Propositional Logic
Putnam-AXIOM
Puzzle
QASC
Quotient Binary Relation Composition
Random
RefSpatial
Reverse String
RiddleSense
RRN
RULER
SALT
SciBench
Sequential multi-question
SLR-BENCH
SolidFGeo2k
Spider
SQA-TEST
Stack Manipulation
stock prediction
StructuredOR
Sudoku 4×4
Syllogism
Symbol
Symbolic-Math Dataset
TabFact
TableVQA-Bench
TACO
TAT-QA
TempCompass
TriView2CAD
UniGeo
VaBenchPoint
Video-Holmes
Vision-MathVerse
Vision-MathVista
VisionMath-Bench
VSI-Bench
Warcraft shortest path
Web of Lies
Where2Place
WTQ
XCSQA
Zebra
ZHONGKAO