HyperAIHyperAI

Command Palette

Search for a command to run...

Question Answering

Question Answering is an important task in the field of natural language processing, aimed at automatically answering questions posed by users through computer systems. This task can be subdivided into subtasks such as community question answering and knowledge base question answering, with evaluation metrics primarily including EM (Exact Match) and F1 scores. Currently, popular benchmark datasets include SQuAD, HotPotQA, bAbI, TriviaQA, and WikiQA. In recent years, models like T5 and XLNet have performed exceptionally well in this area, advancing the accuracy and practicality of question answering systems.

Leaderboard

16 models total

Benchmarks

SQuAD2.0
SQuAD1.1
HotpotQA
SQuAD1.1 dev
T5-11B
TriviaQA
SpanBERT
BoolQ
T5-XXL 11B (fine-tuned)
Natural Questions
PIQA
GPT-3 175B (0-shot)
COPA
WebQuestions
OpenBookQA
TruthfulQA
PubMedQA
PubMedBERT uncased
CronQuestions
MedQA
WikiQA
TimeQuestions
MultiRC
DeBERTa-1.5B
SIQA
LLaMA 65B (zero-shot)
CNN / Daily Mail
Quora Question Pairs
NewsQA
SpanBERT
StoryCloze
BLOOMZ
DROP Test
bAbi
Natural Questions (long)
SQuAD2.0 dev
TrecQA
DaNetQA
StrategyQA
PaLM 2 (few-shot, CoT, SC)
NarrativeQA
MultiTQ
Bamboogle
CoQA
TIQ
WikiHop
Children's Book Test
FEVER
TempQuestions
Quasart-T
FQuAD
OBQA
FLAN 137B (zero-shot)
QASent
SQA3D
FriendsQA
KILT: ELI5
NExT-QA (Open-ended VideoQA)
NQ (BEIR)
RACE
YahooCQA
ASQA
BioASQ
PubMedBERT uncased
FinQA
SemEvalCQA
PeerQA
QuALITY
AI2 Kaggle Dataset
catbAbI QA-mode
catbAbI LM-mode
Complex-CronQuestions
FiQA-2018 (BEIR)
HotpotQA (BEIR)
HybridQA
Molweni
MS MARCO
PopQA
FairytaleQA
QASPER
Story Cloze
Neo-6B (QA + WS)
BLURB
BioLinkBERT (large)
ConditionalQA
DROP
DuoRC
EgoTaskQA
NaturalQA
SpanBERT
OTT-QA
SberQuAD
SCDE
SQuAD
CaseHOLD
ConvFinQA
ReClor
SWAG
VNHSGE-English
Aristo Kaggle Allen AI 8th grade questions
CheGeKa
CliCR
COMPLEXQUESTIONS
ELI5
FanOutQA
GeoQuestions1089
MapEval-API
Mathematics Dataset
MCTest-500
MedMCQA
MedTurkQuAD: Medical Turkish Question-Answering Dataset
MultiQ
PubChemQA
QuAC
Reverb
RuOpenBookQA
TempQA-WD
Torque
TweetQA
ByT5
UniProtQA
WikiSQL
WikiTableQuestions
BLEnD
HellaSwag
LogiQA2
MRQA
VNHSGE-Biology
VNHSGE-Chemistry
VNHSGE-Civic
VNHSGE-Geography
VNHSGE-History
VNHSGE-Literature
VNHSGE Mathematics
VNHSGE-Physics
AGI Eval
AviationQA
BBH
ChAII - Hindi and Tamil Question Answering
COCO Visual Question Answering (VQA) real images 1.0 open ended
CODAH
G-DAUG-Combo + RoBERTa-Large
ComplexWebQuestions
CRUD
EfficientQA dev
EfficientQA test
GPT 3.5 (20-shot)
GPT 3.5 (3-shot)
JaQuAD
JD Product Question Answer
Llama 3 (20-shot)
Llama-3.1-8B-Instruct
MCTest-160
MedMCQA Dev
MetaQA
MMLU
MRQA out-of-domain
MTQA-ELC
MuLD (HotpotQA)
MuLD (NarrativeQA)
MultiSpanQA
PrivacyQA
Qwen1.5-4B-Chat
Qwen1.5-7B-Chat
RecipeQA
SchizzoSQUAD
SimpleQuestions
StepGame
TAT-QA
VoxEval
WebSRC
2Wiki, HPQA, NQ
2WikiMultiHopQA
Aboriginal Dialect
African American Vernacular
Appalachian Dialect
ArabCulture
ARC-c
ARC-e
Australian Dialect
Australian Vernacular
Bahamian Dialect
Black South African Dialect
Cameroon Dialect
CANDLE500
Cape Flats Dialect
Channel Islands Dialect
Chicano Dialect
CLEAR
Colloquial American Dialect
Colloquial Singapore Dialect
CQA dataset
CulturalBench
DiverseHealth
DuReader
Early African American Vernacular
East Anglican Dialect
Falkland Islands Dialect
Fiji Basilect
FreshWiki
Ghanaian Dialect
GlobalCultureQA
GraphQuestions
ChatGPT
Hong Kong Dialect
HPQA
HPSv2
Humicroedit
IIRC
Indian Dialect
Indian South African Dialect
Irish Dialect
Jamaican Dialect
Kenyan Dialect
KGQA
KQA Pro
LCP
LitM
LongBench
LongFact
Malaysian Dialect
Maltese Dialect
Manx Dialect
MapEval-Textual
MultiMedQA
MuSiQue
New Zealand Dialect
Newfoundland Dialect
Nigerian Dialect
North England Dialect
NQ
Orkney Shetland Dialect
Ozark Dialect
Pakistani Dialect
r/NoStupidQuestions
Rural African American Vernacular
Scottish Dialect
SEER
SICK
Southeast American Enclave Dialect
Southeast England Dialect
Southwest England Dialect
St Helena Dialect
Standard American Dialect
STSB
Tanzanian Dialect
Test set
Tristan Dialect
Ugandan Dialect
Validation set
WASSA
WebCPM
WebQuestionsSP
ChatGPT
Welsh Dialect
White South African Dialect
White Zimbabwean Dialect
WikiStart
WinoGrande