4 months ago
SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis
SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis
Pavel Efimov Andrey Chertok Leonid Boytsov Pavel Braslavski
Abstract
SberQuAD -- a large scale analog of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community. We fill this gap by providing a description, a thorough analysis, and baseline experimental results.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| question-answering-on-sberquad | DeepPavlov R-Net | EM: 60.62 F1: 80.04 |
| question-answering-on-sberquad | DeepPavlov multilingual BERT | EM: 64.35+-0.39 F1: 83.39+-0.08 |
| question-answering-on-sberquad | DeepPavlov RuBERT | EM: 66.30+-0.24 F1: 84.60+-0.11 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.
AI Co-coding
Ready-to-use GPUs
Best Pricing
Hyper Newsletters
Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp