Alaa Saade; Alice Coucke; Alexandre Caulier; Joseph Dureau; Adrien Ball; Théodore Bluche; David Leroy; Clément Doumouro; Thibault Gisselbrecht; Francesco Caltagirone; Thibaut Lavril; Maël Primet

Abstract
We consider the problem of performing Spoken Language Understanding (SLU) on small devices typical of IoT applications. Our contributions are twofold. First, we outline the design of an embedded, private-by-design SLU system and show that it has performance on par with cloud-based commercial solutions. Second, we release the datasets used in our experiments in the interest of reproducibility and in the hope that they can prove useful to the SLU community.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| spoken-language-understanding-on-snips | Accuracy (%): 79.3 | |
| spoken-language-understanding-on-snips | Snips | Accuracy (%): 84.2 |
| spoken-language-understanding-on-snips-1 | Accuracy-EN (%): 47.8 Accuracy-FR (%): 42.3 | |
| spoken-language-understanding-on-snips-1 | Snips | Accuracy-EN (%): 68.7 Accuracy-FR (%): 75.1 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.