The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization
The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization
Paul Bergmann Xin Jin David Sattlegger Carsten Steger

Abstract
We introduce the first comprehensive 3D dataset for the task of unsupervised anomaly detection and localization. It is inspired by real-world visual inspection scenarios in which a model has to detect various types of defects on manufactured products, even if it is trained only on anomaly-free data. There are defects that manifest themselves as anomalies in the geometric structure of an object. These cause significant deviations in a 3D representation of the data. We employed a high-resolution industrial 3D sensor to acquire depth scans of 10 different object categories. For all object categories, we present a training and validation set, each of which solely consists of scans of anomaly-free samples. The corresponding test sets contain samples showing various defects such as scratches, dents, holes, contaminations, or deformations. Precise ground-truth annotations are provided for every anomalous test sample. An initial benchmark of 3D anomaly detection methods on our dataset indicates a considerable room for improvement.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 3d-anomaly-detection-and-segmentation-on | Voxel GAN | Detection AUROC: 0.537 Segmentation AUPRO: 0.583 |
| 3d-anomaly-detection-and-segmentation-on | Voxel VM | Detection AUROC: 0.571 Segmentation AUPRO: 0.492 |
| 3d-anomaly-detection-and-segmentation-on | Voxel AE | Detection AUROC: 0.699 Segmentation AUPRO: 0.348 |
| depth-anomaly-detection-and-segmentation-on | Depth VM | Detection AUROC: 0.546 Segmentation AUPRO: 0.374 |
| depth-anomaly-detection-and-segmentation-on | Depth GAN | Detection AUROC: 0.523 Segmentation AUPRO: 0.143 |
| depth-anomaly-detection-and-segmentation-on | Depth AE | Detection AUROC: 0.546 Segmentation AUPRO: 0.203 |
| rgb-3d-anomaly-detection-and-segmentation-on | Voxel GAN | Detection AUCROC: 0.517 Segmentation AUPRO: 0.639 |
| rgb-3d-anomaly-detection-and-segmentation-on | Voxel AE | Detection AUCROC: 0.538 Segmentation AUPRO: 0.564 |
| rgb-3d-anomaly-detection-and-segmentation-on | Voxel VM | Detection AUCROC: 0.609 Segmentation AUPRO: 0.471 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.