SuperGlue: Learning Feature Matching with Graph Neural Networks
SuperGlue: Learning Feature Matching with Graph Neural Networks
Paul-Edouard Sarlin Daniel DeTone Tomasz Malisiewicz Andrew Rabinovich

Abstract
This paper introduces SuperGlue, a neural network that matches two sets oflocal features by jointly finding correspondences and rejecting non-matchablepoints. Assignments are estimated by solving a differentiable optimal transportproblem, whose costs are predicted by a graph neural network. We introduce aflexible context aggregation mechanism based on attention, enabling SuperGlueto reason about the underlying 3D scene and feature assignments jointly.Compared to traditional, hand-designed heuristics, our technique learns priorsover geometric transformations and regularities of the 3D world throughend-to-end training from image pairs. SuperGlue outperforms other learnedapproaches and achieves state-of-the-art results on the task of pose estimationin challenging real-world indoor and outdoor environments. The proposed methodperforms matching in real-time on a modern GPU and can be readily integratedinto modern SfM or SLAM systems. The code and trained weights are publiclyavailable at https://github.com/magicleap/SuperGluePretrainedNetwork.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| image-matching-on-imc-phototourism | SuperGlue | mean average accuracy @ 10: 0.65248 |
| image-matching-on-zeb | SuperGlue | Mean AUC@5°: 31.2 |
| pose-estimation-on-inloc | SuperGlue | [email protected],10°: 49.0 [email protected],10°: 68.7 [email protected],10°: 80.8 [email protected],10°: 53.4 [email protected],10°: 77.1 [email protected],10°: 82.4 |
| visual-localization-on-aachen-day-night-v1-1 | SuperGlue | |
| visual-place-recognition-on-berlin-kudamm | SuperPoint & SuperGlue | Recall@1: 59.64 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.