Comments (3)
Hey @ducha-aiki,
We've now released the LightGlue models trained for ALIKED & SIFT: cvg/LightGlue@29f3e44 These models are frankly very good - we've added results on MegaDepth and will add results on other datasets later (some ScanNet results in PR #25, others likely after the CVPR deadline). As you can see, ALIKED+LightGlue is better than SuperPoint+SuperGlue and pretty close to SuperPoint+LightGlue. For SIFT we need to double the number of keypoints to reach this accuracy (because the detector is much less repeatable).
For now we're not releasing the model trained for SuperPoint-Open because it still needs some more tuning.
While we're at it: it would be really great to have a proper implementation of DoG in kornia, ideally at the level of performance of vlfeat/GPUSIFT. The current implementation is really terrible (I know this was in your TODOs 2 years ago).
from glue-factory.
@sarlinpe thank you! I am surprised at ALIKED results tbh.
Regarding DoG in kornia - to be honest, while I see some value in it, and would like to finally fix that, I don't think it is going to be fast enough to compete with GPU-SIFT either alone or from colmap.
And then, don't see much point there, given enormous memory footprint of the proper Gaussian scale space. Do you see any other arguments for it besides just completeness?
from glue-factory.
- kornia is easier to install than pycolmap (GPU-SIFT requires building from source, we don't yet have the bandwidth to ship cuda-enabled wheels)
- when considering batching, a torch-SIFT could be faster than GPU-SIFT (which would make the training of LightGlue faster or at least more efficient)
Though I don't encourage anyone to use SIFT, except for data with strong in-plane rotations (where we don't have an optimal solution, yet).
from glue-factory.
Related Issues (20)
- pycolmap error HOT 1
- DeDoDe HOT 1
- memory not release HOT 3
- mixed precision training
- Error:_pickle.UnpicklingError: invalid load key, '\x0a'.
- what is add_scale_ori and how to use it?
- gluestick training time HOT 3
- simpler GT line matching HOT 1
- the two places name the gamma differently?
- Performance
- The Required Datasets for Training. HOT 1
- Whether to reuse the Sigmoid function in the confidence loss calculation code? HOT 1
- Instability of LightGlue training
- Train
- Slow Training Speed Issue HOT 1
- OmniGlue HOT 1
- End-to-end SP+LG
- Downloading HPatches hangs
- augmenting own data
- About training only returns the start, not the process and the result HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from glue-factory.