Comments (9)
HI @lwzhaojun you did everything correct, it should have worked, we did not debug black and white images yet (i.e. channels = 1), can you send us your ort model and we will make sure it works end to end.
from fastdup.
In fact, the RGB image model has also been tried, and the same error will be reported. It looks like it's caused by a model input mismatch.
Failed assertion blob.size[0] == NETWORK_DIMENSIONS[1] 224.0000 96.0000 /home/ubuntu/visual_database/cxx/src/image_to_blob.h:155 Failed assertion blob.size[0] == NETWORK_DIMENSIONS[1] 224.0000 96.0000 /home/ubuntu/visual_database/cxx/src/image_to_blob.h:155 terminate called without an active exception Failed assertion blob.size[0] == NETWORK_DIMENSIONS[1] 224.0000 96.0000 /home/ubuntu/visual_database/cxx/src/image_to_blob.h:155 Aborted (core dumped)
Here is my single-channel model.
efficientb1.zip
The following is the three-channel model.
efficientb1_3.zip
Please help me see it.
from fastdup.
hi @lwzhaojun. We have identified the source of the error that the expected image size is 96x62 while so far we support default image sizes of 224x224. Give us a couple of days so we could update the code to add non square image support.
from fastdup.
BTW I was not able to download the first zip file if you can send it again please. I was able to download the RGB model.
from fastdup.
Thank you for your support. After I modified the RGB image size to 224x224×3, The following error occurred:
Failed assertion ptr[j] >= MIN_FEATURE_ALLOWED_VAL && ptr[j] < MAX_FEATURE_ALLOWED_VAL /home/ubuntu/visual_database/cxx/src/data_debug.hpp:354
If you can, I hope you can help debug the 96×62×1. Below is the model of 96×62×1.
efficientb1.zip
Below is the model of 224x224×3.
efficientnet-224rgb.zip
from fastdup.
HI @lwzhaojun we have just released version 0.152 which both supports efficient net non square RGB (3 channels) and black and white (1 channel). The only thing we did not handle is the normalization phase after reading the image. We see on the web there are references for normalization for efficientnet (for example lukemelas/EfficientNet-PyTorch#255) can you please verify which normalization you need so we could support it? BTW we fixed also the 224x224 assertion.
from fastdup.
hi @lwzhaojun did you have a chance to check this? Can I close the issue?
from fastdup.
I'm sorry to verify it now, I just verified that the program can run whether it is an RGB model, a single-channel model, or a non square input. Thank you very much for your great support.
Regarding normalization, we haven't normalized before, but I think normalization is still very important, and I will do a version of normalization recently, and I will have to ask you to support it at that time.
By the way, did you only update to the pip library, not to the github source code?
Finally, you can close the issue. Thanks again.
from fastdup.
hi @lwzhaojun we are glad to hear the update is working for you!
I believe it will be useful to add normalization, send me the normalization you need, we will add some way for the user to provide it. The changes we did were in our c++ engine which is not open source thus you did not see changes in the python side.
Best,
from fastdup.
Related Issues (20)
- [Feature Request]: add mkv video support for fastdup HOT 1
- [Feature Request]: fastdup video extraction to provide timing info for each extracted frame HOT 1
- [Bug]: Pinned `requests` makes `fastdup` incompatible with other packages HOT 3
- [Feature Request]: mean_distance in image cluster relative to centroïd + distance between different clusters (using centroïds) HOT 1
- [Bug]: Kernel keep crashing when trying to run fd.run() HOT 22
- [Bug]: Fix thumbnail resize to look better HOT 1
- [Bug]:AssertionError: For removing wrong labels created by the create_similarity_gallery() need to run stats_file=df where df is the output of create_similarity_gallery() HOT 1
- Use fastdup in code pipeline rather than reports HOT 3
- [Bug]: RuntimeError: fastdup detected your are running an old version 1.60 (10 versions or more vs. the latest) please upgrade fastdup) HOT 2
- [Bug]: Oxford pet dataset, fastdup fails on 8 bad images HOT 1
- [Bug]: bad images warning is gibberish HOT 1
- [Bug]: When running fastdup as two steps (and there are bad images) connected component ids do not match atrain_features.dat.csv
- [Bug]: Can't pip install HOT 1
- [Bug]: Run is crashing when specifying embeddings HOT 3
- [Bug]: UnicodeDecodeError when running fd.run HOT 1
- [Feature Request]: Reidentification mode HOT 1
- [Feature Request]: Unpin dependencies HOT 1
- [Bug]: Colab quickstart.ipynb errors HOT 2
- [Feature Request]: Support for YOLO HOT 8
- [Bug]: Fastdup will create a copy of all images in the 'cdn' folder inside work_dir. HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fastdup.