Comments (2)
from attentiondeepmil.
Hey, I recently committed the original dataloader mnist_bags_loader.py you would have to use that instead of dataloader.py
…
On Tue, May 19, 2020, 4:34 AM Geoffrey Angus @.***> wrote: Hi, Thank you all for providing this repository for public use. I am trying to reproduce the results from the paper, namely the test AUC given for the 50-bag, 10-instance experiment. I've run the implementation in this repository with the following command: python main.py --num_bags_train 50 --num_bags_test 1000 Doing so actually overshoots the result given in the paper, by a substantial margin (0.768 (paper) vs. 0.898 (repo)). I understand that there are differences in the repository vs. the implementation in the paper (i.e. no validation set, no early stopping). However, given that the sample count in the training bags is so small, I am not convinced that such a large difference is due to the data split, and I am printing the AUC at each step for both the train and test set, which should allow me to reason about the early stopping difference. Is there something else that I am missing? Let me know, thanks! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#14>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACNXTIRDEWDOEMZQ27NJ3LTRSHV3JANCNFSM4NETAD2A .
Hi Max, I am also getting much higher AUC values around 0.89. I returned the value Y_prob, and used all truth labels and Y_prob values to compute ROC and AUC, was there anything I did wrong? I used the newly uploaded dataloader mnist_bags_loader.py. Thanks.
from attentiondeepmil.
Related Issues (20)
- How to process a Histopathology datasets and to print a heatmap?
- Do we need bias in the Linear layers? HOT 1
- Question regarding mi-svm HOT 2
- Data Loader for Histopathology images HOT 1
- invalid index of a 0-dim tensor HOT 3
- What is the number of instances per bag in Breast dataset?
- High CUDA memory usage HOT 1
- Unable to access Breast Cancer and Colon Cancer Datasets
- Explanation of variable comments
- Question about batch size (not bag size) HOT 1
- why is tanh and sigmoig used in attention and not relu?
- can you provide command for reproducing the results in the paper
- Increasing Batch Size
- Keras_Implementation_Colon_Cancer HOT 1
- the problem of mean bag length HOT 3
- What's the bag length in Colon data? HOT 2
- Does mnist bag loader make sure it sees all data? HOT 2
- Code for generating Fig 4 & 5
- Steps to modify the code for the Breast and colon dataset HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from attentiondeepmil.