Comments (2)
I believe that's a common problem for distance based losses. They tend to behave unstable when net returns random results (as it is for the first few steps) and label everything as background when classes are highly imbalanced.
I think the problem may lay in your alpha change being dependent on loss value thus being very unstable in early stages. I would try to define loss as: loss = dice * alpha + Haussdorf * (1 - alpha), and start for example from alpha=0.95 and define it to be 0.5 or even lower at the training end - alpha will progressively go down during training time. This way you allow dice do the heavy lifting early to establish some reasonable prediction and not allow early Haussdorf anomalies confuse the network that much. Later on when net outputs better predictions Haussdorf loss should be stable.
from hausdorffloss.
Thanks a lot for your advice. I have used the trick that you provided. The initial alpha is set to 0.00001, and the alpha increases by 0.00002 for every iteration. Then the network can find the vessels in the training and testing. The loss curve is attached. The loss is a little unstable, and I think I need to give a better initial alpha and a better strategy to change the alpha.
from hausdorffloss.
Related Issues (6)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hausdorffloss.