Comments (4)
Hi,
The code is correct.
The ShapeAdaptor.current_dim_true
is defined in each network forward function. For example in VGG network, it's in line 174 - 176. This current_dim_true
indicates the true output dimension dynamically updated for each iteration without the memory penalty, which is required to compute the corresponding penalty term to make it grow no more than the required limit_dim
.
As such, this current_dim_true
will only be available if we have at least one network pass using the forward function, i.e. running predict = model(data)
at least once.
If you make sure you did not modify any part of the code, just try python model_training.py --gpu ID
to test. It should give no error.
Hope it helps.
Sk.
from shape-adaptor.
At the very first iteration, which current_limit_dim
has not yet defined, python would directly give True if one of the conditions in or
is true.
For example, if you try True or a
even if a
is not defined, it would output a True.
from shape-adaptor.
ok, Maybe I add some bugs while modified the code to distributed training
from shape-adaptor.
Ok. Make sure the model has at least one pass on the training data.. Should be an easy fix.
from shape-adaptor.
Related Issues (8)
- some problems about experiments HOT 8
- I wonder if it can be use in other data format like nlp data HOT 1
- resnet shape-adaptor HOT 5
- Is it possible to train with Multi-GPUs? HOT 3
- Question about reimplementation HOT 9
- Question about default weight decay in model_training_imagenet.py HOT 1
- GMACs for ImageNet dataset? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from shape-adaptor.