liangfu / mxnet-mobilenet-v2 Goto Github PK

Hi @liangfu ,

Nice work and performance!
Would you please share the training cost here? e.g. GPU detail, training hours.
Since i have only 1080ti and seems like training imagenet from scratch will takes too much time.
Thanks very much!

Hi, thanks for your contribution first. I am quite interested in training details of mobilenet v2. Is the current train_imagenet.py exactly the setting to reproduce 72.45 accuracy? Thanks.

First of all thank you for providing the training script and parameters about MobileNetV2 (the first repo I've ever seen).

I'm reproducing it for GluonCV thus have a couple of questions regarding the training:

1. How did you decide to set the number of epoch to 480 and batch size to 160?
2. Have you tried to train other MobileNetV2, i.e. 0.75, 0.5.
   • I tried to train 0.75 with the same parameter, but it is 1.5% worse than tensorflow's official model: https://github.com/tensorflow/models/tree/master/research/slim/nets/mobilenet
3. Have you found a significant difference between training with/without your PR for nnvm?

I appreciate your help with my questions.

HI Running the script from_mxnet.py on hikey 970 board with arm5 and MALI GPU, I get this error:
LLVM ERROR: Only small and large code models are allowed on AArch64
If I disable LLVM I get an error that it is disabled. any suggestions? thanks

Any idea why clip is not supported in nnvm belo. My nnvm is the latest one.

TVM: Initializing cython mode...
/home/firefly/2TB/src/firefly/incubator-mxnet-04-13/python/mxnet/init.pyc
/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/init.pyc
/usr/local/lib/python2.7/dist-packages/tvm-0.2.0-py2.7-linux-aarch64.egg/tvm/init.pyc
('x', (1, 3, 224, 224))
Traceback (most recent call last):
File "./from_mxnet.py", line 82, in
nnvm_sym, nnvm_params = nnvm.frontend.from_mxnet(mx_sym, args, auxs)
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 354, in from_mxnet
sym = _from_mxnet_impl(symbol, {})
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 317, in _from_mxnet_impl
childs = [_from_mxnet_impl(childs[i], graph) for i in range(len(childs.list_outputs()))]
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 319, in _from_mxnet_impl
node = _convert_symbol(op_name, childs, attr)
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 278, in _convert_symbol
_raise_not_supported('Operator: ' + op_name)
File "/home/firefly/2TB/src/firefly/nnvm-04-12/python/nnvm/frontend/mxnet.py", line 24, in _raise_not_supported
raise NotImplementedError(err)
NotImplementedError: Operator: clip is not supported in nnvm.

Thanks,

I'm trying to retrain mobilenet v2 such that I already have a pre-trained model (on coco) with weights and I just want to train the last few layers with new images with objects from coco and the model just fine-tunes to that to increase accuracy without losing out on any pre-existing knowledge of all objects on coco. Basically just fine tune to new images. Not customization. How can I do this?

thanks for your great work!!

I have some questions.
I use this model(multiplier = 1.0) to train my detection model and I have to resize my input probably to
300x300 or 512x512 or 416x416,but the pretrained model you provided is 224x224,If this will cause some problems to train detection model ?

thanks for your suggestions.

please fix this code， according to 1801.04381 v3.

misunderstood you code (T_T)