Giter VIP home page Giter VIP logo

proxylessnas's Introduction

ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

@article{cai2018proxylassnas,
    title={ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware},
    author={Cai, Han and Zhu, Ligeng and Han, Song},
    journal={arXiv preprint arXiv:1812.00332},
    year={2018}
}  

Without any proxy, directly search neural network architectures on your target task and hardware!

Note: our code is developed in PyTorch 0.3, and has been tested in both 0.3 and 0.4.

Performance

Mobile settings GPU settings
Model Top-1 Top-5 Latency
MobilenetV1 70.6 89.5 113ms
MobilenetV2 71.8 91.0 75ms
MNasNet(our impl) 74.0 91.8 79ms
ProxylessNAS (mobile) 74.6 92.2 78ms
Model Top-1 Top-5 Latency
MobilenetV2 71.8 91.0 6.1ms
ShufflenetV2(1.5) 72.6 - 7.3ms
ResNet-34 73.3 91.4 8.0ms
MNasNet(our impl) 74.0 91.8 6.1ms
ProxylessNAS (GPU) 75.1 92.5 5.1ms
2.6% better than MobilenetV2 with same speed. 3.1% better than MobilenetV2 with 20% faster.


ProxylessNAS consistently outperforms MobileNetV2 under various latency settings.

Specialization

People used to deploy one model to all platforms, but this is not good. To fully exploit the efficiency, we should specialize architectures for each platform.

Please refer to our paper for more results.

How to use / evaluate

  • Use

    from proxyless_nas import proxyless_cpu, proxyless_gpu, proxyless_mobile
    net = proxyless_cpu(pretrained=True) # Yes, we provide pre-trained models!
  • Evaluate

    python eval.py --path 'Your path to imagent' --arch proxyless_cpu

proxylessnas's People

Contributors

han-cai avatar

Watchers

James Cloos avatar paper2code - bot avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.