Giter VIP home page Giter VIP logo

Comments (6)

Maratyszcza avatar Maratyszcza commented on June 4, 2024

@parthi2929 Are you using PyTorch 1.0 release, nightly build, or build from master branch of pytorch/pytorch?

from cpuinfo.

Maratyszcza avatar Maratyszcza commented on June 4, 2024

The cpuinfo issue was fixed ~20 days ago, it shouldn't show up on a nightly or master build of PyTorch (albeit I haven't yet received a confirmation from people who reported it). However, it is very unlikely that failed download is related to cpuinfo.

from cpuinfo.

parthi2929 avatar parthi2929 commented on June 4, 2024

Sorry I totally missed updating that very important info. I was lastly trying this (requirements.txt file content)

numpy 
torchvision_nightly
-f https://download.pytorch.org/whl/nightly/cpu/torch_nightly.html
fastai
zerorpc

Earlier I also tried below one, but same issue.

https://download.pytorch.org/whl/cpu/torch-1.0.0-cp36-cp36m-linux_x86_64.whl
fastai
zerorpc

from cpuinfo.

soumith avatar soumith commented on June 4, 2024

the cpuinfo "Error" here i think is just a warning, if you use the nightly. The real error is the pickling error, but that just points to a corrupted pickle file (maybe download failed)

from cpuinfo.

parthi2929 avatar parthi2929 commented on June 4, 2024

The repo works locally in my system without any problem. I am now testing with not nightly, but this build. The build was successful in heroku.

Is there a way to verify if and why download of that model failed? There is no error on that, but resnet pth file is not present in the location. My understand was download failed because of cpuinfo, but from your claim, I see that might not be the case. Eventually the pth which should have been downloaded is not in app/models folder in heroku (checked using heroku cli).

Also, as a workaround, is there way I could load a resnet pth myself in custom location in repo (downloaded separately and stored in repo) and ask pytorch to use that instead of trying to download every time (because heroku restarts the dyno, the pytorch may try to download again and again leading to big latency issues).

I have set TORCH_MODEL_ZOO = /app/models in heroku, and had a resnet pth there earlier, but that local file was not anyway considered by pytorch, so I have that removed for now in repo (its another 80+ MB)

from cpuinfo.

Maratyszcza avatar Maratyszcza commented on June 4, 2024

I checked how cpuinfo works without sysfs, and found it works just fine. 9fa0a05 removes logging of error if sysfs files can't be read on x86.
Thus, the issue with file download is unrelated to cpuinfo. I never worked with Heroku, but may assume you need special proxy settings for downloading?

from cpuinfo.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.